Prefect

workflow management, data orchestration, etl
Open jobs

179

Companies looking for

174

Let’s be honest, the data engineering world was already overflowing with workflow schedulers when Prefect sauntered in, promising to be more than just a scheduler. It arrived with a vision of data pipelines as code, embracing Python’s dynamic nature and a frankly admirable commitment to observability. The pitch? Move beyond brittle cron jobs and embrace a truly modern, developer-first approach.

In practice, it’s a bit more involved than simply “wiring things up in Python.” While the core concepts are elegantly simple, mastering Prefect requires a shift in thinking – embracing its task and flow definitions. It distinguishes itself from Airflow by leaning heavily into dynamic mapping and a more opinionated, Python-native experience. Today, it’s gaining traction among those tired of Airflow’s complexity and those building genuinely dynamic data workflows, though one suspects a significant portion of its user base are Python developers who just wanted an excuse to write more Python.

Used together with Prefect

Additional Resources

Compare to other orchestration tools
Jobs (this month)

179

Companies with Jobs

174

Jobs in using Prefect for but please no

data engineer

Head of Data Engineering, Financial Platform @ joinblock

US | 2025-12-25 | USD 239600 - 359400 / year
The role oversees a financial data engineering team to maintain data warehouses and lakehouse systems supporting financial domains like acquiring, issuing, chargebacks, and banking data. A key... read more »
Cyber Security, Data Engineering, Analytics, Data Lakehouse, DWH, AI/ML, Data Science, Snowflake, Databricks, SQL, Python, CI/CD, Airflow, Prefect, Spark, Cloud Computing, AWS, Data Modelling, Data Contracts, C
data scientist

Senior Staff Software Engineer, Risk and Compliance Infrastructure & Data Science @ linkedin

US | 2025-12-25 | USD 181000 - 297000 / year
LinkedIn seeks a technical lead to oversee architecture and data pipelines supporting compliance and risk management platforms. The role's differentiator is its focus on integrating data science... read more »
Management, Analytics, Data Science, Data Modelling, AI/ML, CI/CD, API, ETL/ELT, Data Contracts, Data Quality, Computer Science, SQL, RDBMS, R, Python, Java, Scala, JavaScript, GDPR/CCPA, Spark, Databricks, Snowflake, Airflow, Prefect, dbt, Monte Carlo, BI, Tableau, Power BI, Looker, TypeScript, TensorFlow, PyTorch, Cloud Computing, AWS, Azure, GCP, S3, Git, MLOps, SaaS, LLM, C
promoted

The Fundamentals of Analytics Engineering

The Fundamentals of Analytics Engineering gives a holistic understanding of the analytics engineering lifecycle by integrating principles from both data analysis and engineering. It's a book that teaches concepts and best practices, not just tools and technologies.

Learn More
data engineer

Data Engineer - Platform 1 (P1) @ flyzipline

US | 2025-12-24
Zipline seeks a Data Engineer to build scalable data infrastructure for its logistics platform, with a key differentiator being its focus on autonomous drone delivery and complex international... read more »
Management, CRM, Analytics, AI/ML, ETL/ELT, Data Quality, Python, SQL, Airflow, Prefect, Dagster, Snowflake, BigQuery, Redshift, API, dbt, CI/CD, Docker, Kubernetes, Data Streaming, Kafka, Kinesis
data engineer

Data Engineer, Active Grid Response @ gridwareinc

US | 2025-12-23
Gridware seeks a data engineer to develop ETL/ELT pipelines for its Active Grid Response platform, emphasizing high-precision sensor data integration and real-time processing, with a notable focus... read more »
Management, Data Lakehouse, Analytics, ETL/ELT, Data Lake, Python, SQL, Databricks, Data Quality, Data Science, Cloud Computing, Big Data, Spark, Airflow, Dagster, Prefect, Data Streaming, Kafka, Kinesis, Data Modelling, IoT, Protobuf, Avro, Parquet, Grafana