Prefect

workflow management, data orchestration, etl
Open jobs

179

Companies looking for

174

Let’s be honest, the data engineering world was already overflowing with workflow schedulers when Prefect sauntered in, promising to be more than just a scheduler. It arrived with a vision of data pipelines as code, embracing Python’s dynamic nature and a frankly admirable commitment to observability. The pitch? Move beyond brittle cron jobs and embrace a truly modern, developer-first approach.

In practice, it’s a bit more involved than simply “wiring things up in Python.” While the core concepts are elegantly simple, mastering Prefect requires a shift in thinking – embracing its task and flow definitions. It distinguishes itself from Airflow by leaning heavily into dynamic mapping and a more opinionated, Python-native experience. Today, it’s gaining traction among those tired of Airflow’s complexity and those building genuinely dynamic data workflows, though one suspects a significant portion of its user base are Python developers who just wanted an excuse to write more Python.

Used together with Prefect

Additional Resources

Compare to other orchestration tools
Jobs (this month)

179

Companies with Jobs

174

Jobs in using Prefect for but please no

data scientist

Data Engineer (AI, ML, and Data Science) @ consumer-reports

US | 2025-12-27 | USD 100000 - 120000 / year
Consumer Reports seeks a data engineer to build and maintain data pipelines supporting AI and machine learning, leveraging cloud platforms like Databricks and AWS SageMaker. The role's... read more »
AI/ML, Data Science, Analytics, Management, GenAI, ETL/ELT, Databricks, AWS, Amazon SageMaker, Cloud Computing, Data Quality, API, Data Governance, Cloud Storage, Computer Science, Python, SQL, PySpark, Airflow, dbt, Prefect, CI/CD, Kubernetes, GCP, Azure
data engineer

Data Engineer II - QuantumBlack, AI by McKinsey (Critical Industries) @ quantumblack

US | 2025-12-27
Data Engineer II role promises to design, build, and optimize modern data platforms powering analytics and AI, with a tour through streaming and batch pipelines across aerospace, utilities, and... read more »
Analytics, AI/ML, R, Data Streaming, Vector DB, RAG, Agile/Scrum, C, Computer Science, Data Engineering, Python, Scala, Java, SQL, Cloud Computing, AWS, GCP, Azure, Oracle, Snowflake, BigQuery, Redshift, Delta, Databricks, AWS Glue, dbt, Spark, Flink, Kafka, Kinesis, Airflow, Dagster, Prefect, CI/CD, Terraform, CloudFormation, DataOps, Datadog, Prometheus, Amazon SageMaker, MLOps, GenAI, LLM, Management
promoted

O'Reilly Power BI Learning

Master Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service.

Get Started
analyst

Data Analyst - Actions Analytics @ zetaglobal

US | 2025-12-25 | USD 90000 - 100000 / year
Zeta Global offers a Data Analyst role in the Actions Account Analytics squad, a workflow into AI-powered marketing analytics. The job blends hands-on campaign analytics, end-to-end reporting, and... read more »
AI/ML, Marketing, Cloud Computing, Go, Analytics, Management, LLM, GenAI, DataViz, Tableau, SQL, Data Science, KPI, BI, Power BI, Looker, PowerPoint, API, Airflow, Prefect, Snowflake, Redshift, BigQuery, Python, R
data scientist

Clinical Development Data Science Intern @ genmab

US | 2025-12-25
A clinical development data science internship at Genmab offers exposure to AI/ML projects targeting clinical trial design and safety monitoring, with the differentiator being their focus on... read more »
Data Science, AI/ML, PhD, NLP, GenAI, Analytics, Computer Science, Python, PyTorch, TensorFlow, Pandas, NumPy, RAG, Docker, Airflow, Prefect, Dagster, Cloud Computing, AWS, Azure, GCP, Git, GitHub, GitLab, CI/CD, MLOps, Agile/Scrum
data engineer

Data Engineer II - QuantumBlack, AI by McKinsey @ quantumblack

US | 2025-12-22
Data Engineer II role promises high impact across clients and a culture of continuous learning, but the job description reads like a curriculum vitae for a consulting fortress: heavy emphasis on... read more »
Analytics, AI/ML, R, Data Streaming, Vector DB, RAG, Agile/Scrum, C, Computer Science, Data Engineering, Python, Scala, Java, SQL, PySpark, Cloud Computing, AWS, GCP, Azure, Oracle, Snowflake, BigQuery, Redshift, Delta, Databricks, AWS Glue, dbt, Spark, Flink, Kafka, Kinesis, Airflow, Dagster, Prefect, CI/CD, Terraform, CloudFormation, DataOps, Datadog, Prometheus, Amazon SageMaker, MLOps, GenAI, LLM, Management