Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data scientist

Data Engineer (AI, ML, and Data Science) @ consumer-reports

US | 2025-12-27 | USD 100000 - 120000 / year
Consumer Reports seeks a data engineer to build and maintain data pipelines supporting AI and machine learning, leveraging cloud platforms like Databricks and AWS SageMaker. The role's... read more »
AI/ML, Data Science, Analytics, Management, GenAI, ETL/ELT, Databricks, AWS, Amazon SageMaker, Cloud Computing, Data Quality, API, Data Governance, Cloud Storage, Computer Science, Python, SQL, PySpark, Airflow, dbt, Prefect, CI/CD, Kubernetes, GCP, Azure
data scientist

Clinical Development Data Science Intern @ genmab

US | 2025-12-25
A clinical development data science internship at Genmab offers exposure to AI/ML projects targeting clinical trial design and safety monitoring, with the differentiator being their focus on... read more »
Data Science, AI/ML, PhD, NLP, GenAI, Analytics, Computer Science, Python, PyTorch, TensorFlow, Pandas, NumPy, RAG, Docker, Airflow, Prefect, Dagster, Cloud Computing, AWS, Azure, GCP, Git, GitHub, GitLab, CI/CD, MLOps, Agile/Scrum
promoted

The Fundamentals of Analytics Engineering

The Fundamentals of Analytics Engineering gives a holistic understanding of the analytics engineering lifecycle by integrating principles from both data analysis and engineering. It's a book that teaches concepts and best practices, not just tools and technologies.

Learn More
data scientist

Data Scientist @ grow-with-clay

US | 2025-12-25
Clay pitches itself as a no‑frills growth tool riding a seriously shiny data stack and a fair bit of hype about GTM alpha. The data science role promises end‑to‑end ownership—from data... read more »
GTM, C, Data Science, Funnel, Snowflake, dbt, Dagster, Go, Analytics, SQL, Python, AI/ML, Airflow
data scientist

Senior Data Scientist - Payments @ plaid-

US | 2025-12-24 | USD 174000 - 260400 / year
Plaid’s data scientist role targets turning fintech signals into product decisions, with a production bias that’s unmistakable: you’re expected to drive business impact alongside engineers, not... read more »
Data Analytics, AI/ML, DataViz, API, Data Science, SQL, AWS, Python, dbt, Airflow, Computer Science
data scientist

Data Scientist - Consumer/TMT @ balyasny-asset-management-l.p.

US | 2025-12-23
Balyasny Asset Management seeks a Data Scientist to work on the Consumer & TMT sectors, leveraging AI, LLMs, and advanced models to generate alpha and support investment decisions; their... read more »
Management, Data Science, AI/ML, LLM, Analytics, Data Analytics, Computer Science, Python, SQL, Databricks, Spark, Snowflake, Matplotlib, Plotly, Tableau, Cloud Computing, AWS, GCP, Azure, Airflow, Jenkins, Docker