Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data scientist

Data Scientist II – QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-28
London-based Data Scientist II at QuantumBlack promises a fast-track in a high-performance, client-facing lab where ML meets real business impact. The role blends model work with production... read more »
Analytics, R, AI/ML, PhD, Computer Science, SQL, Python, Data Science, Big Data, PySpark, Hive, Hadoop, SPSS, SAS, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, GenAI, Management
data scientist

Sr. Data Scientist, GenAI Algorithms (Based in Dubai) @ talabat-com

GB | 2025-12-26
Talabat, the Kuwaiti on‑demand platform, wants a data scientist to own an end‑to‑end data value chain across product and business, with a strong tilt toward generative AI and production ML. The... read more »
Data Modelling, GenAI, AI/ML, KPI, Keras, TensorFlow, PyTorch, Python, LLM, NLP, BigQuery, GCP, Data Engineering, Airflow, Computer Science, Data Science
promoted

The Fundamentals of Analytics Engineering

The Fundamentals of Analytics Engineering gives a holistic understanding of the analytics engineering lifecycle by integrating principles from both data analysis and engineering. It's a book that teaches concepts and best practices, not just tools and technologies.

Learn More
data scientist

Data Scientist I - QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-26
McKinsey’s Data Scientist I in London promises a client-facing, high-velocity path that blends analytics, code, and real business impact. You’ll translate business needs into models, collaborate... read more »
Analytics, R, AI/ML, PhD, Computer Science, Python, SPSS, SAS, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, GenAI, Management
data scientist

Staff Data Scientist – Experimentation: Innovation & Research @ sony-interactive-entertainment-llc

GB | 2025-12-25
The role as a Staff Data Scientist at PlayStation demands leadership in experimentation and causal inference, with a focus on building robust frameworks and mentoring teams. The job requires deep... read more »
AI/ML, Data Science, Computer Science, SQL, R, Python, Data Engineering, Airflow, Git, Tableau