Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data engineer

Data Engineer II – QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-28
London-based Data Engineer II at a McKinsey-affiliated team promises pedigree, scale, and a steady drip of enterprise data problems for ML. The role centers on building scalable, modular... read more »
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Scala, Java, Docker, Kubernetes, Spark, Cloud Computing, AWS, Azure, GCP, Pandas, NumPy, Matplotlib, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management
data engineer

Data Engineer I - QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-26
Data Engineer I at a top consultancy places you at the intersection of data pipelines, ML readiness, and client-facing delivery in London. The role promises rigorous on-the-job learning,... read more »
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Pandas, NumPy, Matplotlib, Spark, Cloud Computing, AWS, Azure, GCP, Docker, Kubernetes, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management
promoted

O'Reilly Power BI Learning

Master Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service.

Get Started
data engineer

Associate Data Engineer @ quantexa

GB | 2025-12-25
Quantexa pitches a breadth-first data engineering role inside an R&D group that builds internal applications, demos, and a SaaS version of its platform, aimed at mid-market banks for Retail AML.... read more »
Data Analytics, Go, R, SaaS, Data Engineering, Big Data, Data Lake, Analytics, Cloud Computing, ETL/ELT, Agile/Scrum, Scala, Java, Python, Data Science, Spark, Airflow, ELK, Data Quality