Apache Airflow
Open jobs
1850
Companies looking for Airflow
1710
Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.
Used together with Airflow
Additional Resources
Compare to other orchestration toolsJobs (this month)
1850
Companies with Jobs
1710
Jobs in using Apache Airflow for but please no
| BI, Analytics, Data Quality, Data Analytics, SQL, DataViz, Cloud Computing, Redshift, Azure, Airflow | |||
| Marketing, Go, Analytics, SQL, dbt, Airflow, Amplitude, KPI, Management, DataViz, Looker | |||
|
promoted
O'Reilly Power BI LearningMaster Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service. |
|
||
|
data scientist
Data Scientist II – QuantumBlack, AI by McKinsey @ quantumblack
GB | 2025-12-28
London-based Data Scientist II at QuantumBlack promises a fast-track in a high-performance, client-facing lab where ML meets real business impact. The role blends model work with production...
read more »
|
Analytics, R, AI/ML, PhD, Computer Science, SQL, Python, Data Science, Big Data, PySpark, Hive, Hadoop, SPSS, SAS, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, GenAI, Management | ||
|
data engineer
Data Engineer II – QuantumBlack, AI by McKinsey @ quantumblack
GB | 2025-12-28
London-based Data Engineer II at a McKinsey-affiliated team promises pedigree, scale, and a steady drip of enterprise data problems for ML. The role centers on building scalable, modular...
read more »
|
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Scala, Java, Docker, Kubernetes, Spark, Cloud Computing, AWS, Azure, GCP, Pandas, NumPy, Matplotlib, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management | ||
|
analyst
Senior Commercial Analyst - WISE Platform @ wiseaccount
GB | 2025-12-27
| GBP
60000 - 75000
/ year
Wise Platform Senior Commercial Analyst: join the deal-flow analytics team and partner with Commercial and Delivery to drive growth through data. You’ll build scalable reporting models and data...
read more »
|
Management, Analytics, KPI, SQL, Snowflake, dbt, Git, Airflow, Python, Looker, DataViz, Pandas, NumPy, SciPy | ||
|
analyst
Senior Product Analytics Manager @ wiseaccount
GB | 2025-12-26
| GBP
100000 - 125000
/ year
This role is a high-stakes opportunity for a senior product analytics manager at Wise, a global payments platform. The position requires deep technical proficiency in SQL, data pipelines, and...
read more »
|
Analytics, SQL, Management, Snowflake, dbt, Git, Airflow, Python, KPI, Looker, Superset | ||
|
promoted
O'Reilly Power BI LearningMaster Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service. |
|
||
|
data scientist
Sr. Data Scientist, GenAI Algorithms (Based in Dubai) @ talabat-com
GB | 2025-12-26
Talabat, the Kuwaiti on‑demand platform, wants a data scientist to own an end‑to‑end data value chain across product and business, with a strong tilt toward generative AI and production ML. The...
read more »
|
Data Modelling, GenAI, AI/ML, KPI, Keras, TensorFlow, PyTorch, Python, LLM, NLP, BigQuery, GCP, Data Engineering, Airflow, Computer Science, Data Science | ||
|
data scientist
Data Scientist I - QuantumBlack, AI by McKinsey @ quantumblack
GB | 2025-12-26
McKinsey’s Data Scientist I in London promises a client-facing, high-velocity path that blends analytics, code, and real business impact. You’ll translate business needs into models, collaborate...
read more »
|
Analytics, R, AI/ML, PhD, Computer Science, Python, SPSS, SAS, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, GenAI, Management | ||
|
data engineer
Data Engineer I - QuantumBlack, AI by McKinsey @ quantumblack
GB | 2025-12-26
Data Engineer I at a top consultancy places you at the intersection of data pipelines, ML readiness, and client-facing delivery in London. The role promises rigorous on-the-job learning,...
read more »
|
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Pandas, NumPy, Matplotlib, Spark, Cloud Computing, AWS, Azure, GCP, Docker, Kubernetes, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management | ||
|
data engineer
Associate Data Engineer @ quantexa
GB | 2025-12-25
Quantexa pitches a breadth-first data engineering role inside an R&D group that builds internal applications, demos, and a SaaS version of its platform, aimed at mid-market banks for Retail AML....
read more »
|
Data Analytics, Go, R, SaaS, Data Engineering, Big Data, Data Lake, Analytics, Cloud Computing, ETL/ELT, Agile/Scrum, Scala, Java, Python, Data Science, Spark, Airflow, ELK, Data Quality | ||
|
data scientist
Staff Data Scientist – Experimentation: Innovation & Research @ sony-interactive-entertainment-llc
GB | 2025-12-25
The role as a Staff Data Scientist at PlayStation demands leadership in experimentation and causal inference, with a focus on building robust frameworks and mentoring teams. The job requires deep...
read more »
|
AI/ML, Data Science, Computer Science, SQL, R, Python, Data Engineering, Airflow, Git, Tableau | ||
| Management, Data Quality, SQL, Cloud Storage, Airflow, PySpark, Pandas, Git, Parquet, Linux, Bash | |||
|
analytics engineer
Senior Analytics Engineer @ rockstar-games
GB | 2025-12-23
Rockstar Games is recruiting a Senior Analytics Engineer to design and operate the data plumbing that underpins its mega-franchised games from a London studio. The role blends software development...
read more »
|
Analytics, Big Data, AI/ML, Data Engineering, Data Quality, Git, CI/CD, Terraform, GitHub, Analytics Engineering, Databricks, Azure, Cloud Computing, Airflow, Astronomer, Computer Science, Python, PySpark, SQL, Agile/Scrum, Management, Data Streaming | ||
|
promoted
O'Reilly Power BI LearningMaster Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service. |
|
||
|
machine learning engineer
Machine Learning Engineer @ comparethemarket
GB | 2025-12-21
Compare the Market’s Machine Learning Engineer role is about turning prototypes into production-grade ML services, building pipelines for training, validation, deployment, and both batch and...
read more »
|
AI/ML, MLOps, Data Science, CI/CD, Git, Python, Airflow, Amazon SageMaker, Computer Science, Databricks, Kubernetes, Data Streaming, Kafka, Flink |