Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data scientist

Data Scientist Short Term Trading @ eneco

NL | 2025-12-26 | EUR 86000 - 128000 / year
Eneco’s Flex Optimization Data Scientist operates at the intersection of data science and real-time energy trading, building optimization strategies, bidding algorithms and ML models to maximise... read more »
AI/ML, Data Science, Agile/Scrum, Computer Science, Cloud Computing, Python, SQL, Databricks, Data Streaming, Azure, Kubernetes, Airflow, Snowflake
data scientist

AI Engineer (Full-Stack ML Developer) @ merkle

NL | 2025-12-26
This role seeks a skilled AI Engineer to build and deploy machine learning and generative AI models across production systems. The candidate must integrate APIs, workflows, and automation tools,... read more »
AI/ML, GenAI, API, Airflow, Python, Docker, Cloud Computing, AWS, GCP, Vector DB, LLM, React, CDP, Management, Analytics, Marketing
promoted

Masthead Data

Masthead is a data reliability platform built for Google Cloud, focused on detecting anomalies and ensuring smooth data pipeline operations. It offers real-time notifications for data issues and pipeline errors without direct access to your sensitive data.

Learn More
data scientist

Data Scientist - QuantumBlack, AI by McKinsey @ quantumblack

NL | 2025-12-24
This role is a high-stakes, high-reward opportunity for a data engineer with a strong technical foundation. The position requires expertise in Python, PySpark, and cloud platforms, with a focus on... read more »
Analytics, R, AI/ML, Python, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, Azure, PhD, Computer Science, SPSS, SAS, Hadoop, Management