Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data engineer

Data Engineer - Defensie Unit @ cgi-in-nederland

NL | 2025-12-27
Data Engineer for CGI’s Defence Unit must translate data as a service into defence-ready analytics and AI solutions, building and maintaining cloud data platforms while shaping project... read more »
Analytics, AI/ML, Cloud Computing, Data Engineering, Agile/Scrum, Data Science, DWH, Big Data, Hadoop, Spark, Kafka, NoSQL, SQL, SAS, Python, Informatica, Power BI, Airflow, Azure, AWS, Docker, Kubernetes, BI
data engineer

Senior Data Engineer @ sensorfact

NL | 2025-12-25
Sensorfact’s Senior Data Engineer role reads like a battle plan for industrial IoT data: build real-time streams from raw sensor data, detect faults on the fly, and serve personalised guidance via... read more »
AWS Glue, Analytics, AI/ML, MLOps, Cloud Computing, AWS, Kafka, Flink, ClickHouse, Prefect, AWS Lambda, API, Agile/Scrum, IoT, PhD, Computer Science, Python, Data Streaming, Spark, Kubernetes, Docker, Scala, Airflow, Git, CI/CD, PostgreSQL, Redshift, BigQuery
promoted

O'Reilly: Building AI Agents with Model Context Protocol (MCP)

Design and implement composable agent architectures using MCP. Understand the MCP architecture and how it enables AI applications to access external context. Build MCP servers that expose tools, resources, and prompts to LLMs.

Get Started
data engineer

Sr. Product Manager, Lakeflow @ databricks

NL | 2025-12-25
Databricks seeks a Product Manager for Lakeflow Jobs to own data-aware orchestration on a platform that supposedly handles hundreds of millions of workloads weekly with near-perfect reliability.... read more »
Databricks, AI/ML, ETL/ELT, BI, Data Streaming, Git, Computer Science, Management, Airflow, Dagster, Prefect, Spark, dbt, SQL, Python, Analytics, Data Lakehouse, Delta
data engineer

Data Engineering Principal @ metyis

NL | 2025-12-24
The role is a data engineer position at Metyis, focusing on building and maintaining data pipelines, managing data warehouses, and developing APIs. The job requires expertise in Python, Spark,... read more »
Big Data, Marketing, Go, Management, Analytics, Data Management, DataViz, API, Python, Spark, Azure, Cloud Computing, ETL/ELT, DWH, Data Vault, 3NF, GitHub, CI/CD, AWS Lambda, SQL, Data Governance, Databricks, Synapse, Data Analytics, Data Streaming, Airflow, Kubernetes, PySpark, Bash, Power BI, Computer Science
data engineer

Senior Core Data Engineer - Real Time @ flow-traders

NL | 2025-12-23
This role is a unique opportunity for a senior data engineer to lead real-time analytics at a fast-paced, innovative firm. The position requires expertise in building and maintaining low-latency... read more »
Analytics, Python, Linux, SQL, RDBMS, Git, ClickHouse, Airflow, Kafka, GCP, Dataproc, Pandas, Spark, Beam
data engineer

Core Data Engineer @ flow-traders

NL | 2025-12-23
Flow Traders is hunting a Core Data Engineer to own the end-to-end lifecycle of its most valuable data products—the Security Master, ETF compositions, high-resolution market data, and the trades,... read more »
Data Modelling, Python, Linux, SQL, Big Data, Airflow, Kafka, GCP, Dataproc, Pandas, Spark, Beam
promoted

O'Reilly Power BI Learning

Master Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service.

Get Started
data engineer

Full-Stack Data Engineer @ eneco

NL | 2025-12-23 | € 82000 - 115000 / year
A Senior Data Engineer role at Eneco involves architecting cloud-based data platforms and pipelines, working with diverse sources like smart meters and wind turbines to support Eneco's goal of CO₂... read more »
Data Engineering, Cloud Computing, AI/ML, ETL/ELT, Data Modelling, Data Governance, Data Quality, Git, CI/CD, Management, DevOps, Spark, Beam, Flink, Kafka, SQL, NoSQL, Databricks, Snowflake, dbt, Airflow, Kubernetes, Azure, Python, Power BI, Grafana
data engineer

Data Engineering Associate @ metyis

NL | 2025-12-22
Metyis offers a collaborative, multidisciplinary environment for a data engineer focused on building operational data platforms and supporting Big Data strategies. The role requires expertise in... read more »
Big Data, Marketing, BI, Analytics, ETL/ELT, Data Streaming, AI/ML, Agile/Scrum, Data Engineering, Data Analytics, DWH, Data Vault, 3NF, SQL, Azure, Databricks, Synapse, Airflow, Kubernetes, Python, PySpark, Bash, Git, CI/CD, Docker, Power BI, Computer Science
data engineer

Data Engineer - QuantumBlack, AI by McKinsey @ quantumblack

NL | 2025-12-22
This role is a high-performance, high-reward opportunity for a data engineer seeking to grow as a leader in a global, diverse team. The position emphasizes continuous learning, mentorship, and... read more »
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Python, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, Azure, Computer Science, Scala, Pandas, NumPy, Matplotlib, Spark, DevOps, DataOps, MLOps, Management