Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data engineer

Senior AWS Data Engineer @ asx

AU | 2025-12-26
This role is a compelling opportunity for a senior data engineer with deep AWS expertise, but it’s a steep climb in a highly competitive field. The position requires a hands-on engineer with... read more »
Agile/Scrum, AWS, API, Data Engineering, Data Management, Analytics, Data Modelling, DWH, Data Streaming, Confluence, Kafka, Airflow, AWS Glue, Iceberg, Athena, Redshift, DataViz, Tableau, Power BI, QuickSight, Python, Spark, Terraform, Terragrunt
data engineer

Senior Data Engineer @ macquariegroup

AU | 2025-12-25
Macquarie's Post Trade Data and AI role reads like a heavyweight data engineer gig wrapped in financial compliance and stakeholder theatre. You get hands-on with AWS Redshift, Kubernetes, Python,... read more »
AI/ML, Big Data, Data Engineering, Cloud Computing, Analytics, DataViz, Redshift, Kubernetes, Python, SQL, dbt, Airflow, Dataiku, Data Modelling, Management
promoted

O'Reilly Power BI Learning

Master Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service.

Get Started
data engineer

Senior Data Engineer - 12 months FTC @ tpg-telecom

AU | 2025-12-23
The role involves building data pipelines and processes to support AI initiatives at TPG Telecom, with a focus on creating reusable datasets to ensure a single source of truth; a key... read more »
AI/ML, Analytics, Management, Data Engineering, Cloud Computing, Data Governance, Data Science, ETL/ELT, MLOps, Agile/Scrum, DevOps, Computer Science, SQL, Python, DWH, dimensional modeling, AWS, GCP, Azure, Modern Data Stack, dbt, Databricks, Redshift, Airflow, CI/CD, Git, Java, Terraform
data engineer

Data Engineer - Azure & Databricks @ n2sglobal

AU | 2025-12-23
This position calls for a data engineer skilled in Azure Databricks to build scalable data pipelines with the added twist that integrating diverse data sources like REST APIs and SFTP is a... read more »
Databricks, ETL/ELT, ADF, Spark, API, Cloud Storage, Management, Azure, Data Lake, SQL, Delta, Data Quality, Data Governance, Computer Science, Data Engineering, Python, Synapse, DWH, Big Data, Airflow, Kafka, AI/ML
data engineer

Lead Data Engineer (SSE II) @ zip-co-limited

AU | 2025-12-22
The role involves designing and maintaining scalable data pipelines critical to Zip’s financial operations, with a focus on reliability and security. A key differentiator is leading the uplift of... read more »
ETL/ELT, Analytics, Data Quality, Management, SQL, Snowflake, SQL Server, Data Streaming, Python, Spark, AWS, Terraform, Data Modelling, Airflow, CI/CD, Kafka, Kubernetes, dbt, DataViz, AI/ML