Apache Airflow

workflow management, data orchestration, etl
Open jobs

1850

Companies looking for Airflow

1710

Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.

Used together with Airflow

Additional Resources

Compare to other orchestration tools
Jobs (this month)

1850

Companies with Jobs

1710

Jobs in using Apache Airflow for but please no

data scientist

Senior Data Scientist, ANZ @ airwallex

SG | 2025-12-28
Airwallex seeks a senior data analyst with over five years of experience in forecasting and deep expertise in SQL and scripting languages, leveraging AI for insights. The role’s differentiator is... read more »
Management, AI/ML, Data Science, Go, Marketing, Data Engineering, Computer Science, SQL, Python, R, Airflow, Databricks, dbt, Oracle
data engineer

VP, Data Engineer, Data Strategy Group @ gic

SG | 2025-12-27
This role is a high-impact, high-stakes opportunity for a data engineer at GIC, where technical excellence and strategic insight are paramount. The position requires deep expertise in data... read more »
Data Engineering, Analytics, Management, Agile/Scrum, GitHub, Jira, Databricks, Python, dbt, Airflow, AWS, Cloud Computing, Data Analytics, Data Modelling, DataViz, PySpark, SQL, Docker, Kubernetes, DevOps, CI/CD, BI, Tableau, Microsoft, Data Quality
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data engineer

Senior Data Engineer - QuantumBlack @ quantumblack

SG | 2025-12-27
This role is hyped with promises of growth, mentorship, and a global community, but the description lacks specific technical details and fails to highlight the core technologies and skills... read more »
AI/ML, Python, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, Azure, Analytics, Data Science, Data Engineering, Cyber Security, GenAI, RAG, R, C, Agile/Scrum, Computer Science, Scala, Java, Spark, Pandas, NumPy, Matplotlib, Management
data scientist

Senior Data Scientist - QuantumBlack @ quantumblack

SG | 2025-12-26
Senior Data Scientist at QuantumBlack promises frontier ML R&D across industries, with a toolbox heavy on Python, PySpark, the PyData stack, Airflow and Databricks, Kedro, Dask, RAPIDS, and cloud... read more »
AI/ML, Python, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, Azure, R, Analytics, Data Science, PhD, Computer Science, Scala, NoSQL, DWH, GenAI, RAG
data engineer

Senior Consultant - Data (Data Engineering) @ slalom-consulting

SG | 2025-12-25
A senior data engineer role focusing on designing and operating production-grade data pipelines for Fortune 100 clients, with a notable emphasis on modern data platform best practices. The key... read more »
Analytics, Data Engineering, ETL/ELT, Analytics Engineering, Python, DevOps, CI/CD, Agile/Scrum, Data Modelling, AWS, Kubernetes, Snowflake, Databricks, Spark, Hive, Delta, Iceberg, Vector DB, Airflow, Dagster, Prefect, GitHub, Datadog
data engineer

Data Engineer - QuantumBlack @ quantumblack

SG | 2025-12-25
This role is a high-stakes, high-impact opportunity for a data engineer with a deep technical foundation. The job emphasizes continuous learning, mentorship, and cross-functional collaboration,... read more »
AI/ML, Python, PySpark, SQL, Airflow, Databricks, Docker, Kubernetes, Cloud Computing, AWS, GCP, Azure, C, Analytics, R, GenAI, RAG, Data Quality, Cyber Security, Data Science, Data Engineering, Agile/Scrum, Computer Science, Scala, Java, DevOps, DataOps, MLOps, Pandas, NumPy, Matplotlib, Big Data, Spark, Kafka, Snowflake, AWS Glue, Beam, Flink, Management
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data engineer

Data Engineer - Singapore @ plaudai

SG | 2025-12-24
Plaud Inc. seeks a data professional to develop data pipelines, support data collection, and build datasets for AI evaluation, with a notable emphasis on data security practices. The role offers... read more »
AI/ML, GDPR/CCPA, Cyber Security, Analytics, Data Collection, Data Engineering, Analytics Engineering, SQL, Python, Go, Scala, ETL/ELT, Airflow, Prefect, Dagster, BigQuery, Snowflake, Redshift, Tableau, Looker, Superset, Data Modelling, Data Governance
data engineer

Lead, Platform Engineering @ bain-and-company

SG | 2025-12-22
Vector seeks a Lead Platform Engineer to design cloud-based distributed systems, leveraging expertise in cloud engineering, DevOps, and software development. The role’s differentiator is working... read more »
Analytics, AI/ML, Management, Cloud Computing, DevOps, AWS, GCP, IaC, CI/CD, API, Kubernetes, Docker, Computer Science, Azure, Terraform, Pulumi, Ansible, Puppet, Grafana, Prometheus, Splunk, New Relic, Datadog, CloudWatch, GitHub, Jenkins, GitLab, Circle CI, Python, Git, dbt, Beam, Airflow