Apache Airflow
Open jobs
1850
Companies looking for Airflow
1710
Apache Airflow: the workflow automation darling of the data world, born at Airbnb in 2014. It’s open-source, meaning free, but don’t let that fool you—it’s no walk in the park. Competing with the likes of Luigi, Prefect, and cloud-native solutions, Airflow's main draw is its DAG-based approach (Directed Acyclic Graphs), which gives you full control over complex pipelines. In other words, it’s a power tool for data engineers who love Python and have a thing for manually tweaking dependencies.
In its current state, Airflow dominates orchestration, especially in companies with mature data engineering teams. But beware: Airflow is highly flexible, which also means highly finicky. Miss one task or get the scheduling wrong, and your whole pipeline could come crashing down at 3 a.m. The UI is functional but looks like it escaped from 2015, and scalability? Well, you'll be tuning it yourself. It’s powerful but requires constant attention—like a temperamental race car.
Used together with Airflow
Additional Resources
Compare to other orchestration toolsJobs (this month)
1850
Companies with Jobs
1710
Jobs in using Apache Airflow for but please no
|
analytics engineer
Senior Analytics Engineer @ rockstar-games
GB | 2025-12-23
Rockstar Games is recruiting a Senior Analytics Engineer to design and operate the data plumbing that underpins its mega-franchised games from a London studio. The role blends software development...
read more »
|
Analytics, Big Data, AI/ML, Data Engineering, Data Quality, Git, CI/CD, Terraform, GitHub, Analytics Engineering, Databricks, Azure, Cloud Computing, Airflow, Astronomer, Computer Science, Python, PySpark, SQL, Agile/Scrum, Management, Data Streaming |
|---|
