Dagster

data orchestration, data pipelines, data engineering, airflow, etl
Open jobs

268

Companies looking for

259

When data pipelines became less “plumbing” and more sprawling, existential nightmares, along came Dagster. It promised to be the orchestrator to end all orchestrators, moving beyond simple task scheduling to embrace a more data-aware, testable, and frankly, sensible approach to data processing. The core idea – solidifying data assets as first-class citizens – was quite clever, really, though one does wonder if everyone truly needs that level of metadata obsession.

In practice, Dagster is a Python-based framework that leans heavily into software engineering best practices. Think Airflow meets Prefect, but with a stronger emphasis on data quality and local development. It’s undeniably powerful, but requires a steeper learning curve and a more disciplined approach than some of its competitors. While it’s gained traction among data engineers at companies like Spotify and DoorDash, it hasn't quite achieved the ubiquitous status of Airflow, perhaps because convincing data teams to actually write tests is a challenge even the most elegant framework can’t solve.

Used together with Dagster

Additional Resources

Compare to other orchestration tools
Jobs (this month)

268

Companies with Jobs

259

Jobs in using Dagster for but please no

data engineer

Senior Consultant - Data (Data Engineering) @ slalom-consulting

SG | 2025-12-25
A senior data engineer role focusing on designing and operating production-grade data pipelines for Fortune 100 clients, with a notable emphasis on modern data platform best practices. The key... read more »
Analytics, Data Engineering, ETL/ELT, Analytics Engineering, Python, DevOps, CI/CD, Agile/Scrum, Data Modelling, AWS, Kubernetes, Snowflake, Databricks, Spark, Hive, Delta, Iceberg, Vector DB, Airflow, Dagster, Prefect, GitHub, Datadog
data engineer

Data Engineer - Singapore @ plaudai

SG | 2025-12-24
Plaud Inc. seeks a data professional to develop data pipelines, support data collection, and build datasets for AI evaluation, with a notable emphasis on data security practices. The role offers... read more »
AI/ML, GDPR/CCPA, Cyber Security, Analytics, Data Collection, Data Engineering, Analytics Engineering, SQL, Python, Go, Scala, ETL/ELT, Airflow, Prefect, Dagster, BigQuery, Snowflake, Redshift, Tableau, Looker, Superset, Data Modelling, Data Governance