Dagster

data orchestration, data pipelines, data engineering, airflow, etl
Open jobs

268

Companies looking for

259

When data pipelines became less “plumbing” and more sprawling, existential nightmares, along came Dagster. It promised to be the orchestrator to end all orchestrators, moving beyond simple task scheduling to embrace a more data-aware, testable, and frankly, sensible approach to data processing. The core idea – solidifying data assets as first-class citizens – was quite clever, really, though one does wonder if everyone truly needs that level of metadata obsession.

In practice, Dagster is a Python-based framework that leans heavily into software engineering best practices. Think Airflow meets Prefect, but with a stronger emphasis on data quality and local development. It’s undeniably powerful, but requires a steeper learning curve and a more disciplined approach than some of its competitors. While it’s gained traction among data engineers at companies like Spotify and DoorDash, it hasn't quite achieved the ubiquitous status of Airflow, perhaps because convincing data teams to actually write tests is a challenge even the most elegant framework can’t solve.

Used together with Dagster

Additional Resources

Compare to other orchestration tools
Jobs (this month)

268

Companies with Jobs

259

Jobs in using Dagster for but please no

data engineer

Senior Data Engineer, Analytics @ scribehow

US | 2025-12-27 | USD 127000 - 180000 / year
Scribe hires a hands-on data engineer focusing on analytics engineering and BI to build scalable Snowflake data marts with dbt, modernize orchestration (Dagster or Airflow), and harden governance... read more »
Analytics Engineering, BI, Snowflake, dbt, Dagster, Airflow, Data Governance, AI/ML, Analytics, Data Engineering, GTM, Data Science, ETL/ELT, Cloud Computing, SQL, Management, dimensional modeling
data engineer

Data Engineer @ whatnot-inc

US | 2025-12-26 | USD 180000 - 260000 / year
Whatnot’s Data Engineer role offers end-to-end ownership of data architecture for a high-velocity live marketplace. You’ll design and operate streaming and batch pipelines that power product,... read more »
Marketing, Data Streaming, Analytics, AI/ML, Data Contracts, Data Quality, API, Data Vault, Kafka, dbt, Spark, Flink, Dagster, Airflow, Monte Carlo, Cloud Computing, Snowflake, BigQuery, Redshift, Python, SQL, CI/CD
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data engineer

Data Engineer - Platform 1 (P1) @ flyzipline

US | 2025-12-24
Zipline seeks a Data Engineer to build scalable data infrastructure for its logistics platform, with a key differentiator being its focus on autonomous drone delivery and complex international... read more »
Management, CRM, Analytics, AI/ML, ETL/ELT, Data Quality, Python, SQL, Airflow, Prefect, Dagster, Snowflake, BigQuery, Redshift, API, dbt, CI/CD, Docker, Kubernetes, Data Streaming, Kafka, Kinesis
data engineer

Data Engineer, Active Grid Response @ gridwareinc

US | 2025-12-23
Gridware seeks a data engineer to develop ETL/ELT pipelines for its Active Grid Response platform, emphasizing high-precision sensor data integration and real-time processing, with a notable focus... read more »
Management, Data Lakehouse, Analytics, ETL/ELT, Data Lake, Python, SQL, Databricks, Data Quality, Data Science, Cloud Computing, Big Data, Spark, Airflow, Dagster, Prefect, Data Streaming, Kafka, Kinesis, Data Modelling, IoT, Protobuf, Avro, Parquet, Grafana
data engineer

Data Engineer @ getkikoff

US | 2025-12-23
Kikoff’s data role sits at the pragmatic edge of data engineering and analytics engineering: design, build, and scale foundational datasets and pipelines to fuel analytics, modeling and... read more »
Analytics, Data Quality, Management, Computer Science, SQL, Data Engineering, Snowflake, dbt, Dagster, AI/ML