Dagster

data orchestration, data pipelines, data engineering, airflow, etl
Open jobs

268

Companies looking for

259

When data pipelines became less “plumbing” and more sprawling, existential nightmares, along came Dagster. It promised to be the orchestrator to end all orchestrators, moving beyond simple task scheduling to embrace a more data-aware, testable, and frankly, sensible approach to data processing. The core idea – solidifying data assets as first-class citizens – was quite clever, really, though one does wonder if everyone truly needs that level of metadata obsession.

In practice, Dagster is a Python-based framework that leans heavily into software engineering best practices. Think Airflow meets Prefect, but with a stronger emphasis on data quality and local development. It’s undeniably powerful, but requires a steeper learning curve and a more disciplined approach than some of its competitors. While it’s gained traction among data engineers at companies like Spotify and DoorDash, it hasn't quite achieved the ubiquitous status of Airflow, perhaps because convincing data teams to actually write tests is a challenge even the most elegant framework can’t solve.

Used together with Dagster

Additional Resources

Compare to other orchestration tools
Jobs (this month)

268

Companies with Jobs

259

Jobs in using Dagster for but please no

data scientist

Sr. Staff Marketing Data Scientist @ quizlet

US | 2025-12-26 | USD 225000 - 305000 / year
Quizlet’s senior data/analytics engineering role centers on MMM and cross‑channel incrementality, stitching AppsFlyer/MA MMPs, ad-platform feeds, GA4/GTM, and internal events into an always-on... read more »
AI/ML, Data Science, Marketing, MMM, Stitch, Analytics, API, Google Analytics, GTM, Data Quality, SQL, Python, R, Pandas, NumPy, BigQuery, Snowflake, Redshift, dbt, Airflow, Dagster, CI/CD, Cloud Computing, GenAI
data scientist

Data Scientist @ teamtarro

US | 2025-12-26
Tarro pitches itself as the tech-and-people bridge for mom-and-pop restaurants, and the Data Scientist role reads as an engine for end-to-end ML in a growth-at-all-costs startup. You own pipelines... read more »
AI/ML, Data Science, Marketing, Data Engineering, CI/CD, Computer Science, ETL/ELT, Cloud Computing, Snowflake, Redshift, Python, API, SQL, LLM, RAG, Vector DB, Dagster, Airflow, Docker, dbt
promoted

Masthead Data

Masthead is a data reliability platform built for Google Cloud, focused on detecting anomalies and ensuring smooth data pipeline operations. It offers real-time notifications for data issues and pipeline errors without direct access to your sensitive data.

Learn More
data scientist

Clinical Development Data Science Intern @ genmab

US | 2025-12-25
A clinical development data science internship at Genmab offers exposure to AI/ML projects targeting clinical trial design and safety monitoring, with the differentiator being their focus on... read more »
Data Science, AI/ML, PhD, NLP, GenAI, Analytics, Computer Science, Python, PyTorch, TensorFlow, Pandas, NumPy, RAG, Docker, Airflow, Prefect, Dagster, Cloud Computing, AWS, Azure, GCP, Git, GitHub, GitLab, CI/CD, MLOps, Agile/Scrum
data scientist

Data Scientist @ grow-with-clay

US | 2025-12-25
Clay pitches itself as a no‑frills growth tool riding a seriously shiny data stack and a fair bit of hype about GTM alpha. The data science role promises end‑to‑end ownership—from data... read more »
GTM, C, Data Science, Funnel, Snowflake, dbt, Dagster, Go, Analytics, SQL, Python, AI/ML, Airflow