Delta Lake

data lake, acid transactions, time travel, file format, storage
Open jobs

705

Companies looking for Delta

597

Back in the wild west of big data, when data lakes were less shimmering oases and more swampy messes, arose the need for some semblance of order. Delta Lake, the lovechild of Databricks and open-source ambition, promised to bring ACID transactions to the chaotic world of Apache Spark and data lakes. It aimed to solve the classic problems of unreliable data pipelines and concurrent writes – a noble goal, indeed.

The reality? It’s quite clever, really, though one does wonder if the complexity always justifies the benefit. It layers a transaction log on top of your data lake, essentially creating a reliable table abstraction. Compared to Parquet files alone, it's a significant upgrade. Versus traditional data warehouses? Still a different beast, leaning towards schema-on-read flexibility. Today, it’s become a cornerstone of the modern data stack, embraced by anyone serious about building robust data pipelines, particularly within the Spark ecosystem. Though, let’s be honest, it adds another layer of operational overhead to an already complex world.

Used together with Delta

Jobs (this month)

705

Companies with Jobs

597

Jobs in using Delta Lake for but please no

data engineer

Strategic Account Director - FSI, Singapore Based @ databricks

SG | 2025-12-28
Databricks seeks an Enterprise Account Executive to sell to BFSI in Thailand, a sales role masquerading as data evangelism. You’ll deliver a 90‑day territory plan, meet CIOs and program managers,... read more »
Databricks, Management, Cloud Computing, Big Data, SaaS, Spark, AI/ML, Analytics, Data Lakehouse, Delta
data engineer

Senior Consultant - Data (Data Engineering) @ slalom-consulting

SG | 2025-12-25
A senior data engineer role focusing on designing and operating production-grade data pipelines for Fortune 100 clients, with a notable emphasis on modern data platform best practices. The key... read more »
Analytics, Data Engineering, ETL/ELT, Analytics Engineering, Python, DevOps, CI/CD, Agile/Scrum, Data Modelling, AWS, Kubernetes, Snowflake, Databricks, Spark, Hive, Delta, Iceberg, Vector DB, Airflow, Dagster, Prefect, GitHub, Datadog
promoted

Masthead Data

Masthead is a data reliability platform built for Google Cloud, focused on detecting anomalies and ensuring smooth data pipeline operations. It offers real-time notifications for data issues and pipeline errors without direct access to your sensitive data.

Learn More
data engineer

Trader- Delta One (Derivatives) @ cryptocom

SG | 2025-12-25
This delta-one crypto trading role leans hard on hands-on engineering and risk ownership. You’ll support and enforce risk protocols while trying to squeeze marginal gains from market conditions,... read more »
Delta, Python, Java, C++, Linux