Delta Lake

data lake, acid transactions, time travel, file format, storage
Open jobs

705

Companies looking for Delta

597

Back in the wild west of big data, when data lakes were less shimmering oases and more swampy messes, arose the need for some semblance of order. Delta Lake, the lovechild of Databricks and open-source ambition, promised to bring ACID transactions to the chaotic world of Apache Spark and data lakes. It aimed to solve the classic problems of unreliable data pipelines and concurrent writes – a noble goal, indeed.

The reality? It’s quite clever, really, though one does wonder if the complexity always justifies the benefit. It layers a transaction log on top of your data lake, essentially creating a reliable table abstraction. Compared to Parquet files alone, it's a significant upgrade. Versus traditional data warehouses? Still a different beast, leaning towards schema-on-read flexibility. Today, it’s become a cornerstone of the modern data stack, embraced by anyone serious about building robust data pipelines, particularly within the Spark ecosystem. Though, let’s be honest, it adds another layer of operational overhead to an already complex world.

Used together with Delta

Jobs (this month)

705

Companies with Jobs

597

Jobs in using Delta Lake for but please no

analytics engineer

Solution Architect - ソリューションアーキテクト (1211) @ axtria

JP | 2025-12-28
Axtria seeks a senior Solution Architect fluent in Japan's pharma data landscape, marrying cloud data engineering with governance. The role centers on end-to-end architectures using Informatica... read more »
Data Analytics, Analytics, AI/ML, Cloud Computing, Data Science, Marketing, Data Engineering, Informatica, Databricks, Data Vault, PySpark, Data Lakehouse, CRM, KPI, Python, DevOps, Data Quality, Management, Agile/Scrum, Jira, Confluence, CI/CD, Delta, SQL, AWS, Azure, GCP, Data Governance
analytics engineer

Solutions Architect @ snowflake-computing

NL | 2025-12-23
Snowflake pitches Amsterdam as a hub for post-sales brilliance: a Solutions Architect role that blends enterprise data platform design with hands-on coaching, governance, and multi-vendor... read more »
Snowflake, AI/ML, Cloud Computing, Data Management, Management, Teradata, Spark, Databricks, Hadoop, Oracle, SQL Server, Data Vault, Fabric, Data Governance, Data Lake, DWH, dimensional modeling, 3NF, AWS, Azure, SQL, dbt, Talend, Informatica, Python, PySpark, Parquet, Avro, Iceberg, Delta, Analytics, Tableau, Power BI, Thoughtspot, SAS, NLP, Marketing, Data Analytics
promoted

O'Reilly Power BI Learning

Master Power BI fast: build basic-to-advanced visuals, apply smart design, use dynamic slicers/filters & new cards, choose the right chart, spotlight key insights, brand and theme reports, and seamlessly publish/share in the Service.

Get Started
analytics engineer

Data Architect @ marshmclennan

AU | 2025-12-23
The Data Architect at Mercer, based in Melbourne or Sydney, will design data solutions to support transparency and standardisation, with a noted differentiator being expertise in complex data... read more »
Data Modelling, Analytics, Data Governance, Data Lakehouse, Delta, Vector DB, Management, Collibra, Informatica, SQL, Kubernetes, DevOps, Agile/Scrum
analytics engineer

Senior Data Analytics Engineer @ nhghealth

SG | 2025-12-22
A Senior Data Analytics Engineer at NHG involves building and maintaining scalable data pipelines and dashboards using Tableau and Databricks to aid healthcare decision-making. The differentiator... read more »
Data Analytics, Analytics, Tableau, Databricks, ETL/ELT, Data Governance, Data Engineering, Computer Science, Delta, Spark, Python, SQL, Informatica, Amazon SageMaker, Cloud Computing, Management, AI/ML