Delta Lake

data lake, acid transactions, time travel, file format, storage
Open jobs

705

Companies looking for Delta

597

Back in the wild west of big data, when data lakes were less shimmering oases and more swampy messes, arose the need for some semblance of order. Delta Lake, the lovechild of Databricks and open-source ambition, promised to bring ACID transactions to the chaotic world of Apache Spark and data lakes. It aimed to solve the classic problems of unreliable data pipelines and concurrent writes – a noble goal, indeed.

The reality? It’s quite clever, really, though one does wonder if the complexity always justifies the benefit. It layers a transaction log on top of your data lake, essentially creating a reliable table abstraction. Compared to Parquet files alone, it's a significant upgrade. Versus traditional data warehouses? Still a different beast, leaning towards schema-on-read flexibility. Today, it’s become a cornerstone of the modern data stack, embraced by anyone serious about building robust data pipelines, particularly within the Spark ecosystem. Though, let’s be honest, it adds another layer of operational overhead to an already complex world.

Used together with Delta

Jobs (this month)

705

Companies with Jobs

597

Jobs in using Delta Lake for but please no

data scientist

Sr. Deployment Strategist @ databricks

AU | 2025-12-25
This role involves managing multi-million dollar client engagements from discovery to full adoption, blending strategic communication with project execution. A notable differentiator is the... read more »
Databricks, C, Management, Agile/Scrum, AI/ML, Analytics, Data Lakehouse, Spark, Delta
data scientist

Sr. Forward Deployment Engineer @ databricks

AU | 2025-12-25
A Sr. Forward Deployed Engineer embeds with strategic clients to architect and deliver custom fullstack applications on the Databricks platform, bridging data engineering, AI, and application... read more »
Databricks, Data Engineering, AI/ML, Python, SQL, Java, Scala, JavaScript, TypeScript, API, LLM, C, Analytics, Data Lakehouse, Spark, Delta
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data scientist

Senior Counsel, Employment (APAC) @ databricks

AU | 2025-12-23
Databricks hunts for a Senior Counsel, Employment (APAC), an in-house employment lawyer who will shape HR risk and policy across Australia, India, Japan, South Korea, Singapore and beyond, while... read more »
Databricks, Management, AI/ML, Analytics, Data Lakehouse, Spark, Delta
data scientist

Senior Counsel, Employment (APAC) @ databricks

SG | 2025-12-23
Databricks seeks a Senior Counsel, Employment (APAC), a policy-forward in-house role rather than a data project, reporting to Global Employment and Litigation. The APAC brief spans Australia,... read more »
Databricks, Management, AI/ML, Analytics, Data Lakehouse, Spark, Delta
data scientist

Manager, Field Engineering @ databricks

AU | 2025-12-23
A managerial role to build and lead a pre-sales Solutions Architects team at Databricks, emphasizing collaboration and revenue growth with a focus on data, AI, and cloud solutions. A key... read more »
Databricks, Marketing, Big Data, Cloud Computing, SaaS, AI/ML, Data Engineering, Data Science, Analytics, Data Lakehouse, Spark, Delta
analytics engineer

Data Architect @ marshmclennan

AU | 2025-12-23
The Data Architect at Mercer, based in Melbourne or Sydney, will design data solutions to support transparency and standardisation, with a noted differentiator being expertise in complex data... read more »
Data Modelling, Analytics, Data Governance, Data Lakehouse, Delta, Vector DB, Management, Collibra, Informatica, SQL, Kubernetes, DevOps, Agile/Scrum
promoted

The Fundamentals of Analytics Engineering

The Fundamentals of Analytics Engineering gives a holistic understanding of the analytics engineering lifecycle by integrating principles from both data analysis and engineering. It's a book that teaches concepts and best practices, not just tools and technologies.

Learn More
data engineer

Data Engineer - Azure & Databricks @ n2sglobal

AU | 2025-12-23
This position calls for a data engineer skilled in Azure Databricks to build scalable data pipelines with the added twist that integrating diverse data sources like REST APIs and SFTP is a... read more »
Databricks, ETL/ELT, ADF, Spark, API, Cloud Storage, Management, Azure, Data Lake, SQL, Delta, Data Quality, Data Governance, Computer Science, Data Engineering, Python, Synapse, DWH, Big Data, Airflow, Kafka, AI/ML