Apache Spark

big data, distributed computing, analytics
Spark logo
Open jobs

3184

Companies looking for Spark

2819

Apache Spark revolutionizes large-scale data processing with its lightning-fast, in-memory distributed computing framework. Designed for complex analytics, machine learning, and streaming workloads, Spark dramatically outperforms traditional MapReduce approaches. Its unified analytics engine supports multiple programming languages (Scala, Python, Java, R) and integrates seamlessly with diverse data sources. Spark's resilient distributed datasets (RDDs) and DataFrame abstractions enable sophisticated data transformations with minimal infrastructure complexity. While powerful, it demands significant computational resources and expertise to optimize. Machine learning libraries (MLlib) and streaming capabilities make it a go-to solution for enterprises processing petabyte-scale datasets across distributed environments.

Used together with Spark

Jobs (this month)

3184

Companies with Jobs

2819

Jobs in using Apache Spark for but please no

data engineer

Product Owner / Data Engineer @ iqvia

ES | 2025-12-28
The role involves managing data engineering and AI product development within a fast-paced environment, with the notable differentiator being the need for deep technical fluency combined with... read more »
Data Engineering, AI/ML, Analytics, Snowflake, Databricks, Agile/Scrum, Data Quality, ETL/ELT, Data Modelling, API, Cloud Computing, Azure, Management, Computer Science, Data Science, Spark
data engineer

Data Engineer Scala Spark @ capgemini

ES | 2025-12-25
Capgemini pitches a Data Engineer role inside a global, multi-sector data practice. Expect to build pipelines from scratch, manage batch and real-time workloads with Apache Spark, and stitch ETLs... read more »
Spark, Python, Scala, Cloud Computing, Azure, AWS, GCP, Databricks, Synapse, Airflow, AI/ML
promoted

O'Reilly: Building AI Agents with Model Context Protocol (MCP)

Design and implement composable agent architectures using MCP. Understand the MCP architecture and how it enables AI applications to access external context. Build MCP servers that expose tools, resources, and prompts to LLMs.

Get Started
data engineer

Spark Developer con SQL (Híbrido Málaga) @ ustglobal

ES | 2025-12-23
UST pitches itself as a US multinational with Top Employer status, and the role cleanly maps to a bank-facing data engineering mandate: build and optimize Spark pipelines in Azure Databricks,... read more »
Spark, SQL, Databricks, GitHub, Agile/Scrum, PySpark, Azure