Apache Spark

big data, distributed computing, analytics
Spark logo
Open jobs

3184

Companies looking for Spark

2819

Apache Spark revolutionizes large-scale data processing with its lightning-fast, in-memory distributed computing framework. Designed for complex analytics, machine learning, and streaming workloads, Spark dramatically outperforms traditional MapReduce approaches. Its unified analytics engine supports multiple programming languages (Scala, Python, Java, R) and integrates seamlessly with diverse data sources. Spark's resilient distributed datasets (RDDs) and DataFrame abstractions enable sophisticated data transformations with minimal infrastructure complexity. While powerful, it demands significant computational resources and expertise to optimize. Machine learning libraries (MLlib) and streaming capabilities make it a go-to solution for enterprises processing petabyte-scale datasets across distributed environments.

Used together with Spark

Jobs (this month)

3184

Companies with Jobs

2819

Jobs in using Apache Spark for but please no

data engineer

Data Engineer II – QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-28
London-based Data Engineer II at a McKinsey-affiliated team promises pedigree, scale, and a steady drip of enterprise data problems for ML. The role centers on building scalable, modular... read more »
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Scala, Java, Docker, Kubernetes, Spark, Cloud Computing, AWS, Azure, GCP, Pandas, NumPy, Matplotlib, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management
data engineer

Data Engineer - Defence @ ibm

GB | 2025-12-27
IBM CIC seeks a Managing Data Engineer with advanced analytics expertise to develop innovative solutions for complex business problems, emphasizing leadership and mentorship. A key differentiator... read more »
IBM, Cloud Computing, AI/ML, Analytics, Data Engineering, Data Collection, SPSS, Python, R, SQL, Pandas, NumPy, TensorFlow, PyTorch, Big Data, Hadoop, Spark, Data Science, AWS
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data engineer

Junior Data Engineer - Analytics Engineer @ entain

GB | 2025-12-27
An analytics engineer at Angstrom will design and optimize data models and workflows to produce reliable insights, acting as a bridge between data engineering and analytics. A notable... read more »
Analytics, Data Engineering, ETL/ELT, SQL, Data Quality, Cloud Computing, AWS, S3, Athena, CloudFormation, CloudWatch, Python, Data Modelling, dimensional modeling, RDBMS, BI, Power BI, Plotly, React, JavaScript, API, Spark, Kafka
data engineer

Data Engineer I - QuantumBlack, AI by McKinsey @ quantumblack

GB | 2025-12-26
Data Engineer I at a top consultancy places you at the intersection of data pipelines, ML readiness, and client-facing delivery in London. The role promises rigorous on-the-job learning,... read more »
Analytics, AI/ML, Data Quality, R, Data Engineering, Agile/Scrum, C, Computer Science, Python, Pandas, NumPy, Matplotlib, Spark, Cloud Computing, AWS, Azure, GCP, Docker, Kubernetes, DevOps, DataOps, MLOps, PySpark, SQL, Airflow, Databricks, GenAI, Management
data engineer

Data Engineering Consultant @ uk-talan

GB | 2025-12-25
An enterprise data engineering consultant role at Talan Data x AI promises multi-cloud breadth (AWS, Azure, GCP) and a Databricks Lakehouse core, with DBT, Terraform, and CI/CD baked in. The stack... read more »
AI/ML, Data Management, Analytics, PySpark, Spark, AWS, Azure, Cloud Computing, GCP, Data Lake, Python, SQL, GitHub, CI/CD, Databricks, Data Lakehouse, dbt, Git, Management, DevOps, Data Engineering, DWH, Data Modelling, Data Quality, Data Analytics, DataViz, Data Science, BI, IaC, Terraform, Tableau, Power BI, Snowflake
data engineer

Associate Data Engineer @ quantexa

GB | 2025-12-25
Quantexa pitches a breadth-first data engineering role inside an R&D group that builds internal applications, demos, and a SaaS version of its platform, aimed at mid-market banks for Retail AML.... read more »
Data Analytics, Go, R, SaaS, Data Engineering, Big Data, Data Lake, Analytics, Cloud Computing, ETL/ELT, Agile/Scrum, Scala, Java, Python, Data Science, Spark, Airflow, ELK, Data Quality
promoted

O'Reilly: Building AI Agents with Model Context Protocol (MCP)

Design and implement composable agent architectures using MCP. Understand the MCP architecture and how it enables AI applications to access external context. Build MCP servers that expose tools, resources, and prompts to LLMs.

Get Started
data engineer

Founders Associate @ taptapsend

GB | 2025-12-24
Founders Associate at Taptap Send is a mission-forward, high-velocity role that drops you into the heart of a growing cross-border fintech. You work directly with the Founder to scope... read more »
Word, Spark, SQL, KPI, DataViz, Management
data engineer

Senior Data Engineer - (Genetics) Maternity Cover - 12 months FTC @ our-future-health-uk

GB | 2025-12-22
This role is for a Senior Data Engineer specializing in genetic data processing, with responsibilities involving building and maintaining robust pipelines for data storage and release. The... read more »
Data Engineering, CI/CD, Agile/Scrum, Cloud Computing, Python, Unix, Azure, Parquet, Delta, Docker, Kubernetes, Spark, Databricks, Git, GitHub