Spark logo
Open jobs

3184

Companies looking for Spark

2819

Apache Spark revolutionizes large-scale data processing with its lightning-fast, in-memory distributed computing framework. Designed for complex analytics, machine learning, and streaming workloads, Spark dramatically outperforms traditional MapReduce approaches. Its unified analytics engine supports multiple programming languages (Scala, Python, Java, R) and integrates seamlessly with diverse data sources. Spark's resilient distributed datasets (RDDs) and DataFrame abstractions enable sophisticated data transformations with minimal infrastructure complexity. While powerful, it demands significant computational resources and expertise to optimize. Machine learning libraries (MLlib) and streaming capabilities make it a go-to solution for enterprises processing petabyte-scale datasets across distributed environments.

Used together with Spark

Jobs (this month)

3184

Companies with Jobs

2819

Jobs in using Apache Spark for but please no

data scientist

Intern - Economics (STRUC) @ amazon

US | 2025-12-27 | USD 56 - 97 / hour
Amazon is seeking a Structural Economist Intern to work on econometric analysis of models involving preferences and strategic effects, using large-scale datasets and advanced structural methods... read more »
Marketing, PhD, R, Python, SQL, Unix, Spark
data scientist

Intern - Economics (RFCA) @ amazon

US | 2025-12-27 | USD 56 - 97 / hour
Amazon seeks RFCA Economist Interns to apply econometric methods on large datasets, including regression, panel data, and treatment effects, with the unique benefit of real-world causal analysis... read more »
PhD, R, Python, SQL, Unix, Spark
promoted

O'Reilly: Building AI Agents with Model Context Protocol (MCP)

Design and implement composable agent architectures using MCP. Understand the MCP architecture and how it enables AI applications to access external context. Build MCP servers that expose tools, resources, and prompts to LLMs.

data scientist

Intern - Economics (FMF) @ amazon

US | 2025-12-27 | USD 56 - 97 / hour
Amazon seeks Forecasting, Macroeconomics and Finance Interns to apply time-series econometric methods in large datasets for business trend forecasting. A unique aspect is the emphasis on combining... read more »
PhD, R, Python, SQL, Unix, Spark
data scientist

Staff GenAI Research Scientist @ databricks

US | 2025-12-27 | USD 192000 - 260000 / year
This role is a tantalizing promise of cutting-edge AI research, but the description lacks specificity on the actual technologies, tools, or deliverables expected. The job emphasizes collaboration... read more »
Databricks, AI/ML, LLM, Go, GenAI, PhD, Analytics, Data Lakehouse, Spark, Delta
data scientist

Analytics and Business Intelligence Engineer - Manager - Multiple Positions - 1664773 @ ernstandyoung

US | 2025-12-26 | USD 166730 / year
This position entails managing and executing advanced data analytics projects, including big-data problem solving, data visualization, and deploying machine learning guided by a differentiator of... read more »
Analytics, BI, Cloud Computing, Go, AI/ML, Big Data, DataViz, Data Analytics, Computer Science, Data Science, Management, Python, SQL, Power BI, Agile/Scrum, Pandas, Spark, Docker
data scientist

Staff Data Scientist - Password Sharing @ warner-bros-discovery

US | 2025-12-25 | USD 145600 - 270400 / year
Warner Bros. Discovery seeks a Staff Data Scientist to own end-to-end ML for growth: fraud detection, pricing optimization, and user behavior modeling, with mentoring duties. The role promises... read more »
AI/ML, PhD, Data Science, Python, PyTorch, TensorFlow, SQL, Spark
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

data scientist

Staff Data Scientist, Personalization & Shopping @ pinterest

US | 2025-12-25 | USD 163064 - 335720 / year
Pinterest seeks a Staff Data Scientist to advance Shopping through robust recommendation systems and causal inference, explaining why content is promoted to Pinners. With 7+ years of web-scale... read more »
AI/ML, Python, R, SQL, Spark, Computer Science
data scientist

Sr. Data Scientist, TLM @ uber-com

US | 2025-12-25 | USD 169000 - 188000 / year
Uber seeks an experienced manager to oversee its insurance data infrastructure, involving data modeling, process improvements, and expanding data scope to support growth. A key differentiator is... read more »
Computer Science, Management, SQL, Python, Big Data, Hadoop, Spark, DataViz, Tableau, ETL/ELT
data scientist

Data Scientist II @ radian

US | 2025-12-25 | USD 97000 - 137000 / year
Radian’s Data Scientist II in MIRS shoulders mortgage-credit modeling for defaults and prepayments, blending econometrics, statistics and ML in a cloud-first setup. You’ll estimate and validate... read more »
Cloud Computing, AI/ML, Big Data, R, Python, SAS, C++, AWS, Amazon EC2, Amazon EMR, S3, AWS Lambda, Spark, Management
data scientist

Data Scientist - Consumer/TMT @ balyasny-asset-management-l.p.

US | 2025-12-23
Balyasny Asset Management seeks a Data Scientist to work on the Consumer & TMT sectors, leveraging AI, LLMs, and advanced models to generate alpha and support investment decisions; their... read more »
Management, Data Science, AI/ML, LLM, Analytics, Data Analytics, Computer Science, Python, SQL, Databricks, Spark, Snowflake, Matplotlib, Plotly, Tableau, Cloud Computing, AWS, GCP, Azure, Airflow, Jenkins, Docker