Apache Spark
Open jobs
3184
Companies looking for Spark
2819
Apache Spark revolutionizes large-scale data processing with its lightning-fast, in-memory distributed computing framework. Designed for complex analytics, machine learning, and streaming workloads, Spark dramatically outperforms traditional MapReduce approaches. Its unified analytics engine supports multiple programming languages (Scala, Python, Java, R) and integrates seamlessly with diverse data sources. Spark's resilient distributed datasets (RDDs) and DataFrame abstractions enable sophisticated data transformations with minimal infrastructure complexity. While powerful, it demands significant computational resources and expertise to optimize. Machine learning libraries (MLlib) and streaming capabilities make it a go-to solution for enterprises processing petabyte-scale datasets across distributed environments.
Used together with Spark
Jobs (this month)
3184
Companies with Jobs
2819
Jobs in using Apache Spark for but please no
|
data scientist
Intern - Economics (STRUC) @ amazon
US | 2025-12-27
| USD
56 - 97
/ hour
Amazon is seeking a Structural Economist Intern to work on econometric analysis of models involving preferences and strategic effects, using large-scale datasets and advanced structural methods...
read more »
|
Marketing, PhD, R, Python, SQL, Unix, Spark | ||
|---|---|---|---|
|
data scientist
Intern - Economics (RFCA) @ amazon
US | 2025-12-27
| USD
56 - 97
/ hour
Amazon seeks RFCA Economist Interns to apply econometric methods on large datasets, including regression, panel data, and treatment effects, with the unique benefit of real-world causal analysis...
read more »
|
PhD, R, Python, SQL, Unix, Spark | ||
|
promoted
O'Reilly: Building AI Agents with Model Context Protocol (MCP)Design and implement composable agent architectures using MCP. Understand the MCP architecture and how it enables AI applications to access external context. Build MCP servers that expose tools, resources, and prompts to LLMs. |
|
||
|
data scientist
Intern - Economics (FMF) @ amazon
US | 2025-12-27
| USD
56 - 97
/ hour
Amazon seeks Forecasting, Macroeconomics and Finance Interns to apply time-series econometric methods in large datasets for business trend forecasting. A unique aspect is the emphasis on combining...
read more »
|
PhD, R, Python, SQL, Unix, Spark | ||
|
data scientist
Staff GenAI Research Scientist @ databricks
US | 2025-12-27
| USD
192000 - 260000
/ year
This role is a tantalizing promise of cutting-edge AI research, but the description lacks specificity on the actual technologies, tools, or deliverables expected. The job emphasizes collaboration...
read more »
|
Databricks, AI/ML, LLM, Go, GenAI, PhD, Analytics, Data Lakehouse, Spark, Delta | ||
|
data scientist
Analytics and Business Intelligence Engineer - Manager - Multiple Positions - 1664773 @ ernstandyoung
US | 2025-12-26
| USD
166730
/ year
This position entails managing and executing advanced data analytics projects, including big-data problem solving, data visualization, and deploying machine learning guided by a differentiator of...
read more »
|
Analytics, BI, Cloud Computing, Go, AI/ML, Big Data, DataViz, Data Analytics, Computer Science, Data Science, Management, Python, SQL, Power BI, Agile/Scrum, Pandas, Spark, Docker | ||
|
data scientist
Staff Data Scientist - Password Sharing @ warner-bros-discovery
US | 2025-12-25
| USD
145600 - 270400
/ year
Warner Bros. Discovery seeks a Staff Data Scientist to own end-to-end ML for growth: fraud detection, pricing optimization, and user behavior modeling, with mentoring duties. The role promises...
read more »
|
AI/ML, PhD, Data Science, Python, PyTorch, TensorFlow, SQL, Spark | ||
|
promoted
BigQuery Cost Optimization Guide by Masthead DataThe BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of... |
|
||
|
data scientist
Staff Data Scientist, Personalization & Shopping @ pinterest
US | 2025-12-25
| USD
163064 - 335720
/ year
Pinterest seeks a Staff Data Scientist to advance Shopping through robust recommendation systems and causal inference, explaining why content is promoted to Pinners. With 7+ years of web-scale...
read more »
|
AI/ML, Python, R, SQL, Spark, Computer Science | ||
|
data scientist
Sr. Data Scientist, TLM @ uber-com
US | 2025-12-25
| USD
169000 - 188000
/ year
Uber seeks an experienced manager to oversee its insurance data infrastructure, involving data modeling, process improvements, and expanding data scope to support growth. A key differentiator is...
read more »
|
Computer Science, Management, SQL, Python, Big Data, Hadoop, Spark, DataViz, Tableau, ETL/ELT | ||
|
data scientist
Data Scientist II @ radian
US | 2025-12-25
| USD
97000 - 137000
/ year
Radian’s Data Scientist II in MIRS shoulders mortgage-credit modeling for defaults and prepayments, blending econometrics, statistics and ML in a cloud-first setup. You’ll estimate and validate...
read more »
|
Cloud Computing, AI/ML, Big Data, R, Python, SAS, C++, AWS, Amazon EC2, Amazon EMR, S3, AWS Lambda, Spark, Management | ||
|
data scientist
Data Scientist - Consumer/TMT @ balyasny-asset-management-l.p.
US | 2025-12-23
Balyasny Asset Management seeks a Data Scientist to work on the Consumer & TMT sectors, leveraging AI, LLMs, and advanced models to generate alpha and support investment decisions; their...
read more »
|
Management, Data Science, AI/ML, LLM, Analytics, Data Analytics, Computer Science, Python, SQL, Databricks, Spark, Snowflake, Matplotlib, Plotly, Tableau, Cloud Computing, AWS, GCP, Azure, Airflow, Jenkins, Docker |