Apache Spark
Open jobs
3184
Companies looking for Spark
2819
Apache Spark revolutionizes large-scale data processing with its lightning-fast, in-memory distributed computing framework. Designed for complex analytics, machine learning, and streaming workloads, Spark dramatically outperforms traditional MapReduce approaches. Its unified analytics engine supports multiple programming languages (Scala, Python, Java, R) and integrates seamlessly with diverse data sources. Spark's resilient distributed datasets (RDDs) and DataFrame abstractions enable sophisticated data transformations with minimal infrastructure complexity. While powerful, it demands significant computational resources and expertise to optimize. Machine learning libraries (MLlib) and streaming capabilities make it a go-to solution for enterprises processing petabyte-scale datasets across distributed environments.
Used together with Spark
Jobs (this month)
3184
Companies with Jobs
2819
Jobs in using Apache Spark for but please no
|
machine learning engineer
Machine Learning Engineer 2 @ intuit
US | 2025-12-28
| USD
124500 - 186500
/ year
Intuit’s ML Engineer role embeds you in a data‑science squad to prototype, productionalize, and refine models at scale. You’ll wrangle data, engineer features, and build end‑to‑end pipelines using...
read more »
|
Data Science, AI/ML, Data Management, PhD, Computer Science, Python, NumPy, Pandas, TensorFlow, Keras, R, Spark | ||
|---|---|---|---|
|
machine learning engineer
Machine Learning Engineer @ scribd
US | 2025-12-26
| USD
126000 - 196000
/ year
Scribd's Machine Learning Engineer II sits on the Orion platform, building and tuning real-time ML systems that power recommendations and AskAI. Expect end-to-end ownership—from ingestion and...
read more »
|
Spark, AI/ML, GenAI, Python, Go, Scala, Airflow, Databricks, AWS, Amazon SageMaker, LLM, API, Cloud Computing, AWS Lambda, CloudWatch, Datadog, Terraform, Azure, GCP, Computer Science | ||
|
promoted
BigQuery Cost Optimization Guide by Masthead DataThe BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of... |
|
||
|
machine learning engineer
Machine Learning Engineer @ scribd
US | 2025-12-26
| USD
103500 - 196000
/ year
Machine Learning Engineer II at Scribd, built to design, deploy, and optimize near real-time ML for millions across the Orion platform. Expect heavy exposure to an embedding-based retrieval stack...
read more »
|
Spark, AI/ML, GenAI, Python, Go, Scala, Airflow, Databricks, AWS, Amazon SageMaker, LLM, API, Cloud Computing, AWS Lambda, CloudWatch, Datadog, Terraform, Azure, GCP, Computer Science | ||
|
machine learning engineer
Machine Learning Engineer Intern @ tinder-incorporated
US | 2025-12-25
|
0
/ hour
This internship at Tinder’s ML team offers experience in designing machine learning algorithms across core domains like Recommendations and Trust & Safety, with a unique focus on large-scale...
read more »
|
AI/ML, Python, Computer Science, Data Science, PyTorch, TensorFlow, Databricks, Spark, Go, Java, Scala | ||
|
machine learning engineer
Manager, Machine Learning Engineering @ adobe
US | 2025-12-24
| USD
168200 - 340100
/ year
Adobe's Firefly Foundry Manager for Applied Research asks you to shepherd a distributed team designing and curating large-scale training data for enterprise generative AI, turning research into...
read more »
|
AI/ML, Cloud Computing, API, GenAI, Data Quality, Data Science, ETL/ELT, DWH, AWS, Azure, GCP, Spark, Databricks, Snowflake, MLOps, Data Management |
