Apache Avro

data serialization, row-based, schema evolution, file format, storage
Open jobs

46

Companies looking for Avro

45

Back in the dark ages of data – roughly 2009 – when Hadoop was king and serialization felt like an arcane art, Apache Avro emerged. The promise? A data serialization system that didn’t require pre-defined schemas at runtime, offering both compact data storage and rapid deserialization. Quite clever, really, though one does wonder if everyone fully grasped the schema evolution implications.

In practice, Avro is a bit like the meticulously organized librarian of the data world. It demands schemas – you just define them upfront. This rigidity is both its strength and weakness. While JSON and protocol buffers offer alternatives, Avro's schema evolution capabilities truly shine when data structures inevitably change. Today, it’s a cornerstone of many data pipelines, particularly within the Hadoop ecosystem and increasingly in streaming applications, quietly powering things behind the scenes for those who appreciate a bit of structure in the chaos.

Used together with Avro

Additional Resources

Compare to other file formats
Jobs (this month)

46

Companies with Jobs

45

Jobs in using Apache Avro for but please no

data engineer

Java Software Engineer @ imc-trading

AU | 2025-12-27
IMC seeks a data engineer experienced in Java 11+ to build scalable, low-latency, high-throughput data processing systems using Kafka, Avro, and Parquet, with a unique focus on transforming... read more »
Java, DataViz, Data Engineering, Analytics, Kafka, Avro, Parquet, Data Streaming, Docker, Kubernetes, Linux
data engineer

Director, Principal Data Architect @ tiffany-and-co

US | 2025-12-26
This role is a highly demanding and complex position requiring deep expertise in GCP data architecture, DevOps, and cloud-native engineering. The candidate must lead platform enablement, mentor... read more »
Management, GCP, Analytics, Cloud Computing, Big Data, AI/ML, Data Streaming, Data Lake, DWH, Data Engineering, AWS, Azure, SaaS, Data Management, DevOps, CI/CD, Marketing, Agile/Scrum, BigQuery, Cloud Composer, Fivetran, Power BI, Dataiku, SQL, ETL/ELT, Jira, Azure DevOps, GitHub, Computer Science, Cyber Security, Data Quality, API, Parquet, Avro, JSON, XML, CSV, dbt, Python, Data Science
promoted

The Fundamentals of Analytics Engineering

The Fundamentals of Analytics Engineering gives a holistic understanding of the analytics engineering lifecycle by integrating principles from both data analysis and engineering. It's a book that teaches concepts and best practices, not just tools and technologies.

Learn More
data engineer

Director, Principal Data Architect @ tiffany-and-co

FR | 2025-12-26
The role is an ambitious opportunity for a seasoned data engineer with deep expertise in GCP, but it lacks specificity in defining responsibilities and expectations. The candidate must lead a... read more »
Management, GCP, Analytics, Cloud Computing, Big Data, AI/ML, Data Streaming, Data Lake, DWH, Data Engineering, AWS, Azure, SaaS, Data Management, DevOps, CI/CD, Marketing, Agile/Scrum, BigQuery, Cloud Composer, Fivetran, Power BI, Dataiku, SQL, ETL/ELT, Jira, Azure DevOps, GitHub, Computer Science, Cyber Security, Data Quality, API, Parquet, Avro, XML, CSV, dbt, Python, Data Science
data engineer

Data Engineer -601/602 @ ptrglobal

US | 2025-12-24 | USD 65 - 70 / hour
A data engineer role focused on AWS, Python, and Spark within a bank's consumer division; requires designing data pipelines and models, with a differentiator being expertise in cloud data lake... read more »
AWS, Python, Spark, Data Lake, Agile/Scrum, Data Collection, Analytics, SQL, NoSQL, Data Quality, Data Governance, Data Engineering, PySpark, GenAI, API, Cloud Computing, Data Lakehouse, Databricks, Hadoop, PostgreSQL, Oracle, Cassandra, DynamoDB, MongoDB, Snowflake, Redshift, Airflow, Unix, Avro, Protobuf, Parquet, Iceberg, Data Streaming, Data Modelling, Data Vault, dimensional modeling, CI/CD
data engineer

Data Engineer, Active Grid Response @ gridwareinc

US | 2025-12-23
Gridware seeks a data engineer to develop ETL/ELT pipelines for its Active Grid Response platform, emphasizing high-precision sensor data integration and real-time processing, with a notable focus... read more »
Management, Data Lakehouse, Analytics, ETL/ELT, Data Lake, Python, SQL, Databricks, Data Quality, Data Science, Cloud Computing, Big Data, Spark, Airflow, Dagster, Prefect, Data Streaming, Kafka, Kinesis, Data Modelling, IoT, Protobuf, Avro, Parquet, Grafana
analytics engineer

Solutions Architect @ snowflake-computing

NL | 2025-12-23
Snowflake pitches Amsterdam as a hub for post-sales brilliance: a Solutions Architect role that blends enterprise data platform design with hands-on coaching, governance, and multi-vendor... read more »
Snowflake, AI/ML, Cloud Computing, Data Management, Management, Teradata, Spark, Databricks, Hadoop, Oracle, SQL Server, Data Vault, Fabric, Data Governance, Data Lake, DWH, dimensional modeling, 3NF, AWS, Azure, SQL, dbt, Talend, Informatica, Python, PySpark, Parquet, Avro, Iceberg, Delta, Analytics, Tableau, Power BI, Thoughtspot, SAS, NLP, Marketing, Data Analytics
promoted

BigQuery Cost Optimization Guide by Masthead Data

The BigQuery Cost Optimization Guide is a valuable resource that offers a deep dive into understanding and managing the complexities of BigQuery costs. It provides practical guidelines and strategies to help you optimize both storage and compute expenses, ensuring you get the most value out of...

Learn More
data engineer

IT Engineer (Solution Architect) @ abn-amro

NL | 2025-12-22
This role is a misaligned opportunity for a data engineer with a focus on Kafka and Azure. The job description is vague, lacks specific technical requirements, and fails to define responsibilities... read more »
Data Streaming, BI, Kafka, Azure, Cloud Computing, Java, Linux, DevOps, Agile/Scrum, Management, Avro