Deep dive Avro and Parquet - Read Avro/Write Parquet using Kafka and Spark

Hosted By
Prasad S.

Details
Agenda
- Avro and Parquet - When and Why to use which format?
- Data modeling - Avro and Parquet schema
- Workshop
- Read Avro input from Kafka
- Transform data in Spark
- Write data frame to Parquet
- Read back from Parquet
Speakers
Timothy Spann - Sr. Solutions Architect, airisDATA
Srinivas Daruna - Data Engineer, airisDATA

NJ Generative AI
See more events
NJ Big Data and Hadoop Meetup
3525 Quakerbridge Rd #1400 IBIS Office Plaza, Suite 1400 · Hamilton Township, NJ
Deep dive Avro and Parquet - Read Avro/Write Parquet using Kafka and Spark