Spark 3.5 and Delta 3: what’s new

Details

Hello, Sparklers!

Next Thursday, November 2nd, we're excited to bring together our community to discuss the latest developments in Apache Spark 3.5.x and Delta Lake 3.x.x. We'll explore topics from Spark Connect to Liquid Clustering, explaining how these advancements work and sharing the best use cases. If you haven't yet caught up with the latest breakthroughs in both technologies, now is the perfect opportunity!

Join us for a night of engaging discussions 💬, delicious food 🍕, refreshing drinks 🍹, and a chance to win special gifts for one lucky participant 🏅.

The event will be held at Adevinta Auditorium, 150 Carrer de la Ciutat de Granada in Barcelona. Special thanks to Adevinta for generously providing the venue. We can't wait to see all of you there!

The Agenda:

We've designed a dynamic agenda to keep things interesting throughout the day:

18:30 Opening doors
19:00 Reception & welcome to the Spark Barcelona Meetup 👋🏼
19:15 Spark 3.5.x: What's New?
19:30 Spark Connect: Running Queries from Anywhere!
20:00 Liquid Partitioning: How It Works
20:30 UniForm: The Battle of the Table Formats

20:45 Q&A 🙋🏻‍♀️ Test your knowledge and win an amazing price.
21:00 Networking 🍕🍺

Important Security:

• Access control: The security team requires an attendees list, make sure you register for the event with your ID. Registration will close 24h before the event.
• You’ll be asked to provide your ID (DNI, NIE, etc.) to access the building.

Bio(s):

Paola Pardo is one of the co-founders of Qbeast and co-organizer of the Spark Barcelona Meetup. She bootstrapped Qbeast Open Source technology and participated in several events as a public speaker. Her field of work covers Spark Optimization Plans, Spark Environments, Customized Datasources, Object Storages, and Data Lakes implementations.

Pol Santamaria is a co-founder and CTO @ Qbeast with a strong background in HPC and Distributed Systems. Passionate about new big data advancements, his work includes approximate analytics on data streams with Alluxio, design and implementation of next-generation data lake systems, and building end-to-end data pipelines.

Gustavo Martin is a Senior Data Engineer on Adevinta's Data Platform Team. Before he worked as a Full Stack Architect in different companies such as DIA Supermarket or Amaris. Adevinta has millions of users per month and has to manage huge quantities of information. To extract the maximum insights from the data, Gustavo and his team worked night and day to create a Data Platform that provides the best user experience possible.