Spark Meetup IL - Performance boost!

We are excited to announce we will be holding another Spark meetup!

Which will be great opportunity to meet friends, colleagues and mingle with other Spark enthusiasts.

Expect to expand your horizons and for Sparkly surprises!

Featured Talks:

How To Make Spark Fast Again: DataCleanRoom Stories By Shalom Sanevich

When dealing with large volumes of data using Spark, we have encountered intriguing performance degradation challenges in the implementation of Data Clean Room. I will share a few stories about slow reads, caching, and optimizing logical plans, offering valuable insights and practical solutions to address these challenges.

Advanced Spark Optimization by Ron Flomin

Supercharge your Spark performance! Ron Flomin shares advanced optimization techniques to make your Spark applications run faster and smarter.

Iterative Spark Jobs: Performance Concerns and Trade-offs by Sarah Skutch-Freedman

If optimizing Spark jobs is hard, optimizing iterative Spark jobs can be even harder. We will walk through a case study, starting with the naive approach and attempting techniques such as caching, checkpoints, and more advanced optimizations. We will also discuss common pitfalls to avoid and best practices when writing iterative Spark jobs.