Skip to content

Introduction to Apache Spark using Frameless

Photo of Brian Clapper
Hosted By
Brian C.
Introduction to Apache Spark using Frameless

Details

This is the talk I recently gave at ScalaIO in Lyon, France and at Scale by the Bay in San Francisco. If you didn't make either conference, and you're interested in Spark or Frameless, you'll have a chance to see the talk locally.

The talk, which is mostly in notebooks, compares and contrasts the native Spark DataFrames and Datasets APIs with the Typelevel Frameless API. Frameless adds compile-time type-safety to Spark, via a TypedDataset class, without incurring the runtime overhead associated with the (also type-safe) native Datasets API.

The talk compares and contrasts all three, with lots of running code examples. If you don't know much about Spark, you'll learn a little bit from the talk. If you know Spark, but you know nothing about Frameless, you'll walk away with some exposure to that cool API.

Venue: Azavea
Food sponsor: Vistar Media

Google Meet simulcast: meet.google.com/eqi-sscv-brf

Photo of PHASE: Philly Area Scala Enthusiasts group
PHASE: Philly Area Scala Enthusiasts
See more events
Azavea
990 Spring Garden, 5th Floor · Philadelphia, pa