Past Meetup

Apache Spark & Scala at scale

This Meetup is past

16 people went

Location image of event venue

Details

In this first meetup we will talk about our personal experiences, best practises and pitfalls setting up a Apache Spark cluster, implement Spark jobs in Scala and managing these via Airflow.

Next up we'll end the evening on a high note by having freelance software developer, writer, public international speaker, and amateur musician Peter Hilton (@PeterHilton (https://twitter.com/PeterHilton)) talking to us about Scala's biggest problem: writing maintainable code.

Agenda:

18:00 - Arrive, drink, eat

18:45 - Talk 1

19:30 - Talk 2

20:15 - Drinks and Networking

21:00 - Everybody out

---

Talks:

1. Building a data ingestion & processing pipeline with Spark & Airflow
speaker: Tom Lous

2. How to write maintainable Scala code
speaker: Peter Hilton