2024-09-25 brighton data forum takes on spark and databricks!

Save the date and mark your calendars!

We will meeting on the last Wednesday of September. This time our topic is data engineering, specifically the Databricks platform and the Spark framework for big data pipelines and processing.

Kat McNeill will give an "An introduction to Apache Spark", covering: What is this super fast data processing tool (architecture)? Why was it built (improvement on MapReduce)? How to get started.

Dr Andres Baravalle's talk "Modernising data analytics with Databricks", will take the audience through On the Beach's data analytics journey with Databricks. In this session, we’ll explore how Databricks, combined with AWS and robust CI/CD practices enabled us to build scalable data pipelines and start building a modern data platform.
We'll cover the key features used by data professionals, and we'll give a glimpse into what a project with Databricks looks like - covering collaboration, data engineering and data analytics. Whether you're considering Databricks or looking to modernise your data stack, this talk will offer practical insights and lessons learned along the way.

Whether you are a seasoned data engineer or just starting out, these two talks will give you lots of information and insights on big data tooling.

For those who cannot make it in person, we will be live streaming the event here, (stream to start at 18:30).

The brighton data forum is sponsored by Rittman Mead Consulting and is supported by the Silicon Brighton community.