The evolution of low latency analytics at Risk Management Solutions (RMS)

This is a past event

39 people went

Location image of event venue

Details

I'm excited to announce that Chris George is going to come and speak about the big data work they have been doing for years over at Risk Management Solutions. Chris has a ton of experience with big data technologies and RMS is a contributor to the big data open source community through projects like Apache Arrow. Come hear how Chris and his team have built a low latency query system and how their approach has evolved over time.

There will be a sponsored food truck from “Big Daddy's Texas BBQ” as well as soda and beer.

Zoom link for the meetup:
https://rms.zoom.us/j/472255273

Agenda
6:00 – 6:45 - Socialize over food and drinks
6:45 – 7:00 - Welcome, opening remarks and announcements
7:00 – 8:30 – Chris George - The evolution of low latency analytics at RMS.
8:30-9:00 - Networking

About the event

Learn about the evolution of RMS' low latency analytics. Our evolution on persistent spark contexts to building our query engine with Apache Arrow when pre-computed dimensions are not an option while still being cost effective. A continuation of a talk that Chris gave at the Big Data Conference 2 years ago see we started as heavy contributors and users of Apache Kudu and have since moved on to parquet and snowflake with our own custom query engine. See real numbers and code as well as the pitfalls of the various approaches to this challenge.

About the Speaker

Chris George is Senior Director and Architect of Core Platform at RMS. He has worked with big data technologies for over 15 years including building legal citation detection and storage systems, large scale affiliate attribution and payment systems, real-time metrics for large scale ad tech brokerage and most recently building low latency insurance exposure systems. Chris has used a variety of big data technologies in production settings and brings that experience to the challenges at RMS.