Skip to content

Stream processing at scale

Photo of Daniel Kadvany
Hosted By
Daniel K.
Stream processing at scale

Details

Hello impatient hackers! Thanks for patiently awaiting our next meetup. This time we've got talks about stream processing, taking place at the wonderful TechCode (http://www.techcode.com/) space in Mountain View. Food and drink sponsored by Streamlio (https://streaml.io/).

6:30pm - Eat & social

7:00pm - Talk 1: Matteo Merli & Sijie Guo

Multi-tenant and Geo-replication Messaging with Apache Pulsar

In this session presented by Matteo Merli and Sijie Guo, learn how Yahoo developed a messaging system from the ground-up to support their enterprise requirements of multi-tenancy and geo-replication to support mission-critical services like Yahoo Mail, Finance, Sports, and Gemini ad network.

Matteo Merli is a software engineer at Streamlio (https://streaml.io/), where he works on messaging and storage technologies. Previously, he spent several years building database replication systems and multitenant messaging platforms at Yahoo. Matteo was the architect and lead developer for Pulsar and is a PMC member of Apache BookKeeper.

Sijie Guo is the cofounder of Streamlio (https://streaml.io/), a company focused on building a next-generation real-time data stack. Previously, he was the tech lead for messaging group at Twitter, where he cocreated Apache DistributedLog, and worked on push notification infrastructure at Yahoo. He is the PMC chair of Apache BookKeeper.

7:30pm - Talk 2: Shayan Mohanty

Real Time Text Matching at Scale

Watchful (https://watchful.io/) is a massive event processor that allows users to identify, filter, and route data in real time based on patterns in content and event metadata. Under the hood, the system is powered by a sophisticated distributed non-backtracking regular expression engine and coordination layer designed to provide a turn-key experience for end users. In this talk we will discuss how we designed Watchful’s engine, the high-performance regex evaluation strategies packed into it, and how these concepts allow the system to scale.

Shayan is co-founder at Watchful and has worked in data-oriented roles over the last 7 years. Previously, he built things ranging from fully autonomous credit pipelines to telehealth solutions, and also had a (small) exit from a company he started when he was 16.

8:30pm - All done, see you next time!

https://secure.meetupstatic.com/photos/event/d/d/d/a/600_465416794.jpeg

To suggest a speaker for a future meetup, please email: daniel@fanout.io

Photo of Silicon Valley Realtime group
Silicon Valley Realtime
See more events
TechCode
1172 Castro St. · Mountain View, CA