Skip to content

Details

We are grateful for SF Bay ACM to host our speaker and help promote Apache Heron.

This is the 11th of our monthly sessions in Apache Heron, the streaming data fastest processing engine.

6:30 arrive, register, pizza, network
7:00 ACM intro
7:10 Presentation
Live stream at https://www.youtube.com/watch?

Abstract:
Twitter users start and join multiple conversations every day, so monitoring and mitigating any potential network issue in real time is the key to a smooth user experience. Monitoring and analyzing a network at Twitter scale is extremely hard—and almost impossible to achieve manually. As a result, the company needed to create dedicated data pipelines to monitor network activity, detect potential issues, and generate network usage reports.

Julien will present an overview of the Heron project. Along the way, you’ll learn the challenges Twitter faced when building it and the key technologies it used to overcome those challenges and achieve its scalability, low-maintenance, and low-latency goals.

Bio:
Julien Delange is a staff software engineer at Twitter working on infrastructure services. Previously, he was a senior software engineer at Amazon Web Services, a senior member of the technical staff at Carnegie Mellon University, and a software engineer at the European Space Agency. Julien holds a PhD in computer science from Télécom ParisTec and a master’s degree in computer science from Université Pierre-et-Marie-Curie.
http://julien.gunnm.org/
https://www.linkedin.com/in/juli1/

What have we covered in 2018:
Month#0. An intro to Apache Heron and it's major features - San Francisco
Sep 2018: An intro to Apache Heron and it's major features - South Bay
Oct 2018: Caladrius
Nov 2018: Apache Heron - Stateful
Dec 2018: Caladrius (On popular demand)

What have we covered in 2019:
Jan 2019: Streamlet: Heron Functional API
Feb 2019: Use of Heron at Twitter for Network Analysis
Mar 2019: A Series of Talks on Apache Heron - Part 1
(Low-Level API in Java & Python; Migrate a Storm Topology to Heron Topology.)
Apr 2019: First Year Anniversary @ Twitter HQ in San Francisco.
May 2019: Heron Packing Algorithms.
Jun 2019: Real-time monitoring of Twitter's network infrastructure with Heron

Please join me in thanking:
https://www.meetup.com/SF-Bay-ACM/events/261067309/
http://www.sfbayacm.org/

Members are also interested in