Apache Heron Meetup - First Virtual Event (Monthly)
Details
This is the 20th of our monthly hands-on sessions in Apache Heron, the fastest streaming engine.
- This is our First Virtual Event.
- Online Conference Link will be shared at the hour.
- Slack channel is another mode of communication, for this event.
Agenda:
600-800:
In this session we will discuss:
- State Manager internals
- How Heron state-manager maintains states
- Demo to parse content in state-manager
- Heron Scheduler internals
- Three plans: logical, packing and phyiscal plans
- Two level process guards
Prize: IntelliJ Ultimate License
Huijun Wu, is an engineer working at Twitter, Inc. He has been working on the Heron project since 2016 summer when Twitter open sourced Heron code. He is a founding member of the Apache Incubator Heron. He is an Apache PPMC.
Ning Wang, Data Pipeline engineer at Amplitude Analytics. He is passionate about data processing and is an active contributor in Heron project and an Apache Commiter. Prior to Amplitude, he was technical lead of the Real-time Compute team at Twitter, and he had also worked on Twitter website and Observability backend. In addition, Ning spent many years in the game industry working on (not playing, well maybe a little) games.
Karthik Ramasamy, has over two decades of experience in real-time data processing, parallel databases, big data infrastructure, and networking. He was engineering manager and technical lead for Real Time Analytics at Twitter, where he co-created the Heron real-time engine. Prior to Twitter, Karthik was co-founder of Locomatix, a company specialized in real-time processing on Hadoop and Cassandra, and worked at Greenplum and Juniper Networks. He is the author of several publications, patents and co-author of “Network Routing: Algorithms, Protocols and Architectures.” He has a Ph.D. in Computer Science from the University of Wisconsin - Madison, where he worked extensively in parallel database systems, query processing, scale-out technologies, storage engines and online analytical systems.
Host Bio:
Sree Vaddi, Strategic Solutions Architect & Technical Advisor, a Java Veteran and an Apache PPMC. He was advisor for three startups in Edu Tech and Fin Tech. He is a polyglot programmer. He is experienced in Core Java, Enterprise Edition, Mobile, Big Data, IoT and ML/DL/AI. He worked with Peta Bytes of data both in sizes and throughputs, bringing unprecedented values and business advantages to his employers. He has been Open Source advocate from the very beginnings.
What we covered:
2018:
01.Month#0. An intro to Apache and it's major features - San Francisco
02.Sep 2018: An intro to Apache and it's major features - South Bay
03.Oct 2018: Caladrius
04.Nov 2018: Apache Heron - Stateful
05.Dec 2018: Caladrius (On popular demand)
2019:
06.Jan 2019: Streamlet: Heron Functional API
07.Feb 2019: Use of Heron at Twitter for Network Analysis
08.Mar 2019: A Series of Talks on Apache Heron - Part 1
(Low-Level API in Java & Python; Migrate a Storm Topology to Heron Topology.)
09.Apr 2019: First Year Anniversary @ Twitter HQ in San Francisco.
10.May 2019: Heron Packing Algorithms.
11.Jun 2019: Real-time monitoring of Twitter's network infrastructure with Heron (with ACM)
12.Jul 2019: Heron Streamlet API in Java, Python and Scala
13.Aug 2019: Streamlet: Heron Functional API
14.Sep 2019: Apache Heron - Stateful
15.Oct 2019: A Series of Talks on Apache Heron - Part 2
16.Nov 2019: Streamlet: Heron Functional API
17.Dec 2019: A Series of Talks on Apache Heron - Part 3
(Manage Topologies)
***
18.Jan 2020: Stream Processing & Apache Heron
19.Feb 2020: Stream Processing & Apache Heron - New Deck
20.Mar 2020: State Manager & Scheduler - First Virtual Event
Please join me in thanking our sponsors:
- Amplitude for generously providing their facility to host our meetup and for providing food and drinks.
https://amplitude.com/ - Twitter.com.
https://twitter.com/ - Streaml.io.
https://streaml.io/ - Foundation For Excellence.
https://ffe.org/site/