Heron@Twitter

RSVPs ARE NOT COMPLETE UNTIL YOU COMPLETE THE REGISTRATION AT THE LINK:
http://goo.gl/forms/XP5iqVrH4aWuDgww2

Following the talk, we will provide a hands-on experience with Heron. Bring your laptops and we will show you how to install, use, and operate Heron.

Twitter generates billions and billions of events per day. Analyzing these events in real-time presents a massive challenge. To meet our scaling and operational needs, Twitter designed and deployed a new streaming system called Heron, our next generation streaming system.

In this talk, we will provide an introduction to Heron, how it is being used at Twitter and share our operating experiences and challenges of running Heron at scale. We recently announced our open sourcing of Heron under the permissive Apache v2.0 license. Heron has been in production nearly 2 years and is widely used by several teams for diverse use cases. Prior to Heron, Twitter used Apache Storm, which we open sourced in 2011. Heron features a wide array of architectural improvements and is backward compatible with the Storm ecosystem for seamless adoption.

Speakers:

Karthik Ramasamy (https://www.linkedin.com/in/kramasamy)

https://a248.e.akamai.net/secure.meetupstatic.com/photos/event/b/b/7/c/600_452387996.jpeg

Karthik is the engineering manager for Real Time Analytics at Twitter and co-creator of Heron. He has two decades of experience working in parallel databases, big data infrastructure and networking. He cofounded Locomatix, a company that specializes in realtime streaming processing on Hadoop and Cassandra using SQL that was acquired by Twitter. Before Locomatix, Karthik was at Juniper Networks where he designed and delivered platforms, protocols, databases and high availability solutions for network routers that are widely deployed in the Internet. Before Juniper, at University of Wisconsin, he worked extensively in parallel database systems, query processing, scale out technologies, storage engine and online analytical systems. Several of these research were spun as a companies later acquired by Teradata. He is the author of several
publications, patents and one of the best selling book "Network Routing: Algorithms, Protocols and Architectures." He has a Ph.D. in Computer Science from UW Madison.

https://a248.e.akamai.net/secure.meetupstatic.com/photos/event/b/b/8/6/600_452388006.jpeg

Maosong Fu (https://www.linkedin.com/in/maosong-fu-63471a34)

Maosong Fu is the technical lead for Heron at Twitter. He worked on various components of Heron including Heron instance, metrics manager, scheduler etc. He is the author of few publications in distributed area and has a Master's degree from Carnegie Mellon University and Bachelor’s from Huazhong University of Science and Technology.

https://a248.e.akamai.net/secure.meetupstatic.com/photos/event/d/5/1/a/600_452394554.jpeg

Bill Graham

Bill Graham is a Staff Engineer on the Real Time Compute team at Twitter. Bill’s primary area of focus is on data processing applications and analytics infrastructure. Previously he was a Principal Engineer at CBS Interactive and CNET Networks where he worked on ad targeting and content publishing infrastructure. Before CBSi he was a Senior Engineer at Logitech focusing on webcam streaming and messaging applications. He contributes to a number of open-source projects including HBase, Hive and Presto and he’s a Heron and Pig committer.

AGENDA:

6:00 - 6:30 - Registration and networking

6:30 - 6:45 - The Hive Introduction

6:45 - 7:15 - Heron Introduction - Karthik Ramasamy

7:15 - 8:00 - Hands on Heron - Maosong Fu and Bill Graham

8:00 - 8:15 - Q&A

JOIN THE CONVERSATION! @HIVEDATA