Skip to content

Big Data at Twitter Scale

Photo of Andy Sautins
Hosted By
Andy S.
Big Data at Twitter Scale

Details

We are incredibly excited to announce Dave Rusek from Twitter (https://twitter.com/) will be presenting for our June Meetup! Twitter is a company that I have tremendous respect for and I can't wait to get a glimpse into how they handle their data challenges. Please join for what should be a very interesting and informative presentation.

Ken Anderson at CU was nice enough to provide a room on the CU campus in the CU Visual Arts Complex (http://www.colorado.edu/campusmap/map.html?bldg=F+A). Park in the Euclid Autopark and walk to the beautiful building that says “Art and Art History” on it. When you enter that building, take the stairs on your right down one level and then follow the signs to room 1B20.

Look forward to seeing you there!

Agenda

6:00 – 6:30 - Socialize over food and drink
6:30 – 6:45 - Announcements, Upcoming Events
6:45 – 8:30 - Big Data at Twitter Scale - Dave Rusek
8:30 – ??? - Continued socializing

About the presentation

At over a trillion events and close to 10 PB per day, and growing, Twitter operates a pubsub messaging system few engineers will ever get a chance to lay their hands on. In this talk we will walk through the layered design of Twitter's next generation pubsub messaging system, EventBus, built on top of Apache Bookkeeper and our recently open sourced library, DistributedLog. We will cover some of the problems we wished to solve when creating DistributedLog and EventBus, various use cases, as well as some challenges we face operating it.

About the Speaker

Dave Rusek is a senior engineer with close to 15 years of experience building and operating distributed systems. He holds a Master's degree in Computer science from the University of Michigan and currently works @TwitterBoulder (https://twitter.com/TwitterBoulder) building pubsub messaging systems.

Photo of Boulder/Denver BigData Meetup group
Boulder/Denver BigData Meetup
See more events
CU Boulder Campus
VAC 1B20 Auditorium · Boulder, CO