addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1linklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

I ♥ Log: Real-time data feeds and stream processing with Apache Kafka

This talk will discuss how logs and stream-processing can form a backbone for data flow, ETL, and real-time data processing. It will describe the challenges and lessons learned as LinkedIn built out its real-time data subscription and processing infrastructure. It will also discuss the role of real-time processing and its relationship to offline processing frameworks such as MapReduce.

Jay Kreps blog post 'I heart log' is now available online! Check it out and start the conversation online #hivedata

Meet with Jay Kreps:

Jay is a Principal Staff Engineer at LinkedIn where he is the lead architect for online data infrastructure. He is among the original authors of several open source projects including a distributed key-value store called Project Voldemort, a messaging system called Kafka, and a stream processing system called Samza.


[masked]pm: Registration and Networking (with food & beverages) 

6:[masked]pm: Introduction 

7:00-7:45pm: Talk by Jay Kreps

7:[masked]pm: Q&A session

Join or login to comment.

  • Pashu P.

    Hi everyone! The video recording is LIVE on our Youtube channel here: - enjoy

    June 10, 2014

  • Vinay N.

    Sorry guys not able to make it :( , very interesting topic, is it going to be recorded ?

    1 · March 26, 2014

  • Pashu P.

    Hi everyone! Do you wish to review or share Jay's presentation? Here it is: enjoy!

    April 7, 2014

  • Sunil

    Great presentation.. yes.. voice packets were lost sometimes. I wish jay must have used kafka while speaking :-)

    March 27, 2014

  • al f.

    Great presentation. Awful room acoustics. Sometimes cafeterias don't work out as auditoriums (glass/metal/concrete surfaces; machinery noise).

    March 27, 2014

  • Tarun D.

    Interested in opportunity with LinkedIn infrastructure team connect with me.

    March 26, 2014

  • MM

    Guys, which bldg? How to get to it? Is this near SAP?

    March 26, 2014

    • A former member
      A former member

      yes two bldgs down

      March 26, 2014

    • A former member
      A former member

      still not started.

      March 26, 2014

  • Estella P.

    I won the drawing for one seat to 4 days of Data Analysis with Pig&Hive, list price $2795. I am busy at work, anyone would like to get it for the discount price? Thanks. [masked]

    March 25, 2014

    • Estella P.

      We all professional, I would like to offer 40% or 50% off. Class expired by Sept 26, 2014.

      March 25, 2014

    • Estella P.

      We can meet in the school to register together to verify. It is located in Palo Alto.

      March 25, 2014

  • Pashu P.

    Let's start the conversation now. Jay Kreps just published a blog post - make sure to read, share and comment - looking forward to see you all on Wednesday!

    1 · March 24, 2014

  • Prasenjit C.

    I am attending Ad:Tech 2014 in San Francisco, have to pass on The Hive event. Sorry.

    March 21, 2014

  • rohan T.

    Will be there

    March 5, 2014

  • T. M. R.

    We are excited to be hosting Jay Kreps of LinkedIn at The Hive. This will be the first in a series of talks on real time.

    3 · March 5, 2014

Our Sponsors

  • SAP

    Run simple with the best in cloud, analytics, mobile and IT solutions.


    Interconnect Everything + Augment Intelligence

  • Visa

    Global payments technology company.

  • Pinterest

    A personalized discovery engine for saving and finding everyday ideas.

  • Cloudera

    Enterprise Platform for Big Data. Leading Solution for Apache Hadoop.

  • Perkins Coie

    International firm specializing in business law & litigation.

  • O'Reilly Strata

    Big data technology and strategy Conference.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy