This talk will discuss how logs and stream-processing can form a backbone for data flow, ETL, and real-time data processing. It will describe the challenges and lessons learned as LinkedIn built out its real-time data subscription and processing infrastructure. It will also discuss the role of real-time processing and its relationship to offline processing frameworks such as MapReduce.
Jay Kreps blog post 'I heart log' is now available online! Check it out and start the conversation online #hivedata
Meet with Jay Kreps:
Jay is a Principal Staff Engineer at LinkedIn where he is the lead architect for online data infrastructure. He is among the original authors of several open source projects including a distributed key-value store called Project Voldemort, a messaging system called Kafka, and a stream processing system called Samza.
[masked]pm: Registration and Networking (with food & beverages)
7:00-7:45pm: Talk by Jay Kreps
7:[masked]pm: Q&A session