LivePersonDev Hosts: Growing into a proactive Data Platform

http://photos1.meetupstatic.com/photos/event/e/2/9/2/600_70378002.jpeg

In this Meetup Yaar Reuveni - Team Leader and Nir Hedvat - Software Engineer from Liveperson Data Platform R&D team, will talk about the journey we made from early days of the data platform in production with high friction and low awareness to issues into a mature, measurable data platform that is visible and trustworthy.

Our journey began with much excitement of new technologies (Kafka, Hadoop, Storm ..), fresh architecture and tons of consumers and producers. As time went by, hundreds of producers, high deployment rate, data model violations and handful of pipeline jams and malfunctions, resulting at unfortunate data delays and loss. We knew we need to invest, and so we did, building a game changing system that revolutionized the way we audit and monitor our data. Not bad, considering this was one of our first Spark application experience in production.

Come hear how we're taming 20 billion daily events at Liveperson, how we measure, and identify trends and issues before they pop.

On the agenda:

• Evolution in becoming proactive

• Auditing system showcases

• Implementation (Architecture and some Spark in

production lessons)

Schedule:

• 17:00-17:30 - Gathering with Food & Beers
• 17:30 - Starting

House Keeping Information:

• FREE Parking is available in the building

• Lecture Language: Hebrew

• This Meetup will be video recorded

Please join us, see you!

http://photos4.meetupstatic.com/photos/event/1/4/0/2/600_185345122.jpeg