Kafka, Java, Ruby, React, and Elasticsearch w/ Ward Cunningham and Jason Clark

This is a past event

48 people went

Location image of event venue


6:30 - Arrive & Prep - snacks, get a beer, and just relax for a few meeting fellow practitioners.

7:00pm - Introductions, Announcements, etc.

7:05pm - Talk Begins, "Kafka, Java, Ruby, React, and Elasticsearch w/ Ward Cunningham and Jason Clark"

-:-- - Talk ends & you're welcome to chat, enjoy Lucky Lab, or just hang out and hack.

New Relic receives tons of metrics. Large customers can report thousands of uniquely named metrics per minute, but they want to search and chart them in nearly realtime.

We've turned to Elasticsearch (https://www.elastic.co/) on this problem, tuning it for this write-heavy workload. With small, frequently duplicated documents, it's been an interesting challenge to optimize for low latency indexing new metrics in the midst of this torrent of data.

This talk will describe both our insertion logic and data exploring user-interface built with Kafka (http://kafka.apache.org/), Java, Ruby, React and, of course, Elasticsearch. Special attention will be given to our adoption strategy and performance tuning experience.

Ward Cunningham (http://c2.com/~ward/) (@wardcunningham (https://twitter.com/WardCunningham)) has worked for and consulted to daring startups and huge corporations. He has served as CTO, Director, Fellow, Principal Engineer and Inventor. He is best known for creating wiki. He leads an open-source project rebuilding wiki to solve more complex sharing situations addressing some of societies toughest problems. Ward founded movements in object-oriented, agile software, extreme programming and pattern languages. Ward lives in Portland, Oregon and works for New Relic, Inc (http://newrelic.com/).

Jason Clark (@jasonrclark (https://twitter.com/jasonrclark)) fell in love with programming as a young boy watching his dad work in Clipper and dBase III (no, really). The obsession sparked there continues to this day. He works for New Relic, and in his spare time contributes to the Shoes project. When not at work, he enjoys cycling, homebrewing, and hanging out with his family.