Buffering and consuming MySQL changes via Kafka

Buffering and consuming MySQL changes via Kafka

mypipe (https://github.com/mardambey/mypipe) latches onto a MySQL server with binary log replication enabled and allows for the creation of pipes that can consume the replication stream and act on the data (primarily integrated with Apache Kafka). This presentation goes over mypipe's design and usage of Scala, Akka, Kafka, and Avro after which we look at some applications and possible use cases of mypipe in a data pipeline.

About Hisham Mardam-Bey

Building systems that keep running using open source and Unix since forever. Mainly playing with Scala, Akka, Erlang, Mesos, and distributed systems these days.

Sponsors

http://photos3.meetupstatic.com/photos/event/9/9/1/5/600_450639189.jpeg

http://photos4.meetupstatic.com/photos/event/9/9/1/7/600_450639191.jpeg

Mate1 (http://www.mate1inc.com/careers/#opportunities) is offering the beer. YoppWorks (http://www.yoppworks.com/) brings us the food and a ticket draft for Scala Up North (http://scalaupnorth.com/).