Scaling with Couchbase, Kafka and Apache Spark

Hosted by Pasadena Big Data User Group

Public group

This is a past event

77 people went

Location image of event venue


Couchbase, Kafka, Spark, Hadoop - Polyglot Persistence and the Big Data Pipeline.

Tracking user events as they happen with a rate up to millions of operations per second can challenge anyone providing real time user interaction. It requires both huge scale and a lot of processing to support dynamic adjustment to targeting products and services.

Couchbase accommodates fast access to primary app data for interactive apps at scale while providing interfaces to Apache Spark and Kafka to stream data to Hadoop for deep analytics. As the operational data store Couchbase data services are easily capable of processing tens of millions of updates a day, or more. Streaming through systems such as Apache Spark and Kafka into Hadoop, information about these key events can be turned into deeper knowledge.

These variations on the Lambda architecture are already deployed at sites like PayPal, Live Person and LinkedIn.

About the Speaker

Matt is one of the leaders of the development of Couchbase with a deep software development background with web applications. He had previously helped scale and operatationlize global-scale Java, Ruby on Rails and AMP web applications. He has been a contributor to the memcached project, one of the maintainers of the Java spymemcached client and a core developer on Couchbase. He is currently heading up Couchbase's work in getting the right bits needed for Node.js, Java, .NET and PHP developers (among others).

Parking @ OpenX - You can enter our building from 2 driveways. One is eastbound on Walnut and the other is southbound down Lake. Come down the driveway and park in the lot with the OpenX logo & pull a ticket. Meet Up Entrance will be to your left after you walk out of structure.

The gate will open at 6:30PM. Pizza and drinks will be served. The talk will start at 7:30PM, and end around 9:00 (depending on the length of the talk).