Past Meetup

Building API layer for C* @ Coursera+Netflix & C* Batch loading for Data Product

This Meetup is past

190 people went

Location image of event venue

Details

For this meetup we are excited to be joined by 3 great presenters; Daniel Chia and Sourabh Bajaj, both Software Engineers at Coursera & Christos Kalantzis, Director of Engineering (Cloud Database Engineering) at Netflix.

What You'll Learn At This Meetup:

Daniel: Courral - Database as a service.

Cassandra has served Coursera well as our main scalable data store. Courral is a schema-aware data layer that helps encode Cassandra best practices. Service API boundaries allow us to present clients with a document model, while abstracting away best practices and tricky to implement features like indexes. Like any other service, this boundary also opens up the door to quick experimentation and improvement of service internals without require large re-architecting of client code.

Christos: dAPI - database API

Netflix has been able to solve large scale data needs with our use of Cassandra, Elastic Search and Dynomite. Responsibility for properly consuming those data-stores and coding towards them has traditionally fallen to the Application Developers, with mixed results. dAPI provides an API that allows Netflix developers to build apps on a richer-than-Cassandra schema, with caching and without having to code and maintain code to multiple underlying data-stores.

Sourabh:

Batch loading in Cassandra can be used for cases such as data migrations between different systems etc. Sourabh (software engineer at Coursera) will talk about Nostos (batch loading service at Coursera) and some of its use cases in data products such as recommendations, search and prediction models. We will cover some of the design choice and tradeoffs made in building Nostos and see how the system has evolved over the past one year.

*Parking will be available on the premises

Sponsors:

A big thank you to Coursera for hosting and providing food and drinks!