The Master of Clusters (Kafka & Mongo)


Details
18:00 - 18:30 - Mingling
18:30 - 19:15 - One cluster does not fit all: Architecture patterns for multicluster Apache Kafka deployments - Gwen Shapira System Architect @ Confluent
19:15 - 20:00 - MongoDB MultiMaster Architecture -Pavel Duchovny - Technical Services Engineer @ MongoDB
Title:
One cluster does not fit all: Architecture patterns for multicluster Apache Kafka deployments
Abstract:
In the last year, multicluster and cross-data center deployments of Apache Kafka have become the norm rather than an exception. The reasons are many and include:
Different groups in the same company using Kafka in different ways
Collecting information from many geographical regions and branches to a centralized analytics cluster
Planning for cases where an entire cluster or data center is not available
Using Kafka to assist in cloud migrationGwen Shapira offers an overview of several use cases, including real-time analytics and payment processing, that may require multicluster solutions and discusses real-world examples with their specific requirements. Gwen outlines the pros and cons of several common architecture patterns, including:
Multitenant Kafka clusters
Active-active multiclusters
Failover clusters
Stretching a single cluster between multiple data centers
Using Kafka to bridge between clouds or between on-premises and the cloudAlong the way, Gwen explores the features of Apache Kafka and demonstrates how to use this understanding of Kafka to choose the right architecture for use cases from the financial, retail, and media industries.
Bio:
Gwen is a system architect at Confluent helping customers achieve
success with their Apache Kafka implementation. She has 15 years of
experience working with code and customers to build scalable data
architectures, integrating relational and big data technologies. She
currently specializes in building real-time reliable data processing pipelines using Apache Kafka. Gwen is an Oracle Ace Director, and
author of "Hadoop Application Architectures", and a frequent presenter
at industry conferences. Gwen is also a committer on the Apache Kafka
and Apache Sqoop projects. When Gwen isn't coding or building datapipelines, you can find her pedaling on her bike exploring the roadsand trails of California, and beyond.
https://secure.meetupstatic.com/photos/event/d/6/7/f/600_460554911.jpeg
Title: MongoDB MultiMaster Architecture
Abstract:
“Considering the growing demand for high volume write heavy applications with low latency requirements and complex high availability topologies, building the database layer with a Multi-Master orientation for operation locality is substantial. “
In this session, we will walk through our requirements, decision-making process, architecture and tools required to deploy a MongoDB Multi Master deployment. At the end of the session, audience members will have a better understanding of how to architect and maintain such architecture.
This session is designed for those with good MongoDB experience and architectural and deployment experience with distributed systems.
Learning Objectives
Following this talk attendees should be able to:Understand the Multi Master MongoDB Database design pattern and its benefits.Learn about zone sharding and replica set consideration in a complex environment.Show how Cloud Manager can assist in configuring and maintaining such a complex environment.
Bio:
Pavel Duchovny, 31 years old,
Is a technical service engineer at the MongoDB TLV office. Specializing in solving complex problems with giant Ideas :) Background in distributed database systems and DevOps operations.
https://secure.meetupstatic.com/photos/event/d/6/8/8/600_460554920.jpeg

The Master of Clusters (Kafka & Mongo)