88 Stevenson St, San Francisco, CA
Setting up the key components of scaleable backend infrastructure from scratch requires considerable knowledge and preparation that can take days, if not weeks. Without the correct deployment architecture, deployed infrastructure may be brittle, hard to scale, hard to upgrade and worse, at risk of losing data.
In this talk, we will introduce the Datacenter Operating System (DC/OS) and show how it can easily deploy and manage the key components required when building an "internet of things" platform (or really just any application that is involved in the ingestion and processing of data): including Cassandra, HDFS, Kafka and Spark.
DC/OS is an open source "batteries included" distribution of the Apache Mesos cluster resource manager that includes additional components to facilitate container orchestration, service discovery, load balancing, and a package registry to allow easy installation of distributed systems.
Sunil Shah is an Engineering Manager at Mesosphere, working on tools and services around the Apache Mesos project to make the lives of developers easier. Before joining Mesosphere, Sunil worked at music recommendations service Last.fm and completed a Master's program at UC Berkeley in EECS, working on real-time processing of images collected from drones. When he's not flying drones around, Sunil likes to cycle, camp, hike, ski and play a large drum.
6 pm -- door opens
6 - 6:30 pm -- Check-in/Networking/Light dinner
6:30 -- 6:40 pm introduction
6:40 pm -- 7:40 pm main talk + QA
7:40 pm -- 8 pm networking
8 pm -- 8:30 pm closing
Sr. Manager of Data Science & Engineering at GoPro
Technical Program Manager, Machine Learning at Google
Senior Data Engineer, Internet Archive
Commuter programmer :-)
Hadoop platform architect / manager.