Quarterly Large Scale Production Engineering (LSPE) meet up

Event Agenda and Speaker info

10:45 - Registration

11:00 - Tea

11:15 - Opening Note : Measuring Computing - how lspe-in can partner with CMG and build a stronger community - Milind Hanchinmani

11:30 - Experience of designing a NoSQL backend for Keystone (Authorization and authentication component of Openstack) - Ajay Agrawal, Devops, Reliance

Abstract: OpenStack Identity, or Keystone, is the project that provides authentication and authorization for use by all projects in the OpenStack family. It provides the APIs and the backing implementation to manage key areas such as identity, resources, and assignment. The default backend for persisting data for this purpose is MySQL, deployed either in a master-slave mode, or multi-master mode. In master-slave mode, the master is a single-point-of-failure. Moreover, the slaves are eventually consistent with the master due to the replication lag. A multi-master deployment such as that offered by Galera, improves availability as well as request handling capacity. The price incurred for this improvement is the increased latencies for every write. Moreover, this solution only scales up to the capacity of a single node, but does not scale out.

To help with large deployments, we added an optional NoSQL backend based on Cassandra to address both concerns of single-point-of-failure, and lack of ability to scale-out.

12:15 - Azkaban-Scheduling Hadoop and BigData jobs - Arpit Tak, Software Engineer , Vizury

Abstract : This session will be covering Azkaban overview with its unique features using in large data systems. I will get more details into its EcoSystem, Architecture, Scheduling Multiple Hadoop Jobs, Detecting and Resolving Hadoop Job Failures, Resolving Hadoop Job Dependencies and internals of Azkaban.

Arpit works in Vizury as Software Engineer in Analytics Team and have around 2 yrs of experience in this domain

1:00 - Lunch

2:00 - Platform as a Service @ Yahoo - Sakthivel S, Santosh Yadav , Yahoo

Abstract:We at yahoo media thrive for excellence and deliver amazing customers experience . To provide excellent service, we developed Platform as a Service (PaaS) hosting infrastructure which allows us to provision, deploy, run and scale applications tremendously easy, fast and reliable.

The team will be sharing their experience of transiting from bare-metal to PaaS via IaaS. Also we get a bird eye view of implementing PaaS.

Sakthivel and Santosh are Devops at Yahoo handling critical properties like Frontpage, Finance and News

3:00 - Taming Graphite for a million metrics a minute - Jaseer T. K , Senior Operations Engg, InMobi

Abstract : Jaseer will walk you through how we designed and implemented monitoring as a shared service, at InMobi. This talk covers why we chose Graphite, how we benchmarked it and how we designed the infrastructure.

Jaseer is a Senior Operations Engg at InMobi, works on automation and managing monitoring infrastructure

3:45 - Open forum

4:00 onwards - Tea, snacks and networking.

Parking directions

Enter into the EGL park from Koramangala Indiranagar intermediate ring road. The second building on your left is the venue, Yahoo!. This is the Torrey Pines building. Ask the security for help and tell them that you have come for the #LSPE-IN event at Yahoo and they will help you park and entry.