Scalable Multi-tenant Logging, Metrics and Monitoring as a Service for OpenStack

Live VideoStream on YouTube: http://www.youtube.com/watch?v=HHADVSr7Crg (https://www.youtube.com/watch?v=6X-pVfWeyAI)

The Meetup is being held at Symantec Bldg Q. Please park and enter the building as directed in the map below.

http://photos1.meetupstatic.com/photos/event/7/7/1/7/600_431910487.jpeg

6:00 pm: Arrival & networking
Drinks and Pizza will be provided.

6:30 pm: Scalable Multi-tenant Logging, Metrics and Monitoring as a Service for OpenStack and Cloud Applications- LN Renganarayana

At Symantec, we are building an OpenStack based cloud platform to securely host and manage a variety of products and services. To operate this platform at scale, we found that we need a scalable multi-tenant logging and metrics service. Soon we realized that our customers’ services and products also need the same. For operating at scale, it is invaluable to have a single service that can collect, index and correlate logs, metrics and other events across OpenStack services, our platform and applications.

Our Logging, Metrics and Monitoring (LMM) as a Service is aimed at providing a scalable logging and metrics service for applications and services across the stack: starting from low level networks and core openstack services to platform services to Symantec products. LMM integrates with Keystone to provide secure authentication and multi-tenancy which is used to limit the visibility of logs/metrics to specific users/tenants or to specific services (e.g., only nova or only swift). LMM also provides features for setting up Alerts on log and metric events.

In this session, we will share with you how we have built LMM using battle tested open source / OpenStack components such as Keystone, Kafka, Storm, ElasticSearch, InfluxDB, Logstash, Kibana, and Grafana. We will also present our Keystone based authentication and multi-tenancy model and its implementation for limiting the visibility of logs and metrics for queries and alerts.

7:30 pm: Q&A Session

LN Renganarayana:

LN Renganarayana is an Architect in the Cloud Platform Engineering team at Symantec. He loves to build large scale cloud services and learn new programming models. In his previous life, his excitment with compilers led him to a PhD and some cool automatic parallelization and approximate computing work at IBM Research. You can find out more at: http://www.linkedin.com/in/lrengan/

http://photos3.meetupstatic.com/photos/event/7/7/4/1/600_431910529.jpeg