Infrastructure Engineering @Scale Virtual Meetup #3

Date: 1st Aug 2020
Time: 10:30 am - 1:00 pm
Venue [online]: https://linkedin.zoom.us/j/95812516656?pwd=eWRzYTlpZHh3VnBOeW1LR3FRaER6UT09

Agenda:

Talk #1.

Time: Aug 1, 2020, 10:30 am –11:15 am
Title: Distributed Firewall enabling Single Fabric at LinkedIn
Speakers: Saira Khanum, Kumar Tej Gedala, Arun Thiagarajan

Description:
The infrastructure systems and network engineers share their journey to Single Frabic with the help of Distributed Firewall system. The team walks the audience through various challeges and learnings from them during the design, rollout and enforcement of the host level distributed firewall system throughout LinkedIn to enable one big fabric.

Talk #2.

Time: Aug 1, 2020, 11:25 am – 12:10 am
Title: A Mighty elephant's journey to the cloud - How Twitter made the elephant fly?
Speakers: Abhishek J, Jeffrey Jacson

Description:
The mission we serve at Twitter is to give everyone the power to create and share ideas and information instantly without barriers. And with people tweeting more and more every day, the data produced by these tweets starts to add up that calls for the need for more storage and more compute power. To keep processing massive amounts of data 24/7 and after a careful evaluation, we kicked off an initiative to move the Hadoop ad-hoc and cold clusters to Google cloud services. This initiative, which we fondly call as Partly cloudy. This talk provides insights into the current Hadoop infrastructure @Twitter and its journey to cloud.

Outline:

• Twitter Infrastructure workloads
• Hadoop @Twitter scale
• Partly cloudy - Journey to cloud
• Q&A

Talk #3.

Time: Aug 1, 2020, 12:15 am – 13:00 pm
Title: Introduction to OpenTelemetry on Kubernetes
Speaker: Joy Bhattacherjee

Description:
This talk will provide an introduction to https://github.com/open-telemetry/ as a vendor neutral telemetry stack. Delve into the architecture and design of the project at a high level and end with a detailed explanation and demo of how to deploy open-telemetry on kubernetes.

Outline:

• What is Telemetry and why do we need to have an open standard for it
• The History and lineage of OpenTelemetry
• Architecture
• Component Layout
• Basic Sampling, constant, probabilistc and tail-sampling
• Caveat of using tail-sampling w.r.t. scalability
• Kubernetes Deployment of OpenTelemetry stack
• Quick Demo of open-source code
• Q&A