Centralized Logging Patterns

Cape Town DevOps Meetup
Cape Town DevOps Meetup
Public group
Location image of event venue


• Agenda:
18:00 - 18:45: Arrive & mingle with people.
18:45 - 19:30: Main talk: Centralized Logging Patternss
19:30 - 21:00: Continue chatting & networking.

• Speaker:
Philipp lives to demo interesting technology. Having worked as a web, infrastructure, and database engineer for over ten years, Philipp is now working as a developer advocate at Elastic — the company behind the Elastic Stack consisting of Elasticsearch, Kibana, Beats, and Logstash. Based in Vienna, Austria, he is constantly traveling Europe and beyond to speak and discuss open source software, search, databases, infrastructure, and security.

• Abstract:
Most organizations feel the need to centralize their logs — once you have more than a couple of servers or containers, SSH and tail will not serve you well any more. However, the common question or struggle is how to achieve that.
This talk presents multiple approaches and patterns with their advantages and disadvantages, so you can pick the one that fits your organization best:
• Parse: Take the log files of your applications and extract the relevant pieces of information.
• Send: Add a log appender to send out your events directly without persisting them to a log file.
• Structure: Write your events in a structured file, which you can then centralize.
• Containerize: Keep track of short lived containers and configure their logging correctly.
• Orchestrate: Stay on top of your logs even when services are short lived and dynamically allocated on Kubernetes.
Each pattern has its own demo with the Elastic Stack (previously called ELK Stack), so you can easily try out the different approaches in your environment. Though the general patterns are applicable with any centralized logging system.

• Venue
The new AWS building on the corner of Roeland and McKenzie (old Ferrarri building).

• Parking:
There is a parkade at Wembley square as well as street parking outside the building.

• Sponsors:
Jetbrains for giving away a full license to one of their products
OfferZen for the speaker gift, shirts and stickers

• Code of Conduct
Please see our Code of Conduct here: https://www.meetup.com/Cape-Town-DevOps/pages/21932587/Code_of_Conduct/