Tracing event-based systems (e.g. Apache Kafka) with OpenTelemetry
Details
IMPORTANT PLEASE RSVP HERE: https://www.meetup.com/phillyjug/events/310735267/?utm_medium=email&utm_source=braze_canvas&utm_campaign=mmrk_alleng_event_announcement_prod_unfiltered_v7_en&utm_term=promo&utm_content=lp_meetup&dispatch_id=68bc0418dc113063540da3fceff62d20
***
Host: Jason Young
Presenter: Harry Kimpel (from New Relic)
Venue Hosts: Certara, Radnor
When: Thursday, October 16. Doors: 6:15. Presentation: 7:00.
Details
Ideally, you should be using distributed tracing to trace requests through your event-based system such as Kafka. It decouples producers and consumers, which means there are no direct transactions to trace between them. These systems also use asynchronous processes, which have implicit, not explicit, dependencies. That makes it challenging to understand how your micro-services are working together.
However, it is possible to monitor your event-based systems with distributed tracing and OpenTelemetry. You can then analyze and visualize your traces in an open source distributed tracing tool like Jaeger or a full observability platform like New Relic. In this talk we will leverage a simple application to show how you can achieve this.
About the Speaker
Harry Kimpel is a passionate software craftsman with 28+ years experience in a broad spectrum of development technologies and platforms. Main focus on cloud-native software architectures and all major cloud environments. Passion for model-driven development, application modernization and Dapr. Observing and securing these environments are key aspects. As a Developer Relations Engineer at New Relic, Harry helps software engineers, DevOps, SREs and operations experts to understand and implement proactive and scalable observability practices by leveraging open source technologies and the New Relic platform.