Austin Open Source Data Infrastructure Meetup | Monday June 10th, 2024
Details
We'll be hosting this event with Austin DevOps!
Are you interested in learning more about open-source data technologies? ✅
Do you want to network with local and international tech professionals in a fun, relaxed environment? ✅
🤩 Then join us for an evening full of inspiring conversations and exciting talks by Dennis Wittekind & Garrett Raska
Date: Monday June 10, 2024
Location: Improving
11044 Research Blvd Suite C-120 · Austin, TX
Agenda:
- 18:00 - 18:30 Welcome: Networking & snacks
- 18:30 - 18:35 Kickoff: Welcome Aiven
- 18:35 - 19:15 Taming the Beast - Dennis Wittekind with Confluent
- 19:15 - 20:00 Redpanda & the Evolution of Open Source Streaming Platforms - Garrett Raska
20:00 ~ 21:00 Food & Networking
* Please note that this is an alcohol-free event. Light bites will be provided.
* By attending this event, you agree to abide by our community code of conduct.
Taming the Beast - Dennis Wittekind
How to best manage a highly scalable streaming platform
The Problem
The deployment methodologies afforded to Apache Kafka users and admins are endless.
Unfortunately, despite how easy it has become to deploy and use Apache Kafka, “day 2” management can still be a challenge. Tasks like monitoring, capacity planning, access provisioning, client tuning and configuration, ensuring data quality, and many more can seem insurmountable without the right tools and best practices.
Tools
There are plenty of open source and proprietary tools available today, in addition to some good advice to help tackle managing your burgeoning Apache Kafka deployment:
- Develop a client SDK, enforce client best practices, be wary of ‘Out of the box’ frameworks.
- Have a robust CI/CD pipeline for provisioning Kafka resources
- Use schemas! Build a data contract
- Monitor all the things!
- Plan for outages… even during maintenance
The solution
Equipped with the right tools and best practices, you will be well on your way to a pleasant Apache Kafka experience, with happy, performant brokers, happy customers, and most importantly, a happy Kafka Administrator team, with time to innovate your business as opposed to keeping the lights on.
Redpanda & the Evolution of Open Source Streaming Platforms - Garrett Raska
As cloud infrastructure evolves, distributed systems must adapt. Redpanda will be presenting the approach we took to re-engineer the underlying architecture and core components of a data streaming platform to maximize performance and developer velocity in an open source format.
