Skip to content

Twitter's Apache Kafka® Adoption Journey

Photo of Alice Richardson
Hosted By
Alice R.
Twitter's Apache Kafka® Adoption Journey

Details

Find out about other upcoming online meetups and recordings from past Kafka Meetups all over the world: cnfl.io/meetup-hub

-----

*Time below in Pacific time - to find out when the event is in your timezone follow this link: http://www.worldtimebuddy.com/event?lid=5391959&h=5391959&sts=26650500&sln=17-18&a=show

Agenda:
5:00pm-5:10pm: Online Networking
5:10pm-6:10pm: Ming Liu, Yiming Zang, Twitter (Includes Q&A)

6:10pm: Log in or Join our Slack Space* (https://launchpass.com/confluentcommunity) and go to #events to ask any follow up questions!

Joining our slack space is not instant, so ensure that you follow the steps within this link before the day of the event if you can! https://launchpass.com/confluentcommunity

Speakers:
Ming Liu

Ming is the tech lead of the Messaging team at Twitter. For the last few years, he has been driving Kafka adoption across the company. Prior to Twitter, he has worked on various teams in Microsoft, including managing the Azure CosmosDB and HDInsigh teams.

Yiming Zang

Yiming is a senior software engineer in the Messaging team at Twitter. Recently, he has worked on securing access to Kafka at Twitter, as well as building auxiliary services in the Kafka ecosystem at the company. Additionally, he is also a committer on the Apache Bookkeeper project.

Talk: Twitter’s Apache Kafka® Adoption Journey

Abstract: Until recently, the Messaging team at Twitter had been running an in-house Pub/Sub system, namely EventBus (built on top of Apache DistributedLog and Apache Bookkeeper, and similar in architecture to Apache Pulsar) to cater to our pubsub needs. In 2018, we made the decision to move to Apache Kafka by migrating existing use cases as well as onboarding new use cases directly onto Apache Kafka. Fast forward to today, Kafka is now an essential piece of Twitter Infrastructure and processes over 150M messages per second. In this meetup talk, we will share the learning and challenges in our journey moving to Apache Kafka.

---

Online Meetup Etiquette:
•Please unmute yourself when you have a question.
•Please hold your questions until the end of the presentation or use the zoomchat!
•Please arrive on time as zoom meetings can become locked for many reasons (though if you get locked out a recording will be available, but you may have to wait a little while for it!

----

If you would like to speak or host our next event please let us know! community@confluent.io

Photo of Bay Area Apache Kafka® Meetup group
Bay Area Apache Kafka® Meetup
See more events