Via Varejo taking data from legacy to a new world + Cloud on Apache Kafka®


Details
Join us for an Apache Kafka® meetup on May 9th from 7:00pm hosted by Semantix! The address, agenda and speaker information can be found below. See you there!
---
7:00pm - 7:30pm: Food, Drinks and Networking
7:30pm - 8:15pm: Ronaldo Lanhellas and Marcelo Costa, Via Varejo
8:15pm - 9:00pm: Ricardo Ferreira, Confluent
9:00pm - 9:30pm: Additional Q&A & Networking
-----
Talk 1:
Speakers:
Ronaldo Lanhellas, Software Architect at Via Varejo S.A.
Marcelo Costa, Consultant in Solution Architecture at Via Varejo
S.A. and Volunteer Editor for InfoQ Brazil.
Title:
Staged Event Driven Architecture, taking data from legacy to a new world at Via Varejo S.A.
Abstract:
Apache Kafka it is one of the main options in the market when there is a need to traffic data in the form of stream events between systems with scalability and organization. Via Varejo S.A., on the last Black Friday (2018) we stream more than 50 million messages using Apache Kafka in just 2 days with an average of 25,000 messages per minute. After analyzing how our structure behaved during the last Black Friday, we learned a few lessons and decided to take a new approach to deal with some specific scenarios which we have millions of messages.
Our demand challenged us to seek a solution so that we could extract a high volume of messages (~25.4 million/day) of our system on the high platform (IBM DB2/zOS) and collect, aggregate, change information and enrich data when necessary.
We decided to adopt the SEDA architecture standard to traffic these millions of messages as closely as possible and deliver the desired quality to the target systems with scalability and security. We will present the solution designed by a group of experienced architects and how we orchestrate this massive stream of data we face.
Talk 2:
Speaker:
Ricardo Ferreira, Developer Advocate at Confluent
Title:
Tips and Tricks about Apache Kafka in the Cloud for Developers
Abstract:
Who are you? You are an experienced developer who has used Apache Kafka in your projects On-Premises for a long time, as well as writing code to handle data to/from topics. However, recently your manager asked you to lead a project in which both the Kafka cluster and it's applications will run in the Cloud and just like that -- you find yourself concerned about being able or not to deliver this project.
This talk will show that there is nothing to worry about, though you may put good use in a few tips and tricks provided by this talk to ensure the success of your project. Live demos will be used to show which changes your architecture and code should undergo, as well as discuss the kinds of problems that often arise in cloud deployments. This talk will also share which tools you must have in your arsenal, so you can do better use of your time and of the Cloud.
-----
Join the Community Slack! https://launchpass.com/confluentcommunity
Wanna Speak or host? Email community@confluent.io
NOTE: This is an 18+ Only event

Via Varejo taking data from legacy to a new world + Cloud on Apache Kafka®