Facing Challenges With an Innovative Mindset

We are happy to invite you to our 4th Yotpo engineering meetup, located in our brand new *** Yoqne'am *** office!!!

Overview:

At this meetup, we will share some of the most successful (public 😉) projects that have come out of our R&D department, including our main open source contributions. We will also talk about the challenges that led us to create these solutions, how we implemented them, and how you can utilize them in your day-to-day work.
Please note: The lectures will be given in Hebrew.

Agenda:

18:30-19:00: Gathering
19:00-19:20: Talk #1: An open-source, scalable queuing solution on top of Apache Kafka
19:20-19:40: Talk #2: Actions speak louder than words: Yotpo's Innovation Week
19:40-20:00: Talk #3: Metorikku: Open source created at Yotpo - Spark ETL made super simple
20:00+: Mingling

Abstracts:

19:00-19:20 - An open-source, scalable queuing solution on top of Apache Kafka
Apache Kafka is an open-source distributed streaming platform that can support the creation of several streaming applications, including log gathering, message systems, stream processing, and more. In this lecture, we’ll show how we expanded Kafka's capabilities to create KRS -- a fail-safe queuing mechanism for processing jobs triggered by system events.
We will present the basic architecture overview for microservices communication using message queue, followed by Kafka and its terminology (topics, groups, partitions, offsets).
Once the architecture requirements are clear, we’ll dive deeper into Kafka's Commit policies, and explain why they couldn’t be used to create a job queuing system to fit our needs. Finally, we will present our solutions to this problem, as well as our open-source contributions on top of Apache Kafka.

Yaniv Bronhaim,
Full stack developer at Yotpo
⭐️⭐️⭐️⭐️⭐️

19:20-19:40 - Actions speak louder than words - Yotpo's Innovation Week

Sometimes our innovation dreams do come true. One week each year, Yotpo R&D pauses all day-to-day work to build innovative projects instead. Anyone can pitch an idea, assemble a team, talk to sales & customers, and build an end-to-end product that can have a tremendous impact on our roadmap.

Micha Zana,
Group leader at Yotpo
⭐️⭐️⭐️⭐️⭐️

19:40-20:00 - Metorikku: Open source created at Yotpo - Spark ETL made super simple

Metorikku is an open-source project created at Yotpo that simplifies the writing and execution of ETLs on top of Apache Spark. Using the Metorikku library, users can create complex ETL jobs by only relying on simple configuration files and SQL commands. Moreover, the library includes an infrastructure for creating unit tests. In this talk, we will show how we leveraged Metorikku at Yotpo and made spark accessible to our entire R&D.
Liran Yogev,
Group leader at Yotpo
⭐️⭐️⭐️⭐️⭐️