Migrating Big Data pipelines to AWS : Lesson learned [English]

Important notice: This meetup will be held in English.

Agenda:

18:00 Gathering & Networking

18:30 Migrating Big Data pipelines to AWS : Lesson learned [English]

Many of the commercial big data pipelines are run in-house on privately owned data centers. This allows complete control of hardware and software but it also creates problems where hardware has to be maintained or new hardware has to be procured which cannot always be done as quickly as is required. Is it possible to run big data pipelines on Amazon EMR (Elastic Map Reduce) and achieve similar costs to traditional in-house datacenters? Is it possible to migrate life data processing solution to AWS without interrupting service? Is it feasible to adapt real-time processing pipeline to receive x10 scale while moving to AWS? In this talk, you will learn what challenges we faced attempting such a migrations and how we solved them.

About the speakers:
Lev Brailovskiy
Dir. Software Engineering, Oath
Bellevue, WA

Zilvinas Saltys
Principal Software Engineer, Oath
London, UK

20:30 End of meetup

Parking: There is a parking lot outside of the building at Hamayan St 6, Ramat Gan, which is free during the evening hours.