• Modern big data and analytics architecture patterns on AWS

    Derech Menachem Begin 121

    In the meetup, we will explain & show the benefits of modern data architecture patterns on AWS, in the AWS cloud, explore the principle of decoupling storage from computing. The meetup will host AWS Customers which will show and tell how they completely re-architected their data pipeline to meet their ever growing business requirements, resulting A Highly Available / Scalable production patterns that are able to scale and process billions of event. The core discussion will include dive deep into the Data Lake approach The technologies discussed will be: • Amazon S3, Parquet, and ORC nuances • AWS Glue • Amazon Athena • Presto • AWS Lambda Functions • Spark • AWS Lake formation • Pipelines The meetup will be in Amazon building (floor 28) and will be hosted by Amazon. Playbuzz, Twingo, and Salesforce will join us. 16:30 – 17:00 Gathering and snacks 17:00-17:10 Intro of the meetup Golan Nahum CEO, Twingo • Introducing Twingo • Main patterns and concepts of modern data architecture https://www.linkedin.com/in/twingo/ 17:10-17:35 Chen Salomon, VP R&D, Playbuzz • Building and optimizing DWH directly on S3 - Technical, performance and costs aspects. • How we reduced costs and complexity with server-less data pipelines on AWS https://www.linkedin.com/in/chensalomon/ 17:35-17:55 Igor Velichanski (25 minutes) Big Data Team Lead at Datorama, a Salesforce Company How we built DWH over S3: Using Presto and Spark. • Managing updates and deletes • Efficiency, good practices, concurrency and other considerations https://www.linkedin.com/in/igor-velichanski-34745b3/ 17:55-18:05 – Coffee Break 18:05-18:15 - Daniel Haviv, Big Data Specialist Solutions Architect, AWS • Intro to a new service AWS lake formation https://www.linkedin.com/in/danielhaviv/ 18:15-18:35 Ilia Gulman, CTO at Twingo • Summary for good and bad practices from the event • Live Demo - Common D&A Pipeline on AWS using Data Lake at the core. Introduction to AWS lake formation Ilya is a senior big data expert and architect with 20+ years of experience in pipelines, big data solutions, software development, and complex analytics additional to RSVP please register in the link below: https://tinyurl.com/y64z2cw7