Skip to content

Modern big data and analytics architecture patterns on AWS

Photo of Golan Nahum
Hosted By
Golan N.
Modern big data and analytics architecture patterns on AWS

Details

In the meetup, we will explain & show the benefits of modern data architecture patterns on AWS, in the AWS cloud, explore the principle of decoupling storage from computing.
The meetup will host AWS Customers which will show and tell how they completely re-architected their data pipeline to meet their ever growing business requirements, resulting A Highly Available / Scalable production patterns that are able to scale and process billions of event.

The core discussion will include dive deep into the Data Lake approach

The technologies discussed will be:
• Amazon S3, Parquet, and ORC nuances
• AWS Glue
• Amazon Athena
• Presto
• AWS Lambda Functions
• Spark
• AWS Lake formation
• Pipelines

The meetup will be in Amazon building (floor 28) and will be hosted by Amazon. Playbuzz, Twingo, and Salesforce will join us.

16:30 – 17:00 Gathering and snacks

17:00-17:10 Intro of the meetup
Golan Nahum CEO, Twingo
• Introducing Twingo
• Main patterns and concepts of modern data architecture
https://www.linkedin.com/in/twingo/

17:10-17:35 Chen Salomon, VP R&D, Playbuzz
• Building and optimizing DWH directly on S3 - Technical, performance and costs aspects.
• How we reduced costs and complexity with server-less data pipelines on AWS
https://www.linkedin.com/in/chensalomon/

17:35-17:55 Igor Velichanski (25 minutes)
Big Data Team Lead at Datorama, a Salesforce Company
How we built DWH over S3: Using Presto and Spark.
• Managing updates and deletes
• Efficiency, good practices, concurrency and other considerations
https://www.linkedin.com/in/igor-velichanski-34745b3/
17:55-18:05 – Coffee Break

18:05-18:15 - Daniel Haviv, Big Data Specialist Solutions Architect, AWS
• Intro to a new service AWS lake formation
https://www.linkedin.com/in/danielhaviv/

18:15-18:35 Ilia Gulman, CTO at Twingo
• Summary for good and bad practices from the event
• Live Demo - Common D&A Pipeline on AWS using Data Lake at the core. Introduction to AWS lake formation

Ilya is a senior big data expert and architect with 20+ years of experience in pipelines, big data solutions, software development, and complex analytics

additional to RSVP please register in the link below:
https://tinyurl.com/y64z2cw7

Photo of Big Data Analytics & Big Data BI ISRAEL Meetup group
Big Data Analytics & Big Data BI ISRAEL Meetup
See more events