Hybrid Transactional/Analytical Processing Using Spark & In-Memory Data Fabrics

Abstract:
Increasingly, businesses are trying to achieve better insights out of large amounts of streamed data by bringing it closer to real time processing power and querying from a live data mart. At the moment we are witnessing a convergence of workflows and technology platforms for real time, analytics, cloud, and in-memory processing. This allows us to effectively address time-sensitive business decisions that involve the volumes of big data while benefiting from the velocities of real time processing. This involves real time analytics capabilities for price optimizations, fraud detection, risk calculations, and operational business intelligence. In this session, we present a solution architecture combining volume and velocity dimensions of big data analytics utilizing both in-memory computing and a high performance Spark distribution. We will examine a major airline who has implemented this solution for flight data yield management and optimization of seat inventory by forecasting against 300 million records and 2.2 million flight objects using Spark and an in-memory data grid. We will discuss how to reduce high latency associated with shuffling between HDFS and memory and reprocessing all data for what-if analysis.

Bio:
Ali Hodroj is VP of Products and Strategy at GigaSpaces working with small and large organizations within financial services, retail, telecommunications, and internet media on their Cloud Computing, In-Memory Computing, and Scalability use cases. Prior to joining GigaSpaces, Ali spent his days in biomedical informatics working with big data, distributed computing, and JEE technologies. You can find Ali's blog posts for further reference at: http://blog.gigaspaces.com/author/ali/

Parking & Other Info

• Enter from Hannum Ave into the parking structure for the 200-300 buildings

• Once you park, exit the parking structure on P4 near the elevators.

• Head across the courtyard veering slightly to the right and you will see the 200 building. If you find the 300 or 100 buildings you are in the wrong place. Take elevator to second floor

• Parking is free in the lot, after 630 the gates are open so people can just leave