Skip to content

Details

Description: Data lakes on object storage (Amazon S3, Azure Blob Store) have risen in popularity over the past 5 years due to their lower cost, convenience and the expansion of the ecosystem. Querying data on object stores with distributed query engines like Spark, Presto and Apache Drill makes for an ergonomic and scalable solution.

However, at massive scale this architecture may start to perform too slowly for interactive queries. Alluxio is a distributed cache for big data.

In this talk, Jowanza introduces Alluxio and some of its concepts and share a case study of using Alluxio to improve query performance by 10X in an application with hundreds of concurrent queries on 100s of terabytes. Attendees can expect to learn about Alluxio and some of the intricacies of this particular case study.

Bio: Jowanza Joseph is a Software Engineer at Pluralsight. Jowanza's work focuses on distributed data processing and messaging systems. Previous to Pluralsight, Jowanza worked at Adobe, Edge by Ascential and Zagg. Jowanza contributes to several open source projects and blogs about big data and productivity.

Sponsors: Recursion Pharmaceuticals, Overstock, Google Cloud, Snowflake, Pluralsight, Ternary Data

Related topics

Sponsors

Pluralsight

Pluralsight

Meeting Space

You may also like