What's New in Impala: Query Optimization, Admission Control, Python UDFs

Note: Building closes at 7pm; lobby doors will lock at that time!

• 6-630pm: Foods & bevs

• 630pm-7pm: Query Planning in Impala (Alex Behm)
Alex will present an overview of query compilation in Impala with a focus on query planning. Using example queries and plans, he will explain the most important query-optimization techniques implemented in Impala. Attendees will leave with a reasonable understanding of the importance of query planning, how statistics affect planning outcomes, and how Impala's planning process works.

• 7pm-730pm: Overview of Admission Control in Impala (Matt Jacobs)
Impala 1.3 introduced a new admission control mechanism to avoid oversubscription of cluster resources in times of heavy load. The admission controller was designed to be fast and resilient to failures, so it is decentralized; each Impala daemon makes local decisions and disseminate load information via the Impala statestore. This talk will describe how the admission controller works and things to consider when tuning the admission controller for your workload.

• 730pm-8pm: Python UDFs in Impala (Uri Laserson)
Impala provides the ability to easily analyze large, distributed data sets. This talk will cover the impyla package, which aims to make data science easier with Impala by integrating with Python. The impyla package currently supports programmatically interacting with Impala, running distributed machine learning in Impala, and compiling Python UDFs into assembly instructions via LLVM.

Join or login to comment.

  • Jim U.

    Good balanced presentations on three very complex areas. I really appreciate the frankness of the Cloudera presenters concerning their technology. Resource management presentation really reveals how young this Hadoop ecosystem is. I think Llama is a thoughtful solution to a very messy issue. Thanks for the detail on Python UDFs. The "compile at runtime to IR" is a very interesting approach with very impressive performance. Great job you guys.

    May 20, 2014

  • William L.

    Does this event offer streaming video via the Web? Thanks!

    May 16, 2014

    • Justin K.

      There will not be streaming video, sorry. But we'll post the slides here after the meetup.

      May 19, 2014

  • Richard W.

    Any update on whether streaming video will be available? Thanks!

    May 19, 2014

  • Jamini S.

    Hi Justin, city is not mentioned in the location of the meetup. I assume it is San Francisco...from the zip code. Can you please confirm?

    May 15, 2014

    • Justin K.

      It is. For some reason, Meetup.com is not auto-populating the city field.

      May 15, 2014

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy