Skip to content

Introduction and roadmap for Apache Arrow

Photo of Kelly Stirman
Hosted By
Kelly S.
Introduction and roadmap for Apache Arrow

Details

Join us for talks from the PMC Chair of the Apache Arrow project, Jacques Nadeau, and Arrow committer and creator of Python Pandas, Wes McKinney. Details below.

We'll have pizza, beer, and wine for everyone.

Our kind host for this meetup is Enigma, another contributor to the Arrow project. Note: you must RSVP so we can provide your name to the security desk at the building entrance.

Speaker: Jacques Nadeau

Title: Apache Arrow: In Theory & Practice

Abstract: Apache Arrow is designed to make things faster. Its focused on speeding communication between systems as well as processing within any one system. In this talk I'll start by discussing what Arrow is and why it was built. This will include covering an overview of the key components, goals, vision and current state. I’ll then take the audience through a detailed engineering review of how we used Arrow to solve several problems when building the Apache-Licensed Dremio product. This will include talking about Arrow performance characteristics, working with Arrow APIs, managing memory, sizing Arrow vectors, and moving data between processes and/or nodes. We’ll also review several code examples of specific data processing implementations and how they interact with Arrow data. Lastly we’ll spend a short amount of time on what’s next for Arrow. This will be a highly technical talk targeted towards people building data infrastructure systems and complex workflows.

Speaker: Wes McKinney
Title: Arrow C++ Roadmap and pandas2
Abstract: In this talk will give a general overview of the Arrow C++ project and its relationship with the Python data ecosystem. I will also explain how Apache Arrow relates to internal problems we've been dealing with in the pandas project for many years and how we'll be approaching developing the "pandas2" project.

Photo of Apache Arrow Meetup group
Apache Arrow Meetup
See more events
Enigma Technologies
245 5th Ave, New York, NY 10016 · New York, NY