PythonWA Meetup June - Indexing Exabyte Scale Data with Intake & TBC


Details
Welcome to our June Python WA meetup!
We welcome Python enthusiasts of all skill levels. We'll be starting off with food and beverages at 5:30 pm, with talks beginning at 6:00pm.
Indexing Exabyte Scale Data with Intake
by Charles Turner
Climate models generate a lot of data - petabytes per model run - and this makes efficiently accessing and understanding their outputs difficult. Previous solutions include standardised file structures, sqlite databases, and just knowing where to look. All of these work - to varying degrees - but can leave new users scratching their heads. In this talk, Charles will outline how ACCESS-NRI built tooling around Intake and Intake-ESM to make it easy for Australian researchers to find and access the worlds data, share their own, and avoid writing the same custom scripts as everyone else over and over to work with the data their experiments generate - and how these solutions can be applied to other fields
Charles works at ACCESS-NRI, where he works on open source tools to make analysing climate model data less painful. He previously built similar tooling for air quality and observational oceanography.
https://github.com/charles-turner-1
TBC
by TBC
A big thanks to our
Food sponsor: Horizon Digital
Beverage sponsor: Gage Roads
Venue sponsor: Spacecubed
Hosting sponsor: Ben Fitzhardinge

PythonWA Meetup June - Indexing Exabyte Scale Data with Intake & TBC