Skip to content

PythonWA Meetup June - Indexing Exabyte Scale Data with Intake & TBC

Photo of Ben Fitzhardinge
Hosted By
Ben F. and 3 others
PythonWA Meetup June - Indexing Exabyte Scale Data with Intake & TBC

Details

Welcome to our June Python WA meetup!
We welcome Python enthusiasts of all skill levels. We'll be starting off with food and beverages at 5:30 pm, with talks beginning at 6:00pm.

Indexing Exabyte Scale Data with Intake
by Charles Turner

Climate models generate a lot of data - petabytes per model run - and this makes efficiently accessing and understanding their outputs difficult. Previous solutions include standardised file structures, sqlite databases, and just knowing where to look. All of these work - to varying degrees - but can leave new users scratching their heads. In this talk, Charles will outline how ACCESS-NRI built tooling around Intake and Intake-ESM to make it easy for Australian researchers to find and access the worlds data, share their own, and avoid writing the same custom scripts as everyone else over and over to work with the data their experiments generate - and how these solutions can be applied to other fields

Charles works at ACCESS-NRI, where he works on open source tools to make analysing climate model data less painful. He previously built similar tooling for air quality and observational oceanography.
https://github.com/charles-turner-1

TBC
by TBC

A big thanks to our
Food sponsor: Horizon Digital
Beverage sponsor: Gage Roads
Venue sponsor: Spacecubed
Hosting sponsor: Ben Fitzhardinge

Photo of Python WA group
Python WA
See more events
Riff, powered by Spacecubed
45 St Georges Terrace · Perth, WA
Google map of the user's next upcoming event's location
FREE