Skip to content

LA R Users: September Meeting

Photo of Amy Tzu-Yu Chen
Hosted By
Amy Tzu-Yu C. and Keren X.
LA R Users: September Meeting

Details

LA R Users Group will have our September meeting online on Zoom (https://usc.zoom.us/j/92828963940).

Talk (40min talk, 10min Q&A)

Title: Bigger but local: Tools for uncomfortably big data
Abstract: Sooner or later, every data scientist faces a dataset big enough to require thought about how to handle it without blowing up the machine. We'll talk about three tools which both make it easier to handle bigger data locally and scale nicely to cloud architecture when required:

  1. Parquet. We all want more data, but nobody really wants a 281 Gb CSV. Parquet is a well-supported alternative that solves a lot of the problems with CSVs.
  2. Arrow Datasets. (Experimental!) What do you do when you've got more data than memory? Arrow Datasets are a really easy-to-use option to pull out what you need.
  3. Apache Drill. When you need a power tool, Drill lets you treat a hard drive like a database, putting the power of SQL at your fingertips without the setup.

And thanks to our open-source community, they all work beautifully from R! Join us and learn how to scale up your data engineering skills.

Speaker: Edward Visel
Edward Visel is a data scientist at Uptake, a Chicago startup that detects problems in machines in the industrial internet of things before they cause catastrophic failures. In previous lives he worked in education and politics; in his spare time he, like everyone else, bakes bread.

Code of Conduct: https://github.com/laRusers/codeofconduct

Schedule
6:30 open zoom
6:40-7:20 Presentation
7:20-7:30 Q&A
~8:00 Virtual Social

LA R Users Group
Invite yourself to our Slack group: https://socalrug.herokuapp.com/
Ask us any questions by email: larusers@gmail.com
Find our previous talks on GitHub: https://github.com/laRusers/presentations
Follow us on Twitter: @la_Rusers
Check out more events: https://laocr.org/

***** DON'T BE SHY *******
Reach out if you want to be our speaker. First-time speakers are welcome

Photo of R Meetup - Real Data Science USA (formerly LA R Users Group) group
R Meetup - Real Data Science USA (formerly LA R Users Group)
See more events

Sponsors