Henry and Cosmin review "How to think about GPUs"

# How to think about GPUs

This Wednesday we're reviewing "How to think about GPUs", the latest chapter from Google's great How To Scale Your Model series of posts.

Preparation:
There will not be a prepared presentation but more of a structured conversation.
Spend some time ahead of the meeting skimming the article so we can have a productive conversation.

Resources:
How to think about GPUs - link
Making deep learning go BRRR from first principles, by Pytorch contributor Horace He link
HuggingFace Ultra-Scale Playbook link