Skip to content

Hands-on Session - Building GPT from Scratch!

Photo of Robert M
Hosted By
Robert M.
Hands-on Session - Building GPT from Scratch!

Details

Join us for an interactive session where we follow along with Andrej Karpathy's video: "Let's build GPT: from scratch, in code, spelled out."

### What to Expect?

  • We'll code step-by-step alongside Karpathy, understanding the fundamentals of transformer-based language models.
  • Discuss key concepts such as tokenization, self-attention, and training a GPT model from scratch.
  • Hands-on learning—bring your laptop! We'll code together and troubleshoot any issues as a group.
  • No prior deep learning experience required, but basic Python knowledge is recommended.

### What to Bring?

Your laptop with Python and Jupyter Notebook installed.

  • Enthusiasm and curiosity!

Let’s learn by doing and build GPT from the ground up!

Photo of Strasbourg Deep Learning Meetup group
Strasbourg Deep Learning Meetup
See more events
La Plage Digitale
13 Rue Jacques Peirotes · Strasbourg