Name: Neural Networks: Zero to Hero - language modeling.
Start: 2025-05-11T13:00:00+04:00
End: 2025-05-11T15:00:00+04:00
Location: Pullman Tbilisi Axis Towers

**The spelled-out intro to language modeling: building makemore**

We following a course created by Andrej Karpathy on building neural networks, from scratch, in code.

We start with the basics of backpropagation and build up to modern deep neural networks, like GPT. In my opinion language models are an excellent place to learn deep learning, even if your intention is to eventually go to other areas like computer vision because most of what you learn will be immediately transferable. This is why we dive into and focus on languade models.

Prerequisites: solid programming (Python), intro-level math (e.g. derivative, gaussian).

\-\-\-

This is **second** event from this series.

We implement a bigram character-level language model, which we will further complexify in followup videos into a modern Transformer language model, like GPT. In this video, the focus is on (1) introducing torch.Tensor and its subtleties and use in efficiently evaluating neural networks and (2) the overall framework of language modeling that includes model training, sampling, and the evaluation of a loss (e.g. the negative log likelihood for classification).

If you was absent on previous you can watch all previous lessons.

Full curse is presented on page:
https://karpathy.ai/zero-to-hero.html

\-\-\-

✅ We will follow course program, discuss code, explain fragments that are unclear and learn together.
✅ After course there will be time to eat dinner making new connections in AI worlds and sharing what you think.

Basically you can just view video at your home, but learning in group you can grasp some ideas faster asking questions and learn deeper explaining something that you understand to others.

Daniel Gustaw

Let's learn together

Technology

Open Source

Geeks & Nerds

International Friends

Internet Startups

Science

Python

Cloud Computing

Computer Programming

Web Programming

Technology Startups

Neural Networks: Zero to Hero - language modeling.

Artificial Intelligence

Pullman Tbilisi Axis Towers

Share

Let's learn together

Neural Networks: Zero to Hero - language modeling.

Let's learn together

Details

Members are also interested in