About us
The LLM Reading Club is for anyone interested in building both a theoretical intuition of large language models and practical expertise in their development and use. There’s momentum and fun in numbers! 😊 The club will collectively explore some of the canonical books and research papers pertaining to large language models.
The level of prerequisite knowledge needed to maximise benefit will vary depending on the specific book or paper being covered. Generally, the content will be most suitable for those proficient in Python and with some understanding of (or a willingness to quickly learn) the relevant core machine learning or mathematical concepts.
All are welcome - this includes but not limited to - data practitioners of all hues, enthusiasts, students, researchers, and professionals.
Upcoming events
1
Build a Reasoning Model (From Scratch)
·OnlineOnlineWe are working through Build a Reasoning Model (From Scratch) by Sebastian Raschka.
During each meetup, we will discuss the key concepts from the chapter or pages under review.Raschka provides a hands-on guide to understanding and building modern reasoning models. Starting with a conventional pretrained LLM, the book explores evaluation, inference-time reasoning techniques, reinforcement learning with verifiable rewards, and knowledge distillation.
Please note that the session is not recorded, and participants are responsible for obtaining their own copy of the book.
Buy the book (affiliate links):
Amazon UK
Amazon FranceBook overview:
In Build a Reasoning Model (From Scratch), bestselling author Sebastian Raschka explains how modern reasoning-oriented language models work by implementing their core techniques step by step.
You will begin with a conventional pretrained LLM and learn how to generate and evaluate its responses. You will then explore inference-time techniques such as chain-of-thought prompting, sampling, self-consistency, response scoring, Best-of-N, and self-refinement. Later chapters introduce training-based approaches, including reinforcement learning with verifiable rewards, GRPO, format rewards, and distillation from stronger reasoning models into smaller ones.
Build a Reasoning Model (From Scratch) teaches you how to:- Implement core LLM reasoning techniques from scratch
- Generate, score, and evaluate model responses
- Build verifier-based evaluation systems
- Improve reasoning using self-consistency, Best-of-N, and self-refinement
- Apply reinforcement learning with verifiable rewards
- Understand and implement GRPO-based training
- Distill the reasoning capabilities of stronger models into smaller ones
- Evaluate the accuracy, cost, and latency trade-offs of different reasoning techniques
***
13 attendees
Past events
34
