Foundations First: Stepping Through GPT-1

We'll step through GPT-1 from input to output with Hugging Face's implementation, examining embeddings, attention, and decoding.

We'll shed light into the black box by exploring the core computations behind generative transformers, the (mostly) unchanged building blocks that power today’s vastly scaled language models.

Please come and join us!