Skip to content

Details

Overview
Part of our fortnightly series of paper reading sessions.
We're reading The Annotated Transformer (Harvard NLP). It takes the paper Attention Is All You Need and builds the model in PyTorch, one section at a time, with the code beside the text. Read it before you come: https://nlp.seas.harvard.edu/annotated-transformer/
Check out the journal club channel on our applicant Discord server: https://discord.gg/y6AXyzbXUX

How the session works
This is not a walkthrough. We'll split into small groups to work through a set of questions, then regroup for answers and an open discussion.

Who is this for
Experienced software engineers. You don't need a research background, though you'll get more out of the evening if you're comfortable with the basics of neural networks. You don't need to have come to the earlier sessions.

What to bring
The Annotated Transformer, read beforehand. You won't need a laptop.

Related topics

You may also like