#12 AI Technical: Chain of Continuous Thought

When: Wednesday 28th May 2025, 6 pm – 8 pm.

Where: The Castle Inn, 36 Castle Street, Cambridge, UK. (Most
likely we'll be at one of the large tables upstairs.)

Paper: Training Large Language Models to Reason in a Continuous Latent Space
https://arxiv.org/abs/2412.06769

Description:
Modern LLMs solve complex reasoning tasks by generating a sequence of problem-solving steps in plain English. Coconut is a new approach by Meta that aims to improve on this by instead performing reasoning in a continuous latent space, avoiding the inefficiencies of natural language and capturing the nuance of advanced reasoning. Join us for a glimpse of machine reasoning beyond human language.

You'll need to read the paper in advance. Ideally please also bring along your own copy of the paper to refer to in the
session.