The Race to Open-Source ChatGPT

▷ The Race to Open-Source ChatGPT ◁

Program

• 08:00 - 08:10
  Arrival, coffee & croissants
• 08:10 - 08:45
  Introduction & talk
• 08:45 - 09:00
  Q&A and survey

Language: English

Abstract: Just one year ago, chatbots were out of fashion and most people hadn't heard about large language models and techniques to align them with human preferences. Then, OpenAI broke the internet with ChatGPT and Meta followed suit by releasing the Llama series of language models which enabled the open-source community to build their very own capable chatbots. This has led to a rich ecosystem of open access datasets and models, with many of them hosted on the Hugging Face Hub (https://huggingface.co).

In this talk, Lewis Tunstall will give an overview of the community's efforts to create an open-source ChatGPT, and discuss some of the challenges involved in training and evaluating these models effectively.

Speaker: Lewis Tunstall is a Machine Learning Engineer at Hugging Face whose work lies at the intersection of the open-source and research teams, He is the co-author of the bestseller “NLP with Transformers” book and has previously built machine learning-powered applications for start-ups and enterprises in the domains of natural language processing, topological data analysis, and time series. He holds a PhD in Theoretical Physics, was a 2010 Fulbright Scholar and has held research positions in Australia, the USA, and Switzerland. His current work focuses on building tools and recipes to align language models with human and AI preferences through techniques like reinforcement learning.