MIDOTNET - Ondrej Balas - LLM Internals Deep Dive
Details
Agenda
- 5:30 - 6:30pm Networking
- 6:30 - 7:30pm Presentation
- 7:30 - 7:45pm Closing
Abstract
Unlock the secrets of Large Language Models (LLMs) in this deep-dive session on LLM internals. We'll discuss what an LLM is and how it works, what part 'logits' play in LLMs and how we can leverage them for decision making. Next we will look at using GBNF to constrain output generation to specific formats. Finally we'll compare various models including ChatGPT and Llama, and open source front ends like text-generation-webui and LibreChat.
Bio
Ondrej is the founder of several Michigan-based businesses including UseTech Design, a software design & development consulting firm that builds custom SaaS, dashboards, and ETL processes with .NET and other Microsoft technologies. As a technologist Ondrej leverages modern advances in tech to create software that makes businesses more productive and more efficient. Ondrej was previously a Microsoft MVP in Visual Studio and Development Technologies from 2014-2022, a writer for Visual Studio Magazine, and has been speaking at software conferences across the US since 2012.
Sponsors
