Running open-source LLMs on AKS + Intelligent Automation


Details
Agenda
18:30 Running open-source LLMs on AKS: The how and the why...
In this talk, Liam will introduce the Kubernetes AI Toolchain Operator. He will demonstrate how it can accelerate "time-to-inference" by running open-source LLMs such as falcon and llama2 on Azure Kubernetes Service. He will conclude by presenting its differentiation in a crowded technology landscape, and most importantly why we need it.
Liam is an accomplished technical leader, Principal Engineer, and architect. He is broadly recognised as an industry expert across cloud native software engineering, application modernisation and developer productivity.
19:15 Free Beer, Samosas and Pizza*
19:45 Intelligent Automation
This session aims to describe a real world use case for Intelligent Automation and how you can bring together the capabilities of
Azure and Power Platform to develop a solution.
We will discuss the pitfalls and challenges faced when implementing these solutions and provide some techniques and tips to address them.
Nick is currently Azure Practice Lead at our sponsors Jumar and previously worked for Microsoft between 2008-2021. He has 13 years experience with Azure and a passion for designing and building Innovative Solutions.
20:30 Azure Quiz with Prizes*
*Sponsored by Jumar Azure Practice

Sponsors
Running open-source LLMs on AKS + Intelligent Automation