Hands-On with vLLM: Fast Inference & Model Serving Made Simple

Tired of slow inference and complex serving pipelines? Join us for a live hands-on demo of vLLM, the high-performance inference engine designed for large language models.
​In this session, you’ll learn:

• ​How to install and configure vLLM step by step
• ​Best practices for serving models efficiently with dynamic batching and PagedAttention
• ​How vLLM compares to traditional serving frameworks like TGI and Hugging Face Inference
• ​Tips for running vLLM locally and scaling on the cloud

​This is a practical, no-fluff workshop—you’ll walk away with a running model served via vLLM and the know-how to deploy your own in production.
​🔹 Format: Live coding + Q&A
🔹 Who’s it for: AI engineers, MLEs, founders, and anyone curious about deploying LLMs at scale
🔹 Takeaway: A working vLLM setup and a deeper understanding of efficient LLM serving