Introduction to LLM Inference

Introduction to LLM Inference

We are kicking off a short book club series called An Introduction to LLM Inference. Ted has done a deep dive on how LLM inference works and what are the techniques for optimizing performance. This series will review the learnings he has written up, and Week 1 will cover the fundamentals of LLM Inference.

Come join us in person or online. Please make sure to read the instructions for joining the event below.

Agenda:

• 12:00 - 1:15 pm -- Presentation and discussion
• Time permitting -- Additional Q&A, networking

Links to notes/slides and videos of prior meetups are available on the SDML GitHub repo https://github.com/SanDiegoMachineLearning/bookclub/blob/master/hands-on-machine-learning-3.md

Location:
We are meeting at Aquillius in Rancho Bernardo.

Please Note: There are two steps required to join the online meetup:

• You must go to our Slack community and ask for the password for the meeting. Link to join is below.
• You must have a Zoom login in order to join the event. A free Zoom account will work. If you get an error message joining the Zoom, please login to your account on the Zoom website then try again.
• Use this Zoom link: https://us06web.zoom.us/j/82891977558

Community:
Join our slack channel for questions and discussion about what's new in ML:
https://join.slack.com/t/sdmachinelearning/shared_invite/zt-33z4811de-F_YKuCsQH1ev3TLSnQQfgQ