About us
Learn, network, have fun, and thrive with AI!
Schedule a live session with Yan for career coaching and business consulting: schedule
For per case inquiry, contact *houstonmachinelearning.ai@gmail.com*
All recordings published on YanAITalk channel.
Upcoming events
2
vLLM: LLM inference and serving
·OnlineOnlineThis session introduces vLLM, an open-source library for LLM inference and serving. We will build an intuitive systems-level understanding of how vLLM approaches these production challenges, from a token’s journey through prefill and decode to the scheduling and memory-management techniques that make high-throughput serving practical.
Start exploring at vllm.Slides for past meetups posted: Github
Recordings posted at: YanAITalk
Feel free to reach out if you want to present at upcoming meetups!Note: You must have a Zoom account to login (free account is sufficient). Zoom Link will be posted to the event page one day before the meetup.
42 attendees
Netflix: Towards LLM-Native Recommendation
·OnlineOnlineIn this technical meetup, we will unpack Netflix’s GenRec: Towards LLM-Native Recommendation at Netflix, a report on an LLM-backed recommendation ranker designed for large-scale personalization. The session examines how Netflix verbalizes member history, item metadata, and request context; post-trains a Netflix-adapted foundation model for ranking; constrains outputs to in-catalog titles; and designs inference around real serving-cost constraints.
GenRec presents a disciplined production pattern: context engineering, catalog-aware scoring, reward-weighted alignment, and prefill-only serving. Netflix reports that GenRec improved on a mature production ranker in both offline evaluation and a large online experiment while using substantially fewer labeled examples and input signals.
Slides for past meetups posted: Github
Recordings posted at: YanAITalk
Feel free to reach out if you want to present at upcoming meetups!Note: You must have a Zoom account to login (free account is sufficient). Zoom Link will be posted to the event page one day before the meetup.
26 attendees
Past events
149
