About us
This meetup is focused on AI Performance Engineering including GPUs, CUDA, PyTorch, TensorFlow, Kubernetes, Optimizations, High-Throughput Training Clusters and Low-Latency Inference Clusters.
Upcoming events
3

One Trillion Parameters, One Token at a Time
·OnlineOnlineFriday, November 20 · 5:30–6:30 a.m. Pacific / 13:30–14:30 UTC · Live Zoom session hosted by Rajat Dandekar on Maven. A recording will be available afterward.
You click Send. A cluster of GPUs has to turn a trillion parameters into your next token. Where do the weights fit, what has to move, and what happens when thousands of people are waiting for an answer at once?
Dr. Rajat Dandekar, co-founder of Vizuara and co-author of Build a DeepSeek Model (From Scratch), will use examples from DeepSeek, Kimi, and vLLM to build up the serving stack from one token to a full cluster.- Do the GPU math. Work out why a trillion parameters at 16-bit precision take about 2 TB just for weights, why bandwidth can bottleneck decoding, and how batching lets requests share the cost of reading weights.
- Make the KV cache fit. See what multi-head latent attention (MLA), PagedAttention, and prefix caching each do to reduce memory use or reuse work, including what Kimi K3 does differently.
- Split the work across the cluster. Compare tensor, expert, and pipeline parallelism; see why you might run prefill and decode on separate GPUs; and learn where FP4 and speculative decoding fit.
For engineers building or tuning LLM inference stacks, or working out where to start when latency or GPU memory becomes a bottleneck. Bring your team.
Register free on Maven for the Zoom session
A Meetup RSVP isn’t a Maven registration.4 attendees
Make Your GPU Earn Its Keep: A Kernel Engineering Deep Dive
·OnlineOnlineMonday, November 30, 2026 · 9:00–10:00 AM PST · Online
Zoom link: https://us02web.zoom.us/j/82308186562
A powerful GPU can spend plenty of time waiting. What is it waiting for—and how do you find out?
Talk #0: Welcome and Meetup Updates
by Chris Fregly and Antje Barth
Talk #1: From “Why Is This Slow?” to a Faster Kernel
by Dr. Rajat “Raj” Dandekar, Co-founder of Vizuara
Join Raj for a focused tour of the engineering behind fast AI kernels, drawing on Vizuara’s Kernel Engineering course on Maven. We’ll connect the roofline model to CUDA execution and the GPU memory hierarchy, then look at how profiling guides optimizations such as coalesced memory access, tiling, and tensor-core use. Matrix multiplication and attention provide context for seeing how those ideas fit together in modern AI workloads, including FlashAttention.
The goal is a practical way to decide what to measure, which bottleneck matters, and whether an optimization helped. The session is dedicated to Raj’s talk, with time for audience questions.
Who it’s for: Engineers comfortable with Python or basic PyTorch. Prior CUDA or C++ experience is not required.
Bio: Dr. Rajat Dandekar is a co-founder of Vizuara and a Kernel Engineering course instructor. He holds a PhD in Mechanical Engineering from Purdue University and BTech and MTech degrees from IIT Madras.
Based on: Kernel Engineering: From CUDA Foundations to Frontier AI Kernels
Scheduling note: November 30 is the proposed new date; speaker confirmation is pending.
Zoom link: https://us02web.zoom.us/j/82308186562
Related Links
Github Repo: http://github.com/cfregly/ai-performance-engineering/
O’Reilly Book: https://www.amazon.com/Systems-Performance-Engineering-Optimizing-Algorithms/dp/B0F47689K8/
YouTube: https://www.youtube.com/@AIPerformanceEngineering
Generative AI Free Course on DeepLearning.ai: https://bit.ly/gllm6 attendees
GPU, CUDA, and PyTorch Performance Optimizations
·OnlineOnlineZoom link: https://us02web.zoom.us/j/82308186562
Talk #0: Introductions and Meetup Updates
by Chris Fregly and Antje BarthTalk #1: GPU, PyTorch, and CUDA Performance Optimizations
Talk #2: GPU, PyTorch, and CUDA Performance Optimizations
Zoom link: https://us02web.zoom.us/j/82308186562
Related Links
Github Repo: http://github.com/cfregly/ai-performance-engineering/
O'Reilly Book: https://www.amazon.com/Systems-Performance-Engineering-Optimizing-Algorithms/dp/B0F47689K8/
YouTube: https://www.youtube.com/@AIPerformanceEngineering
Generative AI Free Course on DeepLearning.ai: https://bit.ly/gllm5 attendees
Past events
50
