Building agents with the world's fastest inference on Llama 3.1 405b @SambaNova

This week we will meet an hour early, with a new Sponsor SambaNova Systems.

SambaNova Systems will present about the challenges of how they were able to scale to have the world's fastest inference speeds on Llama 3.1 405b and 70b and show some agentic use-cases of how to take advantage of this record fast inference.

Food will be provided

Schedule:

6:00pm - Doors Open
6:30 - 7:30pm - Talk starts
7:30 - 9:00pm - Networking

Talk Details
a) Explain the SambaNova RDU and its hardware architecture. Will also have a sample chip to showcase as well.
b) Discuss what we are seeing in the market around Agentic AI
c) Show some demos built on the SambaNova Cloud

Speakers

Raghu PrabhakarTitle: Architect
Bio: Raghu Prabhakar is a founding engineer and architect at SambaNova Systems. He specializes in hardware architecture and compilers for dataflow architectures. At SambaNova, Raghu has co-architected four generations of SambaNova's dataflow processor called the Reconfigurable Dataflow Unit (RDU) as well as several key components of SambaNova's compiler stack.

Vasanth Mohan
Title: Director, Technical Product Marketing and Developer Relations
Bio: Vasanth Mohan is a seasoned technology leader, serving as Director of Technical Product Marketing and Developer Relations at SambaNova. With a proven track record of empowering thousands of developers and startups across emerging technologies, including VR/AR, Edge Computing, and AI, Vasanth has helped numerous solutions successfully deploy in the enterprise. At SambaNova, he is now focused on enabling developers and the enterprise to unlock the value of Agentic AI to solve today's business challenges.

Try out their record fast inference here:[ https://cloud.sambanova.ai/](https://cloud.sambanova.ai/) or check out their website at https://sambanova.ai/
Listen to the podcast: https://podcast.genaimeetup.com/
Zoom Link: https://sambanova.zoom.us/j/87242270823?pwd=mF2sGXlGF2ExcuFLxRxoo0y2sKiWoK.1