Edge AI: An introduction to Large Language Models at the edge.


Details
Large Language Models (LLMs) have changed the game in AI with their ability to understand, reason, and generate human-like text. But what happens when we try to bring that power to small, resource-limited devices at the edge?
In this meetup, we’ll dive into the challenges of running AI on edge hardware and show a live demo of a Small Language Model (SLM) running on an NVIDIA Jetson board. You’ll see how tuning and optimization make it possible to bring advanced language capabilities to compact, low-power devices.
Whether you’re into AI, edge computing, or just curious to see cutting-edge tech in action, this session will give you a hands-on look at the future of lightweight language models on the edge.

Edge AI: An introduction to Large Language Models at the edge.