Local AI with Plain Old Ruby Objects and Ollama in Docker with an Nvidia GPU
Details
The Atlanta Ruby Meetup is our monthly ONLINE main event.
This month, Frank Rietta, a 27-year cybersecurity expert, will present on running secure local AI on your own machines without leaking sensitive data to cloud providers. In this presentation, you will learn one way to set up Ollama using Docker, installs free and open source models from Hugging Face, and connects to it using plain Ruby - not Rails - to orchestrate data processing tasks using an AI agent. This is the foundation of a very capable infrastructure suitable for use with legally sensitive data and applications.
While not everyone has a high end Nvidia GPU or similar, this presentation will still be helpful to understand the foundations for how this works. It is actually possible to connect to cloud AI engines using the same plain Ruby code that will be demonstrated.
Hat tip to Dave Kimura for helping Frank get started with this stuff.
Schedule:
6:30pm - 7:00pm: Connect to the Google Meet and chat with other Rubyists
7:00pm - 7:45 pm: Presentation
7:45pm - 8pm: Time for questions and chit chat
Interested in Speaking? Want to show off your Ruby project or Ruby-related technology? Want to suggest a topic? Let us know!