Gem City Machine Learning
Details
NOTE the change in date
Running Local LLMs, by Nick Gerakines,
Overview
Running your own LLM is pretty easy and there are a lot of tools and platforms that make it possible. If you have the right hardware, with a little bit of elbow grease, you can run your own chatbots and interact with LLMs using session interfaces and APIs.
Who am I?
I’m Nick Gerakines, a software engineer and technology enthusiast. I’ve been in the AI/ML/CS space for a short while at UDRI / AFRL and the private sector at companies like PredictAP, DataDog, and Mattel.
https://ngerakines.me/
Presentation Outline
- Title
- Who am I?
- LLM primer
- The LLM landscape
- Sizzle demo – Asking a local LLM some questions
- Ollama overview
- Model directory
- Running Ollama
- Using the ollama run command
- Interacting with ollama with Python
- Closing
- Bonus: https://github.com/ggerganov/llama.cpp
The Gem City Machine Learning (ML) group is part of the GemCity TECH family of user communities in Dayton OH.
Each month we meet at the Innovation Hub located in the newly renovated Downtown Dayton Arcade.
We meet to explore the exciting and growing field of Machine Learning (ML) and Artificial Intelligence (AI).
We regularly meet on the third Thursday of the month. You can find our next event on the GemCity TECH Meetup events calendar.
- Would you like to discover more about machine learning or artificial intelligence?
- Are you interested in being part of a community who are also interested in exploring the field of machine learning?
- Do you work in the field of machine learning and would like to share your knowledge and experience?
Our goal is to have a space where people can present and learn new ML/AI ideas, ask for help on problems they are working on, and meet new people.
We have short talks about machine learning (ML) and how to get into this field.
The format is:
- Social: ~ 30 min
- Lecture: ~ 1 hour
- Social: ~ 30 min
### Connect With Us
You can connect with us through the GemCity TECH Discord Server under the #machine-learning channel.
or check us out on
Gem City Machine Learning