(Gainesville) Machine Learning Workshop: Run LLM on Local Machine

We'll use Llama.cpp and an LLM to setup a local version of ChatGPT on our machine. This is useful if you want to query the LLM and keep the contents of your conversation private and free.

We'll be streaming our video feed via Discord for those who can't make it in person. You'll receive the Discord link a day before the meetup if you RSVP.

Prizes:
First person to show up, gets a Florida Python Ninjas T-shirt.
First five people get 5 dollars off meal price.

-----

Looking forward to seeing you all! During the meetup we'll talk about:

• Why run LLM locally?
• Why use Llama.cpp instead of alternatives?
• Setup Llama.cpp in a Linux-like Podman container
• Download LLM model
• Communicate with LLM via Curl
• Communicate with LLM via in-Browser Chat UI
• Discuss Improving LLM Performance