Running your Own LLM
Details
We had another great session last month with Noah providing some fascinating wisdom and perspective on career path. PayTalk didn't work out so well but we agreed we need more data. We will try it again.
This month Chris Ewing is going to talk about running a local LLM and how to do it.
Running your own LLM
This presentation will motivate some reasons to run your own LLM and explain how to run oLama on a Linux machine. It will then take us into some of the ecosystem around the model for CLIs, IDEs and other tooling. Finally we will take a dive into Pydantic and how to work with the API.
Hardware folks might be interested in this talk due to the idea of having an LLM locally available to something physical you are building/deploying.
Chris Ewing
Chris obtained a Mechanical Engineering degree and continued to work for DOT after graduation. He then left for the oilfield, mostly drilling, to not use much engineering for 25 years - North Sea, Rockies, Brazil, TX
Go to work in IIoT as shoulder surgery botched
Extensive IT education, consisting of Logo class ~1984, Fortan 1991 and VBA 2002
Several startups since 2015, one successful Unity mental health, two failed over IP issues, currently on another
Important
No pizza for the summer! We'll bribe more college kids come fall.
Order of Show
6:00 - Meet and greet
6:15 - Who is looking and who is hiring?
6:25 - Running your own LLM - Chris Ewing
7:45 - #BeerOps