Python Ireland Monthly Meetup
Details
Luca Lodi: Running a ChatGPT-like open source Language Model
This talk covers the story of a python user trying out one of these new open source models "like ChatGPT" (cause it is cool!).
The magic of Python and hugging face's model hub promised to make this a 4-liner easy project.
But he was stuck with a tiny laptop's GPU. Will it run ?
Join us to learn more about how to run pretrained models from hugging face, and the lessons learned when they don't fit in the GPU's VRAM.
Some concepts about the underlying pytorch, CUDA, and transformers LLM will be gently introduced, as they were discovered, from the lenses of a python programmer just trying to make it work.
(No) Assumptions:
- This talk is for everyone with some degree of hands-on python experience. It is NOT a talk about machine learning, chat GPT, nor models.
If you want to submit a talk proposal, please do so here: http://python.ie/meetups
If you wish to sponsor a venue, please contact meetups@python.ie