Name: DAM: Local LLM Prototyping
Start: 2024-11-20T15:00:00+01:00
End: 2024-11-20T17:30:00+01:00
Location: Jesenná 566/5

**Registration closed.**

The workshop will take place at two times - at 3:00 PM and 4:30 PM.
Due to the room's capacity, the **number of spots is limited**.

Join us for an exciting hands-on workshop where you'll learn how to set up, deploy, and use large language models (LLMs) locally on your own device. There is no need to rely on cloud services—this event will show you how to use the power of LLMs directly on your computer for a variety of use cases.

**What You'll Learn:**

* Step-by-step guidance on deploying LLMs with Rancher Desktop, Ollama, and Python 3.12 through Miniconda.
* How to use models for specific applications like:
* Writing assistant: for use cases like proofreading or improving your email content
* Code assistance and debugging (integrating LLMs with VSCode IDE to boost productivity in software development).
* Building custom chatbots for customer service or personal assistants.

**Prerequisites:**
All attendees **must have access** to device with the following minimum requirements:

* **16 GB of RAM**
* **Nvidia GPU or Apple M-series chip**

Additionally, please have the following tools installed **prior to the event:**

* **Ollama** LLM engine: [https://ollama.com](https://ollama.com/ "https://ollama.com/")
* Execute following command after successful installation:
* `ollama pull llama3`
* `ollama pull starcoder2:3b`
* **MSTY UI**: [https://msty.app/](https://msty.app/ "https://msty.app/")
* **IDE VSCode**: [https://code.visualstudio.com/](https://code.visualstudio.com/ "https://code.visualstudio.com/")
* Continue VSCode extension for code completion: [https://marketplace.visualstudio.com/items?itemName=Continue.continue](https://marketplace.visualstudio.com/items?itemName=Continue.continue "https://marketplace.visualstudio.com/items?itemname=continue.continue")

**Speaker:** Marián Ferenc (Application Architect, CIC IBM Slovakia)

The workshop runs in the frame of **all-afternoon meetup Sunset or Sunrise of GenAI?**
[https://www.meetup.com/machine-learning-meetup-kosice/events/303918371](https://www.meetup.com/machine-learning-meetup-kosice/events/303918371/?utm_medium=referral&utm_campaign=share-btn_savedevents_share_modal&utm_source=link&fbclid=IwY2xjawF9oORleHRuA2FlbQIxMQABHaHXcnDyhXgjz3OW85qx6tpE6ZQH38DEqMcYSxJugeTe7ud6rJPWPJwvrw_aem_0I5vzgaCAmC7R2GTa2TMlA)

Diana Trellová

Miloslav Cisko

Adam Marton

Jaroslav Supina

Mária Slovinská

Machine Learning Meetup Košice

Technology

Artificial Intelligence

Software Development

Big Data

Natural Language Processing

MapReduce

Machine Learning

Data Analytics

Predictive Analytics

Neural Networks

Data Mining

Machine Intelligence

Data Science

Deep Learning

TensorFlow

DAM: Local LLM Prototyping

Jesenná 566/5

Share

Machine Learning Meetup Košice

DAM: Local LLM Prototyping

Machine Learning Meetup Košice

Details

Members are also interested in