Name: A survey on LLM fine tuning (Lora, Qlora etc) by Cosmin and Yaroslav
Start: 2023-08-17T18:30:00-07:00
End: 2023-08-17T20:00:00-07:00

Cosmin Negruseri and Yaroslav Bulatov will go over

**A survey on LLM finetuning (LoRa, QLoRa etc)**

**Abstract:**

In this session we'll do an intro into Large Language Model fine tuning and will cover LoRa, QLoRa

**Resources:**

LoRA: Low-Rank Adaptation of Large Language Models [https://arxiv.org/abs/2106.09685](https://arxiv.org/abs/2106.09685)

QLoRA: Efficient Finetuning of Quantized LLMs [https://arxiv.org/abs/2305.14314](https://arxiv.org/abs/2305.14314)

LoRA-FA: Memory-efficient Low-rank Adaptation for Large Language Models Fine-tuning [https://arxiv.org/abs/2308.03303](https://arxiv.org/abs/2308.03303)

This is an online event. Link will be available to previous attendees or by invitation.

Yaroslav Bulatov

Cosmin Negruseri

Deep Learning Study Group (San Francisco)

Technology

Deep Learning

Neural Networks

Machine Learning

Machine Intelligence

Artificial Intelligence

Artificial Intelligence Programming

Study Group

A survey on LLM fine tuning (Lora, Qlora etc) by Cosmin and Yaroslav

Online event

Share

Deep Learning Study Group (San Francisco)

A survey on LLM fine tuning (Lora, Qlora etc) by Cosmin and Yaroslav

Deep Learning Study Group (San Francisco)

Details

Members are also interested in