Deep Learning: LLMs and Retrieval-Augmented Generation (RAG)

Hello Deep Learners,

We kindly invite you to our next Deep Learning meetup on April 8th, hosted by Cloudflight. The topics will be Retrieval-Augmented Generation (RAG) and How to benchmark Large Language Models (LLMs).

***

Agenda

18:30

• Introduction by the meetup organizers
• Welcome by the host

18:45

• Talk 1: Retrieval-Augmented Generation (RAG) - Where are we now?
  Liad Magen

19:40

• Announcements: Events & Job Openings
• Networking Break & Discussions

20:15

• Talk 2: How to measure quality of LLMs: Lessons learned from creating a benchmark dataset for Cyber Threat Intelligence
  Aaron Kaplan
• Networking & Discussions

21:30 Wrap up & End

***

Talk Details:

Talk 1: Retrieval-Augmented Generation (RAG) - Where are we now?

• by Liad Magen

Large Language Models (LLMs) have already become integral to our lives. As much as they perform well in many areas, they still suffer from issues, such as hallucinations when asked about a newly introduced topic that was not part of the training data, or privacy issues (such as the option to remove information). A potential solution that does not require retraining the model is to connect these LLMs to an external memory or a knowledge base. Upon a given question, the system will retrieve relevant documents and then use their content to generate an answer. Since its inception in 2020, the RAG model has gone through (and still is) many changes in all of its modules. In this talk, we will review some of these improvements, and review some of the current open issues.

Talk 2: How to measure quality of LLMs: Lessons learned from creating a benchmark dataset for Cyber Threat Intelligence

• by Aaron Kaplan

The talk will be about use cases for LLMs and NLP in Cyber Threat Intelligence (CTI) report processing. It will focus on how to measure the quality of Large Language Models (LLMs). We will highlight lessons learned from creating a benchmark dataset for CTI report summarisation.

Hot Topics & Latest News:
Do you have some interesting breaking news about Deep Learning? Did you read an interesting paper that you want to share? Did you create an exciting application or achieve some break-through? It would be great to share this in our meetup's Hot Topics section! Please get in touch through contact@vdlm.at

PS: Cloudflight kindly provides drinks and snacks.

We are looking forward to seeing you at our next meetup!