Name: Building Trustworthy LLM Pipelines
Start: 2025-06-09T18:00:00+02:00
End: 2025-06-09T20:00:00+02:00
Location: ICT Hub Kralja Milana

As part of **AI Week**, **Machinery** is organizing a workshop focused on two essential components of modern LLM-based systems: structured outputs and RAG evaluation.

The first session will cover how structured outputs can reduce model errors, enforce schema consistency, and support tasks like document data extraction and Retrieval-Augmented Generation (RAG). Tools such as Pydantic and Visual Language Models will be introduced, along with techniques for contextual metadata generation and structured reasoning.

The second session will focus on evaluating RAG pipelines using standard metrics (e.g., recall@k), LLM-based tools like DeepEval and RAGAS, and custom evaluation criteria for citation accuracy, content quality, and formatting. Participants will also define their own metrics suited to real-world applications.

The workshop is intended for professionals developing or evaluating LLM-based systems.

Ilija Lazarevic

Data Science Club

Technology

Open Source

AI and Society

Data Science

Data Science using Python

Data Architecture

Artificial Intelligence

AI Algorithms

Machine Learning

Data Science using R

Big Data

Data Science for Business

Machine Learning Apps

Machine Learning with Python

Automated Machine Learning

Machine Learning Interpretability

Building Trustworthy LLM Pipelines

ICT Hub Kralja Milana

Share

Data Science Club

Building Trustworthy LLM Pipelines

Data Science Club

Details

Members are also interested in