Zum Inhalt springen

Unstructured Data in LLMs

Foto von Stephen
Hosted By
Stephen
Unstructured Data in LLMs

Details

Topic: Connecting your unstructured data with LLMs
​We are meeting for another happy hour/discussion group about Unstructured Data and its future in machine learning and LLM apps!

What we’ll do:
Have some snacks and refreshments. Have a couple of talks and then unstructured networking.

***

Schedule
6:00-6:55 - Open Doors, food and open networking
7:00-7:30 - MultiModal RAG using vLLM and Pixtral from Mistral AI - Stephen Batifol, Zilliz
7:30-8:00 - LLM Agent Observability: Lessons Learned from Real-World Applications - Dat Ngo, Arize
8:00-8:05 - Small Break
8:05-8:30 - Structuring Unstructured Text using generative AI: The key to information extraction - Oren Matar, Anaplan
9:00-10:00 - Networking

Who Should attend:
Anyone interested in talking and learning about Unstructured Data and LLM Apps.

When:
Nov 14nd, 2024
6:00PM
42 Berlin

Sponsored by Zilliz & Arize

***

Tech Talk 1: MultiModal RAG using vLLM and Pixtral
Speaker: Stephen Batifol, Developer Advocate, Zilliz
Abstract: While text-based RAG systems have been everywhere in the last year and a half, there is so much more than text data. Images, audio, and documents often need to be processed together to provide meaningful insights, yet most RAG implementations focus solely on text.

In this talk, we'll explore the architecture that makes it possible to run such a system and demonstrate how to build one using Milvus, LlamaIndex, and vLLM for deploying open-source LLMs on your own infrastructure.

Through a live demo, we'll showcase a real-world application processing both images and text queries :D

Tech Talk 2: LLM Agent Observability: Lessons Learned from Real-World Applications
Speaker: Dat Ngo, Developer Advocate, Arize
Abstract: If you’re tired of the endless hype around Large Language Models (LLMs) and want to learn real, practical lessons, this talk is for you. We’ll cut through the noise and focus on actionable insights from real-world experiences with LLMs in production. Discover what observability truly means in the context of LLMs, as I share key lessons learned from customers who have successfully scaled their LLM applications. We’ll dive into best practices that can guide your team on its LLM journey, highlighting what works and what to avoid. Whether you’re just starting with LLMs or looking to optimize, expect actionable takeaways from some of the top LLM teams in the world that will help you succeed in the evolving AI landscape.

Tech Talk 3: Structuring Unstructured Text using generative AI: The key to information extraction
Speaker: Oren Matar, AI Researcher, Anaplan
Abstract: In the world of Natural Language Processing (NLP), we often need to extract some of the information from natural language into a structured format: for example, converting a natural query to SQL. Generative AI is a great tool for this task, however, transformer-based translation models, such as GPT, sometimes struggle to adhere to the desired format, and to support the variety of expression of a natural language. In this session we will delve into the intricacies of using transformer-based models to extract information from natural language to a predefined structure. We'll explore effective best practices, including Constrained Generative AI, a technique that can eliminate syntactic errors. Additionally, we will explore the pre-processing, data generation and augmentation methods that helped us achieve near-perfect accuracy in extracting dates and times from textual data. By the end of the session, you will gain insights into harnessing generative AI language models for structured output, opening doors to more accurate and efficient NLP applications.

​Check out Zilliz blog, join our Discord and Milvus Github

***

📸​​​Important note: Please be advised that this event will be recorded and photographed. If you prefer not to be included in any recordings or photographs, please do not hesitate to let us know during the event. Your comfort and privacy are important to us.

Photo of Unstructured Data Meetup Berlin group
Unstructured Data Meetup Berlin
Mehr Events anzeigen
42 Berlin
Harzer Str. 42 · Berlin, BE