Python Ireland August 2025 Meetup

=============================

Talk: Voice of the Customer (VoX): Building LLM Applications for Natural Language Feedback Analysis with LangChain

This talk details the architecture and implementation of a Python-based backend for a customer feedback analysis platform. Key technologies include LangChain for coordinating Large Language Model (LLM) operations and FastAPI for the API framework.
The platform is designed with a provider abstraction pattern, enabling seamless integration of multiple LLM providers. For data processing, it employs Sentence Transformers to perform semantic search and vector-based retrieval. The primary data layer is Snowflake, which manages both data storage and vector similarity searches on the feedback data.
Key implementation details covered include:

• Structured Output: Pydantic is used for parsing and managing structured output.
• Prompt Engineering: The talk will discuss specific techniques for handling prompts.
• Processing Pipeline: A multi-stage pipeline is used for query analysis, embedding retrieval, and generating responses.
• Deployment: The system is deployed using Conda for environment management and Docker for containerization.

The presentation will offer practical code examples and discuss architectural decisions, emphasizing modularity and scalability for building production-ready LLM applications. It is targeted at Python developers who are interested in creating real-world LLM systems, integrating semantic search, and utilizing modern data infrastructure like Snowflake. The main technical focus areas are LangChain integration, multi-LLM architecture, and semantic search with embeddings.

Author: Marios Sirtmatsis

[Meet Mario, a Data Scientist at Personio in Munich who transforms complex data into strategic business solutions. With a robust background in Data Engineering and Machine Learning from TUM and UMass Amherst, his career has spanned diverse challenges, from creating digital twins at Bosch Rexroth to developing legal NLP for contract fairness at Mercedes-Benz. At Personio, he tackles critical projects like churn prediction and is particularly passionate about demystifying Large Language Models, moving them beyond "black box" magic to create reliable, structured applications. This drive led his team to build "VoX," an innovative hackathon project that analyzes customer feedback using natural language—a platform he's excited to present. An active member of the 2hearts community, which champions diverse tech talent, Mario is eager to connect with the Python Ireland community to share ideas on ML, MLOps, and the future of AI.]

=============================

Venue: Personio

Big thanks to our sponsor for this edition: Personio