DevOps for Generative AI & Implementing Team Topologies

Two exciting topics, two very experienced speakers, and many networking opportunities. We are very much looking forward to the next DevOps Meetup in Basel. We extend our heartfelt thanks to our location sponsor Letsboot and catering sponsor Roche for empowering us on this journey.

The agenda for the January 30th evening is as follows:

Agenda:
17:30 – 18:00 Arrival and Refreshments
18:00 – 18:05 Welcome Notes
18:05 – 18:50 DevOps for Generative AI: A LLMOps Journey
18:50 – 19:00 Break
19:00 – 19:45 Implementing Team Topologies
19:45 – 20:30 Networking & Apero

DevOps for Generative AI: A LLMOps Journey
The rise of generative AI introduces new complexities to DevOps. Unlike traditional software, managing generative AI involves various artifacts such as system instructions, RAG configurations, and prompt templates, making it challenging to ensure everything works as intended. In this session, Timo will guide you through the journey of implementing robust DevOps practices for Large Language Models (LLMs). Discover how to streamline your workflows, manage infrastructure, and ensure the reliable deployment of generative AI applications. We will explore how to integrate LLMs as judges to automatically check the performance of your models and deployments, ensuring quality and reliability. Learn from real-world experiences and best practices to optimize your LLMOps journey.

Timo Weiser
Senior Technical Consultant with a strong background in cloud architecture, Timo is a seasoned expert in designing and implementing complex IT solutions. With a passion for automation and efficiency, Timo brings a wealth of experience in cloud technologies, including Kubernetes, Terraform, and various programming languages. His expertise spans across multiple cloud platforms, and he holds certifications as a Professional Google Cloud Architect and Engineer.

Implementing Team Topologies
Team Topologies provides a powerful framework for shaping and optimizing team structures and interactions, enhancing your organizational agility and driving meaningful change within your teams. However, implementing Team Topologies can be challenging without the proper knowledge and guidance. In today's ever-evolving organizational landscape, it is crucial to adopt effective strategies that enable teams to thrive and deliver value consistently. This presentation explores our experience with Team Topologies, providing valuable insights and practical tips to successfully apply Team Topologies and harness its benefits. We will present how we structured the teams in order to enable close collaboration, make communication flow and drive change. By attending this presentation, participants will gain the knowledge and confidence to successfully apply Team Topologies and unlock the full potential of their teams. They will be equipped with practical tips and tricks, along with a tutorial on how to successfully apply the Inverse Conway Maneuver, our lessons learned from implementing it, and which benefits we got.

Marcelo S. Ancelmo
Marcelo S. Ancelmo has 23 years (and counting) of IT experience and has done a bit (or would it be a byte) of everything. A good old-fashioned troublemaker, he started his professional career as a Java programmer, played many architecture games (which he still does today), worked into middleware (and does not regret it), built some great teams, and did infrastructure and operations work. He did some consultancy, delivered a lot of training, has been a mentor, and spoke at conferences. He is deeply engaged with the software community, joining Meetups everywhere he goes, teaming up with JUGs, helping organize events when he has spare time, and participating in working groups and committees. He is the Head of Solution Architecture at KPMG Switzerland, helping the company drive its Technology transformation, still learning everything possible and enjoying all the bumps that come with it.