Wroclaw Open Source Meetup #19

As autumn arrives, so does Wroclaw Open Source Meetup!

We are back after the summer break with its 19th iteration.

Save the date - October 8th, 18:00. As always, we have prepared two presentations, two Q&A sessions, and an afterparty where you can meet fellow tech enthusiasts and socialize with like minded professionals.

Most importantly, we are looking forward to meeting you! Our team will be there, ready to chat, answer your questions, and share our passion for open source.

Agenda:

1. Brief overview of large language model benchmarks; Jan Tacakiewicz, Antmicro

This presentation provides an overview of benchmarking methods for large language models, examining both the approaches used to evaluate model performance and how those strategies have changed. We will explore approaches to measuring model capabilities across diverse domains including reasoning, knowledge, coding, and agentic workflows. Domain-specific suites will be compared along with their design principles and limitations. We will also discuss challenges facing evaluation: data contamination, training data leakage, benchmark decay, and solution hacking. Finally, we will review emerging best practices for future-proof LLM evaluation.

2. Abstracting The Hardware: Bridging Renode and Ghidra for Embedded Vulnerability Research; Dawid Pietrykowski, Antmicro

Physical hardware is the biggest bottleneck in embedded vulnerability research. No exposed JTAG, long boot sequences, risk of bricking your board and the challenge of actually getting your hands on a target device make reverse engineering of those platforms a painfully slow process. But what if you could leave the physical board behind entirely? What if you could go from unknown firmware binary to a full exploit without leaving your computer?
In this presentation we'll talk about how to use Renode, a simulation framework developed by Antmicro, together with the Ghidra Software Reverse Engineering (SRE) tool that was developed by the National Security Agency (NSA). We'll demonstrate how using these tools enables advanced research techniques, allowing you to trace execution, manipulate memory, and weaponize vulnerabilities in software.

Registration:
Attending the event involves a registration at the entry based on the meetup attendee list. You will be asked to provide your name and surname. You have to be an adult to attend. Upon entering the venue, you agree that you might be photographed/filmed.

Schedule:
18:00-18:30 - Registration & coffee
18:30-20:15 - Talks and Q&A
20:15-22:00 - Afterparty

Afterparty:
After the presentations, stay with us for socializing and more discussions at the evening afterparty sponsored by Antmicro with a delicious cold and hot dinner menu, and a selection of regional craft beer and drinks!

Venue:
Concordia Design, Widok hall
Wyspa Slodowa 7, Wroclaw