QA Meetup Nairobi- Feb 28

## Testing used to be simple.

Assertions were binary. Outputs were deterministic. Pass meant pass. Fail meant fail.
Then LLMs entered the system.
Now:

• The same input gives different outputs.
• String matching fails even when the answer is “correct.”
• Small prompt tweaks break everything.
• Production behavior drifts over time.
• Traditional test suites feel… irrelevant.

If you're building AI-powered features, you’ve probably felt this shift. Your old testing mental models no longer apply — and it’s frustrating.

***

### This Meetup

will help QA engineers, SDETs, and product teams move from confusion to clarity when testing LLM-based systems.
Instead of trying to force AI into traditional frameworks, we’ll explore how testing itself needs to evolve.
This is a practical, experience-driven conversation on what actually works when testing LLM applications in the real world.

***

### What We’ll Cover (In Short)

• The Death of Assertions
  Moving from binary pass/fail to probabilistic evaluation, vibe checks, and LLM-as-a-Judge.
• Prompts Are Code
  Why QA now includes prompt engineering and how small wording changes can create massive behavioral shifts.
• The Chaos Monkey by Default
  Handling non-determinism, randomness, and model drift in production systems.
• The New QA Toolkit
  Building Golden Datasets, using semantic similarity over string matching, and practical approaches that have worked in real-world testing.

🎯 Why You Should Attend

• 🤝 Meet and connect with QA professionals from Nairobi’s growing tech ecosystem
• 📚 Learn from real-world implementation stories
• 💬 Share your challenges and get practical solutions
• 🌱 Expand your professional network in a supportive, safe space
• 🚀 Stay ahead of how AI is reshaping testing careers

***

QA is evolving fast — and so should we.
Come as you are. Bring your curiosity. Leave with new ideas, connections, and inspiration.
We can’t wait to see you in Nairobi on Feb 28!