Testing in Production (Talia Nassi - AWS) & Shift Right (Jome Princil - Funda)

Dit is alweer de 3e MeetUp in 2022 op het kantoor van deTesters - TestCoders - TechChamps in de Werkspoorkathedraal in Utrecht.
En het belooft een topavond te worden met 2 interessante talks.

De eerste spreker is Talia Nassi, met een presentatie over Testing in Production. Eind 2019 kwamen wij met een deel van deTesters Talia Nassi tegen op de ConTest conference in New York, waar zij sprak over Testing in Production. Een talk waar wij zeer enthousiast over waren. Wij hebben daarna veel contact gehouden, en ze zou al een paar keer naar Nederland zijn gekomen. Corona gooide meerdere malen roet in het eten, maar nu is het dan eindelijk zo ver.

Na de pauze gaan we verder met een praktijkverhaal over de toepassing van Shift Right bij Funda. In april 2021 hebben wij een online Meetup over dit onderwerp gehouden, met Maarten Groeneweg van Funda als presentator. Dit bleek onze populairste online Meetup van het jaar te zijn, dus herhalen we nu dat verhaal. We zijn een jaar verder, dus het is zeker geactualiseerd. En deze keer wordt het gepresenteerd door een test automation collega van Maarten: Jome Maria Princil.

1. Testing in Production, door Talia Nassi

How do you know your feature is working perfectly in production? If something breaks in production, how will you know? Will you wait for a user to report it to you? What do you do when your staging test results do not reflect current production behavior? If you want to test proactively as opposed to reactively, try testing in production!

By testing in production, you have increased accuracy of test results, your tests will run faster due to the elimination of mocks and bad data, and you will have higher confidence before releases.

You can accomplish this through feature flagging, continuous delivery, and data cleanup. Only when your end-to-end tests pass in production will you know that your features are truly working. After this session Talia Nassi will leave you with strategies to mitigate risk, to better your understanding of the steps to get there, and to shift your company’s testing culture, so you can provide the best possible experience to your users.

In this talk, you'll learn:
· You will learn how to safely test your code in production
· You'll learn how to use feature flagging
· How to mitigate risks of testing in production
· You'll learn how to shift your company’s testing culture

2. Shift Right, een praktijkverhaal over Funda, door Jome Maria Princil

As engineers, at Funda, we get energy out of delivering value for our users. Therefore, we strive to release frequently and safely to production.
For this, we conduct several tests prior to deployment and release to production. All these tests focus on fast feedback, error detection and prevention and are referred to as pre-production tests or Shift Left. These include but are not limited to methods and techniques like code reviews, unit testing, component testing and exploratory testing.
Complimenting Shift Left activities, we need to measure quality during and after deployment and release to production. This is referred to as Testing in Production or Shift Right. Think of, for example, canary testing/deployments, monitoring, A/B testing, chaos testing and measuring business metrices.

As Test Automation Engineers, we are increasingly becoming active in DevOps teams with focus on both Shift Left and Shift Right. And so, it makes sense to have knowledge of the practices and tools that are used in the deployment, release, and post-release phases in addition to knowledge of programming and development tools.

Jome Maria Princil takes you through the Shift Right strategy of Funda, how they evolved from bi-weekly production releases and tweaked their pre-production test strategy to free up time and resources to focus on Testing in Production.

De twee presentatoren
Talia Nassi is a Senior Developer Advocate at Amazon Web Services (AWS) and international keynote speaker who delivers content on all things serverless. She enjoys helping developers understand how to build efficient serverless applications seamlessly and at scale.

Jome Maria Princil is a senior QA Engineer at Funda. She started out as a Datawarehouse Tester 15 years ago and has been with Funda for 7 years now.

Doelgroep

• testers met een technische achtergrond en interesse voor / ervaring met testautomatisering
• deze avond is deels in het Nederlands; de beide presentaties zijn in het Engels

Programma
17:30 Ontvangst en eten
18:30 Talk 1: Testing in Production, door Talia Nassi
19:30 Pauze
20:00 Talk 2: Shift Right, een praktijk-verhaal over Funda, door Jome Maria Princil
20:45 Afsluiting met aansluitend een borrel