What we’re about
DevDay is a monthly informal event for developers to share their experiences, ideas, opinions & perspectives about technology.
Upcoming events (1)
See all- Practical Testing in Databricks: A Software Engineer’s Data Engineering JourneyQuality Court, London, WC2A 1HR, London
Bringing Structured Testing to Databricks Projects
Databricks offers a powerful and flexible environment for building data pipelines, but unlike some tools, it doesn’t provide a built-in framework for testing. This can leave data engineers wondering how to effectively validate their work.
In this session, Joey Lag will guide you through practical approaches to integrate structured testing into your Databricks projects. We’ll draw inspiration from established software engineering techniques to address common testing challenges. You’ll learn how to:
- Modularize PySpark transformations for efficient unit testing.
- Set up containerized environments with PySpark, Delta, and Kafka for seamless local development.
- Implement integration tests that accurately simulate real-world data flows.
We’ll also explore how these testing practices can be seamlessly incorporated into your CI/CD workflow, ultimately building greater confidence in your production data pipelines.
Our speaker, Joey Lag graduated in 2019 with an MEng in Acoustical Engineering from the University of Southampton. He started his career as a signal processing software engineer in 3D audio, before moving into platform engineering and, more recently, data engineering. Now a Solutions Consultant at Sahaj Software, Joey helps clients tackle complex software challenges. His core skills include Python, TypeScript, and C++. Outside of work, he enjoys music production, code art, and calisthenics.
🗓️ Save the Date: September 25th, 2025
📍 Location: Sahaj Software, 1 Quality Court, London, WC2A 1HR
🕕 Time: 6:00 PM – 8:00 PM (BST)
Join us for DevDay, a community event designed to spark conversations and share ideas around cutting-edge tech.
The evening will feature:
🎤 One engaging talk with Q&A
🤝 Plenty of time for networking over free pizza and non-alcoholic drinks
Don’t miss this chance to learn, connect, and share with fellow tech enthusiasts.👉 Please click the link below to register.
