AZ Data Platform

# Title: The intersection of artificial intelligence and testing data

Due to an unforseen scheduling conflict with our speaker, we had to reschedule last week's meeting

Please join us next Wednesday, June 17th

Location: Join: https://teams.microsoft.com/meet/26243549993343?p=6y1ujugWZDLE6JyN6W

Description

The AI-Data Connection Why good AI systems require quality data and vice versa Real-world comparison: What took weeks in 2017 now takes minutes in 2024 How machine learning has revolutionised data processing workflows Traditional Testing Challenges The limitations of manual, rule-based testing approaches Why human error and bias persist in data validation The shocking reality: Only 5 out of 50 professionals do unit testing in data environments AI-Powered Solutions Generating synthetic test data that matches production environments Automated data verification and validation at scale Using Generative Adversarial Networks (GANs) to create realistic test datasets Implementing security scanning before code even reaches source control Test-Driven Development for Data Why writing tests first changes everything How to shift from reactive to proactive quality assurance Practical approaches to continuous integration, delivery, and deployment Real-World Applications Case studies from working with MongoDB, Databricks, and major security firms Tools and frameworks: Mabel, Great Expectations, and more How to protect production data while maintaining realistic test environments Key Takeaways: ✅ AI won't replace data professionals—it will empower them ✅ Synthetic data generation solves PII concerns while maintaining test accuracy ✅ Early detection (on your laptop) beats client-discovered bugs every time ✅ Test coverage means nothing if tests are written to pass, not to validate ✅ DevOps principles apply to data: automate the toil, focus on architecture About Hamish Watson: Hamish is a Microsoft MVP for Data Platform (8+ years) and AI (1+ year), specializing in DevOps with databases. Through his company "Make Stuff Go," he helps organizations understand AI, data, and cloud technologies. He's passionate about community education, mentorship with universities, and making technology accessible to everyone. Hashtag: #MakeStuffGo Whether you're a data engineer, QA professional, developer, or technology leader, this session offers practical insights into leveraging AI for better data quality and faster delivery cycles. Perfect for anyone interested in DevOps, data quality, test automation, or AI implementation. Topics: #AI #DataTesting #TestDrivenDevelopment #DevOps #SyntheticData #MachineLearning #DataQuality #Automation #CICD #MicrosoftMVP #DataEngineering #QualityAssurance

Speaker: Hamish Watson, Microsoft MVP for Data Platform and AI, as he explores the critical intersection of artificial intelligence and data testing. In this engaging talk, Hamish shares insights from over 20 years in technology, demonstrating how AI can transform the way we approach data quality, testing, and validation.

Speaker:

Agenda: 5:00 pm Networking
5:30 Presentation