From Silent Data Failures to Enforceable CI/CD Gates
Details
UPDATE - Event has changed from hybrid to virtual only. Please do not visit VRP today.
-In Continuous Integration(CI) and Continuous Deployment (CD)
Virtual-only event: Zoom and YouTube
If you want to join remotely, you can submit questions via Zoom Q&A.
https://acm-org.zoom.us/j/92575634168?pwd=VqxYn5UUirU24bLGbdKOOd210g9aHu.1
Join via YouTube:
https://www.youtube.com/live/KJaHDKLfBMU
AGENDA
7:00 SFBay ACM upcoming events, introduce the speaker
7:15 speaker presentation starts
8:15 - 8:30 finish, depending on Q&A
Join SF Bay ACM Chapter for an insightful discussion on:
Continuous Integration (CI) is the practice of frequently merging code changes into a shared repository, triggering automated builds and tests to detect conflicts and errors early. Continuous Deployment (CD) is an extension of this process that automatically releases validated code changes directly to the production environment without manual intervention.
Talk Description:
Traditional CI pipelines answer whether code builds and tests pass, but data pipelines can deploy successfully while producing incorrect data. This session presents four enforceable gates organized by the defects they catch: transformation correctness, cross-system integration, contract compliance, and production observability. It explains which gates should block merges, which should block deployments, and how production incidents should become lower-layer regression tests. Examples use Spark, Kafka, CDC, and lakehouse failure modes.
Speaker Bio:
Kunal Jain, Software Engineer 3 at Adobe. I build and operate large-scale data platforms and hold a Master of Software Engineering in Scalable Systems from Carnegie Mellon University. I previously spoke at STAREAST 2026.
Links: https://kunal-jain.com | https://linkedin.com/in/kunalpjain
