DESG 29 Oct 2026 Meetup @ Credit Agricole CIB
Details
Halo Data Engineers Singapore!
We are excited to welcome Thusitha Niroshan Kularathna & Boomi Nathan to talk about:
Autoscale Spark Streaming Workloads Using KEDA - by Thusitha
When running infrequent or episodic ETL pipelines, keeping Spark clusters continuously running wastes valuable resources. By pairing Event-Driven Architecture (Kafka) with Kubernetes Event-driven Autoscaling (KEDA), compute can scale down to zero when idle and trigger spark jobs only when data arrives—delivering maximum cost efficiency without operational overhead..
Running AI Agents in Production - by Boomi
Moving AI agents from a local sandbox to enterprise production requires more than just functional prompts—it demands robust infrastructure, strict guardrails, and secure foundations. This session explores how to design AI Landing Zones to safely operationalize autonomous workflows at scale.
Expected agenda:
6.30pm - 7.00pm - Registration, Food & Networking
7.00pm - 7.45pm - Presentation & QnA by Thusitha
7.45pm - 8.30pm - Presentation & QnA by Boomi
8.30pm – 9.00pm - Post-event Networking
Hope to you all soon!
Cheers!
DESG
