PyData MU Official Launch (DevCon)
Details
Official launching of PyData Mauritius
Session on Real-Time Data Processing with Kubernetes and Spark
Combine the power of Kubernetes for scalable infrastructure and Apache Spark for real-time data processing.
In this session, we will demonstrate how to deploy Spark on Kubernetes for scalable, real-time analytics. Learn about:
• Dynamic Scaling: Managing Spark clusters with Kubernetes for optimal resource usage.
• Real-Time Streaming: Processing live data feeds with Spark’s structured streaming.
• CI/CD Integration: Automating deployment for data pipelines.
Ideal for DevOps engineers, Data Scientists, Data Engineers, and Cloud Architects, this talk will include a live demo showcasing real-time data insights.