Big Data with Spark on Apache Mesos

Target audience:

DevOps, IT, Big Data engineers, Architects

Abstract:

In this meetup we will see how Apache Mesos, the Open Source container cluster manager, can help organizations improve resource utilization and run their apps side by side with their Big Data workloads as well as deploy containerized HDFS nodes.

What will you learn:

• What is Apache Mesos

• Apache Mesos & Container Management core principals

• Overview of Apache Spark

• Differences between YARN & Mesos as Resource Managers

• How to deploy Spark on Mesos side by side with other containers

• Using Mesos to deploy an entire HDFS cluster

Presenter: Yaron Schneider ( https://il.linkedin.com/in/yaron-schneider-2130b7a3 ): Yaron Schneider is a Cloud Solution Architect at Microsoft, working with Startups and Enterprises on embracing the cloud and bleeding edge technologies. Yaron has an extensive knowledge of modern web application workloads, Open Source technologies, Big Data and Analytics as well as networking and infrastructure.Prior to his work with Microsoft Yaron was a CTO at IronSource, a leading ad-tech startup, where he helped architect and build a high throughput and low latency mission critical system.