Spark 2.3 Update, Machine Learning Pipelines Intro, and CI/CD Howto

Two presentations from Databricks tonight!

First, Joe Kambourakis will focus on new updates from the March release of Spark 2.3 such as streaming, vectorized UDFs, and Kubernetes. Next, he'll go through an introduction to Spark machine learning pipelines with Decision Tree Classifier models.

Next, Pete Tamisin will show how to use the Databricks REST API and built in integration with Github to build Continuous Integration/Deployment/Delivery (CI/CD) pipelines for your notebooks and jobs. His talk will focus on using Jenkins and Python scripts to deploy promoted code branches to various environments and on running smoke tests to validate each deployment.

Speakers:
Joe Kambourakis is a data science instructor at Databricks. He has more than 10 years of experience teaching, over five of them with data science and analytics. Previously, Joseph was an instructor at Cloudera and a technical sales engineer at IBM. He has taught in over a dozen countries around the world and been featured on Japanese television and in Saudi newspapers. He is a rabid Arsenal FC supporter and competitive Magic: The Gathering player. Joseph holds a BS in Electrical and Computer Engineering from Worcester Polytechnic Institute, and an MBA with a focus in Analytics from Bentley University. He lives with his wife and daughter in Needham, MA.

Over the course of his 20+ year career, Pete Tamisin has fulfilled many roles, including consultant, solution architect, database administrator, data modeler, web developer, trainer, team leader and product manager. Based in Atlanta, GA, Pete has delivered projects of varying sizes across multiple verticals, including utilities, financials, higher education and manufacturing. Currently, he is a Customer Success Engineer with Databricks, where he provides customers with the support, training and information they need to be successful on the Databricks platform.