Realtime ML + Kubernetes + TensorFlow + KubeFlow + MLflow + PipelineAI + PyTorch

Are you going?

63 people going

Share:

New York Hilton Midtown

1335 6th Ave · New York, NY

How to find us

OPEN TO THE PUBLIC - NO CONFERENCE TICKET IS NEEDED

Location image of event venue

Details

OPEN TO THE PUBLIC - NO CONFERENCE TICKET IS NEEDED

THIS SESSION WILL BE RECORDED AND POSTED TO THE FOLLOWING:

https://youtube.pipeline.ai
https://slideshare.pipeline.ai

Talk 1: Real-Time, Continuous ML/AI Model Training, Optimizing, and Predicting with Kubernetes, Kafka, TensorFlow, KubeFlow, MLflow, Keras, Spark ML, PyTorch, Scikit-Learn, and GPUs

We will cover a lot of topics from this blog post: https://medium.com/@PipelineAI/slack-after-dark-by-pipelineai-ba2ec2397c3a (https://www.youtube.com/watch?v=kuiUSXniDaI)

Chris Fregly, Founder @ PipelineAI, will walk you through a real-world, complete end-to-end Pipeline-optimization example. We highlight hyper-parameters - and model pipeline phases - that have never been exposed until now.

Through a series of live demos, Chris will create and deploy a model ensemble using the PipelineAI Platform with GPUs, TensorFlow, and Scikit-Learn.

While most Hyper-parameter Optimizers stop at the training phase (ie. learning rate, tree depth, ec2 instance type, etc), we extend model validation and tuning into a new post-training optimization phase including 8-bit reduced precision weight quantization and neural network layer fusing - among many other framework and hardware-specific optimizations.

Next, we introduce hyper-parameters at the prediction phase including request-batch sizing and chipset (CPU v. GPU v. TPU). We’ll continuously learn from all phases of our pipeline - including the prediction phase. And we’ll update our model in real-time using data from a Kafka stream.

Lastly, we determine a PipelineAI Efficiency Score of our overall Pipeline including Cost, Accuracy, and Time. We show techniques to maximize this PipelineAI Efficiency Score using our massive PipelineDB along with the Pipeline-wide hyper-parameter tuning techniques mentioned in this talk.

Bio

Chris Fregly is Founder and Applied AI Engineer at PipelineAI, a Real-Time Machine Learning and Artificial Intelligence Startup based in San Francisco.

He is also an Apache Spark Contributor, a Netflix Open Source Committer, founder of the Global Advanced Spark and TensorFlow Meetup, author of the O’Reilly Training and Video Series titled, "High Performance TensorFlow in Production with Kubernetes and GPUs."

Previously, Chris was a Distributed Systems Engineer at Netflix, a Data Solutions Engineer at Databricks, and a Founding Member and Principal Engineer at the IBM Spark Technology Center in San Francisco.

More to come...