Past Meetup

Commercializing Analytics, ML and AI & Ted Dunning (Kubernetes and Big Data )

This Meetup is past

120 people went

Location image of event venue

Details

Presentation 1 - Marta Portugal & Vicky Byrom - Merkle|Aquila - Commercializing Analytics, Machine Learning and AI

Marta Portugal - https://www.linkedin.com/in/martaportugal

Vicky Byrom - https://www.linkedin.com/in/vicky-byrom-00270582

Vicky is the Head of Analytics at Merkle|Aquila. She has over 20 years experience in delivering analytics and actionable insights to large organisations. She is passionate about incorporating latest analytical developments into practical analytical solutions for our clients. As both a statistician and management accountant she bring a strong value focus to analysis – both customer value and marketing optimisation
Vicky’s aim is to take the complexity out of analytics. She is a firm believer that analytics should be delivered in the right language - not shrouded in complex jargon and latest buzz words.

Marta is a Senior Data Scientist at Merkle|Aquila. She has graduated with a MSc in Statistics and Operations Research and has since gained expertise in using statistical and ML techniques including image analysis (real time), predictive modelling, segmentation, neural networks and random forests in order to improve customer acquisition and retention. Marta devotes a lot of her time developing and mentoring junior data scientists within the organisation and has recently developed Merkle|Aquila’s Graduate Programme.

Ted Dunning - Chief Application Architect at MapR - https://www.linkedin.com/in/teddunning

Kubernetes and Big Data

The folk wisdom has always been that when running stateful applications inside containers, the only viable choice is to externalize the state so that the containers themselves are stateless or nearly so. Keeping large amounts of state inside containers is possible, but it’s considered a problem because stateful containers generally can’t preserve that state across restarts.

In practice, this complicates the management of large-scale Kubernetes-based infrastructure because these high-performance storage systems require separate management. In terms of overall system management, it would be ideal if we could run a software-defined storage system directly in containers managed by Kubernetes, but that has been hampered by lack of direct device access and difficult questions about what happens to the state on container restarts.

Ted Dunning describes recent developments that make it possible for Kubernetes to manage both compute and storage tiers in the same cluster. Container restarts can be handled gracefully without loss of data or a requirement to rebuild storage structures and access to storage from compute containers is extremely fast. In some environments, it’s even possible to implement elastic storage frameworks that can fold data onto just a few containers during quiescent periods or explode it in just a few seconds across a large number of machines when higher speed access is required.

The benefits of systems like this extend beyond management simplicity, because applications can be more Agile precisely because the storage layer is more stable and can be uniformly accessed from any container host. Even better, it makes it a snap to configure and deploy a full-scale compute and storage infrastructure

Agenda:
6:30 PM – 7:00 PM: Networking
7:00 PM – 7:30 PM: Marta Portugal & Vicky Byrom - Merkle|Aquila
7.30 PM – 7.45 PM: Q & A Session
7:45 PM – 8:15 PM: Ted Dunning - Chief Application Architect at MapR
8:15 PM – 8:30 PM: Q & A Session
8.30 PM - 9.00 PM: Networking and Drink