Skip to content

Learning Hadoop the Hard Way, and Machine learning algorithms for manufacturing

Photo of Chris Hyland
Hosted By
Chris H.
Learning Hadoop the Hard Way, and Machine learning algorithms for manufacturing

Details

This month's meetup is sponsored by Sky Betting and Gaming, so thank you to them for supplying the pizza and beer!

This time at the Big Data Manchester meetup we have 2 quite different talks from recent ones, first about learning hadoop using a cluster of Raspberry Pi's, and then a talk about using machine learning algorithms for manufacturing systems.

Agenda
6:30pm - Networking
7:00pm - Learning Hadoop the hard way
7:45pm - Machine Learning algorithms for manufacturing systems
8:15pm - Networking

Learning Hadoop the Hard Way

There are many components that make up the Hadoop ecosystem, choosing how to start and what to learn can be daunting. But as a data professional you have to keep learning and people learn in different ways. So how about a challenge ? starting from scratch create a 5 node Raspberry Pi cluster that can run Hadoop, Hive, Pig, Hbase, Spark, Oozie, Solr and the Hue frontend - oh and can you make it recreatable by using an infrastructure as code tool such as chef, and lots of docs and a tutorial video ?

Andy Burgin is Lead Devop Engineer in the Data Tribe at Sky Betting and Gaming, he'll explain the motivations for the undertaking of this "extra curricular" project, the hardware, the software, the challenges and the lessons learned - and yes there will be a demo of the cluster in action.

Machine learning algorithms for manufacturing systems

Machine learning algorithms for control and prediction in manufacturing systems running under a lambda / kappa architecture using Kafka and Flink on a Hadoop cluster

Carl Berry is lecturer in Robotic Engineering at the University of Central Lancashire

Photo of Big Data Manchester group
Big Data Manchester
See more events
Rental Cars
35 Fountain Street · Manchester M2 2AN