Workshop - Data Science In the Cloud Using Amazon

Zaponet - data science solution is proud to host half a day workshop about data science in the cloud

Co-sponsored with the Israeli Statistics Association

Audience: data scientists, data engineers and sysadmins

Agenda:

09:30 – 10:30 AWS Overview:

Presenter:  Guy Ernest

(*) The reason behind Amazon Web Services (unified API, Global infrastructure, pay for what you use..)

(*) The many AWS services: S3, EC2, EMR, EBS, AMIs, DynamoDB, SQS

(*) The AWS pricing model (on demand, reserved instances and spot instances)

10:30 – 11:30 Data Analysis Workflow

Presenter: Jonathan Rosenblatt

(* )Workflow of analyzing data using R (or the software of your choice)  on a remote cloud machine: connecting to the machine using RStudio server, uploading data, downloading results, scaling up and down on the fly.

(*) Why a cloud machine? 

(*) Why a cluster of cloud machines? 

11:30 – 11:45 Coffee Break 

11:45 – 12:45 setting Up An Analysis Environment:

Presenter: Guy Ernest

(*) Gathering logs

(*) Analyzing sample logs: Setting up a single machine: launching an instance, firewall (RStudio server uses port 8787), connecting to the machine (remote desktop & ssh) creating an AMI, upgrading the machine, using EBS and S3,sharing AMIs,

 

12:45 – 13:45 Setting Up The Analysis Environment –Advanced Topics:

Presenter: Guy Ernest

(*) Running MapReduce cluster process on the logs - how to optimize your EMR cluster

(*) Setting up a redshift cluster: Copy clean logs data into the cluster

(*) Connecting to the cluster with the above RStudio instance and also BI tool (Tableau)

(*) Managing costs.


Bio:
Guy Ernest is part of the solutions architecture team of Amazon Web Services, where he helps customers with their first and advanced steps in the cloud.
Guy specialized in Big Data, Analytics and Machine Learning, thanks to his background in these fields prior to joining AWS. Guy founded a couple of start up companies in personalization, mobile search and big data analytics.

Jonathan Rosenblatt is a postdoctoral researcher in the The Faculty of Mathematics and Computer Science at the Weizmann Institute of Science.
Jonathan uses the AWS cloud on a regular basis to analyze neuroimaging and genetic data, typically with R.

 

Join or login to comment.

  • Avi W.

    תשובות ממפגש ביג דאטה
    http://bitly.com/1hH6ICU

    December 26, 2013

  • Asaf B.

    I would like to thank Guy and Jonathan for the great workshop.
    One presentation can be found under the "Files" menu and the other
    Part 1: https://www.dropbox.com/s/p4i0ljm03yp4mis/Machine%20Learning%20in%20AWS%20Cloud%20P1.pdf
    Part 2: https://www.dropbox.com/s/9oo8wp94dqcc7bv/Machine%20Learning%20in%20AWS%20Cloud%20P2.pdf

    December 23, 2013

  • Eitan W.

    great intro to the aws solutions available. cudos to guy for a great overview

    1 · December 23, 2013

  • Gilad B.

    Jonathan's deck was great

    December 23, 2013

  • Ran L.

    Great presentations! Learnt some new, hands-on stuff, which doesn't happen very often on meetups.

    December 23, 2013

  • Meltzer

    Well presented overview of the aws offering. The meetup title was misleading.

    1 · December 23, 2013

  • Ron S.

    It would have been better to start describing a typical flow and demo the varoius Amazon offerings as we go along. I gave up at 13:15

    December 23, 2013

  • Asaf B.

    The meetup main focus is data-science and not big data. In addition each of the infra presented are scalable to handle massive amounts of data. If there are specific question ask the instructor.

    1 · December 23, 2013

  • Eddie P.

    Still no Big Data...

    December 23, 2013

  • David M.

    up to11am we did not start talking about BigData. Just general AWS stuff. Disappointing.

    December 23, 2013

  • Ron S.

    will we be getting the slides?

    December 23, 2013

  • zahiro

    what are the parking procedures?

    December 22, 2013

  • Jack Y.

    Hey! We're looking for a data scientist / entrepreneur to join our seed funded team. I'll be at the event so if you happen to be one, and you're available, shoot me an email (private) and meet me there!

    This shows a bit of the dataset: https://vimeo.com/70917361

    Jack

    December 22, 2013

  • Dan

    How can I get the free parking permit?

    October 25, 2013

Our Sponsors

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more
Allison

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy