addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Re: [codecrewny] Data Analysis and working with NYC Open Data

From: Saikiran Y.
Sent on: Tuesday, November 5, 2013 2:56 PM
Visualizing data is different topic of discussion since it involves taking datasets, categorizing into clusters, formatting and then performing additional processing like classification trees and so on. Once the output is to your liking, you can use tools like D3, Visual.ly, Flot, Excel etc. You don't need to be a scientist but knowing how the data should be represented cannot be summed up in this email.

As per pulling data, its fairly simple to do. Most of them provide a REST API that you can pull at once or periodically. There are plenty of tools available in pulling data, but the easiest is "requests" python library. You can get started literally in 5 mins. 
Most API's  are open, so you simply pull the data using the given URL, but some require you to register with them. In return they will give you a API Key, which you need to either munge it using a secret key or send it as is [usually in the request HEADER ].
Most dataset API's are considerate towards data mining/analysis, so they will return CSV formatted files. But if not, then its almost always JSON format, which you can take and perform data prep for your analysis.

I don't do extensive data mining but I am somewhat reluctantly in the process.

Hit me up if you wanna talk.


On Tue, Nov 5, 2013 at 2:34 PM, Rick Colosimo <[address removed]> wrote:
Dear Bianca,

I'm just figuring this out myself with Ruby+Rails. The things you'll want to search on are REST and .json in the language or tool you want to use. That's the common entry point, it seems, to many open APIs.

Thanks,

Rick

Richard J. Colosimo

On Nov 2, 2013, at 18:29, Bianca <[address removed]> wrote:

I'm trying to learn how to work with NYC open data and APIs in general, but I'm not really sure where to begin. I've tried to Google this, but have been unable to find a high-level overview of how to approach this.

Has anyone in this group worked with data sets and knows how to visualize data? I need a very beginner explanation of how to do this.

Let me know! Maybe we can meet at GA or some coffee shop.

Thanks,

Bianca




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Bianca ([address removed]) from Code Crew - Let's Learn to Code Together!.
To learn more about Bianca, visit his/her member profile

To report abuse or block this person, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Rick Colosimo ([address removed]) from Code Crew - Let's Learn to Code Together!.
To learn more about Rick Colosimo, visit his/her member profile

To report abuse or block this person, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]



--
Sai
[masked]

Our Sponsors

  • Microsoft

    Microsoft provides space for our meetups and study groups.

  • WeWork

    WeWork provides space for our meetups and study groups

  • Code School

    Code School provides Swabbies with a free 48 hour hall pass.

  • Thinkful

    Swabbies get $50 off each month of Thinkful's online mentorship course.

  • Treehouse

    Treehouse provides a special rate for Swabbies; inquire at our meetups!

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy