Re: [betaNYC] Day care map project

From: Anita S.
Sent on: Monday, March 31, 2014 3:53 PM
Hi all,

The server of the DOHMH seems to be down right now, I hope it's not us sending too many requests!

Is anybody scraping right now? Make sure you put in long enough pauses between requests and don't run any scraping mindlessly.

Thanks, Anita


On Mon, Mar 31, 2014 at 1:58 PM, Baris Canatan <[address removed]> wrote:
Hi Steve,

The PHP script (on Github) was updated this weekend to include automatic geocoding through the google geocode api. In case someone want to use the PHP version.

Best,
Baris



Quoting Steven Romalewski <[address removed]>:

I've geocoded the file, in case you'd like the georeferenced version.  See attached.  I added three fields at the end of Chris's file - GeocodedCategory, Lat, and Lon.  The GeocodedCategory indicates the reference data I used for the geocoding (PAD2013 basically means it's geocoded to a building footprint; LION indicates the LION centerline file).  I can share the shapefile also if you'd like.


Steve

=======================================
Steven Romalewski
Director, CUNY Mapping Service
Center for Urban Research at The Graduate Center / CUNY
[cid:image001.png@01CF4CE3.7C483D70]

365 Fifth Ave., Room 6202
New York, NY  10016
Phone: [masked]
[address removed]<mailto:[address removed]>
www.urbanresearch.org<http://www.urbanresearch.org/>
www.urbanresearchmaps.org<http://www.urbanresearchmaps.org/>
@SR_spatial
=======================================

From: [address removed] [mailto:betaNYC-list@meetup.com] On Behalf Of Chris Whong
Sent: Saturday, March 29,[masked]:35 AM
To: [address removed]
Subject: Re: [betaNYC] Day care map project


I took a crack at this tonight.  Wrote a scraper in Ruby using the Mechanize gem.  It grabs all the goodies in the details pages for all 2200 daycares and outputs to CSV.

It doesn't grab the inspection results, but that wouldn't be too hard to add at this point.

I hope it helps!  Geocode it and you're ready to map!

Code here:
https://github.com/chriswhong/daycare_scraper/tree/master

Data here:
https://github.com/chriswhong/daycare_scraper/blob/master/29mar2014.csv

-Chris Whong




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed]<mailto:[address removed]>)
This message was sent by Chris Whong ([address removed]<mailto:[address removed]>) from #betaNYC, a Code for America Brigade for NYC<http://www.meetup.com/betanyc/>.
To learn more about Chris Whong, visit his/her member profile<http://www.meetup.com/betanyc/members/36926012/>
To report this message or block the sender, please click here<http://www.meetup.com/betanyc/abuse/36926012/?table_name=ml&table_id=66999862>

Set my mailing list to email me As they are sent<http://www.meetup.com/betanyc/list_prefs/?pref=1> | In one daily email<http://www.meetup.com/betanyc/list_prefs/?pref=2> | Don't send me mailing list messages<http://www.meetup.com/betanyc/list_prefs/?pref=0>

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]<mailto:supp[address removed]> [http://www.meetup.com/t/img/ml2/blank.gif]




Vriendelijke groeten,
Baris Canatan
Omnisite Webservices
http://www.omnisite.nl
050 -[masked]
06 -[masked]

http://www.webkoop.nl
http://www.faillissementsverslag.nl
http://www.bcinvestments.nl
http://www.tennissen.in



--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
http://www.meetup.com/betanyc/
This message was sent by Baris Canatan ([address removed]) from #betaNYC, a Code for America Brigade for NYC.
To learn more about Baris Canatan, visit his/her member profile: http://www.meetup.com/betanyc/members/13363038/
Set my mailing list to email me

As they are sent
http://www.meetup.com/betanyc/list_prefs/?pref=1

In one daily email
http://www.meetup.com/betanyc/list_prefs/?pref=2

Don't send me mailing list messages
http://www.meetup.com/betanyc/list_prefs/?pref=0
Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]


Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy