Re: Re: [betaNYC] NYC Housing and Vacancy Survey Microdata

From: Kevin M.
Sent on: Friday, August 1, 2014 4:41 PM
Great, thanks everyone!


On Fri, Aug 1, 2014 at 7:59 AM, Chris Whong <[address removed]> wrote:
Max, your scraped data now lives on github here:

https://github.com/BetaNYC/NYCHVS/

John, thanks for sharing your work and the tools you built to do the scraping, as always.

BetaNYC, thanks again for being so awesome.  Community Member: "I need X data".  BetaNYC: "We already scraped it, here you go"


-Chris


On Thu, Jul 31, 2014 at 12:36 PM, John Krauss <[address removed]> wrote:
Hey,

I did the parsing last year!  Thanks for reminding me, I should have shared this with the list:

https://github.com/talos/nychvs

Data can be found here (for 2011 and 2008):

https://github.com/talos/nychvs/tree/master/data

The `.db` file is sqlite, and the `.sql` file is its schema. The CSVs should be self explanatory.

The parse script is here:

https://github.com/talos/nychvs/blob/master/nychvs/parse.py

My recollection is that the pre-2008 files are in a different format, and would've required additional scripting work.  I collected all the raw data here:

https://github.com/talos/nychvs/tree/master/raw

Please feel free to reach out to me if you have any questions, and *please* fork and issue PRs if you end up processing older data sets!

-John




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by John Krauss ([address removed]) from #BetaNYC, a member of Code for America's Brigade Program.
To learn more about John Krauss, visit his/her member profile

To report this message or block the sender, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]





--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Chris Whong ([address removed]) from #BetaNYC, a member of Code for America's Brigade Program.
To learn more about Chris Whong, visit his/her member profile

To report this message or block the sender, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy