addressalign-toparrow-leftarrow-leftarrow-right-10x10arrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcredit-cardcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobe--smallglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1languagelaunch-new-window--smalllight-bulblightning-boltlinklocation-pinlockm-swarmSearchmailmediummessagesminusmobilemoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstar-shapestartickettrashtriangle-downtriangle-uptwitteruserwarningyahooyoutube

Re: [betaNYC] Moving Violation data site I've been working on.

From: Chris W.
Sent on: Wednesday, May 7, 2014, 8:16 AM
Well, there's always scraperWiki... I haven't used it much so maybe someone else can chime in, but I think it's supposed to help you automate this sort of thing, especially if it needs to happen on a regular bases in the future.

-Chris


On Wed, May 7, 2014 at 7:48 AM, akil harris <[address removed]> wrote:
Hey Chris,

Thanks for the suggestions! I took your advice and adjusted the filters a bit, though it's still a work in progress.

I actually built the scraper a few months ago and was just sitting on it not getting much use from it and decided over the weekend to do something with the data and had a couple of free days to do so. I think that sure it could have been done faster if I didn't have to build a scraper / parser for the pdfs. Do you know of any site that aggregates community built scrapers, parsers or apis of data that is locked up in some unhelpful format? I'm never quite sure if I'm doing the work that someone else has already done but it's just difficult to find. 

Thanks again,

Akil


On Tue, May 6, 2014 at 12:34 PM, Chris Whong <[address removed]> wrote:
Akil,

This is great work!  I hope this catches the NYPD's eye as an example of the developer ecosystem adding value to their data.  Can you comment on how big the lift was to build your PDF scraper?  Would you have gotten this out sooner if you didn't have to spend a lot of time turning PDFs into raw data?

Some design notes:  

-Maybe it would be better to show the filter options side-by-side with the map so the user doesn't have to scroll back up to the top to change the options.  

-The mini-map is a bit confusing since it appears that the precinct you've highlighted is behind the pop-up in New Jersey.  Maybe a contrasting basemap in the mini-map would help, or just highlight the precinct on the main map.

Awesome civic hack!

-Chris


On Tue, May 6, 2014 at 12:17 PM, akil harris <[address removed]> wrote:
Hey yinz,

I wanted to show you guys a site I've been working on lately that breaks down the NYPD Moving Violation Summonses.


Right now you can select a year or all years and a violation and see on a map the count of summonses issued by precinct. 

You can then click on a precinct and see the historical data of how many were given for each month in the dataset.

I hope to add a few more features to the site soon.

1) The ability to select multiple violations and aggregate the totals. (Speeding + Unlicensed Driver + Disobey Sign)
2) The ability to select two years and see the rate of change.
3) A precinct details page that will breakdown each violation by precinct over time.

The data is coming from these NYPD PDF files:

Which have been scraped and parsed into json. The code for the parser is available on my github @ https://github.com/akilism/moving_violation_scraper

And if you are interested in the code for the site you can check that out @ https://github.com/akilism/nyc-moving-violations

I'd love to hear your feedback on what you like and what you don't like. 

Thanks,

Akil




--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by akil harris ([address removed]) from #betaNYC, a Code for America Brigade for NYC.
To learn more about akil harris, visit his/her member profile
To report this message or block the sender, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]





--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by Chris Whong ([address removed]) from #betaNYC, a Code for America Brigade for NYC.
To learn more about Chris Whong, visit his/her member profile

To report this message or block the sender, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]





--
Please Note: If you hit "REPLY", your message will be sent to everyone on this mailing list ([address removed])
This message was sent by akil harris ([address removed]) from #betaNYC, a Code for America Brigade for NYC.
To learn more about akil harris, visit his/her member profile
To report this message or block the sender, please click here
Set my mailing list to email me As they are sent | In one daily email | Don't send me mailing list messages

Meetup, POB 4668 #37895 NY NY USA 10163 | [address removed]

People in this
group are also in: