Mailing List Archive

Subject Sender Date
Re: [JOB] Data Analyst for Ed Non-Profit - Sorry to blow everyone's inbox up but Meet-Up sheered off the attachment it looks like. Here is a link to the posting on Box. Justin van D. Jan 27, 2015 11:34 AM
[JOB] Data Analyst for Ed Non-Profit - Hi all, I hope everyone survived the hoarfrost of 2015 just fine.  I work for a new non-pr Justin van D. Jan 27, 2015 11:12 AM
Re: [betaNYC] Is anyone scraping the City's plow map? - Featured on Popsci!   http://www.popsci.com/dig-live­-plow-tracking Sean A. Jan 26, 2015 3:26 PM
Fwd: [NYC-rb] [JOB] Applications Developer at NYPL - ---------- Forwarded message ---------- From: Stephen Schor < [address removed] > Date: Mon, Aidan F. Jan 26, 2015 11:59 AM
Re: [betaNYC] Is anyone scraping the City's plow map? - If you are interested in helping scrape NYC's #PlowNYC website, head over to BetaNYC's #OpenData workgroup. A lively discussion has begun.  Noel Hidalgo | B. Jan 26, 2015 9:55 AM
Is anyone scraping the City's plow map? - I've gotten a few requests for the City's plow map. Has anyone worked/working on it?   < http://maps.nyc.gov/snow/ > It would be interes Noel Hidalgo | B. Jan 25, 2015 11:05 PM
Re: [betaNYC] TLC Taxi Data BigTable Query - How you provide a patch to 18 gigs of data? --- Francis Gulotta [address removed] Francis G. Jan 21, 2015 10:20 PM
Re: [betaNYC] TLC Taxi Data BigTable Query - Preview not available Richard D. Jan 21, 2015 3:10 PM
Re: [betaNYC] TLC Taxi Data BigTable Query - Seems to me that it might make sense to create some standard scripts/queries against some of these data sets as they are released. Tim M. Jan 21, 2015 1:10 PM
Re: [betaNYC] TLC Taxi Data BigTable Query - Preview not available Richard D. Jan 20, 2015 11:33 PM
Re: [betaNYC] TLC Taxi Data BigTable Query - This is a very interesting revelation, actually.  I am racking my brain to figure out how that could have happened... I wonder if they are all isolated incidents or if they are all from the same cabs or something.  Weird. Chris W. Jan 20, 2015 11:04 PM
TLC Taxi Data BigTable Query - Preview not available Richard D. Jan 20, 2015 10:38 PM
NYC DOT hosting a data townhall, RSVP required. - Join in a town hall style meeting about open data formatting and access, with staff from NYC  DOT 's Technology team. Bring your questio Noel Hidalgo | B. Jan 20, 2015 12:50 PM
Using opendata.stackexchange.com to answer NYC #opendata questions? - Joel Natividad brought this up before... Where do you go to ask/answer your NYC #OpenData questions? I know some of you use reddit and stack exchange. What are the boards and email forms you v Noel Hidalgo | B. Jan 18, 2015 3:37 PM
Re: Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - Murray, John is spot on! The relevant s3 docs are here.  http://docs.aws.amazon.com/Ama­zonCloudFront/latest/Developer­Gu Francis G. Jan 17, 2015 11:32 PM
Re: Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - Murray Jan 17, 2015 10:53 PM
Re: Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - Another thing to watch out for -- make sure to gzip compress your CSVs!  Most CSVs will be amenable to gzip compression.  Depending on how sparse the data is, you could see 3MB drop down to as little as 300K, and likel John K. Jan 17, 2015 4:08 PM
Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - Thank you Francis! Murray Jan 17, 2015 12:20 AM
Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - Murray Jan 17, 2015 12:20 AM
Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - If you have to send large static CSV files I would definitely use Amazon's S3 which is part of AWS.  You can serve the HTML/JS from whatever host you like. It doesn't sound like you would need to use an EC2 instance on AWS or H akil h. Jan 16, 2015 4:18 PM
Re: [betaNYC] Department of Buildings License Data - Richard, Damn good questions! I'm more than happy to lend an institutional hand with the FOIL request.  Also, I know there are people on this list who have this data. I'm not sure how the Noel Hidalgo | B. Jan 16, 2015 3:48 PM
Re: [betaNYC] Infrastructure advice for D3/Leaflet Visualization - I'd just use an s3 bucket. It's going to be the cheapest and most performant hosting around. If you want a CDN cloudfront (without SSL) is also dirt cheap and works great with S3. I often use route53 for my regist Francis G. Jan 16, 2015 3:38 PM
NY City Council is looking for a Quantitative Policy Analyst for the Policy & Innovation Division - The New York City Council, which is an equal opportunity employer, seeks a Quantitative Policy Analyst for the Policy & Noel Hidalgo | B. Jan 16, 2015 2:21 PM
Infrastructure advice for D3/Leaflet Visualization - Murray Jan 16, 2015 2:21 PM
Re: [betaNYC] Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - Hey Dan, Thanks! For some context, I helped develop Ezel while at Artsy.net so am very familiar with it -- which certainly biases me towards it! Our code at Artsy is OS here Brennan M. Jan 16, 2015 1:00 PM
a BetaNYC slack instance! - If you are into slack , I've set up a BetaNYC instance. To join, send me your personal email or your slack email account.  PS - Slack is a team communication tool. Slack provid Noel Hidalgo | B. Jan 16, 2015 11:59 AM
Department of Buildings License Data - Preview not available Richard D. Jan 16, 2015 10:03 AM
[Updated video link] THE_MESSAGE -[masked]! Hacknights, Must see video, and JOBS, JOBS, JOBS, JOBS! - HAPPY NEW YEAR! [The previous message's video link was incorrect. This is the correct youtube link , and yes, NYC's CTO is a master builder. 8-] Noel Hidalgo | B. Jan 15, 2015 1:21 PM
Re: [betaNYC] Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - really awesome! great use of d3. What was your experience using Ezel/Backbone? would you recommend it as a front-end framework/boilerplate? Dan K. Jan 15, 2015 1:07 PM
THE_MESSAGE -[masked]! Hacknights, Must see video, QUEENS, and JOBS, JOBS, JOBS, JOBS! - HAPPY NEW YEAR! Agenda * Hacknights in Manhattan and Queens * Recap of our BetaTalk with NYC's First Chief Tech Officer * NYC.gov is looking to hire a few good civic hackers * BetaNYC in the Noel Hidalgo | B. Jan 15, 2015 1:00 PM
Re: [betaNYC] Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - Hey Prudence, Thanks! Would you mind filing an issue on github for that with some details around what browser / os you are using? They should be next to each other. It should look like this:  Brennan M. Jan 15, 2015 12:43 PM
Re: [betaNYC] Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - Hey  Brennan, Great work!  Awesome stuff. Properties often transfer ownership for $0 or >$100 because they are being transferred within a family. A lot of owners will do $0 transfers to compa Matt B. Jan 15, 2015 12:13 PM
Re: [betaNYC] Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - Wow! Great work! I need to play around with this a little more, but is there a way to have the map and the graph of the selected neighborhood vs. hovered neighborhood to be displayed side by side? It's awkward to have to scroll up and d Prudence Jan 15, 2015 11:45 AM
Show BetaNYC: Interactive graphs for exploring Brooklyn's residential property sales data - Hello BetaNYC! I made some interactive graphs for exploring Brooklyn's residential sales by NTA based on the Department of Finance's property sales data. Check it out here: Brennan M. Jan 15, 2015 10:37 AM
Re: [betaNYC] What is your experience with idNYC? - Ooops mobile send fail... Marc S. Jan 14, 2015 5:54 PM
Re: [betaNYC] What is your experience with idNYC? - Something like a WikiData game to have the community contribute to translation and bootstrap that to a learning Marc S. Jan 14, 2015 5:50 PM
Some more Pratt SAVI courses starting next week - Hello BetaNYCers, In addition to Noel and Nathan's su Jessie B. Jan 14, 2015 5:21 PM
Re: [betaNYC] What is your experience with idNYC? - Would it be possible to use google's suggest a translation to run a translation-athon? n On Wed, Jan 14, 2015 at 3:26 PM, Joel Natividad Noel Hidalgo | B. Jan 14, 2015 3:32 PM
Re: [betaNYC] What is your experience with idNYC? - I wonder if they can triage it with Google Forms?  Google groks scalability .  And it appears each GSheet can handle 2m rows and even has some built-in internationalization s Joel N. Jan 14, 2015 3:25 PM
Re: [betaNYC] What is your experience with idNYC? - to add to the translation issue: I'm a Farsi (Persian) speaker and the translation doesn Sadra S. Jan 14, 2015 3:21 PM
Re: [betaNYC] What is your experience with idNYC? - I second that.  Google translate is better than not having anything, but many things are incorrect.  We've had folks look at pages in Spanish, Chinese, Japanese and more.  Aileen  Aileen Gemma S. Jan 14, 2015 3:07 PM
Re: [betaNYC] What is your experience with idNYC? - Just one observation: for Chinese language, Google Translate does a terrible job in translation. I just viewed the page in Chinese, and many translated parts do not make any sense. The application instructions are beyond comprehension at al Kuek Ser Kuang K. Jan 14, 2015 2:57 PM
Re: [betaNYC] What is your experience with idNYC? - Btw, I don't want my initial comments to be misinterpreted. Also, I speak on behalf of myself, not BetaNYC as an organization. Personally, I'm super supportive of the  ID program. I want one. The city has done a great job at l Noel Hidalgo | B. Jan 14, 2015 2:48 PM
What is your experience with idNYC? - Is #idNYC, Mayor Bill de Blasio ObamaCare moment?  There is overwhelming demand that the administration has outsourced a scheduling system yet that it itself is overloaded.  What i Noel Hidalgo | B. Jan 14, 2015 11:34 AM
Re: [betaNYC] If you use archived MTA data, you'll want to read this message... - Lol...Someone went all Jackson Pollock when it should be Nauman. Marc On Jan 12, 2015, at 3:53 PM, Noel Hidalgo | BetaNYC < Marc S. Jan 12, 2015 4:12 PM
Re: [betaNYC] If you use archived MTA data, you'll want to read this message... - Riddles are fun! On Mon, Jan 12, 2015 at 3:53 PM, Noel Hidalgo | BetaNYC < [address removed] > wrote: Warren L. Jan 12, 2015 4:09 PM
If you use archived MTA data, you'll want to read this message... - This is a bit interesting. IF they can do this, why can't the do one of the following: 1. Put this archived data in the state data portal? 2. Roll their own CKAN / data portal? IMHO, thi Noel Hidalgo | B. Jan 12, 2015 3:52 PM
Re: [betaNYC] Linked In looking for a local government engagement lead - Hi Andrew, thanks for the link, but this ended up at Head of Economic Graph Policy Partnerships. Did you mean to point out the Account Executive / EMG gov position? < Noel Hidalgo | B. Jan 12, 2015 2:01 PM
Linked In looking for a local government engagement lead - FYI Andrew R. Jan 12, 2015 1:33 PM
Fwd: Agile Delivery Services RFI - Please Promote... - Hey all- My team, 18F , is helping with a new initiative to make software procurement for the US government more sensible, efficient, and accessible to not-gigantic b Aidan F. Jan 12, 2015 4:47 AM
Re: [betaNYC] VIDEO: Stephen Goldsmith & Susan Crawford – The Responsive City - I haven't read the book yet, but I'm curious about two things - older examples of citizen engagement, and large scale examples.  Do people have examples of older successful feedback loops between citizens and their government Rachel Jan 9, 2015 12:24 PM
Re: [betaNYC] VIDEO: Stephen Goldsmith & Susan Crawford – The Responsive City - Yes, setting aside the temptation to outsource software dev or milk the incubator teat, the ability to track and satisfy citizen demands for inform Marc S. Jan 9, 2015 11:44 AM
Re: [betaNYC] VIDEO: Stephen Goldsmith & Susan Crawford – The Responsive City - Let's hope he is working to build responsive cities that can provide transportation for all , deal with real situations, i.e. Noel Hidalgo | B. Jan 9, 2015 10:55 AM
Re: [betaNYC] VIDEO: Civic Hall walkthrough – Jan[masked] - What year is it? I know, I know. It's because I've been working on catching up 2014 vids! On Fri, Jan 9, 2015 at 6:42 AM, Joly MacFie Joly M. Jan 9, 2015 8:41 AM
Re: [betaNYC] VIDEO: Civic Hall walkthrough – Jan[masked] - What yeaR On Fri, Jan 9, 2015 at 6:42 AM, Joly MacFie < joly@ Joly M. Jan 9, 2015 8:38 AM
VIDEO: Civic Hall walkthrough – Jan[masked] - Speaking of CivicTech, it has a new home in NYC.. Joly M. Jan 9, 2015 6:42 AM
VIDEO: Stephen Goldsmith & Susan Crawford – The Responsive City -   Stephen Goldsm Joly M. Jan 9, 2015 5:39 AM
Fwd: [qtm] Apply to Access Code 2.0 by January 9! - For those of you who are interested in learning to code mobile apps, I highly recommend applying for Access Code 2.0! Noel Hidalgo | B. Jan 8, 2015 2:58 PM
Re: [betaNYC] NYC Street Addresses - Max- You could use the NYC address points https://data.cityofnewyork.us/­City-Government/NYC-Address-Po­ints/4iq4-tuhq For Colin R. Jan 8, 2015 1:18 PM
RE: [betaNYC] NYC Street Addresses - Steven R. Jan 8, 2015 1:08 PM
NYC Street Addresses - Hello - Max G. Jan 8, 2015 1:02 PM
Stringer RFI on Electronic Contract Invoicing Solutions - Anyone going? http://comptroller.nyc.gov/eve­nt/rsvp010815/ Kara C. Jan 7, 2015 4:09 PM
Re: [betaNYC] How will Open Data be Regulated? - Hi Joel, These are constructive suggestions. I believe there is a need for Open Source communities to perform ongoing audits of Open Data validity a Steven A. Jan 7, 2015 1:27 PM
Re: [betaNYC] How will Open Data be Regulated? - Hi Steve, I'm not advocating for congestion-based pricing, as I pointed out in my example.  Just laying out some issues for discussion. The "unrestricted right of governments to publish Joel N. Jan 7, 2015 1:00 PM
Re: [betaNYC] How will Open Data be Regulated? - Dear Joel, No, we don't want congestion pricing for Open Data. This is a very bad idea. Wh Steven A. Jan 7, 2015 9:42 AM
Re: [betaNYC] How will Open Data be Regulated? - Hi, As I see it the only way to truly measure, and by the same token manage or regulate the cost associated with Open Data, is to have all governme Marc S. Jan 5, 2015 7:45 PM
Re: [betaNYC] How will Open Data be Regulated? - Open Data, as previously pointed out, is the modern iteration of government transparency that's always been part and parcel of our democracy. In its modern form, its one the Biggest available sources of machine-readab Joel N. Jan 5, 2015 6:47 PM
Re: [betaNYC] How will Open Data be Regulated? - Marc S. Jan 5, 2015 2:59 PM
Re: [betaNYC] How will Open Data be Regulated? - For some of us, "open data" is an extension of existing regulation and reporting. For example, the City's crash data is to be reported on a monthly basis. We said, that's awesome. We'd like it at a greater granular lev Noel Hidalgo | B. Jan 5, 2015 9:24 AM
How will Open Data be Regulated? - This discussion inspires me to invite all to participate in a broader debate: Who will regulate What governments publish as Open Data? How will thos Steven A. Jan 5, 2015 8:42 AM
Re: [betaNYC] NYS or NYC Web event data? - Preview not available Tom L. Jan 1, 2015 7:30 PM
Re: [betaNYC] NYS or NYC Web event data? - I have agree with Zev. If the information collected is limited to minimize the chance of reidentification, I think the risk would be small an Max G. Dec 31, 2014 3:56 PM
Re: [betaNYC] NYS or NYC Web event data? - Zev, Governments can evaluate public demand for their Open Data programs by storing aggregate data utilization statistics over time and at still delete an Steven A. Dec 31, 2014 12:20 PM
Re: [betaNYC] NYS or NYC Web event data? - Hi, Both points are well taken however it's clear that even anonymized web activity gleaned from logs can be used to identify and target users.&nbs Marc S. Dec 31, 2014 11:21 AM
Re: [betaNYC] NYS or NYC Web event data? - I'm going to have to disagree with you here, Steve. The government has plenty of data that is far more personal and sensitive than anonymous web traffic data, and the benefits of analyzing website traffic data outweigh the risks of a ma Zev L. Dec 31, 2014 9:55 AM
Re: [betaNYC] NYS or NYC Web event data? - I would hope that no government will ever retain logs of this data for more than 30 days and certainly will never publish it. The data could be used for political purposes within government and even Steven A. Dec 31, 2014 8:30 AM
Re: [betaNYC] NYS or NYC Web event data? - Thanks for the insight. In my opinion, it's quite a significant challenge to do this, but your feedback will certainly help in thinking through some options. -Andrew On Fri Dec[masked] at 12:06:15 PM Andrew N. Dec 26, 2014 12:45 PM
Re: [betaNYC] NYS or NYC Web event data? - Thanks for the info, Andrew. That's helpful, if not terribly surprising.  Ideally, a web-event data set would contain every instance of every tracked event (page views, form submissions, video watches, clicks, hovers Zev L. Dec 26, 2014 12:05 PM
Re: [betaNYC] NYS or NYC Web event data? - I've seen/heard a few requests for data like this.  For a variety of reasons both technical- and privacy-related, we can't release log files. In your ideal universe, what kind of a structure would this dataset have, and what level of detail wo Andrew N. Dec 26, 2014 11:51 AM
Re: [betaNYC] NYS or NYC Web event data? - Thanks Chris! I am actually looking for a whole dataset but this is definitely very interesting. -Zev On Fri, Dec 26, 2014 at 11:43 AM, Chris Whong Zev L. Dec 26, 2014 11:46 AM
Re: [betaNYC] NYS or NYC Web event data? - https://data.cityofnewyork.us/­analytics Hi Zev,  It's not a dataset, but this is the analytics page for the data portal that NYC has Chris W. Dec 26, 2014 11:43 AM
NYS or NYC Web event data? - Does anybody know whether the City or State makes available its web traffic data for their public websites? I need an open-source sample data set of web traffic (page views, clicks, etc) and thought a government open data portal could be a Zev L. Dec 26, 2014 11:38 AM
Manhattan Community Board Applications - Manhattan Borough President Gale Brewer's office is now accepting applications to serv Richard R. Dec 24, 2014 7:06 AM
Re: [betaNYC] NYC SBS Stops - Our MTA has a developer list dedicated to such questions. I recommend joining and engaging directly with the MTA's technologists. They are VERY open about helping out. <  Noel Hidalgo | B. Dec 19, 2014 12:04 PM
THE MESSAGE[masked] - NYC's CTO needs your help & a flashlight on 2015! - Noel Hidalgo | B. Dec 18, 2014 6:21 PM
Re: [betaNYC] NYC SBS Stops - It's been a while, but I believe routes.txt includes the succession of stops for each route.   The stops.txt won't say which ones are SBS stops, but you can infer SBS stops by seeing which stops are listed for th Chris W. Dec 18, 2014 5:23 PM
Re: [betaNYC] NYC SBS Stops - Hey Chris,  Thanks for the response. I looked at the GTFS data and couldn't see anything specific for BSB stops. I already have regular bus stops, but is there an indicator to show which stops are SBS stops in GTFS?  Sadra S. Dec 18, 2014 5:15 PM
Re: [betaNYC] NYC SBS Stops - Did anyone respond to this?  You can get all of this out of the GTFS data, but it will take some "munging" to get it into a usable geospatial format.   -Chris Chris W. Dec 18, 2014 4:04 PM
Re: [betaNYC] Vote for Emrals to receive a 5k investment - Too much capitalism... ;-) Best Regards, Steve Motto: "Do First, Think, Do it Again" Steven A. Dec 18, 2014 5:58 AM
NYC SBS Stops - Hello there, Does anyone know where I can get a shapefile or KML or XY of SBS stops? (Steve?) Thanks a lot! -- Sadra Shahab GIS Specialist | Planner Pratt Center for Community Development 200 Willoughby Avenue, Brooklyn, NY 11205 (mai Sadra S. Dec 17, 2014 1:05 PM
Vote for Emrals to receive a 5k investment - Sean A. Dec 17, 2014 12:29 AM
Re: [betaNYC] Fwd: CTtransit will release real-time data for CTfastrak - Awesome we work with them a bit at SCF at well! Hopefully they can get bus trackers on the regular City buses. (My F train :) ) On Monday, December 15, 2014, Noel Hidalgo | BetaNYC <[address removed]> Ben B. Dec 15, 2014 12:39 PM
Fwd: CTtransit will release real-time data for CTfastrak - For those of you who care about transit data, Connecticut is opening up their data and launching a developers discussion list. This is v. cool! n ---------- Forw Noel Hidalgo | B. Dec 15, 2014 11:14 AM
Re: [betaNYC] An invitation to a civic tech / planning event - in DUMBO on December 18 - Currently, BetaNYC is legally an informal organization with fiscal sponsorship though Code for America. This is similar to other CfA brigades. Over the past year, we have grown to a point where we need local fiscal sponso Noel Hidalgo | B. Dec 15, 2014 10:42 AM
Re: [betaNYC] An invitation to a civic tech / planning event - in DUMBO on December 18 - Thank you Tom and Noel for your thoughtful answers.  I am a "B-corp capitalist"; which means achieving http://en.wikipedia.org/wiki/B­enefit_corporation Aliona Dec 13, 2014 12:35 PM
[betaNYC] Want to stay better informed about public meetings? Work with us to get better tomorrow! - Hello All, Mikael H. Dec 10, 2014 4:32 PM
Re: [betaNYC] An invitation to a civic tech / planning event - in DUMBO on December 18 - Perhaps, Tom , Noel should be invited onto the panel! Did I hear you were looking for a moderator? Joly M. Dec 10, 2014 3:26 PM
FYI, geo coding problems with NYC's Crash Data. - Akil has pointed out that NYC's crash data isn't being geocoded like it use to be. If you are interested in following this discussion, join the Open Data Workgroup <  http://bi Noel Hidalgo | B. Dec 10, 2014 2:11 PM
Re: [betaNYC] An invitation to a civic tech / planning event - in DUMBO on December 18 - Hi Aliona! Welcome for being a curious beta.nyc member! Tom casually fear mongers that "police.nyc" COULD infect your computer with a virus. This is wrong. The reality is the city set aside a large collections o Noel Hidalgo | B. Dec 10, 2014 11:37 AM
Re: [betaNYC] GEOMETRYCOLLECTION (LINESTRING ()) to Shapefile? - You can import it into QGIS and save it as a shapefile. I think this can be done without any special plugins in the more recent versions. Begin by importing the tabular data. The import screen should give you a place to choose how to import geometry. For Andrew N. Dec 10, 2014 11:34 AM

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy