addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Hacker Forum: Screen Scraping

Hacker Forum: Screen Scraping


Join us for our first Hacker Forum, an evening of conversations and presentations on a particular topic proposed by Hacker Union members.


This month, we'll be discussing screen scraping.

Join fellow hackers for an evening of tech talks, presentations, and conversations -- as well as dinner and drinks, generously contributed by Yext's engineering team.



Speaker roster and agenda to follow shortly!

Want to talk? Please email Brandon Diamond

Join or login to comment.

  • Jonathan D.

    Some people were asking about the code for scrapi.org - http://github.com/jedahan/collections-api . Nice chatting with everyone afterwards.

    August 12, 2013

  • A former member
    A former member

    Any plans to be awesome and share the slides or the recording?

    2 · August 10, 2013

  • David F.

    Really enjoyed this event - friendly vibe in a nice facility. The speakers were excellent. The food was hot and the drinks were ... cold. The security was a pain but the organizers responded well and made sure that everyone got in before the presentations started. Having the CTO hand out pizza to the queuing crowd was definitely a highlight. I really enjoyed Kevin Caffrey's presentation on Yext's scraping solution, both insightful and informative - he also took the time to discuss it further with me afterwards. Thanks guys!

    2 · August 10, 2013

  • Sasha R.

    Everybody say that it was a great by no one will share a picture :-/

    2 · August 9, 2013

    • Aaron S.

      I just posted a few :)

      1 · August 9, 2013

    • Sasha R.

      Nice. Next will not miss it. Thank u

      August 9, 2013

  • A former member
    A former member

    Great event! Highlight of my week.

    1 · August 9, 2013

  • Suresh

    This was a great meetup. In my view the security was not onerous. In fact the security in the building was on the lighter side. In the financial institutions that I worked we had to pass our bags through a x-ray scanner and checked before we went in. This happened every time we entered the building - w/o exceptions.

    The content was great and the food & drinks were an added bonus. Many thanks to the organizers and the presenters.

    1 · August 9, 2013

  • Jovena W.

    Thanks to those of you that waited out the security line. Rocky start, but worth the wait, right?

    We've not had this issue with the last two events we hosted, and we're looking at how to ensure it doesn't happen again. I hope that the CTO coming down with pizza helped ease the pain?

    It was great meeting all of you!!!

    1 · August 9, 2013

  • Vietnhi P.

    Man, your security is good - at least, it's notHomeland Security, which lets only the bad guys in :)

    August 9, 2013

    • Brandon D.

      Sorry dude! I guess they watched "Hackers" one too many times

      August 9, 2013

  • Dan

    Tight security and long wait time reminds me of a concert. Hahaha. Great Meetup today.

    August 9, 2013

    • Brandon D.

      Thanks Dan! Sorry the security was so rough.

      August 9, 2013

  • A former member
    A former member

    Left when security was too tight.

    August 8, 2013

    • Brandon D.

      Sorry about that! I heard there were some issues with the security guys' systems.

      August 8, 2013

  • Aaron S.

    Building security is an epic slowdown... Over a dozen people stuck in Lobby waiting. At least someone brought pizza down, lol

    August 8, 2013

    • Aaron S.

      But now that I'm upstairs, the office is beautiful, and the wine is tasty :D

      2 · August 8, 2013

  • Sasha R.

    really want to listen about screen scraping cuz before was building parser for 10bet.com but seems like no more slots even after a long period in waiting list :(
    next time will make rsvp earlier

    August 8, 2013

  • Victor O.

    :( sadly too busy at work.

    August 8, 2013

  • Victor O.

    I built SlashDB so that every (database-backed) website can get an API very easily and avoid people having to do screen scraping. Still I would like to attend the meetup. Too bad it's oversubscribed.
    http://www.slashdb.com/solutions/for-websites/

    1 · August 7, 2013

    • Jovena W.

      I just added you to the RSVP list. Please join us!

      1 · August 7, 2013

    • Victor O.

      Thank you. I'll be there.

      August 8, 2013

  • @aaronchall

    Be sure to cancel your RSVP if you can't make it, people on the waitlist are dying to get in.

    1 · August 8, 2013

  • Tendekai M.

    any chance of getting off the waitlist?

    August 8, 2013

  • Rick S.

    Not gonna be able to make it :/

    August 7, 2013

  • Jonathan D.

    I build http://scrAPI.org , and wouldn't mind teaching a class on more advanced screen scraping techniques if enough people were interested.

    2 · February 7, 2013

    • Aaron S.

      very cool... do you freelance as well? I may have a small scraping gig coming up (contact me privately if you like)

      August 7, 2013

    • Jovena W.

      Would you like to join us for the event? We'd love to hear more about what you built.

      August 7, 2013

  • Jovena W.

    Kevin Caffrey, an engineering manager at Yext will give an overview of how we use screen scraping. Our technology verifies and updates business information across over 50 web properties (Yelp, Foursquare, etc). We perform this verification using screen scraping, implemented with a mixture of Java libraries and Selenium. We have also developed methodologies for dealing with rate limits.

    August 1, 2013

  • David F.

    Looks great

    July 19, 2013

  • Brandon D.

    It's on! Yext has offered to host -- and to provide dinner and drinks!

    1 · July 17, 2013

  • Brandon D.

    Is anyone interested in organizing this? If we can get committed participants, I can help get a space.

    June 24, 2013

  • A former member
    A former member

    I've done a bit o' scraping with lxml, requests and spynner, but I'd love to learn more about this topic.

    May 16, 2013

  • A former member
    A former member

    The Bastard Book of Ruby has some good stuff on on web scraping and crawling: http://ruby.bastardsbook.com/toc/

    1 · April 17, 2013

  • A former member
    A former member

    Data Scientist. User Experience ninja. Analytics, Mining, Machine Learning, Lean Startup, Six Sigma and Quality sciences geek. Avid adventurer. Founder of 3 companies.

    April 4, 2013

  • Bill

    Depends where & when.

    February 7, 2013

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy