How I Learned to Stop Worrying and Love the Crowd

Join us as we kick off the Dogpatch Labs Tech Meetup with Dogpatcher Adam Marcus, Director of Data for Locu.

How I Learned to Stop Worrying and Love the Crowd

Crowdsourcing marketplaces like oDesk or Amazon's Mechanical Turk give us access to people all over the world that can solve various tasks, like virtual personal assistants, image labelers, or people that can clean up gnarly datasets. Humans can solve tasks that artificial intelligence is not yet able to solve, or needs help solving, without having to resort to complex machine learning or statistics. But humans are quirky: give them bad instructions, allow them to get bored, or make them do too repetitive a task, and they will start making mistakes. In this talk, I'll explain how to effectively benefit from crowd workers to solve your most challenging tasks, using examples from the wild and from our work at Locu.

 

Adam Marcus
Adam is Locu's Director of Data. He recently completed his Ph.D. in Computer Science at MIT, where his dissertation was on database systems and human computation. He is a recipient of the NSF and NDSEG fellowships, and has previously worked at ITA, Google, IBM, and FactSet. In his free time, he builds course content to get people excited about data and programming.

 

About Locu
Locu’s mission is to help local businesses thrive. With a patent-pending technology platform that digitizes and structures real-world data, Locu is building tools that help businesses connect with customers. http://locu.com

Join or login to comment.

  • A former member
    A former member

    If anyone's looking to add talent to their startup team check out DapperJobs (https://www.dapperjobs.com/). You can post a job for free using "dogpatch" as a code.

    We know that for small teams, finding someone you actually want to work with is important. Unlike normal job boards, we're focused on the culture/personality side of things.

    If you have any questions or feedback, I'd love to hear how we can improve our product!

    December 27, 2013

  • Bill D.

    A+ presentation (Thanks to Adam!) and congratulations to Abby & Sidd for launching a great Meetup group. I look forward to attending many more of their stellar events.

    1 · June 22, 2013

    • A former member
      A former member

      +1, even though it didn't have anything to do with what I'm currently doing, tech-wise. A good tech talk is always a pleasure.

      June 23, 2013

  • marcua

    Good question Chris---verifying real-world actions is certainly tough. If I had to do this on mTurk, I would:
    - Pick only mTurk masters that have approval ratings higher than 90%
    - Ask them to perform other verifiable tasks for me as a second filter, and then
    - Trust them once I knew they did other tasks well.

    I hope that helps!

    June 20, 2013

  • marcua

    Thank you to everyone for coming out, to Abby and Sidd for organizing, and to Chris for recording! I've uploaded my slides here:

    http://marcua.net/presentations/love-the-crowd20130620.pdf

    1 · June 20, 2013

  • Chris B.

    Oh yeah! Adam, if you're reading, I meant to ask after the talk: if you had to get 100 Turkers to *actually* flip coins and tell you their outcomes, how would you do it? :)

    1 · June 20, 2013

  • Chris B.

    Hi everyone, here's the video recording of last night's talk: http://www.youtube.com/watch?v=FL9Q43zO1BQ

    June 20, 2013

  • Allen K.

    It was an excellent meetup. I'd like to see some other kinds of food for the meetup. Chicken Nuggets and fruit salad is my suggestion. The meetup was very informative about "Locu" and crowd working.

    June 20, 2013

  • Philipp H.

    Can't make it after all. Anyone taking notes? Slides? Recording?
    I'm really interested in learning how others are doing this.

    June 19, 2013

    • A former member
      A former member

      It's being recorded; I'd follow up with Abby to find out when/where it's going to be posted.

      June 19, 2013

  • A former member
    A former member

    Developer from Houston looking to move back to the Boston area.

    June 7, 2013

  • Kathleen D.

    Happy to attend!

    June 3, 2013

  • Li S.

    Really look forward to this!

    June 2, 2013

  • Jonathan E. S.

    Sounds very cool -- looking forward to this. Hope I get in.

    June 2, 2013

  • A former member
    A former member

    The date people are allowed to RSVP is the day before this meetup is scheduled. Please update so I can reserve a spot :-)

    June 2, 2013

People in this
Meetup are also in:

Create your own Meetup Group

Get started Learn more
Rafaël

We just grab a coffee and speak French. Some people have been coming every week for months... it creates a kind of warmth to the group.

Rafaël, started French Conversation Group

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy