addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1linklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

Brandwatch Presents: Detecting events on the web in real-time

  • May 7, 2014 · 7:00 PM
  • This location is shown only to members

Brandwatch is a world-leading social media monitoring tool. We find, process and store nearly 50M mentions from the Web every day from our crawlers. As the amount of data we find continually increases, the harder it becomes to separate the signals from the noise for our customers.

Over the last year, we have been building, experimenting with, and scaling a distributed cluster of JVMs that process the data from our client’s queries and detect important mentions and spikes in activity. We used Apache Kafka, ZooKeeper, Curator and Spring to achieve this.

This talk explains the architecture that we built, how it performs, scales and some of the difficulties we’ve faced along the way. We’ve learned a lot in the process, and we hope that now you can learn from us too. 

Doors open at 7pm. Brandwatch will be providing pizza, beer and soft drinks. Please sign-up to let us know that you're coming.

Join or login to comment.

  • James S.

    Thanks all for the kind words. I really enjoyed giving the talk.

    Darran: interestingly we've just launched sample queries, which allow users to sample a percentage of really big queries such as "Apple". This suffices for clients who have smaller budgets as they can extrapolate the numbers for their reporting. For use-cases such as engagement clients do want to see everything though!

    Happy to answer any questions either here or by email.

    May 13, 2014

  • darran e.

    Enjoyed it thanks. Interesting how something like twitter which started in 2006 can spawn other companies. Not even 10 years later you now have a biz, with 200 people based off it.
    By the way has Brandwatch ever tried old technologies like random sampling of twitter for speed? And then your 'hard and full analysis' of data later. Might be worth comparing the two approaches to see how closely they match? Just a thought.

    May 8, 2014

  • Dave L.

    Really enjoyed my first Brighton Java Meetup. An interesting presentation and people. I look forward to meeting you all again at the next one.

    May 8, 2014

  • Anil S.

    interesting stuff. Thanks for the presentation

    May 8, 2014

  • az s.

    A very good event, will definitely be at the next one

    May 8, 2014

38 went

Our Sponsors

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy