GraphX preview: Interactive Graph Processing on Spark

  • July 2, 2013 · 6:30 PM

This meetup will feature the first public preview of GraphX, a new graph processing framework for Spark. GraphX implements many ideas from an existing specialized graph processing system (in particular GraphLab) to make graph computation efficient. The new graph APIs builds on Spark's existing RDD abstraction, and thus allows programmers to blend graph and tabular (RDD) views of graph data. For example, GraphX users will be able to use Spark to construct the graph from data on HDFS, and run graph computation (e.g. PageRank) directly on it in the same Spark cluster.

The proposed API enables extremely concise implementation of many graph algorithms. We provide implementations of 4 standard graph algorithms, including PageRank, Connected Components, Shortest Path all in less than 10 lines of code; we also implement the ALS algorithm for collaborative filtering in 40 lines of code. This simple API, coupled with the Scala REPL, enables users can use GraphX to interactively mine graph data in the console.

The talk will be presented by Reynold Xin and Joey Gonzalez. We would like to thank Flurry for providing the space and food.

Join or login to comment.

  • Andy K.

    I published some pictures I took from this Meetup at https://plus.google.com/photos/116743560897385808882/albums/5899482758719152833

    July 11, 2013

  • W. Allan G.

    Is anyone going to record this session? I'll relinquish my seat if so given the BART strike...

    July 2, 2013

    • Andy K.

      Also, BTW, I was in touch with Stoney this morning, and the reason the video from the last meetup hasn't been published to youtube yet is because of a hardware failure in which all of this editing was lost, so he is re-editing and will be posting both videos ASAP.

      1 · July 2, 2013

    • Stoney V.

      The GraphX meetup video is available at this link. There is a short gap at the begining of Reynold's part of the presentation due to changing batteries. http://youtu.be/vJQ2R...­

      July 6, 2013

  • A former member
    A former member

    Great presentation, material was presented on a level all computer scientists should be able to understand.

    July 3, 2013

  • Stoney V.

    Excellent presentation.

    July 3, 2013

  • Haidar H.

    Excellent meetup thanks to all the organizers and to Flurry for hosting.

    July 2, 2013

  • Nate

    Got stuck guys!! Sincere apologies for the last minute change

    July 2, 2013

  • Preetham

    Research Scientist @ Cisco

    July 2, 2013

  • Preetham

    Interested in Graphx

    July 2, 2013

  • Christopher N.

    Giving up spot for 1 of the 2 folks waiting.

    July 2, 2013

  • W. Allan G.

    Is anyone going to record this session? I'll relinquish my seat if so given the BART strike...

    July 2, 2013

  • Cos

    damn public employees and BART in particular

    July 2, 2013

  • Ethan H.

    Can't make it now. :(

    July 2, 2013

  • Bernardo Gomez P.

    Sadly I will not be able to make it. Look forward to watch the video.

    July 2, 2013

  • Kalpit S.

    Last minute change of plans.....wont be able to make it....hope this talk is recorded...

    July 2, 2013

  • Thomas

    .

    July 1, 2013

  • Michael

    NO BART!

    July 1, 2013

  • Ryan L.

    Sorry, can't make it tonight. :( Have fun!

    July 1, 2013

  • Gerald W.

    very disappointed I can't make it :(

    July 1, 2013

  • Michael H.

    I hope you guys will capture this on video as well for us East-coasters. Excellent job on with that on all prior meetups!

    June 27, 2013

  • Mark T.

    In Sydney, sounds good.

    June 17, 2013

  • John K.

    Want to learn more!

    June 17, 2013

  • Joseph G.

    AMPLab

    June 17, 2013

  • Sam B.

    Had the chance to chat with Joey a few ago about GraphX in Paris, a lot of interesting stuff in GraphX. I wish I could make it. Have fun.

    June 16, 2013

People in this
Meetup are also in:

Sometimes the best Meetup Group is the one you start

Get started Learn more
Katie

I'm surprised by the level of growth I've seen since becoming an organizer, it's given me more confidence in my abilities.

Katie, started NYC ICO

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy