addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscontroller-playcrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramFill 1light-bulblinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonprintShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

SMAQ-talk #2 - SQOOP

Our next meetup is at the ATP Innovations centre in the Australian Technology Park, where Guy Harrison (from Quest) will be talking about SQOOP, an open source tool for getting data out of RDBMS like Oracle into Hadoop for batch processing.

After the talk we'll run a QA, as well as a "SMAQDown" panel session that attempts to dissect and solve a particular architecture problem. If you've got a interesting problem you'd like the group to have a go at solving, please get in touch with Andrew.

We meet at 6.30pm for a 7pm start.

Space is limited so please be sure to RSVP on meetup before the night. The talk:

As Hadoop penetrates the modern enterprise, it will increasing be called upon to integrate with more traditional enterprise data stores, and with Oracle in particular. Hadoop may need to copies of reference data mastered in an Oracle RDBMS to make sense of unstructured data held in Hadoop. Larger volumes of data may be moved from Oracle to Hadoop in order to take advantage of the Map Reduce programming model for complex analytics. In other cases, data from Hadoop - or output from Map Reduce or HIVE jobs - may be copied into Oracle where more real time ad-hoc queries can be supported. Each of these scenarios demand a functional and efficiency means of shifting data between the two data stores. To this end, Cloudera have provided the open source SQOOP utility to import or export data between any SQL database and Hadoop. Quest have partnered with Cloudera to provide OraOop - an free utility that provides performance and functionality enhancements for those who with to inter-operate Oracle and Hadoop. This presentation will discuss the general architecture of SQOOP and how it's extensibility architecture allows third party providers like Quest to provide optimized drivers for specific RDBMS. We'll then discuss technical challenges in moving data between Oracle and Hadoop. Finally, we'll consider how Hadoop changes the landscape for enterprise data management and speculate on how enterprises might leverage and consolidate the strengths of Oracle and Hadoop. About Guy

Guy Harrison is a Director of Research and Development at Quest Software, and has over 20 years experience in database design, development, administration and optimization. Guy is the author of numerous books, articles and presentations on database technology, is the architect of Quest's Spotlight family of diagnostic products and has lead the development of Quest's Toad for Cloud Databases(tm), and the Oracle-Hadoop "OraOop" product. Guy can be found on the internet at www.guyharrison.net, on email at [masked] and is @guyharrison on twitter.

Join or login to comment.

  • A former member
    A former member

    Enjoyed every second of the event. Thank you Andrew for organizing it. There are smart people in the group. Appreciate that explained concepts patiently to a baby (me) in the NO SQL world.

    February 18, 2011

  • Rami M.

    It was a great meet-up - thanks Andrew! Good to connect with some of the community, and find out what people were doing.

    February 18, 2011

  • A former member
    A former member

    Hey Yury, was great to meet you tonight. Glad you managed to find the event in the end. If we do another event at ATP we'll definitely put some better directions up.

    February 18, 2011

  • A former member
    A former member

    Had a great time. Guy is a fantastic speaker, and some of the debates at the end made it all worth it.

    February 18, 2011

  • A former member
    A former member

    Can somebody point me to the exact address where the event is happening? Is it "suite 145 National Innovation Centre, 4 Cornwallis Street, Eveleigh 2015" ?

    February 17, 2011

  • Gary M.

    I would come if it didn't conflict with FP-Syd. Andrew, if possible for next time could you check this conflict, FP-Syd is generally scheduled well in advance. Regards

    February 10, 2011

12 went

Our Sponsors

  • Cloudera

    Generously providing speakers, drinks, and discounted Hadoop training.

  • Google Sydney

    Generously providing meeting space, food and speakers.

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy