addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupsimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1outlookpersonStartprice-ribbonImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruseryahoo

SciDB as a Data Backend for R

We have a short turnaround time this month as we welcome Bryan Lewis to discuss SciDB.

About the talk:

SciDB is an open-source database that organizes data in n-dimensional arrays.

Interesting SciDB features include parallel processing, distributed storage, ACID transactions, efficient sparse array storage, and native linear algebra operations.

The "scidb" package for R provides two general ways to interact with SciDB from R:
1. By running database queries from R transferring data using data.frame iterators.
2. Through a sparse n-dimensional array object class for R inspired by the bigmemory package. The arrays mimic standard R arrays, but operations on them are performed by the SciDB engine.  Data are materialized to R only when requested.

We illustrate using SciDB and R with a few examples including computing a truncated singular value decomposition of a large matrix, and bi-clustering of large arrays using the biclust package.


About Bryan:

Bryan Lewis has worked with R for a number of years and is the author of a number of R packages including irlba, rredis, doRedis, websockets, and bigalgebra, and others. He is the chief data scientist at Paradigm4 in Waltham, MA and has a Ph.D. in applied mathematics.


Pizza starts at 6:15, Bryan will go on at 7 then we'll head to the bar.

Join or login to comment.

  • Giuseppe P.

    Very interesting and relevant talk from a knowledgeable speaker. I think it succeeded in capturing the attention of R users in an area where R has traditionally been weak.

    If there were a button to accelerate the talk's pace by 1.5x, I would have pressed it and crammed a bit more information in one full hour.

    February 12, 2013

  • Jason


    February 12, 2013

  • Mehboob A.

    Never a dull presentation.. ever!

    February 12, 2013

  • Jared L.

    We're working on dimming them.

    February 12, 2013

  • Michele R.

    Dimming the lights in the room will allow those of us online to see the presentation.

    February 12, 2013

  • Jared L.

    Speaker went on a little after 7 so that's when it should have gone live.

    February 12, 2013

    • Michele R.

      Yes, thanks. I wonder if someone can dim the lights so those of us online can see his presentation. B/c of brightness it is difficult to see the slides being projected.

      February 12, 2013

  • Ronald C.

    I may _need_ something like SciDB, and an looking forward to seeing it at work.

    February 1, 2013

    • Jared L.

      Glad we (Bryan) can show it to you.

      February 1, 2013

Your organizer's refund policy for SciDB as a Data Backend for R

Refunds are not offered for this Meetup.

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy