SciDB as a Data Backend for R

  • February 12, 2013 · 6:15 PM

We have a short turnaround time this month as we welcome Bryan Lewis to discuss SciDB.

About the talk:

SciDB is an open-source database that organizes data in n-dimensional arrays.

Interesting SciDB features include parallel processing, distributed storage, ACID transactions, efficient sparse array storage, and native linear algebra operations.

The "scidb" package for R provides two general ways to interact with SciDB from R:
1. By running database queries from R transferring data using data.frame iterators.
2. Through a sparse n-dimensional array object class for R inspired by the bigmemory package. The arrays mimic standard R arrays, but operations on them are performed by the SciDB engine.  Data are materialized to R only when requested.

We illustrate using SciDB and R with a few examples including computing a truncated singular value decomposition of a large matrix, and bi-clustering of large arrays using the biclust package.


About Bryan:

Bryan Lewis has worked with R for a number of years and is the author of a number of R packages including irlba, rredis, doRedis, websockets, and bigalgebra, and others. He is the chief data scientist at Paradigm4 in Waltham, MA and has a Ph.D. in applied mathematics.


Pizza starts at 6:15, Bryan will go on at 7 then we'll head to the bar.

Join or login to comment.

  • Giuseppe P.

    Very interesting and relevant talk from a knowledgeable speaker. I think it succeeded in capturing the attention of R users in an area where R has traditionally been weak.

    If there were a button to accelerate the talk's pace by 1.5x, I would have pressed it and crammed a bit more information in one full hour.

    February 12, 2013

  • AbderRahman S.

    Excellent! Great people talking about a subject I love: Statistics and coding in R.

    February 12, 2013

  • Jason


    February 12, 2013

  • Mehboob A.

    Never a dull presentation.. ever!

    February 12, 2013

  • Jared L.

    We're working on dimming them.

    February 12, 2013

  • Michele R.

    Dimming the lights in the room will allow those of us online to see the presentation.

    February 12, 2013

  • Jared L.

    Speaker went on a little after 7 so that's when it should have gone live.

    February 12, 2013

    • Michele R.

      Yes, thanks. I wonder if someone can dim the lights so those of us online can see his presentation. B/c of brightness it is difficult to see the slides being projected.

      February 12, 2013

  • Ronald C.

    I may _need_ something like SciDB, and an looking forward to seeing it at work.

    February 1, 2013

    • Jared L.

      Glad we (Bryan) can show it to you.

      February 1, 2013

Your organizer's refund policy for SciDB as a Data Backend for R

Refunds are not offered for this Meetup.

Our Sponsors

People in this
Meetup are also in:

Create a Meetup Group and meet new people

Get started Learn more

Meetup has allowed me to meet people I wouldn't have met naturally - they're totally different than me.

Allison, started Women's Adventure Travel

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy