April 28, 2014
How do you turn Big Data into Fast Data? I am not interested in storing large amounts of data. I am interested in retrieving queries of data, often times located by lat,long, z and time ranges from datasets that would be sparse if fully relational. Much of the data is easily relational, but much else, such as comments, hyperlinks, optional data, financial models are best stored in denormalized structures or XML structures. Fully relational structures will be unwieldly and detrimental to application development.
Geophysicist + risk analyst. A big Spotfire user. A firm believer in Fast Data > Big Data. Data velocity and variety and flexibility is key. Is Hybrid RDBMS+NoSQL the future?