CrateDB Distributed SQL & Search Database; Migrating from SQL to NoSQL

Agenda:

• 18:00 Doors open
• 18:30 - 19:30 Intro to CrateDB
• 19:30 - 20:00 Networking w/ food + beer
• 20:00 - 21:00 Remedying the Challenges of Migrating Oracle/Postgres/SQL to MongoDB/NoSQL

Intro to CrateDB
Having stepped into a data-driven era, we have to reexamine our
technical architectures and start innovating in order to accommodate the large amounts of data we have to process and store in near real time.
Tasks regarding reliability and availability have suddenly invaded our backlogs and spare time.

There were a few stages in this transition moving from "Shard the data store" towards "We'll just keep in sync several specialised sharded and replicated systems".
Architectures quickly became complex even though the business problems we are solving are mostly the same.
Reasoning about our system's behaviour usually involves a trip to the closest whiteboard as there are more and more moving parts in our storage and services layers.
The tradeoffs we make are mostly around sacrificing usability in favour of
scalability and reliability.
Looking at our storage layers today, it's very easy to store large amounts of data but rather difficult to query it in various formats and aggregations.

Business requirements regarding finding, analyzing, and processing data and events surface in most products.
We need to be able to retrieve the data we so easily persist without asking the user to provide the (primary) key (a hieroglyphic and a unicorn), nor have to migrate the data into other various systems that provide search capabilities.

CrateDB is a storage solution that scales horizontally on commodity hardware and enables SQL capabilities in order to store and query structured and unstructured data.
With applications in various domains as IoT, sensors data, log analytics and time series data, CrateDB not only stores large amounts of data, but also helps you make sense of that data.
Using the expressiveness of the SQL language and the underlying engine scalability CrateDB can fill in the current gap architecture gap that between storing and retrieving data.

About the speaker:
Andrei Dan is the core developer for Crate.io ( https://crate.io/ ), where they've built CrateDB, a distributed sql database for machine data.

Remedying the Challenges of Migrating Oracle/Postgres/SQL to MongoDB/NoSQL

This is the dark and terrible tale of a migration from an relational SQL database, an RDBMS like Oracle or Postgres, to NoSQL with MongoDB. The battles were fought by those unwilling or unable to learn Mongo’s query language. The trials we faced feeding Mongo back through a SQL data warehouse. The tears shed. The lives lost (well, virtual-lives lost, lol.)
In this session, we will look at how using a scalable SQL database with full text search would have solved all of the most-challenging aspects of SQL-to-NoSQL migration.

About the speaker:
Marios Trivyzas is a core developer for Crate.io ( https://crate.io/ ­ ), where they’ve built CrateDB, a distributed sql database for machine data.