Big Data architecture for O&G

Dmitry Kniazev works as a Solutions Architect, Data Analytics at EPAM Systems (NYSE: EPAM). EPAM is a solutions integrator that outsources solutions implementation to various locations, primarily Eastern Europe. Dmitry has been working with one of the major Oil & Gas companies here in Houston for almost 4 years and participated in various Data Analytics related projects.

In this talk Dmitry will give an overview of the Proof-Of-Concept solution we have created for one of our customer - Oil & Gas company. He will give a brief overview of the WITSML standard that exists in the industry to share the sensor data among different operators and how we tapped to it to build the near real-time alerting application that streams data into Kafka queue and processes it using Spark Streaming.

Time permitting, Dmitry will also discuss the visualization portion on top of this using Highcharts javascript library.