We will open our doors at 18:00, so you'll have enough time for chilling with your colleagues and eating pizza. Wish you lot of fun with our talks, that are starting at 19:00:
Talk 1: "How PAYBACK has implemented an event driven architecture for running realtime marketing campaigns" with Alexander Boyce
As a large multi partner loyalty program, PAYBACK receives millions of events per day. This talk is about how PAYBACK has implemented a performant and scalable system with Kafka and Spark Streaming for processing these events in realtime. Furthermore we will take a look at how this system is run in production:
- Monitoring the entire system by aggregating log messages via Kafka
- Duplicating data from other data sources within the company (e.g. Oracle databases)
- Automated testing for continuous deployment
Alex works as a data engineer at PAYBACK with a focus on open source technologies, such as Apache Spark, Kafka, Hadoop, Cassandra, Spring and the programming languages Scala and Java. Furthermore, his experience includes DevOps (continuous deployment, monitoring and automated testing). Prior to his role at PABACK, Alex worked as an IT-Consultant at Deloitte, designing and developing Big Data systems with the previously mentioned technologies. Alex holds an M.Sc. in Mathematics from LMU Munich.
Talk 2: "Apache Drill - a universal SQL engine for big data?" with Rostislaw Krassow
Apache Drill makes the promise to provide a flexible, distributed SQL engine for large number of data sources for interactive data exploration. Supported data sources include Hadoop, NoSQL databases and cloud storage. Compliance with ANSI SQL 2003 ensures fast onboarding of data analysts and industry-standard interfaces like JDBC/ODBC ensure integration with wide number of frontends.
In the talk architecture of Apache Drill will be introduced first. In the second part a potential use case of joining data from a relational database with data on Hadoop and a NoSQL database will be presented.
Let us discuss if Apache Drill satisfies its ambitions getting a Swiss army knife equivalence of a query engine.
Bio: Rostislaw Krassow is a big data engineer bei inovex GmbH. After working with relational databases in OLTP and DWH scenarios for many years Rostislaw finally went to big data side of life. In the current position he is responsible for design and implementation of Hadoop based solutions in customer projects.