Applied Data Engineering #1

Hi Everyone! Were really pleased to announce our first meetup and get the ball rolling! Thanks to the guys at OpenCredo for hosting and providing the beer, pizza AND speaker! Plan is as follows;

6.30pm - Arrive - Beer, Pizza and Socialising

7pm - Talk - David Borsos - Lead Consultant @ OpenCredo
"Detecting stolen AWS credentials with Spark Structured Streaming"

In this talk I will present the idea of finding anomalies in an event stream generated by Amazon Web Services. The goal is to detect leaks of access credentials resulting in the creation of additional extra infrastructure and extra cost. I am going to explore the details of how such an architecture looks like and how can it be composed of modern stream processing tools such as AWS Kinesis Streams and Spark Structured Streaming

8pm - More beer, pizza and socialising

8.30pm - To a local watering hole

Hope to see you all there!