October - Data Pipelines & Missing S3 Objects

Welcome to October's edition of AWS User Group Leeds!

We're back at BJSS for another regular event, after causing something of a JAM at Leeds Digital Festival!

To enable us to arrange the correct amount of food and drink, and ensure that everyone who wants to attend is able to, please only sign up if you are able to attend, and if after signing up you are no longer able to attend, please update your RSVP to 'no' to make your space available to others.

This meet up is kindly sponsored by BJSS, who will be providing the venue, food and drink.

We have two great talks lined up for you:

Building And Automating Serverless Auto-Scaling Data Pipelines In AWS
Damien Jones - AWS Consultant, Steamhaus

The modern data professional navigates a dynamic data landscape, handling high-velocity raw data at ever-changing volumes. In this 30-minute intermediate session, I demonstrate a fully serverless auto-scaling data pipeline that automatically extracts, transforms and loads data using AWS services.

This session includes:
- Getting and storing API data with AWS Lambda and Amazon S3.
- Transforming the API data with AWS Glue & Amazon Athena.
- Pipeline automation and orchestration with AWS Step Functions and Amazon EventBridge.

Join to enhance your skills and explore the latest in Data Engineering and AWS.

The Case of the Disappearing Logs: An AWS Whodunnit
Simon Hanmer - Principal Consultant, GlobalLogic

In the mysterious world of cloud computing, our team set out to manage their vital logs in an S3 bucket. But as we attempted to retrieve them, the logs seemed to vanish without a trace—only to reappear minutes later. Was it a glitch or something far more elusive lurking in the shadows of their deployment? With no clear culprit in sight, the team was left to unravel the enigma of the missing data, as time continued to slip through our fingers. The chase was on...

Schedule (subject to timings)
17:45 - 18:00: Doors open - turn up, meet people, grab a drink.
18:00 - 18:30: Pizza arrives, more time for people to turn up - please arrive by 18:30 or you may not be able to get in!
18:30 onwards: Talk 1 - Damien Jones - Data Pipelines
19:15-ish: break time - an opportunity to chat, grab a drink, etc
19:45-ish: Talk 2 - Simon Hanmer - Disappearing S3 Logs
20:30-ish onwards: Continue the conversation over drinks at the Brew Society pub, which is round the corner on Aire Street

Where
BJSS, Ground Floor, 1 Whitehall Quay, Leeds LS1 4HR

A short walk from Leeds train station - head west down Aire Street, and it is on the left - you'll see the big 'bjss' sign in the window!

Food and Drink
We’ll be providing a range of drinks, both alcoholic and non-alcoholic, at the venue, from BJSS, our sponsors for this event.

Food will be in the form of pizza - please let us know if you have any specific dietary requirements prior to the day and we will endeavour to meet your needs.

Code of Conduct
Like a large number of other communities, we have an anti harassment policy and code of conduct, in order to support the inclusive nature of our events. Please view here. It is necessary for all attendees, speakers, sponsors and volunteers at any AWS User Group Leeds event to agree with the code of conduct.

Helping with diversity and inclusivity
The organising team for AWS User Group Leeds are keen to promote diversity and inclusivity, in terms of speakers, how events are run, and the composition of the organising team. If you would like to contribute to this aim, particularly if you think you have experiences that you might not consider to be typical for the majority of the tech community, we would be really excited to talk with you at the event.