A tour of a serverless file manager written in Go

Hi GoLang DC,

Please join us as we hear from Eric Bittleman, Principal Software Engineer at Fugue, as he shares how he leveraged Go to build an application that solves the ETL "small file" problem.

Food and drinks will be provided.

Agenda:
6:00 - Doors open. Food & drinks will be served compliments of Fugue.
6:25 - General intro
6:30 – Presentation*
7:15 - Q&A + Social

*Can't attend in person? Add the livestream to your calendar: https://www.hatchit.io/hatchpad-events/

Talk Abstract:
S3FC (S3 File Concatenator) is a new project being open sourced by Fugue. It aims to solve for the ETL "small file" problem (https://blog.cloudera.com/the-small-files-problem/) in a similar vein to Pail (https://freecontent.manning.com/wp-content/uploads/data-storage-in-the-batch-layer-with-pail.pdf).

Where it differs is that instead of being a library, it is a self-hosted cloud based serverless service built in Go running on top of AWS Step Functions. The application is a relatively simple but powerful tool for managing text based ETL source data. Eric will be doing a basic demo of its use cases and dive into its implementation showing how he leveraged the Go language and standard library to build the application.

Github Repo: https://github.com/fugue/s3fc

About the Speaker:
Eric Bittleman has been building software on small to medium sized teams for the past twelve years. He has been using Go as one of his primary languages for the past five years. Eric has worked on projects ranging from peer to peer digital market e-commerce applications to infrastructure as code and cloud security tools. He is currently a Principal Software Engineer at Fugue.

About our Sponsors:

Fugue
Fugue ensures cloud infrastructure stays in continuous compliance with enterprise security policies. Their solution identifies cloud infrastructure security risks and compliance violations and ensures that they are never repeated. Fugue provides baseline drift detection and automated remediation to eliminate data breaches, and powerful visualization and reporting tools to easily demonstrate compliance. To learn more about Fugue, visit: https://www.fugue.co/

hatch I.T.
hatch I.T. connects local engineers, startups, investors, and corporate leaders who share a common vision of strengthening the startup & innovation landscape in the DMV region. They specialize in software development, mobile development & product design recruitment for commercial product startups & small businesses in the DMV region.
To learn more about hatch I.T., visit: https://www.hatchit.io/