This event has passed
A sister Meetup group in Austin, Texas is holding this event; due to the new coronavirus outbreak, this will be held online.
Creating an Automated Spark Development Environment with Analysis and Logging
Wednesday, October 7,[masked]:00 PM
In this meetup, we’re going to put ourselves in the shoes of a Data Engineer tasked by the State of Texas to create processes that extract, transform, and load publicly accessible financial data from the Paycheck Protection Program. This data can then be used in order to create reports that state elected officials can use to make decisions. We’ll also go over how you can leverage CLI tools to create a system in which you can continuously deploy your newly developed Spark jobs through some automation scripts, saving huge amounts of development and deployment time. At the end we’ll even take a look at the finished result of our reports!
Come join us to see this example of the new Data Engineering Experience in action and hopefully inspire similar solutions of your own!