Cross-list: Creating an Automated Spark Development Environment with Analysis

Future of Data: Kansas City
Future of Data: Kansas City
Public group

Online event

This event has passed

Details

A sister Meetup group in Austin, Texas is holding this event; due to the new coronavirus outbreak, this will be held online.

Creating an Automated Spark Development Environment with Analysis and Logging

https://www.meetup.com/futureofdata-austin/events/272704970/

Date/Time
Wednesday, October 7,[masked]:00 PM

Details
In this meetup, we’re going to put ourselves in the shoes of a Data Engineer tasked by the State of Texas to create processes that extract, transform, and load publicly accessible financial data from the Paycheck Protection Program. This data can then be used in order to create reports that state elected officials can use to make decisions. We’ll also go over how you can leverage CLI tools to create a system in which you can continuously deploy your newly developed Spark jobs through some automation scripts, saving huge amounts of development and deployment time. At the end we’ll even take a look at the finished result of our reports!

Come join us to see this example of the new Data Engineering Experience in action and hopefully inspire similar solutions of your own!

Attendees (1)