ELT Pipelines in AWS, Azure, and GCP
Details
The Nashville Data Engineering Group will be hosting a special session from one of our organizing members, Ed Pearson. Prior to this session we will have thirty minutes dedicated to networking with other members of the Nashville tech community and a chance to eat lunch.
About the Session:
Coming into a new cloud environment, you often don’t know what services are available or which to use for building data integrations workflows. With the variety of offerings, from cloud vendor-specific, multi- cloud, or open source, it is difficult to choose the right tool for the cloud you are on.
In this session, Ed will go through an overview of some of the options available on AWS, GCP, and Azure. This will include many of the most common managed ETL/ELT offerings, such as Azure Data Factory, AWS Glue, and GCP Dataflow. Additionally, we will evaluate some open source or multi-cloud alternatives, like Airflow.
The session will explore the ease of getting started with each option, go through which languages and infrastructure may be required or supported, and build a short demo of a simple pipeline in each. We will also discuss what the cost differences are to get started and to put into production.
About the Speaker:
Ed is an experienced technical professional with over 25 years in the industry, with deep expertise in databases, ETL/ELT, data warehousing, and analytics. He has worked with a variety of organizations, from a Fortune 500 logistics company, to small-mid size health care companies, and small marketing and software companies to help them use data technology to drive business value. Focused almost exclusively on cloud technologies since 2014, primarily Azure and the Microsoft stack, with some workloads in AWS. Ed currently holds a position as a Senior Consultant in Data and Analytics for Slalom in Nashville. You can find Ed on LinkedIn or on Twitter @ecpdata
Location:
Nashville Software School | 301 Plus Park Blvd, Suite 300 Nashville, TN 37217
Please park on the North side of the building and enter the lobby. From there take the elevator to the third floor.
Schedule:
- 11:30-12:00 - Networking | Lunch
- 12:00-1:00 - ELT Pipelines in AWS, Azure, and GCP