September Monthly CASSUG Meeting

Greetings, data enthusiasts!

Our September meeting is scheduled for Monday, September 21st, at 5:30 pm! We will meet in person at: Troy Web Consulting, 135 Mohawk St, Cohoes, NY 12047.

Please RSVP if you are attending, so we can purchase an appropriate amount of food for everyone. Food is TBA and will be announced closer to the meeting date. For this meeting, we are welcoming back John Miner, who hails from Rhode Island, to introduce us to the Data Build Tool (DBT)! Thank you for taking the time and energy to travel to Albany to share your experience with us!

Our meeting schedule is as follows:

5:30 PM: Food, soft drinks, and networking
6:15 PM: Chapter news and announcements
6:30 PM: Presentation

We usually wrap up between 7:30 PM and 8:00 PM. John will be presenting, "Introduction to the Data Build Tool (DBT)"

Session Details:
Many people learn from the Jaffle Shop sample dbt project. However, the complexity of the project is quite simple. What I really wanted is a project that goes over the following dbt concepts:

• Seed raw data tables
• Transform raw data using views
• Support multiple databases with macros
• Capture slowly changing dimensions type
• Incremental loading of large data
• Use ephemeral tables as a place holder
• Use dbt utils package to make a date dimension
• Create a dimensional model for reporting
• Save pre-canned queries in analyses directory
• Test data quality using property/schema files
• Output custom data quality exceptions to a table
• Create documentation based on model design

In the end, I created my own sample dbt project using the Chinook database schema as the foundation. I must thank Luis Rocha for the OLTP database design and sample data.

This open source project was built using an Fabric SQL Database as the target. However, it can be built on any supported database using the correct dbt adapter and ODBC driver. At the end of this presentation, a data engineer will be ready to model data for any given database or warehouse.