SciCLOps: A Databricks Quickstart, Powered by DABs

Early in our journey, Databricks users at our company implemented workflows individually, leading to inconsistency and slow onboarding for teams. We have since built a tool (that we call “SciCLOps”) powered by Databricks Asset Bundles (DABs) to enable better workflow reuse and standardization across data engineering, ML, and data science. DABs combined with Terraform, Github Actions, and a service catalog has enabled:

·Users to request Databricks environments with no manual intervention by platform teams
·Much simpler adoption of changes to workflow standards
·Day two support for projects (such as automatic PAT rotation and MLOps)
·Faster promotion of models and science to production due to consistent workflows
·Much more!

SciCLOps has made significant impact to our onboarding speed and time to production. We will give a demo of our SciCLOps tool, as well as explain our journey in building it and the observations we have made along the way.

You will hear from Tara Enright, Senior Data Engineer, and Connor Brown, Lead Data Engineer, 84.51°

Light bites and drink will be provided.

AGENDA
5:30-7:00 p.m. CT
5:30-5:45 p.m. – Food/Networking
5:45-6:15 p.m. – Speaker
6:15-6:30 – Q&A
6:30-7:00pm – Q&A/Networking

EVENT LOCATION
84.51°, 433 W Van Buren St #610s, Chicago, IL 60607
"Old Post Office Building". Attendees will be added to the building visitor list. Please check in at the information desk at the main Van Buren lobby. After check-in, take the DS elevator bank to the 6th floor.

If unable to attend in person, you may join the event via Microsoft Teams.
Click here to join the meeting
Meeting ID: 250 484 152 380
Passcode: Hz3P94

ABOUT 84.51° SCIENCE & TECHNOLOGY SOLUTIONS
We will share exciting science and technology use cases around various Engineering, Data Science, and other Technology topics occurring at 84.51°. Our goal is to network and collaborate with our local data science, engineering, and technology professionals. While anyone is welcome to attend, our topics are specific to Engineering and Data Science.

ABOUT 84.51°
84.51°is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliated partners create more personalized and valuable experiences for shoppers across the path to purchase. Powered by cutting edge science, we leverage 1st party retail data from over 62 million U.S. households to fuel a more customer-centric journey utilizing 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.