Skip to content

Details

Did you know that spark notebooks and data flows generation 2.0 are more costly than python notebooks? As a small company how can you do more with a small capacity?

I will be talking about Python notebooks in this session. Libraries such as Polars, Delta Lake, Duck DB and MS SQL are available to the designer to extract, transform and load data.

At the end of this talk, you will understand how to use the Capacity Metrics application to compare different data engineering designs and fine the most cost effective solution for your company.

Related topics

Big Data
Business Intelligence
Data Analytics
SQL Server
PostgreSQL

You may also like