108 Spotkanie Data Community (PLSSUG) we Wrocławiu

Dzień dobry :)

Zapraszamy na, jak zawsze darmowe, spotkanie Wrocławskiej grupy pasjonatów technologii Microsoft SQL Server oraz Data Platform.

Miejsce to samo jak poprzednio - Pub Wędrówki na Podwalu.

➡️ Agenda spotkania:
18:00 – 18:10 Rozpoczęcie spotkania, sprawy organizacyjne
18:10 – 19:10 Databricks Delta Tables - Why You should not forget about OPTIMIZE and VACUUM operations - Maciej Jastrzębski
19:10 – 20:00 Networking, pizza
20:00 – 21:00 Big Data system migration to Azure - Paweł Tajs
21:00 Zakończenie

➡️ Abstrakty Sesji:

• Databricks Delta Tables
  Databricks Delta Tables. How You can work with them using almost pure SQL (including creation), and how important it is to have a proper maintenance process. What is the risk of leaving them alone?
• Big Data system migration to Azure
  The presentation describes the migration of a Big Data system to Azure, which involved moving 600 TB of data and consolidating it into a single narrow Delta table of 35 TB with over 430 billion rows. To accomplish this, a proof-of-concept (PoC) was conducted with the assistance of Microsoft and Databricks. The PoC allowed the team to explore different data formats and preview features, such as Databricks Serverless SQL Warehouse, while also analyzing the performance and costs associated with the migration. The results of this project demonstrate the feasibility of migrating large-scale data systems to Azure while taking advantage of advanced features and services.

Everything is presented in a live demo notebook mode, so it should be fun


➡️ BIO prelegentów:

• Maciej Jastrzębski - 13 years of experience in the Data World.
  Former Tester, Data Warehouse Developer, DWH Manager, BI Developer, Team Leader, and many more…
  Currently Principal Data Engineer at Volvo.
  Strong background in DWH, SQL, and ETL processes in the old on-prem world.
  Nowadays working in an Azure Cloud environment focusing on migration 'On-Prem to Cloud' projects.
  Using DataBricks in Azure for more than three years.
• Paweł Tajs - Azure Solutions Architect and Big Data Specialist with a mathematics background, started as Database Developer to gain extensive in-depth knowledge in SQL Server. Experienced in implementing and maintaining various data processing systems, focusing on delivering Spark projects with a comprehensive software development lifecycle (integration, testing, deployment). Currently designing the solutions to support Big Data Analytics using Databricks in Data Mesh architecture.

➡️
Dziękujemy partnerom grupy za wsparcie - dzięki nim możemy spotykać się w tak fajnym miejscu :)
* Objectivity
* Volvo Group Digital&IT
* Twoja firma? :)

➡️ W komentarzach nasi Partnerzy opowiedzą coś o sobie i się przywitają.
Zapraszamy serdecznie do zapoznania się, można znaleźć tam ciekawe rzeczy!

➡️
Gdyby i Twoja firma szukała okazji do współpracy to zachęcamy do kontaktu :)

Pozdrawiamy serdecznie,
Roman Czarko-Wasiutycz
Rafał Zakrzewski