Dzień dobry :)
Zapraszamy na, jak zawsze darmowe, spotkanie Wrocławskiej grupy pasjonatów technologii Microsoft SQL Server oraz Data Platform.
Spotkanie odbędzie się 24.10 tradycyjnie w Pub Wędrówki na Podwalu.
➡️ Agenda spotkania:
18:00 – 18:15 Rozpoczęcie spotkania, sprawy organizacyjne
18:15 – 19:30 The New Kid on the Data Lakehouse Block - Piotr Ostrowski
19:30 – 20:10 Networking, pizza
20:10 – 21:00 Wprowadzenie do Delta Live Tables - Konrad Kukulski
21:00 Zakończenie
➡️ Abstrakty Sesji:
- The New Kid on the Data Lakehouse Block - Piotr Ostrowski
Presentation on Ilum, the latest entrant in the Data Lakehouse platform market, designed as a robust, free alternative to platforms like Databricks and Cloudera.
Why should you attend?
- Understand the limitations of current platforms: we’ll discuss the key challenges with existing data management systems—high costs, rigid deployment options, and complex administrative tasks.
- Introduction to Ilum: learn about Ilum’s core features and how it reduces administrative overhead with automated integrations with Kubernetes.
- Kubernetes and data management: explore how Kubernetes simplifies data operations, providing automatic scaling, failover capabilities, and streamlined cluster management.
- Ilum’s evolution into a Data Lakehouse platform: discover Ilum’s growth from a simple tool to an advanced Data Lakehouse platform, leveraging open-source tools like Jupyter and MLflow for flexible and scalable data operations.
This presentation is perfect for data engineers who need practical and scalable solutions for managing large datasets without the burden of heavy infrastructure.
- Wprowadzenie do Delta Live Tables - Konrad Kukulski
Podczas tej sesji przybliżymy koncepcję Delta Live Tables (DLT) – nowoczesnego narzędzia zaprojektowanego przez Databricks do automatyzacji i uproszczenia przetwarzania danych. Skupimy się na omówieniu, jak DLT pomaga w zarządzaniu złożonymi przepływami danych, zwiększając niezawodność, optymalizację i łatwość monitorowania procesów przetwarzania.
Kluczowe punkty sesji to:
Czym są Delta Live Tables i jakie problemy rozwiązują w kontekście inżynierii danych?
Przegląd funkcjonalności DLT, w tym automatyzacja, transformacje oraz zarządzanie wersjonowaniem danych.
Przykład praktycznego zastosowania DLT: stworzenie prostego pipeline'u do przetwarzania danych.
Dyskusja na temat przyszłych kierunków rozwoju narzędzi wspomagających zarządzanie strumieniami danych.
Sesja dostarczy uczestnikom solidnych podstaw do zrozumienia roli DLT w przetwarzaniu danych, pokazując, jak mogą wykorzystać to narzędzie w swoich codziennych projektach, aby uprościć i zautomatyzować przepływy danych.
➡️ BIO prelegentów:
- Piotr Ostrowski – an experienced specialist with over ten years of experience in the technology industry. He began his career as a Cloud Engineer and later honed his skills in roles such as Big Data Developer, Technical Leader, Lead Solution Architect, and now serves as Client Solutions Director.
Throughout his career, Piotr has gained expertise working with a variety of technologies, with a particular focus on Big Data and Blockchain. This has enabled him to lead advanced projects for international clients, with a strong emphasis on the Asian and Australian markets. His combination of technical knowledge and management skills makes him a leader in creating innovative technological solutions. His career is a testament to his dynamic growth and commitment to seeking the best, tailored solutions for businesses.
- Konrad Kukulski
Konrad Kukulski is an experienced ML Architect and Senior Data Engineer with a strong focus on machine learning, AI, and data engineering, particularly in cloud environments like Azure and AWS.
He brings over a decade of experience across industries including finance, logistics, telecommunications, and retail, where he has designed and managed complex data pipelines using technologies such as Azure Databricks, Synapse, Data Factory, and Azure Machine Learning.
Building on his academic background in computer science and medical informatics, Konrad has also been involved in research projects at the intersection of AI and medicine, developing innovative solutions for healthcare challenges.
In addition to his technical expertise, Konrad has extensive experience in data science, having developed machine learning models for predictive analytics, recommendation systems, and risk management.
His expertise includes consulting on AI solutions, optimizing ETL processes, and driving business value through data-driven projects. A passionate chess enthusiast, Konrad combines his strategic mindset with cutting-edge technologies in his professional endeavors.
Partnerzy spotkania:
* Sofixit
* Accenture
* Lingaro
Pozdrawiamy serdecznie,
Rafał Zakrzewski
Robert Tomaszek