Name: DataOps in action with Nessie, Iceberg and Great Expectations
Start: 2022-11-15T18:00:00+01:00
End: 2022-11-15T19:30:00+01:00

We are back again with another meet-up in which we will explore modern and innovative data engineering concepts and technologies.

What is DataOps? Why do we need it and how to put in into action?
With the spotlight on Nessie, Iceberg, and Great Expectations, Antonio Murgia will lead us to conquer the great expectations(pun intended) of DataOps: velocity, reliability, quality.

Project Nessie enables version control on data lakes (iceberg tables, views, and delta lake tables). It is a transactional catalog for data lakes with git-like semantics.
Apache Iceberg is a high-performance format for huge analytic tables. It supports flexible SQL commands and schema evolution, it hides partition management and supports time travel.
Great Expectations is an open standard for data quality providing data testing as well as automated documentation and profiling.

Antonio Murgia is a big data architect at Agile Lab, he is also an Apache Spark contributor.
https://www.linkedin.com/in/antonio-murgia/

Grab your drink of choice and join us November 15 at 18:00 on [teams](https://teams.microsoft.com/l/meetup-join/19%3ameeting_ZmNiMmFmMDAtNDA3OS00NTg5LTlhMGYtNjc4MDMzYjA5Mzdi%40thread.v2/0?context=%7b%22Tid%22%3a%22eee7e750-299f-468f-a6c3-9f28923f6133%22%2c%22Oid%22%3a%2218ed30a8-1866-4b91-8cc4-d9745bf1d13f%22%7d).

Eugeniu

Big Data & AI Milano

Technology

Open Source

Hadoop

Big Data

Apache Spark

Apache Kafka

Spark Streaming

Artificial Intelligence

Machine Learning

NoSQL

Data Visualization

MapReduce

DataOps in action with Nessie, Iceberg and Great Expectations

Data Engineering

DataOps

Online event

Share

Big Data & AI Milano

DataOps in action with Nessie, Iceberg and Great Expectations

Big Data & AI Milano

Details

Members are also interested in