Making Apache Spark™ Better with Delta Lake

Details

Apache Spark and Delta Lake (delta.io) are both open-source projects that help with big-data production workloads. While Apache Spark is de-facto the industry standard for big data processing, Delta is a newer complementary project that has recently moved under Linux Foundation to become a standard for building data lakes (and more) in cloud. The last news was just freshly announced at Spark + AI Summit in Amsterdam this October and will get introduced to our community by Jirka Harazím, a Solutions Architect from Databricks.