Mini-meetup: graph-based DSLs for (not-only) Spark
Details
Graph-based DSLs for (not-only) Spark
Graphs are a natural and powerful way to capture relations.
In this talk, Andreas Drobisch from Fyber tries to shed some light on how they can be used to create DSLs in Scala, which than can be visualized and interpreted in different ways.
To do that, we will start with a little introduction to graphs, look into common examples and showcase how we used this approach to model our Apache Spark aggregations and generate code for Airflow.
There will be also a short excursion into the evolution of the (open-source) library that we used to implement the graph aspect, which went from OOP Interfaces to Typeclasses and cats.
After the talk, there will be time to discuss the topic while having a beverage and Pizza.
Looking forward to see you!
Please bring some kind of ID for an easy entrance.