Higher Order Function (Lambda) in Spark SQL
Speaker: Jonathan Winandy (Spark trainer)
Spark 2.4 introduces a possibility to write Higher Order Function in Spark SQL. Th addition of high order function allows expressing an optimized query against a complex data structure inside a Spark Dataframe, such as list, map, and a structure.
The talk will go in deep into this feature, compare it with existing solution such as User Defined Function, and also an internal work of the query execution.
