addressalign-toparrow-leftarrow-rightbackbellblockcalendarcameraccwcheckchevron-downchevron-leftchevron-rightchevron-small-downchevron-small-leftchevron-small-rightchevron-small-upchevron-upcircle-with-checkcircle-with-crosscircle-with-pluscrossdots-three-verticaleditemptyheartexporteye-with-lineeyefacebookfolderfullheartglobegmailgooglegroupshelp-with-circleimageimagesinstagramlinklocation-pinm-swarmSearchmailmessagesminusmoremuplabelShape 3 + Rectangle 1ShapeoutlookpersonJoin Group on CardStartprice-ribbonShapeShapeShapeShapeImported LayersImported LayersImported Layersshieldstartickettrashtriangle-downtriangle-uptwitteruserwarningyahoo

A Deep-dive into Structured Streaming

Hello Spark Enthusiastic's! 

We would like to invite you to join us on Marionete Offices where we will have Tathagata Das, Databricks Professional talking in live video. Please create an account here and bring your own laptop!

6:30-6:45pm: Mingling

6:45-7pm: Welcome

7-7:40pm: Apache Spark 2.0: Structured Streaming with Tathagata Das

7:45-8:30pm: Databricks Community Edition Workshop with Carlos and Raul

8:30-8:40pm: Mingling 

Abstract: A Deep-dive into Structured Streaming 

In Apache Spark 2.0, we have extended DataFrames and Datasets in Spark to handle streaming data. Streaming Datasets not only provides a single programming abstraction for batch and streaming data, it brings support for event-time based processing, out-or-order/delayed data, sessionization and tight integration with non-streaming data sources and sinks. In this talk, Tathagata will take a deep dive into the concepts and the API and show how this simplifies building complex “continuous applications."


Tathagata Das is an Apache Spark Committer and a member of the PMC. He’s the lead developer behind Spark Streaming, and is currently employed at Databricks. Before Databricks, you could find him at the AMPLab of UC Berkeley, researching about datacenter frameworks and networks with professors Scott Shenker and Ion Stoica.

Join or login to comment.

  • Carlos R.

    TD talk slides:

    1 · December 7

  • Jules S. D.

    Thank you to Raul, Carlos, and the Marionete team for hosting and launching the first Apache Spark Meetup in Lisbon.

    Good to see you all virtually; may be next time physically.

    1 · December 6

    • Carlos R.

      Thanks Jules for setting this up!!! And TD for the excellent talk!

      December 6

  • Nuno V.

    Great presentation! Waiting for the next one! Kafka maybe? :)

    December 6

    • Carlos R.

      Hello Nuno, thank you for showing up! We have some plans already :) The next topics will be Cloudera and kafka on think big data group.

      1 · December 6

  • Miguel S.

    Hello! During the workshop will the focus be in the Community Edition or we will also work with the Full-Platform Trial?

    December 4

    • Raul F.

      Hello Miguel! Thanks for your question.

      The Community Edition is enough for our workshop. The extra functionalities present in the Full Platform version are not a requirement for this demonstration.

      December 5

    • Miguel S.

      Ok. Thanks very much!

      December 5

  • Carlos

    December 8 is a public holiday. For me it's fine, but not sure that was the intended

    November 4

    • Carlos R.

      Hello Carlos thx for notice it. We rescheduled it to 6th of December!

      November 4

Our Sponsors

People in this
Meetup are also in:

Sign up

Meetup members, Log in

By clicking "Sign up" or "Sign up using Facebook", you confirm that you accept our Terms of Service & Privacy Policy