Skip to content

Graph-based stream processing with Apache Pulsar

Photo of Zhenhao Li
Hosted By
Zhenhao L.
Graph-based stream processing with Apache Pulsar

Details

The Netherlands Pulsar group's first in-person meetup will take place at The Hacker Building (www.hackerbuilding.nl, Herengracht 551, Amsterdam) on Friday 8th April!
The second talk will be streamed via this link: https://www.airmeet.com/e/6b991480-b5c2-11ec-be1a-5fae97929f62

Talk 1: Graph-based stream processing with Apache Pulsar

By ingesting data with Apache Pulsar and applying graph-based stream processing in real-time, you can perform near-instantaneous graph analytics on vast amounts of data. The application that analyzes the Twitter network, created with the Apache Pulsar as an essential part of the application’s architecture, will be shown. Pulsar provides easy communication between Memgraph and the backend server.
When connecting a Pulsar data stream to Memgraph, you only need to create a transformation module that will map incoming messages to the property graph model. This data can then be traversed and analyzed using the Cypher query language without implementing custom algorithms or relying on development-heavy solutions. MAGE (Memgraph Advanced Graph Extensions) is a graph library that works well with Pulsar-powered systems and contains graph algorithms meant for analyzing streaming data.

Speakers:
Ivan Despot is a Developer Relations Engineer at Memgraph. His passion for mathematics and graph theory inspired him to become part of the Memgraph team and start contributing to the field of graph analytics. Besides graph-based technologies, he is also interested in streaming platforms, stream processing, and event-driven development.
Katarina Šupe is a Developer Relations Engineer at Memgraph. Her journey there started with a summer internship, and her mathematics and computer science background was a perfect match to work in Memgraph. She enjoys contributing to different areas and exploring new real-time data visualization technologies. She sees the graph world as a future of data analytics due to the variety of algorithms used for stream processing.

Talk2 (remote): Deep Dive into the Pulsar Binary Protocol

To achieve maximum performance, some important choices have been made when designing the Pulsar binary protocol.
This talk will explain how Pulsar implements all the features of a high quality streaming protocol such as frame multiplexing, session establishment, keep-alive, flow control, authentication and authorisation, encoding, zero-copy capabilities and more.

Speaker:
Christophe Bornet is a Senior Software Engineer at DataStax. Through his love for open source, he is a core team member of JHipster and OpenAPI-generator. Christophe discovered Pulsar in 2018 during a R&D project he was leading at Cdiscount, and since then has made various contributions to it.

Reservation required
Please sign up now if you are coming so that we can start working on the logistics. We want to arrange drinks for everyone;)
If you change your plan later, don't forget to update your RSVP.
Looking forward to seeing you in person!

Next meetup in May
We have an amazing speaker visiting Amsterdam from Monday 16th May to Wednesday 18th May. We are looking for a host for one of those evenings.

Photo of Netherlands Apache Pulsar Meetup group
Netherlands Apache Pulsar Meetup
See more events
The Hacker Building
Herengracht 551 · Amsterdam, NH