Skip to content

Apache Airflow TLV Meetup 🍁 Fall Edition with SQream

Photo of Databand, an IBM Company
Hosted By
Databand, an IBM C.
Apache Airflow TLV Meetup 🍁 Fall Edition with SQream

Details

Welcome to our fall edition Meetup, hosted by Databand & sponsored by SQream.
*Lectures will be presented in Hebrew.
*This event will be presented both in-person and virtually – a virtual link is provided below.
*Attendees must register with an email address.
/////////////////////////////////////////////////////////////////////////////////
About SQream:
SQream makes it possible to ask bigger questions of extremely large, complicated data sets. With no off-limits questions, data scientists in manufacturing, telecom, and finance get unprecedented new insights at exceptional speed. For far too long, decision makers have known that the critical answers they needed were in their data, but it was impossible to get to them. With SQream, you can finally “dig deeper, go faster, and reach anywhere” so you’re able to ask bigger questions about your data – on prem, in the cloud, or at the edge. This is why organizations ranging from fast-growth startups to Fortune 100s rely on SQream. Ask bigger.
/////////////////////////////////////////////////////////////////////////////////
Event Description:
Join us for a new and exciting event with two lectures from fellow data engineers and leaders in the industry. In this event, you'll learn how SQream is building the next-gen data Lakehouse and how they make it possible to ask the bigger questions when dealing with large and complicated data sets. Additionally, you'll learn about cross-platform data Lineage and the challenges of observing data flow in complex data pipelines, as well as understanding the impact of pipeline failures.

Stick until the end of the event for questions and cool giveaways!
/////////////////////////////////////////////////////////////////////////////////
Schedule:
18:00-18:30 - Gathering - Pizza and beers
18:30-18:35 - Welcoming and introductions
18:35-19:20 - SQream lecture: Building the next-gen data Lakehouse
19:20-19:50 - Databand lecture: Cross-platform data Lineage
19:50-20:15 - Questions and giveaways*

*Giveaways are for in-person attendees only

// Building the next-gen data Lakehouse by Yaniv Leven, VP SaaS Products, and Rotem Shaltiel, Solution Architect at SQream
In our first lecture, Yaniv and Rotem will go over the challenges in building a peta-scale data Lakehouse, using Airflow as a transformation layer and GPU as the core computing power to support it. SQream helps make it possible to ask bigger questions of extremely large, complicated data sets. Using a superfast GPU-based engine, analysts get unprecedented new insights at exceptional speed.

// Cross-platform Data Lineage by Niv Sluzki, Engineering Manager at Databand
Everybody is talking about data lineage these days, yet the main focus is on what happens inside the data warehouse. In this lecture, I'll explain the challenges of observing data flow in complex data pipelines that involve Airflow, dbt, and managed Spark services. I'll also cover the challenges that occur when trying to understand the impact of a pipeline failure when running on multiple distributed systems and how you can achieve a lineage solution in your data architecture.
/////////////////////////////////////////////////////////////////////////////////
Can't attend in person? No problem!
Join the Meetup virtually here:
https://us06web.zoom.us/j/84092364208?pwd=ZFNMRVBYREM4aDc2Ykp3cjdBUVdsZz09
Topic: SQreameet-up
Time: Oct 25, 2022 at 06:30 PM (Jerusalem Time)
Meeting ID: 840 9236 4208
Passcode: 471428
/////////////////////////////////////////////////////////////////////////////////
Travel tips:

  • There is no parking at the building. Attendees and participants can find paid parking around the premises.
  • All participants must bring an ID with them to enter the building and access the event space.

COVID-19 safety measures

Masks required
Event will be indoors
The event host is instituting the above safety measures for this event. Meetup is not responsible for ensuring, and will not independently verify, that these precautions are followed.
Photo of Tel Aviv Apache Airflow Meetup group
Tel Aviv Apache Airflow Meetup
See more events