The TBDEG is joined again by Alex Merced for a discussion on data engineering!
Note: the Zoom meeting will be open 10-15 minutes prior to the event and will be recorded.
Title
TBDEG - Zero ETL & Virtual Data Marts: A Discussion in Painless Data Engineering by Alex Merced
Abstract
The challenges of building and maintaining data pipelines have become all too familiar. This meetup, titled "ZeroETL & Virtual Data Marts: A Discussion in Painless Data Engineering," aims to shed light on these common pains and explore innovative solutions that can revolutionize the field.
The event will kick off with an engaging presentation that delves into the typical pain points experienced by data engineers. These challenges include dealing with brittle pipelines that often necessitate endless backfilling and contending with the delays resulting from layers of pipelines, leading to stale and inaccurate data reaching data consumers.
However, the meetup doesn't stop at identifying problems. Our discussion will introduce you to potential solutions that harness the power of Dremio, enabling the adoption of "Painless" Patterns such as "ZeroETL" and "Virtual Data Marts." These patterns are designed to reduce the manual effort involved in data movement and the creation of data movement pipelines. Attendees will gain insights into how these approaches can streamline data engineering workflows, enhance data quality, and improve data accessibility for stakeholders.
Following the presentation, we invite the audience to participate in an open discussion. This forum provides a platform for data professionals to share their own challenges in the world of data engineering, exchange ideas, and explore collaborative solutions. It's an opportunity to connect with fellow data enthusiasts, industry experts, and peers, making it an invaluable experience for anyone looking to navigate the complexities of modern data engineering with less pain and more efficiency.
Join us at "ZeroETL & Virtual Data Marts: A Discussion in Painless Data Engineering" and be part of a dynamic conversation that promises to reshape the way we approach data engineering challenges. Together, we can pave the way for a more seamless and productive future in the world of data.
Bio
Alex Merced is a developer advocate for Dremio, a developer, and a seasoned instructor with a rich professional background. Having worked with companies like GenEd Systems, Crossfield Digital, CampusGuard, and General Assembly.
Alex is a co-author of the O'Reilly Book "Apache Iceberg: The Definitive Guide." With a deep understanding of the subject matter, Alex has shared his insights as a speaker at events including Data Day Texas, OSA Con, P99Conf and Data Council.
Driven by a profound passion for technology, Alex has been instrumental in disseminating his knowledge through various platforms. His tech content can be found in blogs, videos, and his podcasts, Datanation and Web Dev 101.
Moreover, Alex Merced has made contributions to the JavaScript and Python communities by developing a range of libraries. Notable examples include SencilloDB, CoquitoJS, and dremio-simple-query, among others.
twitter: amdatalakehouse
threads: alexmercedcoder
mastodon: @alexmerced@data-folks.masto.host
linkedin: /in/alexmerced
