OpenLineage Meetup @ Astronomer

Data engineers and pipeline managers know that producing data lineage – end-to-end pipeline metadata instrumented at runtime or parsed at design time – is a heavy lift without a shared standard for lineage metadata. It requires duplication of effort across pipeline tooling, and deployment of new tools can break existing lineage workflows. Getting useful lineage can seem like a sisyphean task.

Enter OpenLineage, an increasingly adopted open standard for lineage metadata collection. It defines a generic model of run, job, and dataset entities identified using consistent naming strategies. The core lineage model is extensible by defining specific facets to enrich those entities.

Join us at the SF Astronomer offices on August 30th at 5:30 pm PT to learn more about the OpenLineage spec. You’ll meet other members of the ecosystem, learn about the project’s goals and fundamental design, and participate in a robust discussion about the future of the project.

Also on the agenda: a special guest speaker, John Lukenoff, will be giving a presentation about his lineage use case.

Someone in the lobby will direct you to the seventh floor. If you arrive late, send us a message in Slack.