SF Data and AI Engineering

Welcome to Data and AI Engineering, a community for developers, engineers, and enthusiasts passionate about the tools, technologies, and practices driving modern data and AI innovation.

Our focus spans the entire ecosystem of data engineering and AI engineering, from foundational data systems to cutting-edge machine learning infrastructure. We cover topics like:

• Distributed computing with Apache Spark, Flink, and related frameworks.
• Database systems, including PostgreSQL, Oracle, DuckDB, and Snowflake.
• Data lake and table formats like Apache Iceberg and Delta Lake.
• Emerging tools like Weaviate, vector databases, and other AI-focused technologies.
• DevOps and production strategies for pipelines and machine learning systems.

Whether you’re a developer building pipelines, a data scientist operationalizing models, or a systems architect designing for scalability, you’ll find something valuable in our talks, workshops, and hackathons.

We are open to OSS developers, vendors, consultants, and startups—anyone who builds, supports, or benefits from these tools.

Our community thrives on sharing practical insights, lessons learned, and solutions to real-world challenges.

Join us to learn, collaborate, and advance the field of Data and AI Engineering together!

Also, subscribe to our luma to be first to receive our newsletter and event invites:

https://lu.ma/aiengineering