
What we’re about
This is a developer-centric meetup focused on Apache Spark, Apache Flink, Apache Kafka, Apache Mesos, related Typesafe and Twitter OSS stacks, and broader distributed Data Science and Machine Learning. We're open to all OSS developers, vendors, consultants, and startups both using the tools and building or supporting them, attending, presenting, and organizing.
How it may be complementary to the original Spark Users, now Bay Area Spark Meetup: Spark in its end-to-end ecosystem -- Mesos, Akka, Kafka, Cassandra, etc., with focus on what works for the final goals of the whole pipeline. We will teach you how to use Scala for Spark to make you more effective, and consider devops options so you can get to production faster. We'll invite projects relevant to or inspired by Apache Spark, such as Apache Storm, Apache Flink, and others, and will be focused on putting together useful OSS as a system.
Upcoming events (2)
See all- Workshop: "Building production-ready LLM-powered applications" by Josh TobinOakland Scottish Rite Center, Oakland, CA
📣 Attention! Clear your schedules for November 13th! 🗓️
🌟 We're thrilled to host a Workshop "Building production-ready LLM-powered applications" with Josh Tobin, CEO of Gantry & co-creator of Full Stack Deep Learning.
A must-attend for anyone interested in #AI & #LLM! 🌟
Food and drinks are included 🍕🥤👉 Secure your spot today for this transformative session!
About the course
The way AI-powered apps are built has changed:- Before LLMs, an idea would bottleneck on training models from scratch, and then it'd bottleneck again on scalable deployment.
- Now, a compelling MVP based on pretrained LLM models and APIs can be configured and serving users in an hour.
An entirely new ecosystem of techniques, tools, and tool vendors is forming around LLMs. Even ML veterans are scrambling to orient themselves to what is now possible and figure out the most productive techniques and tools.
In this course, we'll teach you how to build AI-powered applications from scratch, while following the best practices that will allow you to balance shipping quickly with building high-quality, production-ready applications your users trust. We'll walk you through a structured approach to AI app development loosely based on the test-driven development methodology used in traditional software engineering.
About your Instructor
Josh Tobin is the cofounder and CEO of Gantry, co-creator of Full Stack Deep Learning, and a former OpenAI / UC Berkeley AI researcher.Gantry is building product testing and analytics for AI-powered applications.
Testing and analytics are essential tools when building any product, but they’re even more essential for AI-based applications. That’s because these applications fail in harder-to-detect ways, and those failures erode user trust over time, eventually leading to churn. Gantry helps you build AI your users trust through powerful observability, analytics, and evaluation for your AI-powered products.
About The Full Stack
Building an AI-powered product is much more than just training a model or writing a prompt.The Full Stack brings people together to learn and share best practices across the entire lifecycle of an AI-powered product: from defining the problem and picking a GPU or foundation model to production deployment and continual learning to user experience design.
We've taught courses in building deep learning-powered applications at UC Berkeley, in-person, and online. More recently, we hosted the first LLM bootcamp focused on teaching practitioners how to build LLM-powered applications, from prompt engineering to retrieval augmentation and AI-first design. Our courses have featured contributed lectures from Pieter Abbeel (Professor at UC Berkeley and co-founder of Covariant), Richard Socher (co-founder of You.com and former Chief Scientist / EVP at Salesforce), and Andrej Karpathy (OpenAI researcher and former Director of AI at Tesla).
Our courses have been described as "high quality tokens" by Andrej Karpathy, "the most comprehensive and interesting class I ever attended" by Boris Dayma (creator of Craiyon and Dall-E mini), and "I can't believe they made this available for free" by Jo Kristian Bergum (Distinguished Engineer at Yahoo and Co-Creator of Vespa).
- Scale By the Bay is back in November!Oakland Scottish Rite Center, Oakland, CA
Scale By the Bay returns in person at its iconic home in Oakland on the shores of Lake Merritt.
Central theme is "Code and Data in the Age of AI.
We'll have our famous three tracks and a new one:
- Thoughtful Software Engineering
- Cloud Architectures
- Data Pipelines for ML/AI
- Open-Source Science (brand new)
It's been awhile since our meetups reconvened in person. We're slowly getting back into the swing of things. Companies are opening their doors, engineers trek to workshops and live events all over Bay Area. We'll have our hallway track, OSS demos, a bespoke all-day hands-on workshop the day before the talks, a fireside chat with OpenAI, and folks from all the leading companies in technology sharing their insights.
There will be code and data in every talk. The density of actionable content at SBTB is at least 5x higher than any other event you'll attend this year. As an independent conference, we can compare all systems objectively and real usage in the wild by 3rd parties will help you build better and faster.
The incredible line-up of speakers is here, with more to come.
Check the intro videos for inspiration.
We need all our sponsors back - coming back live is no easy feat. If your company cares about developer community, connect with us on sponsorship opportunities and reengage with our community going forward, and SBTB and the meetups and around the world.
Early Bird, Special rates, and Diversity tickets are available!
Secure your spot now and see you by the Bay!