Scaling Postgres to the next level at OpenAI

PostgreSQL serves as a cornerstone of OpenAI's backend infrastructure, powering many of our most critical features. In this talk, I will share how we've taken PostgreSQL to the next level to handle OpenAI's demanding workloads. I'll cover the challenges we faced, the lessons learned from outages, and the strategies we implemented to scale PostgreSQL to handle millions of queries per second (QPS).

Key topics include:

• Connection Pooling: How we effectively manage connection pooling with PgBouncer.
• Read Replication: Strategies for scaling read replicas to meet increasing demand.
• Schema Migrations and Long-Running Queries: Approaches to seamless schema migrations and resolving performance bottlenecks caused by long-running queries.
• Observability: Enhancing monitoring and observability to ensure reliability and performance.

Pizza is provided, and we also have a user group lending library of books & papers related to Postgres and Databases.

===== Speaker:
Bohan Zhang is a member of the technical staff at OpenAI. Prior to joining OpenAI, he co-founded OtterTune, a startup specializing in automatic database tuning services. He has also been a speaker at various PostgreSQL conferences, including PostgresConf 2024 and PostgresConf Silicon Valley 2023. He also co-authored with Prof. Andy Pavlo the article "The Part of PostgreSQL We Hate the Most," which critically examines PostgreSQL's implementation of MVCC, and is cited in the PostgreSQL's Wikipedia page.