Wait Your Turn - Durable Queues in Postgres

What do you do when the work required to handle a web request takes longer than the browser timeout? What do you do when you need to do something but there are no users around to talk to your server? You, my friend, need a queue.

This talk is about building job queues to do the grunt work in your web app. We'll start with the motivations for using a queue and we'll proceed by building one from scratch using PostgreSQL. We'll discuss features like persistence, concurrent job handling, retries, fault tolerance, and responding to jobs sent from outside your app.

We'll follow a running example of a shared, live word cloud that grows as we throw content at the server. Bring a laptop or a phone — yes, you'll all be able to submit URLs to a server full of strangers, what could possibly go wrong — and we'll watch it scale, and occasionally fall over, in real time. Aimed at anyone who's wired background jobs into a Node app and wanted a clearer picture of what's going on under the hood; no Postgres experience required.

🍕🍻 Pizza and drinks will be provided thanks to sponsorship from Puck - the open source visual editor for React.

In-person attendees: Please arrive at Runway East (ground floor) between 19:00 and 19:15 for refreshments and socializing. Make sure you are registered to attend so we have an idea of numbers for catering.

Remote attendees: We will start broadcasting the event at 19:30 online via YouTube, there is no need to register.

Don't forget to join the Async Slack for updates.