PyTexas Monthly Meetup: Celery and its Challenges in Production - Dishant Sethi

Join us for our monthly meetup! The meetup will take place in the PyTexas Discord server, so be sure to join!

This month we are excited to be joined by Dishant Sethi

Speaker: Dishant Sethi
Topic: Celery and its Challenges in Production
Asynchronous task queues like Celery have become essential in handling time-consuming or background jobs and optimising performance in production.

Running Celery at scale comes with unique challenges. In this talk, will explore topics such as:

• maintaining worker reliability
• optimising tasks
• handling errors
• handling retries effectively
• task prioritisation
• monitoring
• autoscaling based on number of tasks under heavy workload