Management UI Performance Degradation

From 17:54 UTC on April 22, our monitoring began detecting degraded performance on the Management UI, with response times increasing above normal levels. Customers may have noticed the Management UI feeling slow or unresponsive between 17:54 UTC on April 22 and 12:33 UTC on April 23.

A period of elevated automated traffic placed additional load on our servers, which combined with an existing issue in how we handle slow requests led to a gradual build-up that caused the performance degradation our monitoring detected.

Timeline

• 17:54 UTC, April 22 — Monitoring detects degraded performance and increasing response times
• 08:02 UTC, April 23 — Team alerted, investigation begins
• 09:37 UTC, April 23 — Servers restarted, normal performance restored
• 12:33 UTC, April 23 — Fix applied

What We've Done

• Updated our server configuration to prevent this from recurring
• Improved our alerting to ensure our team are notified more promptly of similar degradation
• Performance improvements to our most resource-intensive pages are underway

We appreciate your patience, and we're sorry for any disruption this may have caused. If you have any questions, please don't hesitate to reach out to our team.