This incident has been resolved. We will provide further information in a public incident report.
Summary
On November 9, 2023, from 20:02 PM UTC to 20:20 PM UTC, we experienced intermittent timeout errors in storefronts and admin. Approximately only 13% of our global sessions were affected by this incident.
Our global sales flow and Admin were affected for 18 minutes during this incident.
We apologize for any inconvenience this may have caused.
Timeline
At 20:09 PM UTC, our incident response team was notified of the issue.
At 20:18 PM UTC , the team identified that a couple of offending apps overloaded our database, degrading its performance. The team promptly blocked them, mitigating the incident.
At 22:06 PM UTC , follow up actions were then executed by enabling more refined throttling policies that will catch similar cases in the future. The offending apps were then unblocked and monitored.
At 22:42 PM UTC , we declared the incident as fully mitigated.