This incident has been resolved. We will provide further information in a public incident report.
Summary
On November 9, 2023, from 20:02 PM UTC to 20:20 PM UTC, we experienced intermittent timeout errors in storefronts and admin. Approximately only 13% of our global sessions were affected by this incident.
Our global sales flow and Admin were affected for 18 minutes during this incident.
We apologize for any inconvenience this may have caused.
Timeline
At 20:09 PM UTC, our incident response team was notified of the issue.
At 20:18 PM UTC , the team identified that a couple of offending apps overloaded our database, degrading its performance. The team promptly blocked them, mitigating the incident.
At 22:06 PM UTC , follow up actions were then executed by enabling more refined throttling policies that will catch similar cases in the future. The offending apps were then unblocked and monitored.
At 22:42 PM UTC , we declared the incident as fully mitigated.
No components marked as affected
Resolved
This incident has been resolved. We will provide further information in a public incident report.
Summary
On November 9, 2023, from 20:02 PM UTC to 20:20 PM UTC, we experienced intermittent timeout errors in storefronts and admin. Approximately only 13% of our global sessions were affected by this incident.
Our global sales flow and Admin were affected for 18 minutes during this incident.
We apologize for any inconvenience this may have caused.
Timeline
At 20:09 PM UTC, our incident response team was notified of the issue.
At 20:18 PM UTC , the team identified that a couple of offending apps overloaded our database, degrading its performance. The team promptly blocked them, mitigating the incident.
At 22:06 PM UTC , follow up actions were then executed by enabling more refined throttling policies that will catch similar cases in the future. The offending apps were then unblocked and monitored.
At 22:42 PM UTC , we declared the incident as fully mitigated.
Monitoring
We continue to work on mitigation actions in order to guarantee normal platform behavior and implement preventive measures.
We will send an additional update in the next 30 minutes, or as soon as we have more information to share.
Monitoring
Although the issue was mitigated, some shoppers may experience instability in Cart, using Storeframework and Admin.
Our incident response team is monitoring to guarantee that normal platform behavior is fully reestablished.
We will send an additional update in the next 30 minutes, or as soon as we have more information to share.
Monitoring
We identified an issue in our platform and it was already mitigated.
From 20:02 PM UTC to 20:20 PM UTC we've experienced 15% decrease on our sessions and Admin navigation.
We didn't perceived any impact in our global orders sessions.
Our incident response team is monitoring to guarantee that normal platform behavior is fully reestablished.
We will send an additional update in the next 30 minutes, or as soon as we have more information to share.