Get email notifications whenever VTEX creates, updates or resolves an incident.
Get incident updates and maintenance status messages in Slack.
Subscribe via Slack
By subscribing you agree to the Atlassian Cloud Terms of Service and acknowledge Atlassian's Privacy Policy.
Get webhook notifications whenever VTEX creates an incident, updates an incident, resolves an incident or changes a component status.
Visit our support site.
All Systems Operational
Checkout
Operational
WebStore
Operational
Administrative Environment
Operational
Internal Modules
Operational
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Past Incidents
Mar 24, 2023
No incidents reported today.
Mar 23, 2023
Resolved -
This incident has been resolved.
Mar 23, 09:14 GMT-03:00
Mar 23, 09:14 GMT-03:00
Monitoring -
Admin latency normalized. We have identified the main contributing factor, which is our caching layer setup which we have been making improvements to. We will be reverting such setup to a previous known version and spend the following days further investigating the causes for the spikes in high latency
Mar 23, 08:41 GMT-03:00
Mar 23, 08:41 GMT-03:00
Update -
From 10:36 UTC to 10:50 UTC we detected quite elevated latency on the admin modules, which will break user experience with timeout errors
From 11:15 UTC latency is still high but admin should be usable, but slow/degraded experience
Mar 23, 08:30 GMT-03:00
From 11:15 UTC latency is still high but admin should be usable, but slow/degraded experience
Mar 23, 08:30 GMT-03:00
Identified -
High latency and timeout errors while using the admin module
Mar 23, 07:36 GMT-03:00
Mar 23, 07:36 GMT-03:00
Mar 22, 2023
Resolved -
We have identified the cause for the overload and will continue to investigate aside to define follow up actions.
User experience should be nominal since 15:12 UTC
Mar 22, 13:07 GMT-03:00
User experience should be nominal since 15:12 UTC
Mar 22, 13:07 GMT-03:00
Update -
We believe user experience is back to nominal. We continue to further investigate into what caused the overload.
Mar 22, 12:33 GMT-03:00
Mar 22, 12:33 GMT-03:00
Monitoring -
One of our internal apps was overwhelmed with traffic and needed to scaled further above its limits. We expect latency and error rates to now be nominal and the user experience to not be degraded anymore. We will further investigate in detail why this app was overwhelmed
Mar 22, 12:20 GMT-03:00
Mar 22, 12:20 GMT-03:00
Investigating -
We are currently investigating an issue in our admin environment. User experience on the admin environment will be degraded, users may notice slowness or timeout errors
Mar 22, 11:57 GMT-03:00
Mar 22, 11:57 GMT-03:00
Mar 21, 2023
No incidents reported.
Mar 20, 2023
No incidents reported.
Mar 19, 2023
No incidents reported.
Mar 18, 2023
No incidents reported.
Mar 17, 2023
No incidents reported.
Mar 16, 2023
No incidents reported.
Mar 15, 2023
No incidents reported.
Mar 14, 2023
No incidents reported.
Mar 13, 2023
Resolved -
From 05h00 to 21h13 UTC, stores have experienced increased delays (of upwards of hours) when updating product prices via the admin panel or via upload of a price sheet. We have identified that the issue was related to a cache layer of our platform and we applied mitigation actions to fix the behavior. Stores are now operating normally and an incident report will follow in the next days.
Mar 13, 18:44 GMT-03:00
Mar 13, 18:44 GMT-03:00
Update -
We are continuing to monitor for any further issues.
Mar 13, 18:14 GMT-03:00
Mar 13, 18:14 GMT-03:00
Monitoring -
We have cleaned the affected cache and products are appearing with the intended prices. We are monitoring our platform to ensure there are no cases left.
Mar 13, 18:13 GMT-03:00
Mar 13, 18:13 GMT-03:00
Update -
Cleaning our cache proved to mitigate the issue, but it required us to be very cautious when applying changes in order to not disrupt the rest of the platform. Prices have been updated for most of the affected products, and we're speeding up the mitigation in order to restore the experience faster.
Mar 13, 18:08 GMT-03:00
Mar 13, 18:08 GMT-03:00
Identified -
We have identified an increase of delays to update product prices. We are working to clean our caches in order to update product prices to the newest data.
Mar 13, 16:27 GMT-03:00
Mar 13, 16:27 GMT-03:00
Mar 12, 2023
No incidents reported.
Mar 11, 2023
No incidents reported.
Mar 10, 2023
No incidents reported.