From 20h30 to 22h00 UTC, a portion of customers could not complete checkout because of increased delays on payment authorizations. After that period some clients could still see incomplete orders due to the extended delays. At 1h:50 UTC all events were consumed and payments service was fully reestablished.Detailed reports:
https://io.vtex.com.br/incident-report/2021-04-04-Incident+04+Apr.+2021_+Degraded+sales+due+to+Payments+Gateway+outage.pdf
https://io.vtex.com.br/incident-report/2021-04-04_Incident_04_Apr_2021_Checkout_error_and_orders_duplicated.pdf
No components marked as affected
Resolved
From 20h30 to 22h00 UTC, a portion of customers could not complete checkout because of increased delays on payment authorizations. After that period some clients could still see incomplete orders due to the extended delays. At 1h:50 UTC all events were consumed and payments service was fully reestablished.Detailed reports:
https://io.vtex.com.br/incident-report/2021-04-04-Incident+04+Apr.+2021_+Degraded+sales+due+to+Payments+Gateway+outage.pdf
https://io.vtex.com.br/incident-report/2021-04-04_Incident_04_Apr_2021_Checkout_error_and_orders_duplicated.pdf
Monitoring
A fix has been implemented and we are monitoring the results.
Identified
The issue has been identified and a fix is being implemented.
Investigating
We are investigating increased delays on payments authorization. Some users may not complete checkout.