Affected components

No components marked as affected

Updates

Write-up published

Read it here

Resolved

Shortly after the full recovery from the previous incidents, our OMS service had to process a huge backlog of messages that queued up during that time.

Our engineering team executed the recovery plan, which started indexing the backlog slowly.

During that time, the ability to list order in the OMS administrative interface and List Orders from OMS API's were unavailable.

Tue, May 28, 2019, 12:06 AM
1h earlier...

Resolved

This incident has been resolved.

Mon, May 27, 2019, 10:17 PM
55m earlier...

Identified

We are continuing to work towards full resolution of this issue. We continue to work on recovery.

Mon, May 27, 2019, 09:22 PM
51m earlier...

Investigating

We are investigating a scenario with our OMS services.

Users may see errors while trying to access the OMS administrative environment and API calls may see elevated error rates.

This incident does not affect the ability to place orders.

Mon, May 27, 2019, 08:30 PM