Write-up
Extended delays in product reindexing queue

From July 31 21:00 UTC to August 1 16:59 UTC the platform presented extended delays in the product reindexing queue for Intelligent Search.

It did not have any impact in the sales flow, but caused delayed updates in search and product listing pages \(e.g. promotions might not display the most up-to-date information in these pages\).

We apologize for any inconvenience this may have caused.

Timeline

At 13:15 UTC, we started investigating extended delays when reindexing products in Intelligent Search.

At 13:24 UTC, we identified processing delays in our indexing queue started on July 31 at 21:00 UTC. This processing lag caused our indexing queue to grow until it started to recover automatically through our autoscaling systems on August 1 07:00 UTC.

At 14:30 UTC, we confirmed a consistent improvement in the observed symptoms, as product accumulated in our indexing queues were processed with increased processing provided by our autoscaling systems since August 1 07:00 UTC.

At 16:33 UTC, we continued monitoring our indexing queue, and observed that most products were indexing normally then.

At 16:59 UTC, we confirmed that our indexing queue was fully normalized.