From 15h30 UTC to 16h10 UTC, FastStore WebOps faced an outage caused by its Router service. FastStore WebOps is the underlying platform where clients using FastStore deploy their stores.
At 15h40 UTC, we identified that our router service had been deleted, and we promptly started the restore process. Meanwhile, we opened a separate investigation to map what happened. At 15h48 UTC, we finished the main cluster mitigation and restored other support infrastructure.
At 15h56 UTC, FastStore traffic was restored, but a secondary service used to serve optimized images was still unreachable. At 16h10 UTC, our image optimizer service was restored.
For us to continue to be the trusted partner to the success of our clients, our team is working on follow-up actions to ensure that this incident does not happen again and that we identify and recover from future incidents faster. We are committed to improving our systems to guarantee a reliable and trusted platform.
Read the complete report here.