Errors on Answers Overview Page
Incident Report for Yext
Postmortem

Summary

On January 12th, 2021, at 1:20 p.m. ET, a backend database server storing analytical data for Answers started experiencing elevated latencies. This resulted in timeouts and errors for some users on the Answers Overview Page. Engineers restored service at 1:35 p.m. ET.

Root Cause

A large query was executed on the database server in question at a time of high load, which degraded its performance to the point of requests timing out.

Remediation

In order to prevent such queries causing outages in future, we will tune these database servers to improve resiliency, as well as adjusting the query in question to improve its own performance, and exploring ways to filter potentially problematic queries.

Posted Jan 15, 2021 - 09:31 EST

Resolved
This incident has been resolved.
Posted Jan 12, 2021 - 14:30 EST
Monitoring
A fix has been implemented and we are monitoring the results.
Posted Jan 12, 2021 - 13:40 EST
Identified
We have identified a problem resulting in increased error rates on the Answers Overview page and are working on a fix. Answers Serving is unaffected.
Posted Jan 12, 2021 - 13:38 EST
This incident affected: Customer Portal.