Search logs not saved for some regions
Incident Report for Yext
Postmortem

Summary

At 11:59AM ET on Tuesday, May 23, 2023, a code change was merged into the production code base before necessary infrastructure to support the change was available. At 5:21 PM ET on Tuesday, May 30, 2023, the code change was deployed to production, resulting in high failure rates and a loss of Yext Search logs data. For customers with enough hourly search volume to show a clear hourly trend line, this would appear as in searches during the outage when viewing a graph of searches in report builder.  Customers without enough search volume to show a clear hourly trend line may not notice a difference. The code change was reverted at 11:58AM ET on Wednesday, May 31, 2023, and error rates returned to normal by 12:55PM ET..

Root Cause

A code change was deployed to production before necessary infrastructure was available to support the change.

Remediation

The code change was reverted. The team is investigating the feasibility of recovering some basic information from the lost Yext Search logs. This post will be updated once that investigation is completed.

Posted Jun 12, 2023 - 15:49 EDT

Resolved
This incident has been resolved.
Posted May 31, 2023 - 12:42 EDT
Monitoring
A fix has been implemented and we are monitoring the results.
Posted May 31, 2023 - 12:11 EDT
Identified
The issue has been identified and a fix is being implemented.
Posted May 31, 2023 - 12:06 EDT
Investigating
We are currently investigating this issue.
Posted May 31, 2023 - 11:58 EDT
This incident affected: Search (Search Serving).