Degradations in Live API
Incident Report for Yext
Postmortem

Summary

On July 8th, 2019, 4:35 p.m. ET, an upgrade was performed to our Live API platform to improve serving latencies for our customers. This upgrade caused some customers to be unable to access Live API until 7:57 p.m. ET, when our team identified and resolved the root cause. Pages locators were unaffected.

Root Cause

The upgrade to Live API had been mistakenly configured with overly aggressive security settings. This caused Cloudflare, our CDN provider, to incorrectly flag and block requests from some of our clients. Reverting the security changes restored service to all affected customers.

Remediation

We will be adding safeguards to detect and resolve this class of issues in our pre-production testing. Additionally, we will be building out infrastructure to allow our customers to test their integrations against upcoming Live API changes.

Posted Jul 15, 2019 - 15:10 EDT

Resolved
At 7:55 p.m. ET, we resolved an issue which had prevented some of our customers from accessing the Live API after a routine upgrade to our serving infrastructure at 4:35 p.m. ET. A full postmortem will follow.
Posted Jul 08, 2019 - 20:00 EDT