On December 1st, 2021, beginning at 4:15PM ET, Yext engineers observed and began investigating delays in a server of our asynchronous messaging service. This degradation affected a portion of sites in the Pages Generation system. Multiple mitigation efforts were applied, and the Pages Generation pipeline fully recovered at 4:39PM ET on December 3rd. Engineers continued monitoring the service over the weekend before declaring the incident resolved on December 6th, 2021.
A configuration setting was incorrectly applied on the asynchronous messaging service for pipelines associated with the Pages Generation system, causing a node failure to stall the pipeline.
The configuration setting has been updated and we have also rolled back recent updates to our asynchronous messaging service to conduct further testing for similar issues.