Summary

On 6/13/18, at 6:38 PM EDT, Search Tracker was discovered to be returning inaccurate data. The underlying location data and configuration was not affected, but the search tracker results were inaccurate. The analytics team began investigation, and deployed a fix at 10:23 PM EDT, scheduled to be applied by the overnight data sync job. The fix was applied successfully overnight and verified at 8:30 AM EDT the following morning.

Root Cause

An update to improve our data aggregation scripts had inadvertently introduced a bug that resulted in errors in the Search Tracker tables. Going forward, we will improve our testing infrastructure for data aggregation script improvements to catch such bugs.

Posted Jul 09, 2018 - 10:23 EDT

Resolved

The fix has been successfully applied to all accounts and the significant display errors have been resolved. As usual, we will continue to closely monitor data in Search Tracker and correct issued as they are discovered.

Posted Jun 14, 2018 - 10:31 EDT

Monitoring

We have identified the source of the recent issue that caused significant errors in the data displayed in Search Tracker and have developed and tested a fix. The data will be refreshed for all accounts during a nightly batch process. We will post an update once the fix is reflected in all accounts.

Posted Jun 13, 2018 - 22:23 EDT

Investigating

We are investigating issues causing inaccurate data to appear in the Search Tracker. Underlying location data and configuration is not affected, but the analytics search results shown are inaccurate. We will update when we have further information.

Posted Jun 13, 2018 - 18:38 EDT

This incident affected: Customer Portal Login.