Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Date

Authors

Joseph (Pepe) Kelly Reuben Roberts

Status

Resolved

Summary

Person Search Sync Failed

Impact

Person search page was not showing data between 07:35 and 08:00

Table of Contents

Non-technical Description

The overnight sync procedure for TIS was unable to run.

...

Trigger

...

...

Detection

  • Detected when slack notifications in the #monitoring-prod channel failed to appear

...

...

Resolution

  • Created a new cluster to use based on the terraform description

  • The sync jobs run fine when manually triggered however this is a temporary solution

...

Timeline

  • - Question raised by user on Teams

  • - 07:51 - Sync job re run

  • - 07:58 - Sync finished

  • - 08:00 - confirmed with users fixed

...

...

Root Cause(s)

...

Action Items

Action Items

Owner

M

...

Lessons Learned

  • Te