Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 3 Next »

Date

Authors

Joseph (Pepe) Kelly Reuben Roberts

Status

Resolved

Summary

Person Search Sync Failed

Impact

Person search page was not showing data between 07:35 and 08:00

Non-technical Description

The overnight sync procedure for TIS was unable to run. This meant only some trainees were being shown on the person search page.

Trigger

Detection

  • Detected when slack notifications in the #monitoring-prod channel failed to appear

Resolution

  • Created a new cluster to use based on the terraform description

  • The sync jobs run fine when manually triggered however this is a temporary solution

Timeline

  • - Question raised by user on Teams

  • - 06:29 - Quickest fix (re-running the job) didn’t work on STAGE

  • - We rebuilt the infrastructure similarly to NIMDTA.

  • - 07:51-07:58 - Ran the Sync job again; trainees becoming visible during this time.

  • - 08:00 - confirmed with users fixed

Root Cause(s)

Action Items

Action Items

Owner

M

Lessons Learned

  • Te

  • No labels

Slack: https://hee-nhs-tis.slack.com/
Jira issues: https://hee-tis.atlassian.net/issues/?filter=14213