• Root Cause(s)

• Trigger

• Resolution

• Detection

• Action Items

• Timeline

Root Cause(s)

• The call to update the ESR database failed.

• ESR reported that the ETL was unauthorised (HTTP 401)
  
  

Trigger

• Failed update to ESR service

Resolution

• Disabled the following notification tis-esr-etl-cron-daily-export job so the applicant export would be able to finish.

• Restarted esr & profile service on ‘green’ stack.

• Manually triggered the tis-esr-etl-cron-applicant-export job and then the tis-esr-etl-cron-daily-export job.

• Checked slack message showing files transferred at 18:00.

Detection

• Message via. monitoring channel

Action Items

Timeline

• 16:45 to 17:53 - Message picked up and investigation to re-run the affected jobs

• Confirmed uploaded files the following day