2020-07-27 ESR Applicant Export Failed

 

Date

Jul 27, 2020

Authors

@Joseph (Pepe) Kelly

Status

 

Summary

TIS ESR ETL Failed

Impact

N/A

 

  • Root Cause(s)

  • Trigger

  • Resolution

  • Detection

  • Action Items

  • Timeline

Root Cause(s)

  • The call to update the ESR database failed.

  • ESR reported that the ETL was unauthorised (HTTP 401)

Trigger

  • Failed update to ESR service

Resolution

  • Disabled the following notification tis-esr-etl-cron-daily-export job so the applicant export would be able to finish.

  • Restarted esr & profile service on ‘green’ stack.

  • Manually triggered the tis-esr-etl-cron-applicant-export job and then the tis-esr-etl-cron-daily-export job.

  • Checked slack message showing files transferred at 18:00.

Detection

  • Message via. monitoring channel

Action Items

Action Item

Owner

Issue

Action Item

Owner

Issue

Trigger scheduled tasks differently.

 

 

Timeline

  • 16:45 to 17:53 - Message picked up and investigation to re-run the affected jobs

  • Confirmed uploaded files the following day