/
2021-01-07 NIMDTA Sync jobs failing to start automatically

2021-01-07 NIMDTA Sync jobs failing to start automatically

Date

Jan 07, 2021

Authors

@Liban Hirey (Unlicensed)

Status

Resolved

Summary

The NIMDTA Sync jobs failed to start

Impact

 

Non-technical Description

 


Trigger

  •  


Detection

  • Detected when slack notifications in the #monitoring-prod channel failed to appear


Resolution

  • The sync jobs run fine when manually triggered however this is a temporary solution


Timeline

Jan 7, 2021

  • 00:05-01:29 AM Jobs failed to run

  • 11:05 - Service was restarted

  • 11:05 - Service was redeployed (based on the compose modified time)

  • 11:25 - Jobs manually triggered by @Liban Hirey (Unlicensed)

Jan 8, 2021

  • 00:05-01:29 AM Jobs ran normally


Root Cause(s)

  • Still unknown for the time being


Action Items

Action Items

Owner

Action Items

Owner

 

 


Lessons Learned

  •  

Related content

2019-07-30 ElasticSearch Sync Job failed
2019-07-30 ElasticSearch Sync Job failed
More like this
2021-02-08 Northern Ireland TIS Instance: ElasticSearch down
2021-02-08 Northern Ireland TIS Instance: ElasticSearch down
More like this
2022-02-18 Person Search List failed to refresh
2022-02-18 Person Search List failed to refresh
More like this
2023-04-11 ndw-etl-prod task was not run
2023-04-11 ndw-etl-prod task was not run
More like this
2021-09-29 NDW ETL overnight jobs failed
2021-09-29 NDW ETL overnight jobs failed
More like this
2021-03-10 The NDW ETL failed and didn't recover for PROD & STAGE
2021-03-10 The NDW ETL failed and didn't recover for PROD & STAGE
More like this