Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Action Item

Type

Owner

Issue

Rewrite the job:

  • Idempotency

  • Update & Delete stale?

Prevention

https://hee-tis.atlassian.net/browse/TISNEW-4459

Improve sync-service alerting and/or resilience

Prevention

https://hee-tis.atlassian.net/browse/TISNEW-3124

Timeline

  • 07:55 Dev team noticed job failed and attempted to re-run. It failed again and we began investigating.

  • 08:13 Chris Nowak - User noticed that TIS was missing data - person search

  • 08:18 - Feedback to uses - We are looking into it from Simon

  • 08:27 - Firefire channel created by Simon

  • 09:01 - TIS Sync started again

  • 09:02 - Service Status updated by Phil

  • 09:57 - Sync [PersonPlacementEmployingBodyTrustJob] completed successfully.

  • 10:25 - last job finished in our notifications channel

  • 10:29 - NDW ETL Started again

  • 10:35 - Service Status - changed back to green / all OK