Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 2 Next »

Date

Authors

Status

Resolved

Summary

Impact

TCS down

Non-technical Description


Trigger


Detection


Resolution


Timeline

  • : 14:16 BST - First AuthenticationFailureException thrown

  • : 14:18 BST - Notification of TCS Health Check failure on Slack (#monitoring-prod)

  • : 14:18 BST - Users start flagging the problem on Teams

  • : 14:24 BST - Issue identified as a Rabbit authentication error

  • : 14:30 BST - Typo in password rectified and TCS redeployed

  • : 14:30 BST - TCS stable again

Root Cause(s)


Action Items

Action Items

Owner


Lessons Learned

  • No labels

0 Comments

You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.