Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 5 Next »

Date

Authors

Cai Willis

Status

TIS21-6217 - Getting issue details... STATUS

Summary

RabbitMQ ran out of memory, affecting TIS services (particularly Reval)

Impact

Any data updated on GMC day before has not/will not reflect on our system

Non-technical Description

The system we use to send messages between our services ran out of memory. This led to a delay in updates across a number of TIS servies


Trigger


Detection

Inspection of lastUpdatedDate column by developer


Resolution


Timeline

  • 21:23 Recommendations service reports failure to connect to rabbitmq

  • -

  • Restarted TCS

  • -

5 Whys (or other analysis of Root Cause)


Action Items

Action Items

Owner

Comments


Lessons Learned

  • No labels