Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 4 Next »

Date

Authors

Joseph (Pepe) Kelly Yafang Deng Jayanta Saha

Status

In Progress

Summary

Impact

Non-technical Description

Trigger


Detection

There were 2274 messages in the dlq until we got the notification in #monitoring-prod Slack channel and shovelled them.


Resolution


Timeline

BST unless otherwise stated

  • 14:34 noticed the alert: “RabbitMQ PROD too many messages in the DLQ” in #monitoring-prod channel, then shovelled them to another queue “esr.dlq.2023.08.10“

  • 10:32 had a huddle and looked into the messages in queue “esr.dlq.2023.08.10“

Root Cause(s)


Action Items

Action Items

Owner


Lessons Learned

  • No labels

0 Comments

You are not logged in. Any changes you make will be marked as anonymous. You may want to Log In if you already have an account.