...
Re-configure logging on several services
Errors in one service of
Cannot delete entity with id 'null'. This is because when gmcReferenceNumber of trainee from rabbit is 'null', but it is trying to delete record from Elastic Search.We can change to not using gmcReferenceNumber as ID as it can be ‘null’
And we should have some code for ‘null’ handling
Disable .
Resolved error caused by null values of
gmcReferenceNumberbeing passed to Elastic Search.Disabled tis-revalidation-connections cloudwatch logging until log output can be fully reviewed.
...
Timeline
: 17:00 - Noticed the over-sized logging when doing an ad-hoc review of CloudWatch.
: 10:00 - Raised issue in Stand up where it was classed as a LiveDefect (although no users were affected, it is a current issue with an impact on monthly costs).
: 11:00 - Identified fixes that could be put in place within one of the services.
: 11:10 - Started implementing the fixes...
: 14:12 - Fix deployed moving ElasticSearch query logging to the
DEBUGlevel (and handled null values): 15:10 - Fix deployed to remove Spring Boot debug logging
: 13:00 - Change deployed to disable cloudwatch logging for
tis-revalidation-connection
Root Cause(s)
Misconfiguration of logs on some services.
...
Action Items | Owner |
|---|---|
| |
| |
| |
| |
| |
|
...