Date |
|
Authors | |
Status | In processDone |
Summary | The requests for a full data sync for new trainee profiles were not being processed, resulting in missing data (e.g. email address) in trainee profiles. |
Impact | Onboarding emails were not being sent (recorded as ‘FAILED’) since TSS had no record of some new trainee email addresses. |
...
10:30 As part of the discussion around
, it was mentioned that unusually large numbers of emails for trainee onboarding were being recorded as ‘failed’ due to no email address, but that the trainees in question had email addresses in TIS.Jira Legacy server System Jira serverId 4c843cd5-e5a9-329d-ae88-66091fcfe3c7 key TIS21-6673 21 ~21:00 (?) redrive all production data to ensure trainees have email address and other profile data populated.
13 ~13:00 (?) fix to tis-trainee-details to remove JavaType attribute of profile-created messages
~13:00 DLQ and Cloudwatch alarm for profile-created queues
~11:00 Sentry configuration corrected.
...
Action Items
Action Items | Owner | |
|---|---|---|
As per ticket | Various | Done |
See also:
...
Lessons Learned
Integration tests over microservices may be a bit of an anti-pattern, but alerts and DLQs are essential to catch unobserved errors.