Date |
|
Authors | |
Status | DocumentingResolved |
Summary | ESR sent loads of files and it looks like we haven’t captured everything from. In fact we had but a discrepancy between ESR’s specification and their implementation meant that they rejected the notifications we sent them. |
Impact | It would appear that applicants would be missing or not sent to ESR. |
...
Filter the notification files for those that St. Helens needed (VPD: 96) and modify the VPD to be 3 digits
Modified the part of the system that writes to CSV to ensure the VPD is at least 3 digits.
...
Timeline
- 17:28-17:38 - 7 RMF files received (EMD, KSS, EOE, MER, OXF, NWN, LDN)
- 17:45 - MongoDB down
- 18:09 - MongoDB manually restarted
- 18:10 - MongoDB up
- 19:10 - MongoDB down
- 19:20 - MongoDB up
- 21:36 - MongoDB down
- 22:31 - MongoDB up
- 15:19 - Live defect https://hee-tis.atlassian.net/browse/TIS21-1265 created
- 16:57 - WMD RMF received
- 18:30 - WMD RMF received
- 15:21 - Query raised on teams about unreceived data
...
We sized Mongo on the basis we wouldn’t get many full files.
There isn’t anything to signal that Mongo is struggling before a fatal VM failure.
The VM doesn’t stop and start in a reasonable time.
The replicaset replica set isn’t as ‘highly available’ as it should be (not on separate VMs)
...
Action Items
Action Items | Owner |
|---|---|
Test loading full files with a larger instance | |
[not critical] Clean up Applicant records (for past placements) marked as | |
Calendar of releases/milestones would be useful. | Andy Nash (Unlicensed) has started this in the team calendar |
...
Lessons Learned
Time to crack on with Tech Improvement work