Date | |||||||||
Authors | |||||||||
Status | Documenting Done | ||||||||
Summary |
There was an issue processing a Placement Create bulk upload file and a number of other files were not processed until the service was restarted | ||||||||
Impact | Users uploaded files were not processed. We restarted the service to “skip over” the file that was problematic. |
...
Restarted service
After testing the file in the stage environment, //TODO.found that it was processed there.
Tested the file on local, it took more than 2 hours:
...
Timeline
BST unless otherwise stated
13:55 - File uploaded and starts being processed.
13:55-15:24 - Other users upload files and the large file was being processed
15:24 - Error logged
15:25 - User report on Teams
15:10-15:37 - One of the copies of TCS, which bulk upload relies on was restarted and was busier.
15:24-15:40 - Service monitored for signs that data was still being processed and once it became clear it wasn’tfinding no indication the file was being processed, the service was restarted
15:53 - Service processes queued files
17:29 - Admin user tried uploading the same Placement Create file again, and then it was processed successfully
...
Look for logs to check if the job is really stalledstalled… pair up whenever possible.