2021/2: Q4 | Review#8 (2022-04-12 to 2022-04-26)

(We are changing our Quarterly schedules to fit in with the academic year from now on. So 2022/3 Q1 will begin on 1 May 2022. As a consequence, we will use April to continue with 2021/2 Q4 work, and plan out 2022/3 Q1 work)

Welcome

Overview of the last couple of weeks
Any interruptions to our apps / Live Defects
Team going through what they’ve achieved during the last couple of weeks
Feedback from those on the call on what we have done (constructive criticism / praise / questions)
Collaboration with those on the call on what to do next

Please ask questions, that’s what this Review is primarily for - your constructive interrogation of what we’re doing:

out loud on the call - really, we’d appreciate you doing this!;
write in the Team meeting chat; or
fill in the post-Review survey after the call (for questions that occur after the call is over, or if you don’t want to ask the question during the call for whatever reason, and for letting us know whether the Review meets your expectations, or whether you have some suggestions for improvement)

Executive Summary:

LiveDefects this iteration (last fortnight): 3 - a TSS Trainee’s data was not properly transferred between a previous pilot and the current one. ESR integration went down (accidental cause no mitigation needed). Postcode validation for international postcodes prevented user from successfully logging into TSS. First two have been fixed, the third came to light yesterday and is being fixed.
Reval app: Focus has entirely been on completing as much of the filtering work as was possible.
TIS Self-Service app: Work around tidying up data (e.g. Dr in Training role) in advance of Tranche 2 beginning. Work commenced on setting up a Trainee user community to enhance our capacity to follow user-centred design (UCD) product development.
TIS: Some work going on, notably around converting Programme Membership into Curriculum Membership, but not yet complete enough to cover in this Review.
ESR: n/a
Quarterly Objectives and Key Results (OKRs): We came close to delivering. Falling short mainly on getting much in the way of Trainee feedback (we can still ask, of course)
Changes to the roadmap: n/a

Live Issues:

(the reason we include these is to be open and transparent about when our apps have been compromised, in order to confirm that we’re constantly iterating to improve performance, resilience and security of our Apps.)

key	summary	created	updated	status

Loading...

Refresh

Incident logs

2022-04-25 UK postcode validation preventing user with international postcode from completing Form R (A)

2022-04-22 ESR integration database went down

Left over from last iteration

2022-04-11 TIS Self-Service user could not log in (migration from previous user pool not working)

Dev team demo work completed during this iteration (last two weeks)

Area	Description	Team Representative	Demo - from Prod URL where feasible

Area	Description	Team Representative	Demo - from Prod URL where feasible
TIS Self-Service (TSS)	3rd Pilot Tranche 1 summary	@Nazia AKHTAR	243 - Sign ups 192 - Form R Part A submissions 201 - Form R Part B submissions These figures are greater than the number of post-graduate doctors in training that we were expecting for this pilot. Signups have been skewed by the super-efficient Thames Valley LO and their super-keen invitees for Tranche 2 who have started signing up earlier than anticipated! We are working to separate out the numbers.
TIS Self-Service (TSS)
Revalidation
Revalidation
Trainee Information System (TIS)	Validate Visa Dates	@Edward Barclay	https://stage-apps.tis.nhs.uk/admin/people/person/279584/edit-sensitive-data
	Prevent creation of multiple matching placements when user repeatedly clicks save	@Steven Howard	demo
Electronic Staff Record (ESR)
Electronic Staff Record (ESR)
Northern Ireland Medical and Dental Training Agency (NIMDTA)

Objective Key Results (OKRs) 2021/22 Q4:

	1st Iteration	2nd Iteration	3rd Iteration	4th Iteration	5th Iteration	6th Iteration	7th Iteration	8th Iteration
OKR #1: Prepare and launch 3rd TSS pilot Preparing for the wider release of TSS in 3 tranches from April 2022
Key Result#1: 99% of trainees successfully able to login using self-sign up and the MFA.	too early	too early	0.1	0.3	0.4	0.5	0.8	0.9
Key Result#2: 25% of trainees complete a survey.	too early	too early	0.1	0.1	0.1	0.1	0.1	0.2
Key Result#3: Support materials enriched based on feedback.	too early	too early	0.5	0.5	0.5	0.5	0.6	0.7
Key Result#4: 95% of admins agree that the process has been made more efficient by TSS.	too early	too early	0.1	0.1	0.4	0.4	0.6	0.7
OKR #2: Keycloak to Cognito authentication migration Extricating us from our reliance on an outdated application (Keycloak), several major versions behind what is supported
Key Result#1: All TIS apps can accept authentication from Cognito.	too early	0.3	0.4	0.8	0.8	0.8	0.8	0.8
Key Result#2: Keycloak is no longer used for user authentication by any TIS apps.	too early	0.1	0.2	0.4	0.5	0.5	0.6	0.6

TIS21 Confluence Space

2021/2: Q4 | Review#8 (2022-04-12 to 2022-04-26)

Welcome

Executive Summary:

Live Issues:

Dev team demo work completed during this iteration (last two weeks)

Objective Key Results (OKRs) 2021/22 Q4:

OKR #1: Prepare and launch 3rd TSS pilot

OKR #2: Keycloak to Cognito authentication migration

TIS team development (following external review)

TIS interim roadmap:

Feedback