2021/2: Q4 | Review#5 (2022-03-01 to 2022-03-15)

Welcome

  • Overview of the last couple of weeks

  • Any interruptions to our apps / Live Defects

  • Team going through what they’ve achieved during the last couple of weeks

  • Feedback from those on the call on what we have done (constructive criticism / praise / questions)

  • Collaboration with those on the call on what to do next

Please ask questions, that’s what this Review is primarily for - your constructive interrogation of what we’re doing:

  • out loud on the call - really, we’d appreciate you doing this!;

  • write in the Team meeting chat; or

  • fill in the post-Review survey after the call (for questions that occur after the call is over, or if you don’t want to ask the question during the call for whatever reason, and for letting us know whether the Review meets your expectations, or whether you have some suggestions for improvement)

Executive Summary:

  • 2 LiveDefects this iteration (last fortnight): TIS Reference migration interrupted TIS between 16.00-18.15 on a Fri afternoon / Thames Valley list of doctors did not automatically sync on Reval - it was available again within 40mins of discovery.

  • Reval app: Changing Recommendation history order to be by ‘Actual Submission Date’, with newest record at the top.

  • TIS Self-Service app: Following feedback from the last Review, we’ve made it easier/more obvious for Trainees to save Form Rs as PDF. A webinar has been arranged to target those HEE admins coming into TIS Self-Service recently. We had a 'Hack day' where we created a chatbot proof of concept. 3rd Pilot summary of progress (sign ups 43.3%, 96.5% have signed up with SMS, 86.2% have submitted a Form R Part B, only 2 Trainee queries, few support requests)

  • Quarterly Objectives and Key Results (OKRs): TIS Self-Service 3rd Pilot is going very smoothly, with only a couple of queries so far. We are also making good progress on our technical OKR.

  • Changes to the roadmap: n/a.

Live Issues:

(the reason we include these is to be open and transparent about when our apps have been compromised, in order to confirm that we’re constantly iterating to improve performance, resilience and security of our Apps.)

key summary created updated status
Loading...
Refresh

Incident logs

 

2022-03-04 TIS services disrupted

2022-03-03 TV list of doctors did not sync for Under notice and All doctors

Dev team demo work completed during this iteration (last two weeks)

Area

Description

Team Representative

Demo - from Prod URL where feasible

Area

Description

Team Representative

Demo - from Prod URL where feasible

TIS Self-Service (TSS)

Trainee feedback (via TIS Admins) - Make ‘how to save Form R as a PDF’ process clearer so admins get fewer queries.

@john o

Forms List screens

New prompt when no submitted forms

 

New prompt when submitted forms

Submitted Form R page

 

Clicking on Save a copy as a PDF button opens this page (desktop browser)…

…then clicking Save opens this with a default filename of: TIS Self-Service _ Form R Part-A.pdf

Webinar arranged for 24th March

@Alistair Pringle (Unlicensed) / @Nazia AKHTAR

Audience will be admins who haven't been involved to this point

TIS “Hack day”

@Nazia AKHTAR

The TIS Team had a Hack day this iteration. The purpose was to come together as a team and work through one or more challenges as a team, free from the normal daily distractions of planned work and meetings. This is an increasingly standard tool for teams to improve their collaboration, team-working to deadlines, and to do peer-to-peer personal development.

This Hack day focused around two challenges, one of which was a practical one relating to TIS Self-Service: the idea of developing a chatbot to answer questions that Trainees might have that are related to the Form R they are being asked to complete.

TIS Self-Service 3rd Pilot progress

@Nazia AKHTAR

Out of the 201 Trainees forming this pilot

  • Ensure trainees can independently create an account on TSS
    We have seen 87 accounts created (up from 49 last iteration) and only a couple of issues raised so far

  • Ensure trainees can use SMS to authenticate
    We can see 84 trainees logged in via SMS (up from 48), 3 via Authenticator app (up from 1)

  • Ensure instructions in the comms are understood clearly by trainees
    We have seen a reduction in queries to admins which shows that guidelines were clearly understood

  • Ensure forms are submitted
    We have seen 65 Form R Part A (up from 36) and 75 Form R Part B (up from 38) submissions as part of this 3rd Pilot submitted by trainees

Revalidation

Sorting Recommendation history in details page

@Doris.Wong

Recommendation history order by Actual Submission Date, with newest record at the top

 

 

 

 

Trainee Information System (TIS)

date validation has been added to ensure Placements cannot have an end date set before the start date

@Edward Barclay

Placement Planning tool:

Person Placement Update page:

 

 

 

 

 

 

 

Electronic Staff Record (ESR)

 

 

 

 

 

 

Northern Ireland Medical and Dental Training Agency (NIMDTA)

 

 

 

 

 

 

Objective Key Results (OKRs) 2021/22 Q4:

1st
Iteration

2nd
Iteration

3rd
Iteration

4th
Iteration

5th
Iteration

6th
Iteration

OKR #1: Prepare and launch 3rd TSS pilot

Preparing for the wider release of TSS in 3 tranches from April 2022

Key Result#1: 99% of trainees successfully able to login using self-sign up and the MFA.

too early

too early

0.1

0.3

0.4

 

Key Result#2: 25% of trainees complete a survey.

too early

too early

0.1

0.1

0.1

 

Key Result#3: Support materials enriched based on feedback.

too early

too early

0.5

0.5

0.5

 

Key Result#4: 95% of admins agree that the process has been made more efficient by TSS.

too early

too early

0.1

0.1

0.4

 

OKR #2: Keycloak to Cognito authentication migration

Extricating us from our reliance on an outdated application (Keycloak), several major versions behind what is supported

Key Result#1: All TIS apps can accept authentication from Cognito.

too early

0.3

0.4

0.8

0.8

 

Key Result#2: Keycloak is no longer used for user authentication by any TIS apps.

too early

0.1

0.2

0.4

0.5

 

TIS team development (following external review)

TIS interim roadmap:

Feedback