TIS Self Service - Users and Stakeholders feedback

Feedback - Hotjar (General/Ad-Hoc Feedback)

This table captures all TIS Self Service feedback received from users and stakeholders so far with the intention that User Research can be carried out to improve the User Experience in the future. The last column categorises them as either UI, UX, UR or bugs in general that needs to be addressed.

Item no.

Trainee/Other Users

Profile: Personal details

Profile: Placements

Profile: Programme

Form R (Part A/Part B)

Other feedback

General comment

TIS Comments

Item no.

Trainee/Other Users

Profile: Personal details

Profile: Placements

Profile: Programme

Form R (Part A/Part B)

Other feedback

General comment

TIS Comments

1

Other User

 

 

 

if an incorrect format is flagged which has to be corrected before the form can be submitted (e.g. on mobile number) can the correct format be shown

 

 

UX

  • Hint text / example acceptable format for

    • Contact Telephone (landline)

    • Contact Telephone (Mobile)

Ticket:

https://hee-tis.atlassian.net/browse/TISNEW-5612

 

2

Other User

I can't see how you make edits eg to address/contact details?

It would be good to have a grade under 'current placement'. It would be good to be able to quickly see an overview of previous posts also (length, grade, FT/LTFT).

 

 

  • Another thing that would be useful would be projected CCT date.

  • Where would LTFT status appear?

 

UX/UI

  • Display of Current/Future/Past placements

  • Display of Whole Time Equivalence

Ticket:

https://hee-tis.atlassian.net/browse/TISNEW-5572

3

Other User

 

  • I was wondering if it could have 'Current placement', 'Next placement' and then previous placement's underneath on placement section.

  • Also whether there could be a contact for each placement? As for example if we want to request annual leave prior to us starting in our next placement, it would be helpful to know who to contact under our 'next placement'.

 

For forms you fill in, I think it's more relevant for 'out of programme' applications etc, but could it have an application status? As you mentioned it is read then approved by someone, perhaps it would be reassuring to have 'recieved', 'in process', 'accepted' for example, and this is just a button the person on the other side will press as a quick response.

 

  • It works well!

UR

Contact for placement not recorded on TIS. (PAG)

OOP application process and approval steps. (PAG)

4

Trainee - Keisha

 

 

 

 

 

I think the site is very user Friendly and easy to use

Form R: The Form R sections that pre-populate are brilliant! I have just recently submitted my form R for ARCP and it is a long ardous process doing it n adobe. It was much simpler to complte on the site

Profile: The section under personal details on the rotations is very helpful as well.

Overall I think it’s a very good site and will be very beneficial to trainees(especially once you’ve left foundation training as it all gets a bit more complicated

PR

5

Trainee - Carla

 

 

 

 

The only feedback I can think of would be to continue having the Hotjar popup even after this trial as often with these things it's hard to find someone to contact if there are questions/problems.

I think it's great so far!

PR

6

Other User

Should be easy to edit your profile yourself with new contact details. This should be integrated and signposted with the HEE main trainee website

Previous placements for the sake of form R and CV would be useful. Being able to hide placements yourself might be good

 

It will be great to generate form R from these details into a PDF to upload to portfolios or keep for our own records and also be able to overwrite data as needed

Even if LTFT or mat leave you still need to keep track of time out of program and whole time equivalent percentage so it's good to have that information easily available. I am LTFT and it would be good to link whole time equivalence or LTFT percentage to each rotation that has been done.

Looks good and straightforward to use

UX/UI

  • Print PDF of submitted form

  • View/Hide placements

  • Display of whole time equivalence

Tickets:

https://hee-tis.atlassian.net/browse/TISNEW-5457

7

KK Muneer
WM paeds Trainee

 

 

 

 

Can you also put the NETS and GMC surveys on this platform please? It is a real headache for trainees to sort these 3 things (Form R, GMC survey and NETS) as they all come out in various emails over various times during the earlier phase of the academic year even though they are more relevant near the end of the year when it is ARCP time. Would be a life saver if you got them on here and kept a log!

 

UR

NETS and GMC Survery are not recorded on TIS. (PAG)

 

8

KK Muneer (second email)
WM paeds Trainee

 

 

 

 

Just saw the video. I am a paediatric trainee in the WM deanery so my tips are based on my experience. 

Few tips to make our lives easier: 

  1. Adding the GMC survey and NETS as mentioned in my previous email - and to include some evidence of it being done (we had to screenshoot the GMC survey in the past as there was no uploadable confirmation sent!)

  2. Adding a link to KAIZEN (trainee e-portfolio) which will be very handy for ARCP as it needs Form R and the above surveys

  3. Adding a link to 
    https://www.westmidlandspaediatrics.com/ which has the latest paediatrics trainee info and deadlines. If this is not only for paediatrics, then adding a link to all specialties, divided by deanery

  4. Can placements be organised in a single line instead of boxes? That way it covers a lot more in a small space?

  5. The CCT date would be so helpful as it gets fed back to Form R and before every ARCP we need to excavate our acceptance letters to find the exact date

  6. Can you include a section on VISA for those on various visa schemes so that they know when to renew etc

  7. Front page can have a dashboard to include messages from HEE / our chosen deaneries, social media handles

  8. I hope the app will be free?

 

 

UR

  • Link to e-portfolios. There are a number of e-portfolios and the only one administered in HEE is the Horus Foundation e-portfolio.

  • Links on Local Offices websites/comms to the TISSS

  • Visa section - current visa/expiry and notification to renew - need to review with CIT where this is already available outside of TIS

  • Landing page for TISSS: Social media, Messages / Notifications

UX/UI

  • Re-organising the look and feel of Placements

    • single readable line instead of box display

  • CCT date: This is part of the programme display

Ticket:

9

Jill

 

 

 

  • Form R Part B - Section 2: TOOT I wonder if in the instructions box and the Type of Work column maternity leave should be changed to parental leave.

 

  • In the paper Form R (attached) the final column “Name and Location of Employing/Hosting Organisation…..” is not replicated in the TIS Form R

  • Time out of Training – OOP Pause (OOPP) needs adding to this section

  • Section 3: Declaration relating to Good Medical Practice

    • 1) I declare that I accept……. There is a typo, “paced” should say “placed”.

 

  • Section 4 and Section 5

    • The paper form R suggests reflection is only needed if a significant event etc (previously declared or new event) has been resolved. The TIS Form R suggests it is needed regardless of whether the event has been resolved. Is this correct?

    • One final thing, I wonder if it could be made clearer at the start of the form that if a trainee makes any amendments to pre-populated data, they should also email the specialty school team so that TIS can be updated. It does allude to this, but I think it could be clearer.

 

 

UI/UX

  • Change wording to ‘Parental leave’ on hint text instead of maternity leave.

    • “e.g. name and grade of specialty rotation, OOP, maternity leave, etc.“

  • Name and Location of Employing/Hosting Organisation > It is in the ‘Site name’ and ‘Site Location’ of the ‘Type of work’

  • Missed Section 4 and 5 text for resolved and unresolved declarations

UR

  • Updating of fields text to be made clearer to the trainees

 

Ticket:

10

Phil Cudd

 

 

 

 

  • screens refer to Form-R (Part B) and Form R-b on the menus - consistency

 

  • General Medica Council - Need the l

 

  • No RITAs in NW

  • Designated Body - the GMC knows us as, for example, Health Education Thames Valley (no England). Is it worth keeping this consistent, even if it is out of date? Just thinking it might confuse some of the more easily bewildered trainees.

 

UI/UX:

  • Consistent labelling of menus, links and buttons

  • Typos

  • Form R-a → Form R (Part A)

  • Form R-b → Form R (Part B )

UR:

  • RITAs would still appear on the form, as this is the signed off version of the COPMED form. Any change to the form would require sign off form COPMED.

  • Designated body and Local Office terminology agreement of and usage (PAG)

Ticket:

11

Gemma

 

 

 

Time out of Training - Should we leave as 0 or nothing at all?

 

 

UR:

  • Time out of training to be left blank or 0? Does it make any significant difference?

12

Ade

 

 

 

 

Education Supervisor or Educational Supervisor consistency???

 

UI:

  • Educational Supervisor

Ticket:

13

Lisa Edwards

 

  • Placements – only has a site field, probably need to show employing trust/lead employer and site e.g. Oxford University Hospitals NHS Foundation Trust as Employing Trust, John Radcliffe Hospital as Site.

  • Placements - will they be displayed in date order (newest/current first) – order at the moment seems to be random?

  • Programme – doesn’t show a date to/from just the fact that its current.

 

I know the end goal is to allow trainees to make updates via the UI but in the mean time need to cover this.  When we used the intrepid self-service for placements and/or Form R most of the queries we had were about their data not being what they expected it be.

 

  • Training number – trainees often need this when they first start for registering with eportfolios etc.  Is this something that could be displayed?  Maybe for the future?

  • Browser compatibility – some trainees will be using computers that default with IE (like ours do) so a message similar to what is currently displayed on the reval staging site would be good

 BROWSER NOT SUPPORTED

Revalidation Web Application does not support your browser.

Please try opening this web application using the latest version of Chrome, Firefox, Opera, Edge.

  • Also something on the screen that tells them who to contact if any information is wrong (this might be different for the pilot trainees) e.g. ‘to query or amend any of the details shown please contact xxx’.  The first thing a trainee will notice is what is wrong particularly if it is their personal data (even though in most cases it’s because they haven’t updated us).

 

UI:

  • Placements display

  • UX/UI : Browser compatibility message display - @john o/ @Steven Howard , can the reval approach be copied here? Please ticket up if so.

UR:

  • Add Training number to Profile > Future work as NTN is not currently on TIS

  • Who to contact if info is incorrect? @Nazia AKHTAR / @Alistair Pringle (Unlicensed) / @Sebastian Kwok (Unlicensed) Does this need to form part of comms as well as an info type message/text on TISSS? If so, what is the correct wording and the contact?

    • An idea would be to direct them to the submit Support query page we are going to build within TISSS.

14

James Pillinger

 

 

 

Also when I have completed Form R Part a  and click continue to submit it takes me to the bottom of the summary page. I was expecting to be taken to the top so I could review everything I entered. Obviously that can be done manually but if someone is completing in a rush they may click submit instantly without scrolling up. When I did the same for the Form R Part B it took me to the top of the summary page.

 

 

UR/UX:

  • Navigational experience

  • @john o / @Steven Howard - For you attention, please raise UX/UR ticket as required.

15

Lisa Edwards

 

 

 

  • Wordings to be changed for previous and new declarations n Form R B

  • List of DBC to be updated to have other bodies (NI, SCOT, WAL, Defence Deanery)

 

 

16

Michael Walton-Mayall

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Profile

  • Personal details does not include title, but on the PGMDE Support Portal link in support, we request title.

  • Would it not be best to spilt fullname into first name last name, so trainees with multiple names can see it is recorded correctly?

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

  • The placements order is odd, it has the latest one first, then the next one is the oldest one.

  • Placements do not state grade, WTE, or Type – these seem vital fields.

 

 

 

 

 

 

 

 

 

 

  • Form R A& B Tabs, if you click into a previous form, and then look at how to print it, you cant then just click the tab again, you have to either press “< back" twice, or click onto a different tab, and then back.

 

 

 

 

 

 

 

 
















 

Form R part A.

  • List of previously submitted forms is not in any order I can comprehend.

     

 

Personal Details

  • Immigration status, this list is wrong, doesn’t have UK national as an option, and has non relevant options and hasn’t been Brexit updated.

     

Declarations:

  • The programme specialties and specialties are only listed as: 

    ACCS – Anaesthetics, GP returner or Geriatric Medicine

     

Programme:

  • We should only be listing CT1-3 and ST1-8 as options here. Not

  • Post Type or Appointment: This should be a dropdown list validation, not free text.


Form R Part B

  • Slight concern that people are going to just press save & Exit thinking they are finished as that is so much more obvious than the “go to next page” bit

     

Form R Part B section 4 & 5

  • Resolved Declarations, date of entry into portfolio can be in the future.

 


Form R Part B Section Covid (after section 6, before section 7)

  • If you click on NO, after clicking YES, you loose everything you wrote when you go back to yes.

  • First noticed here, but if you click the text alongside a click square or circle (why are some squares with ticks, some circles with dots? Is it that circles are max 1, and squares choose as many as you like?)), it jumps you back up to the top of the page, ☹

 

Form R Part B section 7

Should not the continue to submit be green box like form A?

Self Service feedback

  • Menu top right when not in full screen pulls down a menu that has an X in the top right, but the X does nothing, you have to click hide above it instead.

 

 

 

 

 

 


 

 

 






???, the title is concatenated in Fullname


On the form, it split. On Profile we display the fullname. Perhaps wait until user feedback.







CURRENT/FUTURE/PAST






Unable to replicate.
Used tisss.testuser8@hee.nhs.uk to test both Form R Part A and B


Already raised, currently being worked on.

 

 

 

 

 

 



Will be addressed as part of the SYNC ticket

 

 

 

We are pre-populating then allow to overwrite with MEDICAL_CURRICULUM type list of curriculum

Should be resolved by the Sync ticket.

Only Placement Grade.

https://build.tis.nhs.uk/metabase/question/310

Already raised in:

Issue #3 :

 

 

 

 

 

 

UX – post MVP review with users

 

 

 

 

No validation at the moment except date has to be valid.
NON-MVP ticket to add validation to restrict future dates.

 

Raise as an investigation task and what can be done to improve the experience (UX). NON MVP


Yes, radio buttons are single choice, tick boxes are multi-select.

Replicate and raise a NON-MVP ticket.

 

Raise a non-MVP ticket. Different approaches were used for part A and B.

17

18th March Self-Service Meeting

Change "Sensitive Data" heading as GMC/GCD/PH number is not sensitive data

 

 

 

 

Adding clear curriculum start and end dates

 

 

 

 

 

 

 

 

 

 

Autopopulate more of the placement's training post as "yes"

 

 

 

 

 

 

clear message stating where each field is mastered

 

 





18

15th April Self-Service Meeting

 

 

 

Cannot save or submit Form R Part B (PROD)





No dropdown options are presented for 'Declaration Type' (PROD)


COVID Declaration not appearing (PROD)






Form R Date Range validation change from 10 years to 25


 

 







 

Feedback - Hotjar Survey (Active)

Trainee/Other user



How would you rate your experience today?

How satisfied are you with the ease of use and navigation experience of TIS Self Service?

How did you find raising an issue you encountered while using the service?

How would you rate the support you received while using the service?

Has TIS Self Service improved upon your previous experience completing Form R's?

Did all features work as expected?

Which feature would you most like to see and use next on TIS Self Service?

Any other comments or suggestions?

TIS Comments

Lynn Bradley

8

4

1

2

YES

YES

Notifications for upcoming placements

I like the look and feel of the system. Clean not complicated. I got confused on the immigration status being a UK Citizen - wasnt sure what to pick Could only see 3 Programme Specialties - was that deliberate for this stage of testing Post Type/appointment - will a new trainee know what this is? Hotjar - on the question about features you would like to see next I could only make a single selection - should I be able to select multiple? if not is it a typo and it should read feature not features Hope you find this useful

UI:

  • Immigration Status - Story ticket raised

  • Programme specialty, Post type etc. - Synchronisation work missed development/incomplete - Bug ticket raised

  •  

Ticket:

 

6a05d030

10

5

5

5

No - t

Yes

Notifications for upcoming placements

t

N/A

6e4ade27

8

4

 

 

No - Could not access form

No - Could not access form

OOP Application Form

 

N/A

f76a2929

6

3

 

 

No - Presume this question needs to come out if not being made available in the pilot

No - Programme information not displaying to and from date, this would be helpful I think.
Also under placement information just has site - need to show Trust and site e.g. OUH as Trust, John Radcliffe Hospital as site.  Important especially for Lead employed

OOP Application Form

needs a message to say that if any amendments requested who to contact?

UI/UX:

  • Display of Site and Trust

 

Ticket:

f3d27f6a

6

3

1

1

No - A

Yes

Notifications for upcoming placements

Can password screen have a show password button option so you can see you what you are typing in. Helps avoid getting it wrong..... usually sited have an eyeball symbol next to password field to click and allow it to show rather than just asterisk. Will help with accessibility

UX/UR:

  • Show/Mask Password on Login screen. Explore Cognito if this is available as a configuration @Andy Dingley / @Joseph (Pepe) Kelly

4a8ca2bd

8

4

 

 

Yes

Yes

 

 

N/A

2562b19c

6

4

4

3

Yes

Yes

Notifications for upcoming placements

 

N/A

  86093069

9

4

4

4

Yes

Yes

 

 

 

27fd9956

8

4

3

3

Yes

Yes

Notifications for upcoming placements

 

 

9dec4110

4

3

 

 

No - “N/A”

No  –  “ i found the layout of the placements difficult to follow ”

Notifications for upcoming placements

i found the layout of the placements difficult to follow.

 

2f401919

8

3

 

 

Yes

Yes

LTFT Application Form

 

 

76119567

7

 

 

 

 

 

 

 

 

86093069

9

4

4

4

Yes

Yes

 

 

 

f76a2929

0

1

1

1

No  –  “ 1 ”

No  –  “ 1 ”

LTFT Application Form

 

 

 ce5bb01a

2

2

2

2

 

 

 

 

 

ce5bb01a

3

2

1

1

 

 

 

 

 

ce5bb01a

4

2

2

 

yes

yes

LTFT Application Form

 

 

 

TISSS App and Form Rs Field names discrepancies

FORM R Part A (naming difference)

App Field Name

Field Validation Filed Name

Comments

Forename(s)

Forename

 

Surname (GMC-Registered)

GMC-Registered Surname

 

Please add your 'Other' immigration status

Immigration Status (Other)

 

Primary Qualification (most recent)

Primary Qualification

 

Home Address
District
Town or city
Country
Postcode

 

Home Address:
Address Line 1
Address Line 2
Address Line 3
Address Line 4 (Legacy)
Postcode

 

  • The field names have been completely changed.

  • Validation is forcing user to enter a District?

  • Country is a freetext?

  • Whilst providing an address is mandatory on the form, we should follow similar validation rules that are on TIS admin for bulk people upload for Address line 1-3 and Post code fields.

    • Since we are now aligning with Oriel, Line 1,2 and Postcode are mandatory.

    • We should not be having addresses where there is line 3 but no line 2.

    • Similarly, we do not expect a Line 4 anymore although we are keeping the field as a display on the TIS ADMIND UI for legacy reasons. We do not expect the trainee to provide a Line 4. - (@Ashley Ransoo / @Adewale Adekoya new ticket)

Contact Telephone (landline)

Contact Telephone

  • Mandatory field

Only accept landline, if not completed you can't move on but TIS Admin is not mandatory or work properly????

  • This should ask for a contact telephone number, this could be the same mobile number that they enter in the Mobile number field.

Contact Telephone (Mobile)

Contact Mobile

  • Mandatory field

Email

Email Address

 

Anticipated Completion Date of Current Programme

Anticipated Completion Date of Current Programme (if known)

 

Post type / Appointment

Post type or appointment

 

Full Time Equivalent in Training

Full Time or % of Full Time Training

 

FORM R Part B (naming difference)

App Field Name

Field Validation Filed Name

Comments

Forename(s)

Forename

 In Section 1

Surname (GMC-Registered)

GMC-Registered Surname

 In Section 1

Current Deanery / HEE Local team

Deanery / HEE Local Team

 In Section 1

Previous Designated Body for Revalidation (if applicable)

Previous Designated Body for Revalidation

 In Section 1

Previous Designated Body for Revalidation (if applicable)

Date of Previous Revalidation

In Section 1

Jira Tickets

key summary type created updated due assignee reporter priority status resolution
Loading...
Refresh

Any other comments or suggestions?