Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Questions and feedback from PO's, BA's and SMLs/BMs.

...

#

...

Feedback

...

Comment

...

Reporter

...

Owner

...

The following fields are reported by teams as not being used:

  • Review time, portfolio review date, trainee notified of outcome nor any of the additional fields.
  • Review Time and Portfolio Review Date
  • we don't have any use for the curriculum specialty (14) or sub-type (15) as far as I'm aware.
  • Comments (12) should possibly be removed, or at least made only visible to local teams

...

Remove:

  • review time
  • portfolio review date
  • trainee notified of outcome

...

The Assessment Status (4) field could be useful if we could report on it properly; it's not useful in and of itself currently to us

...

PYA (23) is not just for the completion of GIM - it's for any Medicine (JRCPTB) curriculum.

...

Academic curriculum assessed (1) refers to the academic curriculum the trainee is on (e.g. ACF, ACL) and was assessed in (Academic Outcome, 2)

...

Comments such as "Trainee progressing well" should now be included in the Supplementary Detail section under Detailed reasons for recommended outcome (1) or Additional comments from the panel (6), depending on the outcome/details

...

The field 'next review date' used to auto-populate the next ARCP form on the system, but no longer does this. This is a particular feature I used to use a lot and would be really useful to me if there could be something like this on TIS

The 'next review date' field; should this date be one year exactly after the assessment you are inputting? On the most part yes, but often we need to have a review before that, for those out of sync trainees who are due to gateway before the year is up or for trainees who have had an adverse outcome

...

Additional Fields, we use Panel Members. Employer/Exception reports is a legacy field to avoid data issues (this process was replaced with the LEP Report). In theory, the other 3 Additional Fields could be useful, but our ability to customise these has been very limited, and I'm not sure how much use they'd be going forwards

There's kind of two parts to this; I'll talk about the second in a bit (how the fields could be improved), but the first is more of a national/HEDG/whatever decision, which is whether these fields are still necessary? As far as I'm aware, the documentation/activities/exams fields are a carry-over from the old RITA days, when panels might need to record the specific evidence seen. However, now the panels just view the ePorfolio; there might be particular pieces of evidence that are especially relevant to the ARCP outcome, but these are should be commented on in the appropriate Supplementary Detail fields anyway (i.e. if the reason for an O3 is exam failure, "Detailed reasons for recommended outcome" should be, for example, "MRCPCH Part 2 failure"; if an exceptional O3 is being awarded following recommendation from OH, "Mitigating circumstances" would include "Letter from OH regarding sickness"). I personally think that the "Activities", "Exams" and "Documentation" fields are surplus and not useful now, but that would probably require agreement from HEDG/similar

If we are expected to continue to use these fields, for starters, being able to have 'default' lists for certain curricula would be useful. For example, having the MRCGP exam results available as an option for evidence considered would be a complete waste in Paediatrics. We should also be able to isolate this by regions; for example, our Paediatrics programme uses summary documents, which the trainees complete to summarise their evidence/training over the period being assessed, and one of the panel members uses this in the ARCP (adding their own notes having reviewed the portfolio ahead of time) to 'present' the portfolio to the panel. I don't know of any other regions doing this, but having the ability to include "Summary document" in Documentation would be useful to us. This would probably require having something like a national reference table with the ability to add ARCP Acitivites/Exams/Documentation to a curriculum (or vice-versa), and within that, mark which regions it would be available to (similar to the new Associated Local Offices field in Intrepid)

Panel members we use anyway, but would need to have some kind of reference table to populate this with, or a more streamlined approach would be to have panel members 'book' on to certain ARCP panels, with admins then having the facility to remove them from entire panels (if they didn't show up) or from individual ARCPs (if they left part-way through the day/had to step out as they were a particular trainee's Educational Supervisor/whatever)

Employer/Exception Reports is a legacy field; I think this should probably be kept as a read-only legacy field for the time being, as it'll only apply to ARCPs between April 2013 (when revalidation started for junior doctors) and Winter 2015 (the last round of Employer Reports before Live Reporting was introduced with the LEP Reports)

...

...

the Concern Summary should have text from the ARCP panel with regards to revalidation (e.g. "Trainee declared unresolved significant event; no current concerns but awaiting coroner's report"), whereas the Responsible Officer's Comments are for any comments the Responsible Officer needs to make on the form (as the ARCP form is the means of transferring information to a doctor's next Responsible Officer); this can either be regarding the information noted on the ARCP form by the panel (e.g. "Coroner's report received 06/11/2017 and reviewed by RO; no concerns") or to add additional information not covered by the ARCP panel

...

Currently working on GMC ARCP return and what I think would be really useful going forward is the drop down options for Grade at next rotation should include the drop down options required by GMC as well as relevant grades, for example, F2 ARCP 6 needs "Not known from ARCP as trainee applies to specialty training" or Specialty Training ARCP 6 "Trainee completed training - not applicable"

...

  • Change values within "Grade at Next Rotation Field" drop down (Joanne Watson (Unlicensed) to get GMC ARCP return recognised fields)
  • Within post-assessment detail field #9

...

Journey

  • bulk upload of assessments within Assessments megamenu
  • view/search within assessments with filtering
  • person record shows outcome only
    • click through to assessments detail page within Assessment
    • indicate on navigation to show them where they are (STEVE)
    • back button to take user back to previous location

...

Navigation

...

Questions and feedback from PO's, BA's and SMLs/BMs.


#
Feedback
Comment
Reporter
Notes
Owner
1

The following fields are reported by teams as not being used:

  • Review time, portfolio review date, trainee notified of outcome nor any of the additional fields.
  • Review Time and Portfolio Review Date
  • we don't have any use for the curriculum specialty (14) or sub-type (15) as far as I'm aware.
  • Comments (12) should possibly be removed, or at least made only visible to local teams

Remove:

  • review time
  • portfolio review date
  • trainee notified of outcome

Review time has been removed but still need to remove Portfolio Review Date and Trainee Notified of Outcome field
2

The Assessment Status (4) field could be useful if we could report on it properly; it's not useful in and of itself currently to us

Consideration for reporting


3

PYA (23) is not just for the completion of GIM - it's for any Medicine (JRCPTB) curriculum.

No additional work required


4

Academic curriculum assessed (1) refers to the academic curriculum the trainee is on (e.g. ACF, ACL) and was assessed in (Academic Outcome, 2)

No additional work required


5

Comments such as "Trainee progressing well" should now be included in the Supplementary Detail section under Detailed reasons for recommended outcome (1) or Additional comments from the panel (6), depending on the outcome/details

No additional work required


6

The field 'next review date' used to auto-populate the next ARCP form on the system, but no longer does this. This is a particular feature I used to use a lot and would be really useful to me if there could be something like this on TIS

The 'next review date' field; should this date be one year exactly after the assessment you are inputting? On the most part yes, but often we need to have a review before that, for those out of sync trainees who are due to gateway before the year is up or for trainees who have had an adverse outcome

Next review date should exactly 1 year following the most recent one, but should be editable
Not implemented yet - and not a mandatory field.
7

Additional Fields, we use Panel Members. Employer/Exception reports is a legacy field to avoid data issues (this process was replaced with the LEP Report). In theory, the other 3 Additional Fields could be useful, but our ability to customise these has been very limited, and I'm not sure how much use they'd be going forwards

There's kind of two parts to this; I'll talk about the second in a bit (how the fields could be improved), but the first is more of a national/HEDG/whatever decision, which is whether these fields are still necessary? As far as I'm aware, the documentation/activities/exams fields are a carry-over from the old RITA days, when panels might need to record the specific evidence seen. However, now the panels just view the ePorfolio; there might be particular pieces of evidence that are especially relevant to the ARCP outcome, but these are should be commented on in the appropriate Supplementary Detail fields anyway (i.e. if the reason for an O3 is exam failure, "Detailed reasons for recommended outcome" should be, for example, "MRCPCH Part 2 failure"; if an exceptional O3 is being awarded following recommendation from OH, "Mitigating circumstances" would include "Letter from OH regarding sickness"). I personally think that the "Activities", "Exams" and "Documentation" fields are surplus and not useful now, but that would probably require agreement from HEDG/similar

If we are expected to continue to use these fields, for starters, being able to have 'default' lists for certain curricula would be useful. For example, having the MRCGP exam results available as an option for evidence considered would be a complete waste in Paediatrics. We should also be able to isolate this by regions; for example, our Paediatrics programme uses summary documents, which the trainees complete to summarise their evidence/training over the period being assessed, and one of the panel members uses this in the ARCP (adding their own notes having reviewed the portfolio ahead of time) to 'present' the portfolio to the panel. I don't know of any other regions doing this, but having the ability to include "Summary document" in Documentation would be useful to us. This would probably require having something like a national reference table with the ability to add ARCP Acitivites/Exams/Documentation to a curriculum (or vice-versa), and within that, mark which regions it would be available to (similar to the new Associated Local Offices field in Intrepid)

Panel members we use anyway, but would need to have some kind of reference table to populate this with, or a more streamlined approach would be to have panel members 'book' on to certain ARCP panels, with admins then having the facility to remove them from entire panels (if they didn't show up) or from individual ARCPs (if they left part-way through the day/had to step out as they were a particular trainee's Educational Supervisor/whatever)

Employer/Exception Reports is a legacy field; I think this should probably be kept as a read-only legacy field for the time being, as it'll only apply to ARCPs between April 2013 (when revalidation started for junior doctors) and Winter 2015 (the last round of Employer Reports before Live Reporting was introduced with the LEP Reports)


Removed from TIS - see app for fields included now.
8

the Concern Summary should have text from the ARCP panel with regards to revalidation (e.g. "Trainee declared unresolved significant event; no current concerns but awaiting coroner's report"), whereas the Responsible Officer's Comments are for any comments the Responsible Officer needs to make on the form (as the ARCP form is the means of transferring information to a doctor's next Responsible Officer); this can either be regarding the information noted on the ARCP form by the panel (e.g. "Coroner's report received 06/11/2017 and reviewed by RO; no concerns") or to add additional information not covered by the ARCP panel

No additional work required


9

Currently working on GMC ARCP return and what I think would be really useful going forward is the drop down options for Grade at next rotation should include the drop down options required by GMC as well as relevant grades, for example, F2 ARCP 6 needs "Not known from ARCP as trainee applies to specialty training" or Specialty Training ARCP 6 "Trainee completed training - not applicable"

  • Change values within "Grade at Next Rotation Field" drop down (Joanne Watson (Unlicensed) to get GMC ARCP return recognised fields)
  • Within post-assessment detail field #9



10

Journey

  • bulk upload of assessments within Assessments megamenu
  • view/search within assessments with filtering
  • person record shows outcome only
    • click through to assessments detail page within Assessment
    • indicate on navigation to show them where they are (STEVE)
    • back button to take user back to previous location




11

Navigation

  • display Assessments at the top level




12Do we need to record completion and outcome of the exams (AKT, CSA) GP trainees do on TIS? Some local offices seem to record this on Intrepid but i know RCGP eportfolio is often the primary system for such data.No, can be managed via E-portfolioAlistair Pringle (Unlicensed)
Joanne Watson (Unlicensed)
13Confirm if anything is no longer correct? For example do we still need the outcomes for RITA and for LAT and FTSTA trainees?

as long as there's still legacy outcomes for RITAs/LATs/FTSTAs, I don't think we'll need those any more (RITA and FTSTA are gone, and I think LATs are only continuing in the other nations) Otherwise it looks fine


Outcomes from 2016 and before will appear in TIS as read only values to maintain the legacy values.
14Create an Assessment

There should be an option to create an assessment in a  person’s record too

Also I do not believe that a front page for Assessments showing all assessments, for all trainees of all specialties, is particularly useful. I am not sure I would ever navigate to a trainee’s ARCP pages from this page as it brings up all trainees of the same name?

Being able to batch create/update assessments for a number of trainees at a time would however be useful

Under Event ‘trainee ID’ needs to be GMC number

Layout of page is clunky. Forename and surname are better suited next to one another  

One page to add all ARCP info would be easier to navigate than 4 different pages

Gemma Sams

Adding an assessment via the trainee record has been included in interation two of component - as demoed in the S&T 1/2/18.

Bulk update functionality is in backlog of tasks

Aim to remove the trainee ID from all areas of the UI - frequently reported feedback.

UI flow has been designed to go down each column rather than along the row.




Create an AssessmentWhen typing in ‘Grade at next rotation’ and ‘Academic curriculum assessed’ no options begin to appear and not able to select an option from drop down boxLaura GriffithsPost-assessment functionality not in iteration one.

Create an Assessment

I can add the date, type and Status, but I am not able to add anything under Programme number - I can't even click into the box.  It also shows Programme name is populated but underneath in red highlights that Programme name is required.  As I can’t save this information, I am unable to test further in adding an assessment.

Laura West

IE issue.

IE compatibility issues are in the process of being worked through and added back in to E2E testing.



Create an Assessment

It would be more helpful if there were clues of how to use this page like ‘type in GMC number first’.

RITA shouldn’t be an option under ‘type’ for anything but legacy items. No trainee should be awarded a RITA anymore.

I’m unclear how the type of ‘academic’ would be used so I’m not sure how useful that would be. All academic assessments are by definition also an ARCP.

It feels like there is a lot of blank space on the page and fields could be pulled together a little so you don’t have to scroll down/worry you’re missing something.

Madeline Leverton

Tool tips

Is this a common agreement?


Post-assessment


Links to having all the info on one page issue.



Create an Assessment

I can create an assessment and add information in the fields, but I am unable to save this information in Pre – assessments and Post – assessment limiting me to further testing. 

Joanne O'BrienWill need to look into further as Pre-assessment has been working.

Create an Assessment
  1. Dropdown options for grade at next rotation don’t include CT1, CT2, ST1 to ST8 options or not applicable/other
  2. Grade at time dropdown not available
  3. There is nowhere to record the outcome of the assessment
  4. It is unclear how much space is available to record comments on reasons for outcome etc. This appears to display as a single line of text rather than an expanding text box.
  5. Rather than true or false, could this be yes or no?
  6. It would be better if dates were shown as dd/mm/yyyy rather than yyyy/mm/dd
  7. Can the assessments be displayed with the most recent first
  8. It would be much easier if all information was on one page, rather than 4 separate tabs.
  9. When searching for a trainee in assessments it appears to bring up trainees several times (for each recorded ARCP), can it just display the trainees once
  10. I don’t appear to be able to add new assessments for current trainees, though this could be because the system is set up for testing on a limited number of test trainees or I am missing something
  11. Can we have the option to search for a trainee by GMC/DRN in the assessment section
Angela McMahon
  1. Post-assessment
  2. Should autopopulate based on trainee's placement at Review Date - not meant to be editable.
  3. Post-assessment
  4. Not a comments box. Adverse outcomes and Not assessed have reasons.
  5. Agree, need to look at the use of True and False
  6. Date format - speak to devs again - may link to more focussed filtering though.
  7. On assessments list? Yes, there is a Sort function - will demo.
  8. Previously mentioned
  9. Brings up each assessment event the trainee has had - to enable the end user to see the assessment history of the trainee.
  10. Second person to mention this - will check permissions
  11. GMC/GDC definitely


Create an Assessment
  1. Where has the trainee ID come from (apologies if I missed this as I couldn’t join the assessments Skype last week)?  Without it I cannot create an assessment yet I don’t know where the number is derived from.  When searched for the trainee in people I can then find the number but it seems a random number?
  2. Assessment type does not list IRCP and RCP (Dental assessment types)
  3. PYA is only relevant to medical specialties; could this therefore not show unless a medical specialty is selected?
  4. Grade at next rotation – not applicable to all, DFT for example is a 1 year programme therefore this field is not applicable yet is a required field.
  5. Where exactly do you select the assessment outcome?!  Cannot see an option to select.
  6. Could true and false be yes or no?
  7. Dates not in consistent format, would be better to be DD/MM/YYYYY
  8. Would be better if all one tab rather than separate ones
  9. Cannot see a way to bulk create assessments?
Matthew Hill
  1. System ID. We will have it removed from the front end as searching on GMC/GDC/PH number or surname should suffice.
  2. On their way - next iteration
  3. Good point
  4. Will look at mandatory fields
  5. Post - assessment details - not in this iteration
  6. Yes - already mentioned
  7. Already mentioned
  8. Already mentioned
  9. In progress - overall bulk upload function beign developed for 'People' first.


Create an Assessment
  1. I can create an assessment by entering a trainee ID (randomly typing in numbers and picking one, but I have no idea what the Trainee ID is).
  2. It defaults a programme but I don’t know on what basis, the programme associated with the trainee completed in 2015.
  3. If you start tying in a Trainee Surname or First Name the drop down boxes appear blank, though you can select a record by clicking somewhere in the blank box.  When I typed in Rich (in the surname box) and clicked in the blank drop down box I ended up with Richard John Brown (Rich was not part of the Surname).
  4. The programme name for Richard John Brown was populated but the programme number wasn’t (though it is visible via the Programme Membership screen).
  5. The calendar doesn’t work properly as reported in other streams.
Mike Richardson
  1. See above
  2. Should default to the programme the person was in at the time of the Review date or previous programmes - to allow for assessments after the trainee has completed their training.
  3. Links to smart search - we are looking at ways to improve the smart search function and also we have moved the 'create assessment' function into the trainee record in the following iteration.
  4. Needs more investigation - what Browser and version?
  5. Agreed and already ticketed up and with the devs.


Create an Assessment
  1. Good can search for GMC number, but field needs to be updated to show GMC number and not Trainee id
  2. Programme name was pre-populated after choosing trainee id, but this was not seen by the system until I re-selected the option.
Claire Whittle
  1. Common request
  2. think this is like the problem Laura West reported - what browser and Version?


Create an Assessment
  1. New assessment name box- when typing it pops up and shows empty, no names but if you click on empty box, a selection is made…. can’t see who is being selected
  2. Navigation- Have to create a new assessment and then go back to the person’s record. Can a new assessment be created in the trainee record as currently this function doesn’t appear to be possible?
Maria Kist
  1. We won't be creating assessments in this way in the second and in future iterations as it simply doesn't work for end users.
  2. Done!


Create an Assessment
  1. In Post-Assessment detail, academic curriculum assessed field drop down needs to be sorted.In Post-Assessment detail, academic curriculum assessed field – cannot select an option from the drop down list.
  2. In Post-Assessment detail, grade at next rotation field – cannot select an option from the drop down list.
Sue Barrand
  1. Post assessment not in iteration one
  2. as above


Create an Assessment
  1. I tried to type in a trainees name and no names appear on the dropdown list to select.
  2. I typed a trainee’s GMC number (7529299) into the ID field and it converted it to their internal system ID. The internal system ID should never appear on the front end.
  3. The Status field automatically populated with “Appealed” when I chose the trainee ID. The status should only automatically populate after the review date field has been populated so that they system can calculate if the status should be “scheduled” or “overdue”.
  4. The programme number should automatically populate the way the programme name automatically populates.
  5. The Type, Status, and ProgrammeName fields automatically populate but red warnings still show up below them saying values are required.
  6. The “Programme name is required” validation is permanently displayed and as such it is not possible to save the assessment record.
Alice Brindle
  1. Already reported
  2. System IDs to be removed
  3. Is manual for moment but should in fact be automated
  4. Agreed - browser and version?
  5. Need to agree mandatory fields
  6. See Claire Whittle and Laura West


Create an Assessment
  1. We think Trainee ID should be changed to GMC number.
  2. We would prefer to be able to type dates rather than using the calendar.
  3. We think the true/false drop-down options should be replaced with yes/no.
  4. 4 pages to complete one assessment seems excessive, we think it would be better for this to be on one page.
  5. We don’t like the layout of the fields, it is unclear how you navigate the page (the order in which you should fill in the fields).
  6. When the programme name is blank, you can not progress, as the field is still required.
  7. When the grade at time is ‘not available’, we would like to be able to type over this.
  8. Where do you complete the outcome of the assessment?
  9. When saving the event page, it loops back to the assessments list rather then staying on the page for you to complete the other sections.
  10. We weren’t sure what the ‘extend completion of training date’ was, we think this is when a CCT date is extended after an adverse outcome. If so, we think this would be better named as ‘Completion of training date (following review)’
Y&H
  1. Common request
  2. Already fedback in previous components
  3. Agree
  4. Common request
  5. Unfamiliarity with system - can look at
  6. Programme name should not be blank??? or is this possible?
  7. ? not sure what this means
  8. Post assesssment - next iteration
  9. Navigation quirk/error
  10. Can be changed


Create an Assessment
  1. I would want to be able to create an assessment from within a person’s record.
  2. Would want an option to filter by specialty on the front page of assessment.
  3. I am not able to access the drop down for type or programme name
Oliver Witos
  1. Done - next iteration
  2. OK
  3. Interesting - browser and version please

15View/edit assessments (admin) (pre-assessment only)
  1. Assessments are not in date order
  2. Pre Assessment:
  3. PYA is only associated with Medicine ARCPs in Peninsula
Gemma Sams
  1. Can sort
  2. Will look at  - previously mentioned


View/edit assessments (admin) (pre-assessment only)
  1. Feels a little unnecessary to have to click through four tabs of information for one assessment – could all information be on one page?
Laura Griffiths
  1. Already mentioned


View/edit assessments (admin) (pre-assessment only)
  1. On reviewing assessments for Dr Husam Jamil and Jenna McMinn, it hasn’t pulled through all details: Missing: Review date, status, grade at time, (Portfolio review date – is this field necessary as there is already a review date) Curriculum Specialty, completion of training date prior to review, 10% Lay and External have not been pulled through.
  2. Defaulting to ‘False’ where the field has been left blank is distracting.
  3. Academic curriculum assessed is mandatory yet not all trainees are academic.
Laura West
  1. Will report to devs with details = Jenna McMinn's assessment record for the period of 12/6/16 to 9/3/17 in V10 shows the Status = Completed, Review Date = 9/3/17, Grade at Time = Specialty Training Year 5, Curriculum  = Cardiology, Curriculum sub type = Medical Curriculum. 
  2. True/False will be looked at
  3. Post assessment not in this iteration


View/edit assessments (admin) (pre-assessment only)
  1. The field ‘Time out of Training’ can’t be required as sometimes trainees don’t submit their Form R (and get a 5 for it). They would subsequently submit it, but that is sometimes after the ARCP is awarded. I also don’t think it should be listed in the pre-assessment section as this section is often filled out a long time before the ARCP while we may only just get TOOT a few days before the panel.
  2. I don’t see anything under ‘documents considered’, I imagine that will be fixed in the next iteration.
  3. PYA probably doesn’t need to be a required field and could be a ‘tick’ box as the vast majority of ARCPs will be a no. PYAs only happen for a few trainees and only in 1 year of their training so it seems like a lot of ‘no’ entries to make for a few ‘yes’ entries. In addition, if you go to older ARCPs, this wasn’t a required question but rather a tick box and it looks like you haven’t mapped a non-tick to mean a ‘no’ in this question so whenever you go to an old ARCP, you would need to fill out this ‘no’.
  4. Grade at Time: sometimes it says ‘Not Available’ – I assume this is because the post doesn’t have the right information. In this case, we should be able to manually override the post information so that this field can be filled in from the user’s knowledge.
  5. I haven’t provided any feedback on the post-assessment detail and revalidation as you said those aren’t ready yet.
Madeline Leverton
  1. Will look at mandatory fields and general validation rules
  2. To look at
  3. Already mentioned
  4. If trainee not in placement this may show - is this a data quality issue?
  5. Spot on




View/edit assessments (admin) (pre-assessment only)
  1. On reviewing some trainee's record's, I have noticed missing/ not pulling through information such as curriculum specialty, title, grade at time.
  2. Academic curriculum is mandatory and not all trainees are academic.
  3. I am able to view trainee's records and edit the information but not able to save these changes.
Joanne O'Brien
  1. Noted
  2. Noted
  3. Browser - need more info


View/edit assessments (admin) (pre-assessment only)Post assessment detail will not save.Angela McMahonNot in this iteration

View/edit assessments (admin) (pre-assessment only)When editing post assessment page it will not saveMatthew HillNot in this iteration

View/edit assessments (admin) (pre-assessment only)I can view and edit and assessment but everything above still applies.Mike RichardsonOK

View/edit assessments (admin) (pre-assessment only)
  1. In pre-assessment detail-Is the portfolio review date the same as the ARCP event date? Do we need both?
  2. Would WTE months OOPR/T during period pre-populate if this was applicable? Unable to add any details into this field manually.
  3. Do we need both “WTE months OOPR/T” and “Months OOPR/T” fields? Is there any difference between these two fields?
  4. Does PYA need to be a mandatory field?
  5. Should days out of training be in the pre-assessment detail section, as we would check this information from their Form R which is reviewed at the ARCP Panel? As this is a mandatory field, I need to add something into this field to be able to move on, which I wouldn’t be able to do before the ARCP Panel.  Would make more sense to have it under post-assessment detail.
  6. Post-Assessment Detail – unable to select appropriate grade. Only options started “zzz” or “academic”. Perhaps this should be a drop down list rather than start typing? Need to type 3 letters before it brings up whole list, no matter what letters you enter. You can over-write these options with your own choice e.g. ST1 – is this right?
  7. Academic curriculum assessed should not be a mandatory field.
  8. I like the free text boxes for supplementary details, but more space to type would be useful. It would also be better if we could see all text at once rather than having to scroll across.  
  9. Post Assessment Detail did not save the fields that we completed. We only completed the mandatory fields, perhaps this was because of the problems with the “grade at next rotation” field (please see previous feedback)?
  10. There is nowhere to record the outcome of the ARCP.
  11. We also need to be able to record if the trainee was not assessed at this ARCP and the reason for this, e.g. mat leave, sick leave, non-engagement, etc.
  12. It would be helpful if the ARCP “status” changed to complete once you have completed the post-assessment details, rather than having to do this manually.
  13. In post assessment – if I select something from the drop down menu, I cannot then go back to having nothing in this field.
  14. We run a report from Intrepid to let us know the dates of upcoming ARCPs for all of our trainees to help us with scheduling – will we still be able to do this using TIS? This is critical for us and we would be unable to manage the ARCP process without the ability to do this. 
  15. “Go back to Person record” does not always work.
Claire Whittle
  1. No - to be removed
  2. Yes - from trainee's placement info
  3. One is 'WTE months OOPR/T during period' and the other is 'Months OOPR/OOPT counted towards training' to show of the time on OOP what is being counted.
  4. No
  5. Already reported by Madeline - need to review all mandatory fields
  6. Not in this iteration (and through to 11 and 13)

12. Agree

14. Yes, reporting requirements

15. Navigation



View/edit assessments (admin) (pre-assessment only)I think would be really useful going forward is the drop down options for Grade at next rotation should include the drop down options required by GMC as well as relevant grades, for example, F2 ARCP 6 needs "Not known from ARCP as trainee applies to specialty training" or Specialty Training ARCP 6 "Trainee completed training - not applicable"Lynn BradleyGood call

View/edit assessments (admin) (pre-assessment only)
  1. In outcome window- under appeal, 10% audit, external trainer, trainee notified of outcome all have options of true or false. Perhaps Yes or No would be better suited?
  2. Where is the outcome field? Past outcomes not pulling through into post assessment. When on post assessment screen in one of the previous outcomes, there is no indication of date/outcome you’re looking at. Ie, if a trainee has 8 ARCPs in history and you select one- can’t really tell which one has been selected…
  3. Grade at next rotation is a free text box and allows you to type and save nonsense. No drop down, is it possible to have a drop down to select as currently on Intrepid with highlight of the current grade so we don’t have to go back out to check and come back in to select?
  4. Next review date lets you select a date in the past (may be needed for amending past records, not certain about this), doesn’t let you manually type a date
  5. Academic curriculum is currently a mandated field- not all trainees will have an academic curriculum and there is no option to select 'none'. Also, it should be alphabetised, and allow a drop down which currently there isn’t. It also lets you type and save nonsense.
  6. When searching a trainee is assessments, it pulls through all previous ARCPs with oldest at the top…can this be the other way round? Oldest at the bottom..
  7. 2 x fields asking about extension to training (in outcome and in supplementary details), is this necessary? Which field will pull through on reports?  CCT date to automatically extend if additional months are added?
Maria Kist
  1. Agree
  2. Post assessment - not in this iteration and through to 5.

6. Sort?

7. Current functionality. 



View/edit assessments (admin) (pre-assessment only)
  1. Dates are in inconsistent formats throughout assessment component
  2. On the list of assessments for a trainee, the column Academic curriculum assessed is always blank. This column should show the Curriculum name (DR2:   [DataRepositoryV2.Intrepid.HEE].[R0].[vwAssessment].[CurriculumName] and should have a generic title like Curriculum Assessed.
  3. Filter on status field – shows status.[overdue|completed|appealed|scheduled]. Would be better to have the prefix removed.
  4. Clicking on Go back to person record in Post-assessment detail takes you to a blank screen; Event, Pre-assessment and Revalidation all work as expected.
  5. In list of assessments for a trainee, Showing 1 – of items is not displaying correctly.
Sue Barrand
  1. Dates to be looked at
  2. Column headers shown in validation sheet - do need to be fixed on TIS
  3. ?
  4. Next iteration
  5. links to point 2?


View/edit assessments (admin) (pre-assessment only)
  1. The incorrect field of “Academic curriculum assessed” is appearing on the list of assessments for GMC 7529299. The field should be curriculum. The curriculum displayed needs to be the curriculum for the trainee’s clinical assessment not the curriculum for their academic assessment. Only academic trainees ever receive academic assessments.
  2. The review date and outcome fields are not populating with any values on the assessments list view.
  3. The “status” (overdue, scheduled, etc.) of the assessment is not displayed on the assessment list. This field to me seems more relevant to this view than to the assessment full details view.
  4. I don’t understand the completion of training date (prior to review) field. What is this?
  5. I don’t understand why the pre-assessment details and post assessment details are split in two totally different views. I would argue it is better to have them in two labelled sections in the same view. Otherwise, someone could easily get confused as to what assessment they are actually filling in post-assessment details against!
  6. Academic curriculum assessed is coming up as mandatory. Very few trainees are academic and academic trainees do not necessarily always have an academic assessment with each clinical assessment so this field should definitely not be mandatory
Alice Brindle
  1. Agree
  2. OK
  3. OK
  4. To show the what the date was and what it changed to after assessment (if an adverse outcome was given for example). Current functionality
  5. Navigation and layout
  6. Review mandatory fields


View/edit assessments (admin) (pre-assessment only)
  1. It isn’t clear if the page has saved or not when a change has been made.
  2. The dates are formatted inconsistently throughout the assessment for example some are YYYY – MM – DD whilst others are DD/MM/YYYY. We would prefer the latter format.
Y&H
  1. Already looking at Save behaviour
  2. Already raised


View/edit assessments (admin) (pre-assessment only)
  1. Assessments not appearing chronologically
  2. Not able to see outcomes
  3. Pre Assessment:
  4. Grade at time appearing as not available. Not able to manually enter this.
  5. PYA should not be a yes/no box
  6. Should days out of training be mandatory at this stage of the creating the record?
  7. When you enter the assessment record you are then in the assessment section and if you click back you are directed back to assessment home page not the people page
Oliver Witos
  1. Sort?
  2. On list? Already raised
  3. Pre-assessment:
  4. Common feedback - browser? Can we have an example (GMC no. please)
  5. And not for all
  6. Can move - already raised
  7. Navigation

16View assessments outcome in a person record
  1. In this view, as Academic curriculum assessed is the first field they are all blank as not all trainees will be academic. 
  2. The review date and outcome columns are all blank. 
  3. The dates are American  - can this be changed to British view eg. 23/01/2017. 
  4. As there are 4 pages, once you have clicked into another tab of an assessment, you can no longer see what date or curriculum you are reviewing. 
  5. The reasons (U codes ) do not show in the outcome. 
  6. Assessments are not in a chronological order.
  7. Supplementary details on post assessment tab does not expand with the text.  In order to read the information you have to put your cursor into the field and move it along with the arrow key .  This is not very practical or sensible.  Text could be deleted in error.
  8. Revalidation section on Intrepid logs which documentation has been reviewed:
  9. Form R, LEP report, ES report, SOAR (For NES Only) and Other.  These fields don’t appear in TIS and therefore that information has not pulled through.
Laura West
  1. ? more info about the record being looked at needed
  2. already raised
  3. already raised
  4. Navigation and layout
  5. Post assessment
  6. on list? Sort?
  7. No, can be looked at
  8. OK
  9. Should be in Docs reviewed - will look at


View assessments outcome in a person record
  1. I can view and edit previously and newly created assessments. The overall outcome list on trainee’s list of assessments is not currently useful as it looks like ‘review date’ only shows on this list if it is a newly inputted event rather than one that existed in Intrepid. Can this field be mapped to the existing field in Intrepid? Likewise, there are no outcomes listed against any ARCP (probably because it looks like this field doesn’t exist yet in TIS). ‘Academic Curriculum Assessed’ – will that map to the curriculum assessed? It isn’t currently doing that for existing or new ARCPs.
  2. When you navigate from the person record list of Assessments, logically clicking ‘go back to list’ (upper left corner) would take you back to the list of ARCPs for that person. However, this actually takes you back to the overall list of all assessments, which isn’t actually useful. You will often want to go back and forth between a couple of ARCPs for a given trainee. This does happen when you click on ‘go back to person record’ when you are in ‘pre assessment detail’ but if you are in ‘post-assessment’, this link doesn’t work and takes you to a ‘assessments’ page (as if it isn’t referencing that ‘person’ record anymore).
Madeline Leverton
  1. Yes, list is not showing what it should. Will be fixed
  2. Will improve navigation in trainee record - next iteration












View assessments outcome in a person record
  1. The assessments spread over 4 pages is not very helpful. Once you move on you lose the date your reviewing etc. and it would be more useful to see the assessment as one whole event.
  2. Dates set out in American style can this be change to a British view? 
  3. You cannot expand text boxes (text in one long line) which makes reading the information very difficult indeed.
  4. No information in the in the review date and outcome section in the assessment tab. Also the academic curriculum assessed is the first field which I don’t think is very helpful as not all trainees are academic.
Joanne O'Brien
  1. OK
  2. OK
  3. OK
  4. Post assessment and 


View assessments outcome in a person recordOn the ARCP summary page it is not pulling previous outcomes, review date or curriculum through when accessing via person record but appears to show this when accessed via assessments with the exception of outcome and review dateAngela McMahonTo be looked at

View assessments outcome in a person recordOutcome box shows but blank as wasn’t able to add when creatingMatthew HillNext iteration

View assessments outcome in a person record

Yes but why do we have to go here to add the detail rather than via the create assessment screen? I don’t appear to be able to select what I need and Save in this screen.

Mike RichardsonNavigation

View assessments outcome in a person recordIn Assessments under person record – dates are written in YYYY/MM/DD format. Within the record, they are the other way round, i.e. DD/MM/YYYY. This should be consistent across TIS.Claire WhittleAgree

View assessments outcome in a person record
  1. In person’s record, academic curriculum assessed is blank even though it is populated as can be selected, same with review and outcomes and some periods to and from dates column.
  2. Post and pre assessments screens have no name of trainee or identifiable information -Forgot whose details was filling. If was completing this and had to go away and come back, it would be difficult to remember which trainee record you’re on and if it’s not saved, will have to go out and start again. Can identifier be added to the screen? -Not TIS ID because if transferring information from paper outcome, this is not something we have recorded so wouldn’t help in identifying
  3. Supplementary details comment windows being on one line is really difficult to read if there is a longer paragraph. Not very user friendly. Can this expand into a box as currently on Intrepid so you can see full comment at a glance?
  4. Saving a new assessment- no indication that it's been saved other than a flash of the screen. Would it be possible to add a message to say it's saved?  Changes to outcomes don’t appear to be saving
  5. Pre-assessment details don’t seem to allow changes to be made
  6. ‘Documents considered’ in pre assessments seems to be floating, there is nothing below it, no option to add anything and can’t click on it… Should this field be in pre assessment? Would we not populate this after the assessment rather than before? Do we need this at all?
  7. Navigating from post assessment to pre assessment brings up a blank screen
  8. I don’t know if there a really obvious explanation for this but do we really need an event, a pre assessment and a post assessment page? Can it not be all one so you can see all the details ono one page?
Maria Kist
  1. List? to be fixed
  2. Agree
  3. OK
  4. Save behaviour is being looked at by Matt
  5. ? What changes and to which record (GMC No.)?
  6. Can be moved - is it needed? SMLS to comment.
  7. Navigation or browser issue?
  8. Common question - will probably be changed


View assessments outcome in a person recordI cannot find anywhere to record an assessment outcome.Sue BarrandPost assessment

View assessments outcome in a person recordThere is no outcome field in a person’s assessment record.Alice BrindlePost assessment

View assessments outcome in a person record
  1. When opening an assessment from person record, it opens to the post-assessment details page. We think it would be better for the assessment to open on the events page.
  2. There doesn’t seem to be the option to create an assessment from a person record.
Y&H
  1. Agree - needs to be fixed
  2. Iteration 2 based on feedback from me


View assessments outcome in a person recordNot able to see the outcome when listedOliver WitosTo be fixed
17Data – correct and presentPre populated data seems to be correctLaura Griffithsthanks

Data – correct and present

Data that is there looks correct but as above it has not pulled through everything.

Laura WestAgree - to be looked into

Data – correct and present

This appears to be correct, but sometimes information isn’t pulling through – see feedback above for more details.

Medeline LevertonAs above

Data – correct and present

Doesn’t look like all data is being pulled through. 

Joanne O'BrienAs above

Data – correct and present
  1. Doesn’t appear to be pulling all data through, for example review dates and comments made at previous ARCPs don’t appear to be recorded
  2. Could we just have access to the trainees in our LETB/Deanery rather than all trainees, or an option to filter out other LETB/Deaneries
Angela McMahon
  1. Example GMC no. please
  2. Yes, this is being looked at right now


Data – correct and presentWhen searching for a hyphenated name (Smith-Jack) nothing comes upMatthew HillSearch function need to be improved

Data – correct and presentI don’t think so, historic assessments don’t seem to have any details shown.Mike RichardsonWe know there is some info not coming through - can you let me know a GMC no. of all details missing?

Data – correct and present
  1. Status and Review date under Event have not gone across to TIS from existing Intrepid record.
  2. In Pre-Assessment – Portfolio review date, curriculum specialty and Grade at time have been recorded as not available rather than as the date recorded on intrepid.
Claire Whittle
  1. Known
  2. Known


Data – correct and present
  1. Names don’t appear to be alphabetised, same as reported in other components
  2. Not all data pulling through…can’t see previous assessments, review dates and outcomes on assessments page
  3. Can dates be in same format as intrepid? DD/MM/YYYY rather than YYYY/MM/DD?
Maria Kist
  1. Agree
  2. As previously mentioned
  3. Yes


Data – correct and presentBlank fields appearing in list of assessments for a trainee e.g. GMC no 6132340 has blank review dates and outcomes, both of which I can see in DR2.Sue BarrandTo be fixed

Data – correct and presentComments on this have been included in my feedback above.Alice BrindleOK

Data – correct and presentThis seems correct.Oliver WitosOK