Page Comparison

Key questions for focus on reporting functionality

1. Within which provider organization is risk greatest?
2. Within an organization where is risk greatest?
3. Within an organisation where is good practice being demonstrated?
4. Which organization presents the greatest risk within a specific training programme/learner group?
5. How do results from different professional groups compare within organizations

We need to understand:

• User groups and their needs
• How these groups use the report
• What these groups expect from the report
• What are we building this in? (Tableau at the moment, but will this be possible with the answers to the above)

Language and messaging

• How are we defining risk? Outliers (NTS), Benchmarks, Raw score

• Data extraction
• The volume of info and what do external users need?
• Reputational damage
• Within theme or indicator which questions make them up and what were the responses 'drill-down'
• In EXTERNAL users cant action the data, they won't distribute the survey and there will be no Data we need to make sure it's usable for EXTERNAL
• Risk by 5X5 Matrix?
• Link to the HEE Quality framework
• Year-on-year longitude (data where N<3)
• Creating a bank of non-med data that can map to NTS data

• UI Page instead to access further data
• Intro dashboard could adapt the page which explains all the other dashboards to create an overall introduction
• Log in dictates if you see Internal or External tool

• What happens when response rates increase and released nationally
• What happens when the survey has done two revolutions
• Do we need it at all
• Link is broken so email better
• Add in which survey the tool links to (date)

• HEE Branding to be better
• Contents page would be useful
• Purpose of the survey upfront
• Navigation to each area with a short description
• Last updated - Data as title
• Contact information

• Need an indication of response rates to show the validity
• Add a theme/indicator level under the domain
• Responders by Region - may be more useful to have response numbers vs total learners (ie. Total potential responses)
• Future - To cover all domains in questions
• Respond by Region. Change to number + Split Med and Non-Med
• Useful only to operational staff

• Do filters filter all pages or just single page
• How will this be presented year on year
• Not measuring against all the domains
• Number of questions varies by domain (2-15) How best to summarise
• Not useful EXTERNALLY (Just more information to navigate past)
• What are our response rates? What do about non-med?
• If we get Slide 1 right we don't need this

• Overall satisfaction by location (Drill down on a map)
• Rag ratings
• Positivity/negativity
• OS by Region/Trust/Programme - Drill down to see questions
• Can we RAG
• Domain useful internally at National/board level
• Question categories: eg Teaching, Supervision useful externally and Local Office level
• Would like the option to compare responses to regional mean as well as national (overall sat. by location chart)
• Ability to be able to compare results for sites as well as trusts
• Create a common NETS language (like GMC flags - or NETS flags)
• Click on a result by domain to see questions items that feed into it
• Domain level too broad 'overall Sat need to drill down to 'Supervision', 'Training' etc
• Breakdown of response has 'value' for local offices
• Can we map risk against the HEE risk matrix?
• OV Sat/OV Variance tabs would be useful if displayed by Category/Teacher/Supervision
• Results on a page. eg - for a provider - too many tabs to view all data
• If we theme the questions by Supervision etc, it may be easier to understand/more useful
• OV Variance filter by colour coding to investigate potential risk
• Introduce a slider with movable maximum and minimum to highlight the top and bottom ranges
• Domain summary - Lime the idea of having one list of questions taher rather than response types
• End The end goal - EDU Provider . can choose themselves, click download & obtain a report on themselves
• Addition of Average bar of those selected

• Can we RAG/Categorise data in some way as GMC? (We all understand that system & so do trusts)
• Currently can't answer business questions from too!
• How do we identify the key areas of risk in these pages
• Ask National Directors how they want to analyze business risk
• How do we know which are our organizations of greatest risk? Need to agree threshold + process
• Calculation of data/scores/risk. How do we want to count? Data methodology
• If we cant do % response rates - do no's at - National/Regional and also at Placement/Trust level
• How is this currently better than excel?
• Don't use '+ive & '-ive' as it's confusing terminology

• Instead of an external tool can we generate a PDF report