2024-12-05 - Application Count, Fill Rate Demo & Feedback

Attendees: @alice.gagg2 @Clare Wright Jon Howes, Fiona Muchet, Chad Atkinson

Demo - https://tabanalytics.data.england.nhs.uk/#/projects/1272

Previous Actions -

Questions from Data Analytics Team

• For the Dashboard :

  • Should we clean up Preference Region in the back end or leave it as it appears in the data. For eg if Preference Region = “London and Kent, Surrey and Sussex” should we make it just “Kent Surrey and Sussex” ? or “Other”

  • Should all NULL Grades be excluded from Application Counts no matter the status?

    • To be checked as part of QA with Chad for NULL grades

  • For Offer Year 2025-2026, why for some specialties is there already a ‘Round 2’ present? Why do some specialties have a Round 2 but not a Round 1?

• Cross Over Application calculation Question:

  • To calculate if an applicant is a cross over applicant or not we only look at those applicants who have applied for more than one specialty within the same OfferYear+OfferRound. So Cross over applcant = Applicant who has applied to more than one Offeryear+Offer Round is this correct?

     For Applicant ID  = 5154

     Only for Offer year 2024-2025 in "2024 Medical Round1" the applicant is Crossover applicant , in other offer years eg 2023-2024 the same applicant is not a cross over applicant. Is the right in assuming? 

    • Yes calculation is correct but…

    • Would also be useful to know have they applied for other Offer Years, Offer Rounds, etc

  • Application Counts Questions:

    • As not all records have a status of ‘Applied’, for Application Counts an ApplicationID with any status except ‘In Progress’, 'Application withdrawn before submission' is considered to be an application. Are there any other statuses which should not be included?

      • Yes, all but these two should count as an application

    • Application Status of ‘Longlist Unsuccessful’ produces a record with a NULL Grade. Is this expected? Should those with this status be excluded from Application Counts completely or just those with NULL Grades?

      • To be checked as part of QA with Chad for NULL grades

    • Should all NULL Grades be excluded from Application Counts no matter the status?

      • To be checked as part of QA with Chad for NULL grades

Q&A / Feedback

• Fill rate dashboard:

  • Different slicing based on Nation, vacancy type(national/ local) etc

  • Regional Breakdown view

  • Build additional layers of report one fundamentals done

• Application Counts

  • Send examples of NULL grades to Chad to investigate

  • Post numbers (Oriel definition) would be useful for competition ratios

• Cross overs

  • Yes calculation is correct but…

  • Would also be useful to know have they applied for other Offer Years, Offer Rounds, etc

    • cross over applicants - how many applied for the same specialty in other offer years / other offer rounds in the same offer year/ applied for different specialties in different offer years & rounds

• All reports

  • Look at medical round grouping using newly added fields https://hee-tis.atlassian.net/browse/TIS21-6785

  • Continue to look at data use cases for building of additional reports.

  • Liaise with Fiona of getting historical data to allow for trend analysis