SDN Strategic Associate, David Lockhart Hawkins, has released a series of posts on the recently-published Qualification Achievement Rates (QAR), retention rates and pass rates for 2018-19 to 2023-24.
In this blog, we have collated the key highlights and data points for you. For the full posts and to view the associated spreadsheets, visit David’s LinkedIn page.
- Achievement rates are based on the Hybrid End Year. The Hybrid End Year is the later of the Achievement Year, Expected End Year, Actual End Year or Reporting Year of a programme. These rates are based on combined frameworks and standards across all provision of all ages.
- Pass rates are based on the individual aims that were successfully completed in the relevant year (the Hybrid End Year). They are calculated as the number of learning aims achieved divided by the number successfully completed.
- Retention rates are based on the individual aims that were successfully completed in the relevant year (the Hybrid End Year). They are calculated as the number of learning aims completed divided by the number of leavers.
The data should be used internally for comparison and note that QAR and retention are notoriously slow-moving measures due to the hybrid year calculation.
QAR by standard – Some headline notes on 23/24
“The overall achievement rates for apprenticeships for 23/24 are up 10% overall from 54.6% to 60.5%. Some 5000 more apprentices are included in this year’s population to last years with 288,700 in the measurable data.
It takes a long time for QAR to mean something due to the hybrid year calculation method. The learners included in these rates had been on programme for more than 42 days and had the latter of their planned end date, actual end date or achievement date between August 1st 2023 and July 31st 2024 or were simply last reported in that year.
Also, many apprenticeship withdrawals are for reasons outside of a providers’ control, for example departure out of sector, or to another employer that works with someone else or are just difficult working environments. Certain sectors naturally see more of a transient workforce. So use the data to benchmark your performance against your peers for sure, but ensure you understand its place.
So, use the data to benchmark your performance against your peers for sure, but ensure you understand its place.
- 477 standards in scope for 23/24, compared to 517 in 22/23 showing a decline in the range of standards delivered.
- Standard overall QAR improved from 54.3% to 60.5% overall which is a significant improvement.
- Level 2 standards improved from 53.9% to 59.8%
- Level 3 standards improved from 54.7% to 60.1%
- Higher level (4+) standards improved from 54.0% to 61.4%
- Volume of apprentices on programmes that were at or above the 60% threshold that indicates on track for accountability framework purposes was 52.05% of the population up from 26.4% in the standards data set (assumes programmes with less than 10 were on track).
- 295 standards up from 185 were above the 60% accountability threshold for QAR, 182 were below the threshold.
- Team leader remained the largest apprenticeship cohort with 12570 in cohort (2.18% of the overall population), however only three of the top ten largest programmes was above the 60% threshold (Business Administrator – 68.6%), Senior Leader 65% and Installation and Maintenance Electrician 62.5%. 12 of the top 20 in size were above 60%, 8 below it with Adult Care Worker and Lead Adult Care worker showing annual improvement but both still being below 50% at 46.1% and 44.8% respectively.”
David has created a summary document showing all of the apprenticeship standard Qualification Achievement Rates (QAR), Retention rates and pass rates for 2018-19 to 2023-24.”
Follow this link to view the full post and attached spreadsheet.
Large cohort rankings
“Out of the 2023-24 Apprenticeship success data I broke down the ranking of providers with greater than 500 apprentices in their cohort to look at their overall performance in comparison to the smaller provider market. In our annual analysis we use size of cohort, the volume of apprentices in that year’s QAR population for ranking. In those with more than 500 apprentices Just over 60% exceeded the national achievement rate average of 60.5% (up from 54.6% last year which for a second successive year is a significant improvement), though only five of them would rate in the top 100 providers by QAR ranking.
Of providers with large cohort populations, 63.2% would be viewed as on track in the accountability framework measurements, 24.1% as needs improvement and 12.8% in at risk categories. This is fairly consistent with providers of all size provision where nationally 57% of providers are in the on track category, though 9% of providers nationally have insufficient data showing in the national rates to place them.”
Follow this link to view the full post and the large provider rankings spreadsheet.
Small/Medium cohort rankings
“I broke down the ranking of providers with 40-499 apprentices in their cohort, what I’d call Small-Medium providers to look at their overall performance comparison.
Overall 1,111 providers have measurable data, 133 with over 500 in cohort, 737 with 40-499. This medium sized cohort provision is the majority of the sector and includes some large organisations with smaller provision.
Of the mediums, 449 (60%) were above the national achievement rate average, near identical to last year’s 59.7%, compared to 60% for large provision. 49 of them would rate in the top 100 provider ranking in QAR.
What is also noticeable is the average size of cohort amongst the better performers, commonly being under 100, not uncommon for employer providers or university cohorts. Naturally the overall rates are a mix of provision, levels and sectors so do take that into consideration. A broader range of provision is likely to have pockets of good performance and worse performance. Of providers with medium cohort populations, 61.1% would be viewed as on track in the accountability framework measurements factionally lower than large providers, 25.4% as needs improvement and 13.6% in at risk categories.”
Follow this link to view the full post and the medium provider rankings spreadsheet.
Micro cohort rankings
“This is the breakdown for micro cohorts (0-39 apprentices in cohort). 241 micros have measurable data but there are 353 providers that had this volume of apprentices (down from 341 last year) but where provision is less than 10 there may not be a published rate.
68.8% % of the 241 were above the national achievement rate average. 49 micro providers were in the top 100 QAR for providers overall. 14 providers here had 100% QAR, pass and retention rates from low volume provision but is still significant. 3 of those 14 had 30 apprentices so to have all pass is very impressive.
Of micros with published data 46.2% would be viewed as on track in the accountability framework measurements significantly down on larger provision but importantly 31.2% of this provision does not have published data. 10.8% is in the needs improvement category and 11.9% in the at risk category, the latter broadly similar to all provider types.
With this volume of apprentices there is usually greater control, the provider potentially knows every apprentice but on these volumes every apprentice counts when it comes to the financial viability of provision but a cohort of less than 40 is rarely a viable business unless its supported by other revenues outside of apprenticeships. Many of the top performers are not small organisations, they just have smaller cohorts.
As per the other types, you need to look closely at the apprenticeship standards delivered for added context but its a useful measure to see their overall positioning for achievement rate and retention rates.”
Follow this link to view the full post and the micro-provider rankings spreadsheet.
Overall rankings
“There are 1111 providers with sufficient data for their ranking, there are 112 with insufficient sized populations or have had their data not shown for a total of 1223 providers. Last year we had 1260 providers with data so the market has shrunk marginally.
14 providers have 100% achievement rates but generally form from lower volume provision and employer providers show some impressive performance at the top of the list.
Of all provision with data showing rates 57% would be viewed as on track in the accountability framework measurements, 21% in needs improvement and 13% as at risk. This is fairly consistent across all sizes of provision. This does of course need to be taken into context with the sectors providers operate in and the fact that 39% of standards have average success rates below the on track value of 60%.”
Follow this link to view the full post and the overall rankings spreadsheet.
If you would like more analysis of your position against your peers by standard or by age level David is available to perform this analysis for you. Contact as at info@lockharthawkins.com for more information.
Further support
Webinar – Strategic planning and the Apprenticeship Accountability Framework
This session is also available as a recording. Please contact us if you would like to arrange this for your team.
Providers are measured and monitored by their performance against the indicators of the Apprenticeship Accountability Framework. Understanding the measures and the data used is essential for any leader and manager in the sector. In April 2024 the Department for Education updated the indicators for the framework and these will have significant impact on providers and their planning.
So, how do we work with the data effectively and how do we benchmark performance? What do we do with it and how do we plan and implement appropriate actions to improve?
This 2-hour deep-dive session with David, will help you improve your understanding, get effective ways of planning and effective implementation of strategy in this area to lay a strong foundation for the coming years.
This session covers:
- Understanding the Apprenticeship Training Provider Accountability Framework, the indicators and risks
- How the framework works with quality inspection
- Data, Strategy and setting effective targets
- Interventions and working with action plans
Visit the events page for more information and to book your place.