Latest star ratings released for Employment Zones
Submitted by Daniel on Fri, 05/12/2008 - 7:21am
The April-September star ratings have just been released. Major headline? They're totally different to the previous set of ratings. To the point where it raises questions about whether they're worth looking at. I might put together an analysis of the results for next week if there's enough demand, but I can't guarantee that the analysis won't say 'ignore them'. Anyone interested?
Comments
Daniel,
I really wouldn't bother analysing them. Without knowing the targets against which the performance is evaluated - with different targets for different providers in the same area even - the numbers are entirely empty.
There are also some fairly glaring inconsistencies. The points for quality, for example, are based on self assessment. Reed in Partnership score very poorly for sustained outcomes in virtually all areas - against the unknown targets which they set out in their bid for the contracts. Yet they have the highest quality marks of all providers in four of their areas!
We so sorely need transparency around performance on all provision, whether outsourced or delivered by Jobcentre Plus. Unfortunately, these star ratings are far from that need.
I see your point on this. The analysis, if I do put one together, would be around trying to find wider patterns in the results. For example, does the spread of scores between the two sets of results remove statistical significance from them, what are the averages and possible sources of difference between providers. I would probably suggest an even larger pinch of salt than was used with the New Deal results a while back.
Also, if I were being cheeky, I would point out that Reed self-assessing themselves as super in quality needs to be taken into account!
Seriously though, the DWP are due to respond on my request for traffic light reports next week. Assuming they don't find some ingenious method of making the data completely useless for performance analysis, this will be far more useful in understanding the provision landscape. Pathways will be particularly interesting, as it's in many ways a forerunner of the FND procurement process, and nobody's meeting target so far.
Would anyone know if these contracts are being looked at for other providers to bid?
Hi Jonny,
The short answer is no. Employment Zones are being replaced by FND next year, but won't be changing hands before then.