New Deal performance by providers

by Char on 29 Apr, 2008 in

I am interested in finding out the new deal performance of delivery districts by provider, similar to the analysis for http://indusdelta.co.uk/story/analysis_new_deal_performance_20062007 but covering all districts.

Can you help? Please let me know either way asap as I need this data rather quickly.

by Daniel on 29 Apr, 2008

It may not be much consolation, but the FND contracts are going to have public performance measurement when they come in. Performance in existing contracts does not have public figures of this kind, I'm afraid. I'm relying on 'informal knowledge transfer' and on Freedom of Information requests to get the information I do get at the moment. I have further performance information on contracts from two years ago, but that doesn't seem relevant enough to publish given how quickly things are changing.

Additionally, the DWP's own performance measurement system is currently broken, so their in-house information has not been updated since June 2007. Seriously. The page with information they do have is at http://www.jobcentreplus.gov.uk/JCP/Partners/providerstatistics/index.ht...

They're relying on manual data collection and estimations, but this means, among other things, that they're unlikely to be checking the accuracy of performance claims by providers in bidding. At any rate, I've never seen a query raised on performance claims in bids, even when it varies significantly between different bids. DWP procurement staff: please tell me if this is not the case!

stdClass Object
(
    [cid] => 44
    [pid] => 0
    [nid] => 114
    [subject] => It may not be much
    [comment] => 

It may not be much consolation, but the FND contracts are going to have public performance measurement when they come in. Performance in existing contracts does not have public figures of this kind, I'm afraid. I'm relying on 'informal knowledge transfer' and on Freedom of Information requests to get the information I do get at the moment. I have further performance information on contracts from two years ago, but that doesn't seem relevant enough to publish given how quickly things are changing.

Additionally, the DWP's own performance measurement system is currently broken, so their in-house information has not been updated since June 2007. Seriously. The page with information they do have is at http://www.jobcentreplus.gov.uk/JCP/Partners/providerstatistics/index.ht...

They're relying on manual data collection and estimations, but this means, among other things, that they're unlikely to be checking the accuracy of performance claims by providers in bidding. At any rate, I've never seen a query raised on performance claims in bids, even when it varies significantly between different bids. DWP procurement staff: please tell me if this is not the case!

[format] => 1 [timestamp] => 1209512832 [name] => Daniel [mail] => [homepage] => [uid] => 1 [registered_name] => Daniel [picture] => [data] => a:5:{s:7:"contact";i:1;s:17:"mimemail_textonly";i:0;s:18:"admin_compact_mode";b:1;s:15:"googleanalytics";a:1:{s:6:"custom";i:0;}s:21:"flexibleaccessibility";a:3:{s:6:"colour";s:13:"high contrast";s:4:"font";s:5:"large";s:6:"linear";N;}} [score] => 0 [users] => a:1:{i:0;i:0;} [thread] => 01/ [status] => 0 [contact] => 1 [mimemail_textonly] => 0 [admin_compact_mode] => 1 [googleanalytics] => Array ( [custom] => 0 ) [flexibleaccessibility] => Array ( [colour] => high contrast [font] => large [linear] => ) [depth] => 0 [new] => 0 )
by Daniel on 30 Apr, 2008

Char then asked: "Many thanks for your prompt reply - much appreciated.

"It is hard to believe that this data is so difficult to get. Thanks for directing me to the page on provider statistics. I can live the fact that it's only 3 months of data. Unfortunately however, it seems that the data given on this page is for New Deal Young People only. Do you know if it's available for the other New Deal programmes also or am I on a wild goose chase?

"The data on the page I directed you to is only for some elements of New Deal, not for the whole thing. It can give you a brief indicator of what's going on, but not too much."

You might want to look at recent ALI/Ofsted reports also from www.ofsted.gov.uk since they started using performance against target as a key quality measure in their reports on providers a year or so ago. Given the cycle of up to four years for ALI inspections and the lack of official data to rely upon, this will give a necessarily incomplete picture, and will require a lot of manual data collection from individual provider reports.

As for the situation being hard to believe, well, yes it is. Unified, accessible MI with agreed measurement standards is a cornerstone of contract management. I would hope that DWP contracts staff are rather unhappy that their MI system isn't working.

Once again, I should add the caveat that I'm speaking from outside the situation. People on the inside, or anyone who can help with Char's mission, are welcome to add their thoughts!

stdClass Object
(
    [cid] => 48
    [pid] => 0
    [nid] => 114
    [subject] => Char then asked:
    [comment] => 

Char then asked: "Many thanks for your prompt reply - much appreciated.

"It is hard to believe that this data is so difficult to get. Thanks for directing me to the page on provider statistics. I can live the fact that it's only 3 months of data. Unfortunately however, it seems that the data given on this page is for New Deal Young People only. Do you know if it's available for the other New Deal programmes also or am I on a wild goose chase?

"The data on the page I directed you to is only for some elements of New Deal, not for the whole thing. It can give you a brief indicator of what's going on, but not too much."

You might want to look at recent ALI/Ofsted reports also from www.ofsted.gov.uk since they started using performance against target as a key quality measure in their reports on providers a year or so ago. Given the cycle of up to four years for ALI inspections and the lack of official data to rely upon, this will give a necessarily incomplete picture, and will require a lot of manual data collection from individual provider reports.

As for the situation being hard to believe, well, yes it is. Unified, accessible MI with agreed measurement standards is a cornerstone of contract management. I would hope that DWP contracts staff are rather unhappy that their MI system isn't working.

Once again, I should add the caveat that I'm speaking from outside the situation. People on the inside, or anyone who can help with Char's mission, are welcome to add their thoughts!

[format] => 1 [timestamp] => 1209560111 [name] => Daniel [mail] => [homepage] => [uid] => 1 [registered_name] => Daniel [picture] => [data] => a:5:{s:7:"contact";i:1;s:17:"mimemail_textonly";i:0;s:18:"admin_compact_mode";b:1;s:15:"googleanalytics";a:1:{s:6:"custom";i:0;}s:21:"flexibleaccessibility";a:3:{s:6:"colour";s:13:"high contrast";s:4:"font";s:5:"large";s:6:"linear";N;}} [score] => 0 [users] => a:1:{i:0;i:0;} [thread] => 02/ [status] => 0 [contact] => 1 [mimemail_textonly] => 0 [admin_compact_mode] => 1 [googleanalytics] => Array ( [custom] => 0 ) [flexibleaccessibility] => Array ( [colour] => high contrast [font] => large [linear] => ) [depth] => 0 [new] => 0 )
by Daniel on 30 Apr, 2008

"Thanks again for your help - it is greatly appreciated.

Hopefully (!) this will be my last question of the day:

Can you tell me which New Deal programmes (Young New Deal, 25+, etc.)
that the data on New Deal results captures?
http://indusdelta.co.uk/story/analysis_new_deal_performance_20062007
"

I actually look forward to questions. The site would be fairly empty without them, so ask away on anything that takes your fancy.

The current New Deal contracts cover NDYP and 25+. ND50+ is probably rolled into it as well, but I can't remember off the top of my head, despite writing a bid for one that's currently delivering! ND Music is virtually defunct, unless someone knows something I don't.

stdClass Object
(
    [cid] => 51
    [pid] => 0
    [nid] => 114
    [subject] => Pasted in from e-mail...
    [comment] => 

"Thanks again for your help - it is greatly appreciated.

Hopefully (!) this will be my last question of the day:

Can you tell me which New Deal programmes (Young New Deal, 25+, etc.)
that the data on New Deal results captures?
http://indusdelta.co.uk/story/analysis_new_deal_performance_20062007
"

I actually look forward to questions. The site would be fairly empty without them, so ask away on anything that takes your fancy.

The current New Deal contracts cover NDYP and 25+. ND50+ is probably rolled into it as well, but I can't remember off the top of my head, despite writing a bid for one that's currently delivering! ND Music is virtually defunct, unless someone knows something I don't.

[format] => 1 [timestamp] => 1209568094 [name] => Daniel [mail] => [homepage] => [uid] => 1 [registered_name] => Daniel [picture] => [data] => a:5:{s:7:"contact";i:1;s:17:"mimemail_textonly";i:0;s:18:"admin_compact_mode";b:1;s:15:"googleanalytics";a:1:{s:6:"custom";i:0;}s:21:"flexibleaccessibility";a:3:{s:6:"colour";s:13:"high contrast";s:4:"font";s:5:"large";s:6:"linear";N;}} [score] => 0 [users] => a:1:{i:0;i:0;} [thread] => 03/ [status] => 0 [contact] => 1 [mimemail_textonly] => 0 [admin_compact_mode] => 1 [googleanalytics] => Array ( [custom] => 0 ) [flexibleaccessibility] => Array ( [colour] => high contrast [font] => large [linear] => ) [depth] => 0 [new] => 0 )
by Daniel on 30 Apr, 2008

I've just requested the following from DWP under Freedom of Information rules, and will publish any response I get when it arrives:

  1. Could you confirm if the PLMI system is working properly and producing MI for provider delivery of contracts?
  2. Either from this, or through collated Annex 10s, or through whatever other means you are using to track provider performance MI, could you send me a list of performance by providers in all currently delivering contracts across the UK? Given that the whole of London and South East New Deal was stored on a single spreadsheet last I checked, and ESF and other programmes likewise, I believe this would entail sending me less than 25 existing spreadsheets.
  3. Could you provide a table or other document listing the FoI requests received by the DWP, what they asked for and your response to them? I note that a partial list is available on http://www.dwp.gov.uk/foi/foi_index.asp but this appears to be out-of-date and to not cover all requests in any case.
stdClass Object
(
    [cid] => 52
    [pid] => 0
    [nid] => 114
    [subject] => FoI request
    [comment] => 

I've just requested the following from DWP under Freedom of Information rules, and will publish any response I get when it arrives:

  1. Could you confirm if the PLMI system is working properly and producing MI for provider delivery of contracts?
  2. Either from this, or through collated Annex 10s, or through whatever other means you are using to track provider performance MI, could you send me a list of performance by providers in all currently delivering contracts across the UK? Given that the whole of London and South East New Deal was stored on a single spreadsheet last I checked, and ESF and other programmes likewise, I believe this would entail sending me less than 25 existing spreadsheets.
  3. Could you provide a table or other document listing the FoI requests received by the DWP, what they asked for and your response to them? I note that a partial list is available on http://www.dwp.gov.uk/foi/foi_index.asp but this appears to be out-of-date and to not cover all requests in any case.
[format] => 1 [timestamp] => 1209569450 [name] => Daniel [mail] => [homepage] => [uid] => 1 [registered_name] => Daniel [picture] => [data] => a:5:{s:7:"contact";i:1;s:17:"mimemail_textonly";i:0;s:18:"admin_compact_mode";b:1;s:15:"googleanalytics";a:1:{s:6:"custom";i:0;}s:21:"flexibleaccessibility";a:3:{s:6:"colour";s:13:"high contrast";s:4:"font";s:5:"large";s:6:"linear";N;}} [score] => 0 [users] => a:1:{i:0;i:0;} [thread] => 04/ [status] => 0 [contact] => 1 [mimemail_textonly] => 0 [admin_compact_mode] => 1 [googleanalytics] => Array ( [custom] => 0 ) [flexibleaccessibility] => Array ( [colour] => high contrast [font] => large [linear] => ) [depth] => 0 [new] => 0 )

Post new comment

The content of this field is kept private and will not be shown publicly.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Allowed HTML tags: <a> <em> <strong> <cite> <code> <ul> <ol> <li> <dl> <dt> <dd> <h1> <h2> <h3> <del> <small>
  • Lines and paragraphs break automatically.
  • You can embed tablemanager tables within your nodes using the following syntax:
    [tablemanager:table_id,pagination,admin_links,column=?|start=?|end=?,attribute=?|attribute=?|...]
  • You may use [view:viewname] tags to display listings of nodes.

More information about formatting options