Press Release - Fourth Validation Compendium Report
19 December 2007
Government departments have improved the quality of the data
systems used to report progress against their Public Service
Agreements. But a report out today by the National Audit Office
found that although half of the data systems needed no further
work, over a third, though broadly appropriate, needed
strengthening and some 15 per cent were not fit for purpose or not
fully established.
Today’s report looked at the quality of the data systems used by
departments to measure progress against their 2005 – 2008 Public
Service Agreement (PSA) targets. PSAs were first introduced in 1998
to improve the accountability of Government spending. Today’s
findings give an overall picture of the quality of data systems
supporting all 2005-2008 PSAs.
After reviewing 237 data systems operated by 17 departments, the
NAO found that 50 per cent were fit for purpose. Some 35 per cent
were broadly appropriate but needed strengthening and eight per
cent were not fit for purpose. For six per cent it was too early to
tell and one per cent of data systems had not been established at
all.
Although departments have improved the quality of their data
systems over time, they have been less successful at transferring
the learning to the development of new data systems. The report
found that improvements had been made in 46 per cent of the data
systems which had been used to monitor progress against previous
targets, but departments had found it less easy to implement good
practice when establishing data systems for the first time.
The report concludes that the Comprehensive Spending Review 2007
has introduced a number of changes to the PSA framework, aimed at
strengthening the framework of accountability. These changes will
address a number of the recommendations that we have made about
data systems.
The NAO has recommended that departments should explicitly
consider measurement issues when setting new PSAs, specifically
that all the elements of performance that they are targeting are
defined and measurable. They should also evaluate existing data
sources to assess their suitability for PSA monitoring purposes.
Reports to management boards should disclose limitations to data
quality and departments should introduce a management function to
challenge and approve data quality.
Sir John Bourn, head of the National Audit Office, said
today:
“Good quality data are essential if performance measures
and targets are to be used effectively to improve public sector
delivery and accountability. It is good news that data systems are
improving, but departments must transfer these lessons to their new
data systems. If we are to have confidence in the performance
reported by government, all systems used to monitor it must be
robust.”
Notes for Editors:
- Press notices and reports are available from the date of
publication on the NAO website, which is at www.nao.org.uk. Hard
copies can be obtained from The Stationery Office on 0845 702
3474.
- The Comptroller and Auditor General, Sir John Bourn, is the
head of the National Audit Office which employs some 850 staff. He
and the NAO are totally independent of Government. He certifies the
accounts of all Government departments and a wide range of other
public sector bodies; and he has statutory authority to report to
Parliament on the economy, efficiency and effectiveness with which
departments and other bodies have used their resources.
Press Notice 66/07
All enquiries to Donna Watson, NAO Press Office: Tel: 020 7798
7038
Mobile: 07917 555 388