As the chairman of the expenditure review central steering committee, I welcome this opportunity to discuss with the committee our report to the Minister for Finance on the expenditure review initiative for the period June 2002 to June 2004. We took the initiative in preparing this report and welcome the committee's interest in it.
It might help if I set out briefly the background to these expenditure reviews. The initiative began in 1997 as part of the financial reform agenda set out in Delivering Better Government. It was one of a number of initiatives taken by Government in the context of the strategic management initiative. The aim of it was to achieve better informed resource allocation decisions and enhanced accountability for the results achieved for these resources.
A central steering committee was established to oversee the review process. All Departments undertook to carry out reviews each year under joint steering committees comprising the Department of Finance and the spending Department. These reviews were to be submitted to the Minister for Finance and the relevant line Minister.
The first round of reviews covered the period 1997 to 2001. The number of reviews approved by Government for this period was 126. By April 2002, the number of reviews actually completed was 70. Of the remaining 56 reviews, 26 were carried over into the 2002-04 review period, five of the areas due for review were evaluated in another context and 25 were not proceeded with.
When the expenditure review initiative was first established, its objective was to review all expenditure programmes over a three-year period. The Government reviewed progress on the expenditure review initiative in June 2001 and again in spring 2002 and initiated a number of reforms to the process. It was clear, with the benefit of a number of years' experience of Departments and offices developing arrangements and operating the review initiative, that the arrangements for reviews were not satisfactory and that the original objectives of systematically reviewing all programmes over a three-year period was overly ambitious and simply not feasible.
These views were echoed by the Comptroller and Auditor General in the conclusions and findings of his value for money report, No. 39, on the expenditure review initiative published in January 2002. The report made the a number of recommendations including: a comprehensive strategy for the development of the expenditure review initiative should be put in place; stronger support mechanisms and central guidance should be provided; a systematic process of quality assessment of reviews should be implemented; a formal process for monitoring review impacts should be initiated; a clear set of principles should be established enabling areas of expenditure to be prioritised and scheduled for review; and review reports should be published, where possible. It is worth recalling that the Comptroller and Auditor General also found in his report that the expenditure review process despite its shortcomings "had the effect of directing attention to areas of expenditure which had not hitherto been analysed to any great extent and that the initiative provided some reassurance that taxpayers' money was generally being used to good effect in the areas under review".
The structural improvements to the expenditure review initiative arising from the Government's review of progress were designed to improve the efficiency and effectiveness of the expenditure review initiative as well as to address the shortcomings in the expenditure review arrangements confirmed by the Comptroller and Auditor General. The central steering committee has been working since then to implement the changes approved by the Government and recommended by the Comptroller and Auditor General. The recent report from the central steering committee to the Minister for Finance sets down the progress made and reviews the operation of the revised arrangements which have been put in place.
When I last appeared before an Oireachtas committee in regard to the expenditure review initiative in March 2002, it was to discuss with the Committee of Public Accounts the recommendations in the Comptroller and Auditor General's value for money report. I propose, therefore, to illustrate the changes made since April 2002 by reference to those recommendations. I also propose to make reference to the additional recommendations for improvements made in our recent report to the Minister for Finance.
As regards the recommendations of the Comptroller and Auditor General that a "Comprehensive strategy for development of the [expenditure review initiative] should be introduced and a clear set of principles should be established enabling areas of expenditure to be prioritised and scheduled for review", the Government had decided in 2001 that a more focused approach to the selection of reviews was appropriate. This decision set down clear criteria for the selection of topics for review emphasising that programmes of strategic importance or involving significant levels of expenditure should be selected for review. In May 2002, the Government agreed the arrangements for the 2002 to 2004 round of reviews and approved a list of 52 reviews to be undertaken in 2002. The list of reviews included 23 reviews carried forward from the previous round of reviews and Departments were given the option to reconsider and update their list of indicative reviews for the years 2003 and 2004 in the light of the prevailing circumstances.
The central steering committee subsequently added a further 53 reviews, including three carried forward from the earlier round, bringing the total of reviews planned for the 2002-04 round to 105. As part of an approach of ensuring greater co-ordination between Departments in regard to reviews, following consultation with Departments, the Government invited the central steering committee to include some cross-departmental reviews in the 2002-04 round of reviews. In response, two topics for cross-departmental reviews were selected to commence on a pilot basis in 2002, namely, programmes aimed at the long-term unemployed, to be led by the Department of Enterprise, Trade and Employment — the Secretary General of that Department, Mr. Seán Gorman is present this morning — and programmes on road safety to be led by the Department of the Environment, Heritage and Local Government. Responsibility for the latter transferred to the Department of Transport with the realignment of certain departmental functions following the change of Government in June 2002. These two reviews are included in the 105 reviews planned for the 2002-04 round of reviews.
Standard general terms of reference for expenditure reviews were also approved by the central steering committee in July 2003 with a view to improving the quality and consistency of reviews. The standard general terms of reference is included as Appendix 5 of the expenditure review report recently submitted to the Minister for Finance. The terms of reference for individual studies are based on this agreed standard and also agreed at senior management level before work commences on the review.
Notwithstanding the 2001 Government decision that reviews should focus on programmes of strategic importance or involving significant levels of expenditure, it is clear to the central steering committee that problems persist with getting Departments to focus on such programmes and significant areas of expenditure. Some of the topics selected for review by Departments remain relatively small in scale. In its recent report to the Minister for Finance the expenditure review committee recommended that future review reports should clearly indicate what percentage of the organisation's total budget the review covers and the specific business factors underlying the choice of review topic.
To provide stronger central support for the review initiative as recommended by the Comptroller and Auditor General, an expenditure reviewers' network was established in July 2002 with support from the central steering committee secretariat in the Department of Finance to provide central support to reviewers and direct training in expenditure review. It has developed a three-day training course in expenditure review which has been delivered to approximately 120 civil servants to date. It also holds seminars for network members on issues relevant to expenditure reviews. To date seven seminars have been held. The network is also supported by a computer extranet website which acts as a central source for information and guidance for all Departments and offices.
The recent report to the Minister proposes to build on the progress achieved by the reviewers' network by tasking it with further strengthening the supports to smaller offices to carry out evaluations and with improving the range of central supports available generally. Feedback from the people involved with expenditure reviews suggests that additional supports are required.
In addition to the specific training in carrying out expenditure reviews which has been put in place, the centre for management and organisation development, CMOD, in the Department of Finance has introduced a number of training programmes in policy analysis which will further strengthen the evaluative capacity of Departments. CMOD introduced a basic short course in policy analysis in 2000 which has since been continuously updated to reflect relevant developments. Approximately 200 staff have been trained under the basic programme since its introduction. Two new professional courses were introduced in 2003 — a two year part-time higher diploma programme and a two year full-time masters programme in public policy analysis. The first graduates of the diploma and masters programmes, 30 in all, will come on stream this year.
The recent expenditure review report recommends that Departments and offices should seek, in particular, to make more use of the participants in the masters programme in meeting their analytical requirements and in supporting the expenditure review initiative. This is already beginning to happen. Three of the participants in the masters programme are undertaking projects directly related to expenditure review. One of them has recently been assigned a project supporting the cross-departmental study on supports for the long-term unemployed in order to give greater impetus to the completion of this review. When arrangements for the establishment of a panel of external assessors to assess the quality of reviews being produced was completed in mid-2003 the systematic quality assessment of reviews recommended by the Comptroller and Auditor General was put in place. Some 25 expenditure reviews have been quality assessed to date and a further two have been submitted for review. The arrangements for assessing the quality of reports are now working well.
At departmental level the submission of draft reports to quality assessment and the resultant comments from the assessors is improving the quality of the final reports. The central steering committee's conclusions and recommendations for improvements to the expenditure review process included in their recent report to the Minister were greatly assisted by analysis of the views and experiences of the assessors' engagement with Departments and offices on their draft reports.
Monitoring the impacts of reviews, as recommended by the Comptroller and Auditor General, is being addressed through meetings between the central steering committee and Secretaries General. Seven such meetings have taken place in the past two years. While these meetings have been useful in monitoring overall activities in the Departments concerned in regard to expenditure reviews and evaluation generally, the central steering committee considered that more was required to strengthen both the potential and actual impacts of expenditure review reports at departmental level. In this regard, the recommendations in their recent report to the Minister for Finance were: each expenditure review should state the percentage of the organisation's total budget and the specific business factors underlying the choice of topic for review; Departments and offices should put systems in place to ensure that the responses to the expenditure review initiative recommendations by their organisations are tracked and reported regularly to their management advisory committee; Departments should provide details in their annual reports on all forms of evaluation activity, including expenditure reviews, and detail progress in implementing recommendations set out in the evaluation-review reports and the impacts achieved as a result. These recommendations were designed to achieve this objective by requiring more transparent, open and systematic monitoring and reporting of expenditure review recommendations.
In the interests of promoting greater accountability to the Oireachtas and the public in regard to the expenditure reviews, the Government decided in 2002 that the reviews should generally be made available to the Oireachtas and that they should be published on departmental websites. The central steering committee has sought to further strengthen these accountability arrangements by recommending that: Departments forward copies of their review reports directly to the clerks of the appropriate Oireachtas committees; and future progress reports on modernisation action plans to be submitted to the performance verification groups under Sustaining Progress should include details of current expenditure review plans.
It is clear from the foregoing that significant improvements have been introduced to the expenditure review initiative during the 2002-04 round of reviews to address the shortcomings identified in the review process by the Comptroller and Auditor General in his value for money report. The central steering committee, having reviewed their operation and taking account of the time it takes for the revised arrangements to become fully effective, took the view that further refinement of some of the improvements and some additional initiatives were appropriate. The committee believes that the recommendations made in its recent report to the Minister will further develop the procedures introduced in the 2002-04 period with particular emphasis on increasing the internal and external accountability of Departments and offices for their review activity with a view to achieving a volume of reviews and at the same time increasing their impact on decision-making.
The year 2002 was the first year of the new round. The Government approved 52 reviews for that year, including 23 carried forward from the earlier period. The 52 reviews included the two pilot cross-departmental reviews to which I have referred. Subsequently, the central steering committee approved a further 53 reviews, including three carried forward from the previous round, to be undertaken in the years 2003 and 2004. This brought to 105 the total reviews planned for the three years 2002-04.
The position at the end of last month was that 28 of these reviews have been completed, of which 14 were carried over from the earlier period. A further 12 reviews have been quality assessed or are in the quality assessment process and a further 41 are in progress. Of the remaining 24 reviews, ten of the programmes scheduled for review have been or are being otherwise evaluated, nine have yet to start and five are not going ahead.
In summary, the total number of completed reviews under both rounds of reviews is 98, with 70 under the 1997-2001 round and 28 under the 2002-04 round, of which 14 were carried over from the earlier round.
In its recent report to the Minister, the central steering committee noted that, while the number of expenditure reviews to which Departments had committed themselves was reasonable — taking into account evaluations under the national development plan and sectoral studies — there had been slippages in the completion of reviews by comparison with the approved programme. The conclusion in regard to the overall level of review activity was drawn against the background of the Government view taken in 2002, based on experience of operating the expenditure review initiative in the early years, that to attempt to review all programmes was overly ambitious. In arriving at the conclusion, the committee also took account of the fact that 13 national development plan evaluations, including the mid-term evaluation of the national development plan in 2003, and at least 100 sectoral studies or reviews had been undertaken outside the formal expenditure review initiative between 2002 to 2004.
The committee also concluded that some expenditure reviews were postponed and others were not proceeded with for perfectly valid reasons. These included organisational change or delays in the implementation of the programme in question, the review topic being included in another form of evaluation — for example, being part of the national development plan review or a sectoral evaluation review — that another key area has with the passage of time become a more important topic for the conduct of a review or that policy changes in the area in question have meant that the conduct of the review would not be meaningful or useful.
While there were mitigating factors in some instances, such as the transfer of departmental functions, new Government priorities to be implemented, etc., the recent expenditure review report to the Minister found that the evaluative capacity of Departments and offices was variable and there were some deficiencies in Departments and offices in planning, managing and resourcing expenditure reviews. These factors contributed to the slippages in completion of reviews as scheduled. While the training programme will remedy many of these deficiencies, the report to the Minister from the committee made several recommendations designed to further strengthen the arrangements in place in Departments and offices for planning and implementing reviews. It recommended that Departments and offices should properly resource reviews. To ensure that this will happen, the report further recommended that expenditure reviews should be included in statements of strategy and the role profiles of the relevant staff and that the management advisory committee in each Department and office should appoint one of its members to co-ordinate and report on the expenditure review process within the organisation.
In keeping with the whole thrust of the strategic management initiative, Departments are primarily responsible for the development of policy for their sectors and for management of their own expenditures. They are also responsible for carrying out expenditure reviews and implementing any recommendations arising therefrom and implementing change in their areas of responsibility. The Minister for Finance has accepted the findings and recommendations in the central steering committee's report. Upon receipt of the report, he wrote last November to all Ministers urging them to ensure that their Departments and offices take appropriate steps to implement the recommendations.
As chairman of the central steering committee, I have written to Departments and offices urging them to complete outstanding reviews as a matter of urgency and to report progress in this regard and inviting them to propose topics for the next round of expenditure reviews for 2005 to 2007 for submission to Government. I have also asked them to indicate the steps which they have taken to implement the recommendations of the expenditure review report. I also expect that the recommendations in the report to the Minister, which are designed to make Departments more accountable externally in regard to the expenditure review initiative — such as copies of all future reviews being forwarded to the appropriate Oireachtas committees and progress on reviews being included in reports on modernisation for performance verification purposes — will add to the pressure on Departments to make more progress on completing their reviews on time and to a high standard. The decision to bring to the attention of this committee the report to the Minister on the expenditure review initiative and the recommendation that the performance verification group be informed by each Department and office of the reviews in their area should also improve the quality and output of completed reviews.
I remind the joint committee that the expenditure review initiative is just one of several important developments in regard to the Government's continuing drive to secure better value for money and more effective and efficient management of public expenditure and that consideration of progress on the expenditure review must also be seen in this wider context. As I have already indicated, extensive evaluation also takes place outside the expenditure review initiative. Evaluation capacity within the Civil Service is being enhanced through the provision of targeted training and the introduction of professional courses in public policy analysis. In that context, the first masters and higher diploma graduates will be coming on stream this year. Work is progressing on the development of performance indicators with a view to shifting the focus more on the results being achieved by Departments and offices. A pilot project linking business planning to resource allocation in the Estimates and to performance measurement is due to report to the Minister for Finance shortly. The rolling multi-annual capital envelopes introduced in the 2004 budget will significantly improve the management of capital programmes and projects. Revised Department of Finance capital appraisal guidelines for the appraisal and management of public expenditure proposals were recently published.
The joint committee's deliberations will be helpful to the central review committee in continuing the process of improving the expenditure review initiative and in making preparations for the next round of reviews.