Measuring the impact of the Programme

Croke Park, Dublin 01/12/2009

1www.nrn.ie

Paul Keating

Rural Development support Unit

Tipperary Institute

Building Alliances in Agriculture and Rural Development Conference

Why measure the Impact?

• It’s a Requirement

• Accountability for Public Funds

• Strengthen and Develop the Programme

Big Picture Challenges at EU level

• Constituency and coherence at EU level

• Scale and Disparity of Data involved

• Analytical complexity in attributing cause and effect

Practical Challenges at Programme Level

• Multiple sources and systems for Data management

• Considerable Effort required in data collection and recording

• Changes to the programme

• Timing!!!

Emerging context

• Mid Term Evaluation 2010

• Emphasis on the demonstration of Value for Public Money– Both Nationally and by the European Court of Auditors

• 2013 is approaching!

Measuring the impact of Axes 3 and Axes 4

Clarity, Consistency and Completeness

Measuring the impact of Axes 3 and Axes 4

Clarity, Consistency and Completeness

www.nrn.ie 8

Indicator Measurement Baseline Target       

Importance of rural areas

per cent population in rural areas

59 per cent 59 %

Farmers with other gainful activity

Sole holders-managers with other gainful activity as

percentage of total number of farm holders (sole holders-

managers)

42 per cent of farmers are part-time

50 %

Employment development of non-agri sector

Employment in secondary and tertiary sectors (2ndry & 3ary)

93 % of those employed are in (2ndry

& 3ary)

96 %

Economic development of non-agri sector

GVA in secondary and tertiary sectors

97.4 per cent GVA 98 %

Self-employment development

Self-employed persons 16.9 % of persons at work, employer or

own account worker

20 %

Overall Indicators for Axes 3

Where are the Indicators?

Document - RecordRDP - Department IT systemsLAG Plan - LAG RecordsProject Proposal - Project Records

Challenges – Institutional

• 36 independent organisations administrating a complex component of a much larger programme

• Recently reconstituted multi-programme LAGs

Challenges – logistical

• Information Management System at LAG level

• Verification (Proof)

• Project Tracking

• Analysis of External Factors

Challenges – Technical

• Do the Indicators demonstrate the value added by the LEADER approach?

• How do you measure the output and impact of animation?

• The system must work for LAGs and the Departments

Develop a Culture of Impact Evaluation

Some conclusions

– The Programme Must be compliant • Common Monitoring and Evaluation Framework.• Regulations• National Guidelines

– Focus on Axes 3 and 4• Measurement/proof is an ever present issue• Impact Evaluation/Value Added will be key terms• Address the measures and the method• New and complementary indicators need to be developed.

– Monitoring External Factors will be Key