DEVELOPMENT EVALUATION DAY 2011

Establishing evaluability during planning and implementation of development cooperation

Ministry for Foreign Affairs

Project Cycle

PROGRAMMING

IDENTIFICATION

FORMULATION

Appraisal

Monitoring

WORK PLANNING

FINANCING DECISION,AGREEMENTS

Evaluation

Mid-termEvaluation

IMPLEMENTATION

Project Cycle Management

Challenge: The project plan is prepared when we know least!The project should become a learning process.

• Principles:– Dividing planning into three phases: Identification – project

formulation – work planning during implementation– Establishment of a monitoring and evaluation system to feed

lessons learned to planning– Flexibility through a clear decision making system that approves

changes to plans when justified– Project document / Logical framework as a basis for work

planning, monitoring and evaluation

Project Logic

WHY and BY WHOMis the project needed?

WHAT IMPROVEMENT / CHANGE will the project cause?

HOW TO VERIFY / MEASUREthe improvement?

HOW will the results be achieved?WHAT to do?

WHAT INPUTS AND RESOURCESare needed?

PROBLEMS OPPORTUNITIESBENEFICIARIES

OVERALL OBJECTIVE & INDICATORS

PROJECT PURPOSE & INDICATORS

RESULTS & INDICATORS

MEANS

ACTIVITIES

LogFrame Matrix

Project description(“Intervention

Logic”)

Indicators Sources of Verification Assumptions

Overall objective Measures the extent to which the contribution to the overall objective has been made

Sources of information and methods used to collect and report it including who and when

Project purpose Helps answer the question “How will we know if the purpose has been achieved?” including quantity, quality, time

Sources of information and methods used to collect and report it including who and when

Assumptions

Results Helps answer the question “How will we know if the results have been delivered?” including quantity, quality, time

Sources of information and methods used to collect and report it including who and when

Assumptions

Activities (may be used to summarise resources/means)

(may be used to summarise the costs)

Assumptions

Project planning provides a sound basis for evaluation when ...

• objectives are clearly defined at different levels – overall objectives, project purpose, results

• objectives describe: what should change? (not: what will be done?)

• indicators and target values are defined for all objectives

• baseline data is available for the indicators (or produced during of project inception through studies)

• a monitoring and reporting system is in place producing systematic information against the objectives / LogFrame

Monitoring vs. evaluation?Dimension Monitoring Evaluation

Timing • Continuous • Periodic

Scope • Use of means/inputs• Implementation of activities• Achievement of objectives• Problem solving

• Achievement of objectives• Relevance of objectives and implementation strategies• Lessons learned

Those involved

• Those who manage and implement the programme

• External, independent persons to provide objectivity

Users of the results

• Programme management and implementers• Evaluators!

• Programme management and implementers• Policy makers

Types of evaluation

PROJECT

TimeSTARTING POINT

DESIRED SITUATION

Mid-Term Review (MTR)

Appraisal(Ex-Ante

Evaluation)

Final Evaluation

Ex-Post / Impact

Evaluation

Result

Result

Result

Project Purpose

Overall

Objective

Evaluation Criteria (OECD/DAC)

OVERALL OBJECTIVES

MEANS

ACTIVITIES

RESULTS

PROJECT PURPOSE

EFFICIENCY

IMPACT

EFFECTIVENESS

SU

ST

AIN

AB

ILIT

Y

RE

LE

VA

NC

E

PROBLEM

Project planning Project implementation

MONITORING CHANGEProg-ress

report

Prog-ress

report

Prog-ress

report

Prog-ress

report

Prog-ress

report

Prog-ress

report

FinalreportFinalreport

EVALUABILITY = sound project planning + systematic monitoring

Overall objectives +Indicators +Baseline

Results + indicators + baselineactivitiesinputs

Project purpose +Indicators +Baseline

Identi-fication report

Identi-fication report

Incep-tion

report

Incep-tion

report

Projectdocu-ment

Projectdocu-ment

INCEPTION

IDENTIFICATION

FORMULATION

Ex-postevalu-ation

Ex-postevalu-ation

Finalevalu-ation

Finalevalu-ation

Mid-term

evalu-ation

Mid-term

evalu-ation

EVALUATION

RELEVANCEIMPACT + otherEFFECTIVENESS appropriateEFFICIENCY criteriaSUSTAINABILITY

Apprai-sal

report

Apprai-sal

report

APPRAISAL