ResultsMonitoring and Reporting

Case Management Annual Review

20 – 22 January, 2015

Outline

Reporting on Results

Challenges and Lessons

Monitoring Results

Performance Indicators

Results

ResultsA Describable or measurable change that is derived from a cause-and-effect relationship

Changes reflected in results at different levels

Inputs Activities Output Outcom

e Impact

Operations/Processes Results

4

Definition

Impact

Outcome

Output

Changes in conditions• More children likely to be living in a protective,

nurturing environment;

Changes in capacity and performance of the primaryduty-bearers

• New protection policy adopted by government• Implementation institutions at national and

sub-national levels created/ strengthened

What all implementers produce• Institutional model developed for implementing

Child protection policy• Key decision makers convinced and committed

Result

Key CharacteristicsCharacteristic Impact Outcome OutputType of Change Changes in the lives

of people: realization of their rights

Institutional Change: values, laws – associated with institutional/ Duty Bearer performance, new institutionsBehavioural change: new attitudes, practices

Operational Change: products and services, knowledge, skills resulting from completion of activities of development interventions.

Time in Change Long Term e.g. End of Program Cycle

Mid-Term appx 1-4 years i.e. end of project year, mid-project, end of project

Immediate Result i.e. instant product of activity

Accountability Collective + external influences at a higher level (economic,socio-cultural,institutional,environmental,Technological etc.)

Collective: various stakeholders, UN, government and partners outside the UNDAF + external influences

Individual agencies

Familiar Examples MDG/SDG GoalsMGDS II Goals

Project Key Results/Objectives

Project/AWP Results

What should I consider when formulating a

result?Specific

Measurable

Achievable

Relevant

Time bound

A good result should be…

Result Specific(nature of the change, the target group, the

target region

Measurable(using indicators)

Achievable(realistic)

Relevant(answer to the identified

problem)

Time Bound(within

programme cycle)

By 2020, Eliminate all forms of violence against all women and girls in the public and private spheres, including trafficking and sexual and other types of exploitation (SDGs Goal 5.2)

YES/NO? YES/NO? YES/NO? YES/NO? YES/NO?

By 2018, 50% of households with vulnerable children in the 10 target district are supported with child protection case management services.

YES/NO? YES/NO? YES/NO? YES/NO? YES/NO?

By 2015, A national framework of operation for Case Management is developed

YES/NO? YES/NO? YES/NO? YES/NO? YES/NO?

Let us do a SMART Analysis of the results

below

Performance Indicators

Quantitative or Qualitative variables that allow stakeholders to verify changes produced by a development intervention relative planned Results

Types of Indicators speak to Types of Results i.e:Impact Result -> Impact IndicatorOutcome Result -> Outcome IndicatorOutput Result -> Output Indicator

So how does a good indicator look

like?

Indicators are supposed to be

SMART, neutral and have associated

baselines and targets

Good Indicator ?

Examples of good performance indicators• # of case managers provided with bicycles in the 10 target districts

• # of vulnerable children supported through child protection case management services in the 10 target districts

• % of case management cases closed within 3 months of registration.

Common Mistakes when formulating performance indicators

• 500 case managers provided with bicycles (‘500’ makes it a result)

• Increased # of vulnerable children supported through child protection case management services in the 10 target districts (‘Increased’ eliminates the neutrality)

• # of children and women victims of violence or abuse that are supported by Community Victim Support Units in the 10 districts

(‘children’ is 1 indicator and ‘women’ is another)

Confused about phrasing indicators and

results? Results use verbs such as:• Enhanced• Improved• Reduced• Increased• Available• (Bill) passed

Indicators are represented by:• A number• Percentage• Ratio • Perception (Qualitative)• Opinion (Qualitative)• Judgements (Qualitative)

Monitoring Results

Monitoring Results• This involves regular and systematic assessment based on

participation, reflection, feedback, data collection, analysis of actual performance (using indicators) and regular reporting

• Helps programmes understand were they stand in relationship to results planned, to track progress (on the basis of intended results and agreed indicators)

• Also helps identify issues and analyze relevant information and reports that become available as implementation occurs.

Key Points:• We monitor based on intended results• We use agreed performance indicators to measure

progress• Must be regularly done throughout programme life cyce

and information used to inform interventions

Common Tools Used for Monitoring Results

• Results Tracking matrices

• M&E plans

• Monitoring Reports

• Evaluations (for Impact indicators)

Results Tracking Matrix

Result Indicator Baseline Target Status Means of Verification/Data Source

Comments

Outcome

Output

Activity

Monitoring Reports• Monitoring visits/missions/activities are a ‘Means of

Verification’

• A monitoring report should specify the objective (intended result) of the exercise

• It should incorporate verification of certain project results of interest

• It should clearly explain the methodology, participants (with numbers), findings (on results), explanation of findings, challenges and suggestions in ensuring the project achieves the intended results are achieved

MONITORING MISSIONS ARE NOT

FOR SITE SEEING!!

Reporting on ResultsDuring this quarter

alone, we were able to train 60 child protection

workers in case management

What was the result of these

trainings?

What were the targets?

How many trainings? How many men and

women? From which districts?

Reporting on Results• This means providing a clear and precise update on the

project/programme’s progress towards achieving the intended results.

• Progress on results is assessed using the agreed performance indicators as well as additional information (usually in the narrative) explaining the current status

• Reporting on results means sidelining ‘activity and processes language’

• A results based report should tell the reader how close the project/programme is to achieving its results.

Important

Where possible, always ensure that performance indicators are disaggregated according to age (child/adult) and sex

(male/female)

Result Activity Reporting Results Reporting

500 child protection workers are provided with bicycles in the 10 target districts

The project procured and distributed 300 bicycles to 300 child protection workers in 6 districts

Through the project, 300 child protection workers from 6 districts were provided with bicycles. This resulted in an increase in the average # of households visited per month.

500 child protection workers are trained in case management

The district conducted 1 case management training for 25 child protection workers.

25 child protection workers (10M, 15F) were trained in case management. Monitoring visits showed a significant improvement in the quality of case plans developed.

By 2015, A national framework of operation for Case Management is developed

A national stakeholder meeting was conducted in order to draft a framework of operation for case management

Through a national stakeholder meeting, a draft framework of operation for case management was developed.

Activity vs Results Reporting

ANNEX 4 of Programme Cooperation Agreement with (name of partner) Template for Programmatic Reporting Reporting Partner: […] Country: […] STANDARD PROGRESS REPORT No. and title: […] Reporting period: […] I. PURPOSE This section is a résumé of the Programme Document as approved in the Programme Cooperation Agreement (PCA). It includes: Main expected results as per the approved Country Programme Document and Country

Programme Action Plan (CPAP) or United Nations Development Assistance Framework Action Plan (UNDAF-AP).

Reference to how the programme relates to the UNDAF and how it aims to support national development goals including the Millennium Development Goals and PRSP goals as pertinent.

II. RESOURCES This section includes total approved budget and summary of resources available to the programme. III. RESULTS Information in this section includes: An assessment of the extent to which the programme is progressing in relation to the

expected results for the year. Main activities undertaken and achievements. Implementation constraints, lessons learned from addressing these and knowledge gained

from evaluations and studies that have taken place in the course of the year. Key partnerships and inter-agency collaboration: impact on results. Other highlights and cross cutting issues pertinent to the results being reported on.

IV. FUTURE WORK PLAN Information in this section includes: Priority actions planned for the following year to overcome constraints, build on

achievements and partnerships, and use the lessons learned during the previous year. Indication of any major adjustments in the strategies, targets or key outcomes and outputs

planned in the country programme. Estimated Budget required (including any major funding shortfalls).

V. FINANCIAL IMPLEMENTATION This section is a provisional report on the financial implementation status. This section should also include total approved budget over the full programme component period, current year budget and expenditures (provisional) for the year.

Report Template used by UNICEF Partners

Results reporting matrix used by UNICEF Partners

Programme Outputs*

Performance indicator*

Targets*Achievement in reporting period**

Cumulative progress to date**

Overall Status (select) Narrative assessment/ summary of progress**

Output 3.1.1 Key national actors have the technical capacity and evidence to develop and implement appropriate regulatory and accountability frameworks fro quality and equitable child protection by 2016

On track /

Constrained/

No progress/ Met

Output 3.1.2. A child protection model established in 3 districts and documented to inform a child protection system by 2016

Output 3.1.3. Communities in selected districts have enhanced knowledge and understanding of how to recognise and eliminate practices and behaviours harmful to children, and how to access child protection services by 2016

Progr. Output 3

Challenges / bottlenecks faced in the reporting period

Proposed way forward

Challenges/Lessons

Identifying lessons learned through our M&E efforts helps us to uncover programming practices or operational approaches that we want to promote, avoid, or share with others

TIPS• Lessons learnt should consist of a generalized principle

that can be applied in other situations.

• Do not write the lesson only as an observation, description or a recommendation that lacks justification. Justify the lesson with proof of why it is valid.

• Explain the lesson in the context of the project. For it to be useful to others, they need to understand the situation in which it occurred to know if might be appropriate or useful for them.

Lessons

Challenges

• By identifying and documenting challenges, a programme is more likely to overcome them.

• Challenges commonly pose as opportunities for learning• In RBM, challenges should be obstacles that affect the

programme in achieving its intended results. • It is always good practice to accompany a challenge with a

practical suggestion on how it can be overcome.• A programme that documents the same challenges demonstrates

poor ability to learn.

Thank you for Listening

Any questions or remarks?