ENHANCED LIVELIHOODS IN THE MANDERA ENHANCED LIVELIHOODS IN THE MANDERA TRIANGLETRIANGLE

Learning and monitoring approaches within Learning and monitoring approaches within ELMTELMT

Vanessa Tilstone, Learning, Monitoring and Vanessa Tilstone, Learning, Monitoring and Evaluation AdvisorEvaluation Advisor

ELMT Consortium: 6 ELMT Consortium: 6 INGOs and 20 LNGOsINGOs and 20 LNGOs

CARE Somalia (lead)CARE Somalia (lead) VSF Suisse (Kenya and Somalia)VSF Suisse (Kenya and Somalia)

CARE EthiopiaCARE Ethiopia CARE KenyaCARE Kenya

Save US (Ethiopia)Save US (Ethiopia) Save UK (regional)Save UK (regional)

Goal: Increased self-reliance and resiliency of the population through improved livelihoods in drought prone pastoral areas of the Mandera Triangle

6 intermediate results relating to:

1. Livelihood protection; 2. Livestock health, production and marketing,

3. NRM, 4. Livelihood diversification,

5. Peacebuilding 6. Promoting pastoral voice/policy

Operational areaOperational area

Why evidence of Why evidence of change approach:change approach: Needed a broad framework to Needed a broad framework to

accommodate accommodate different monitoring different monitoring systems and a range of activities;systems and a range of activities;

Needed a way to ‘break down’ broad Needed a way to ‘break down’ broad and ambitious higher level and ambitious higher level objectives objectives into ‘incremental changes’ we could into ‘incremental changes’ we could focus on and monitor;focus on and monitor;

Needed a way to Needed a way to separate out changes separate out changes influenced by ELMTinfluenced by ELMT vis a vis other vis a vis other complementary activities and programs;complementary activities and programs;

Evidence of change Evidence of change monitoring planmonitoring planChange Change indicatorindicator

Monitoring Monitoring tool to be tool to be usedused

How oftenHow often By whomBy whom

Cross cutting Cross cutting issues/prograissues/program principlesm principles

Other changes Other changes observed –ve observed –ve and +veand +ve

E.g. VSF Suisse Somalia: enhanced income E.g. VSF Suisse Somalia: enhanced income sourcessourcesChange indicator Monitoring tool How often Who

Increased knowledge and implementation of meat and milk hygiene practices.

Training evaluation form and follow upWhat they learnt from the trainingUse of what they learnt

After training and 3 months after the training

Trainer and community facilitator

Reduced spoilage of milk and meat

Story of change interview:Average daily volume of meat and milk spoilage compared to previous-Causes of the increase/ Decrease.

3 months and 6 months after the training

Livestock technician

Increased income for selected individuals and groups

Story of change interview:-Average daily income compared to previous-Causes of the increase/ decrease.

3 months and 6 months after the training

Livestock technician

Increased confidence to carry out IGAs and engage with other actors

Change diaries/Story of change Change diaries/Story of change interviews:interviews:

- Are you doing other things in your - Are you doing other things in your business that you didn’t do before the business that you didn’t do before the training? What prompted you to training? What prompted you to make those changes?make those changes?

3 months and 6 months after the training

Livestock technician

Evidence of change Evidence of change reviewreviewChange Change indicatorindicator

Evidence of Evidence of positive positive changechange

Evidence of no Evidence of no /negative /negative changechange

Action pointAction point

Cross cutting Cross cutting issues/prograissues/program principlesm principles

Other changes Other changes observedobserved

E.g. SC/US NegelleE.g. SC/US NegelleIR3: Improved NRM

Encourage elders councils to hold regular rangeland management fora to reassert more mobile (including cross-border livestock production system)

CIs and local government initiate meetings

Increasing community contribution to the meetings e.g. in Wato PA the community gave 1 bull, 3 cows and 5000Birr contribution.

AP: Consider gradual phasing out of SCUS contribution at next NRM sector meeting

Indigenous NRM knowledge informs decision-makers

Government bodies are supporting elders decisions e.g. 2 people from Nura Umba and Adadi PAs were imprisoned for 2 years after they refused to dismantled their illegal private enclosure according to elders

AP: Facilitators to ask AP: Facilitators to ask community and government community and government other ways in which they are other ways in which they are collaborating before next collaborating before next meetingmeeting

Pastoralists move to seasonal grazing lands peacefully

Last meetings reported: 400 private enclosures dismantledbased on the elders decision at meeting; 60,000 animals moved to seasonal grazing areas peacefully from 10 Pas following the hagaya rain;3,000 animals (50 ‘kara’) moved from Algae and Duak to Arero

Large investors and elite are not dismantling enclosures; farm encroachment continuing

AP: PM to interview key informants to verify and ask how much of this was due to elders meetings and decisions;AP: raise diplomatically with government offices.

Other changes Siminto meeting in June reported: Opening of access routes to water, grazing sites and salt and mineral licks e.g. to licks in Beadle, Siminto and Koba

AP: PM to carry out AP: PM to carry out interviews with local people interviews with local people in Beadle, Siminto and Kobain Beadle, Siminto and Koba

Important principles of Important principles of evidence of change evidence of change review:review:1.1. It is It is only a toolonly a tool – so it’s effectiveness depends on how it is – so it’s effectiveness depends on how it is

used!used!2.2. Needs to be analytical, open and honestNeeds to be analytical, open and honest else not worth else not worth

doing;doing;3.3. Should be done with Should be done with field staff and managers;field staff and managers;4.4. Examples need to be specific and verifiable: Examples need to be specific and verifiable: need need

‘evidence‘evidence’’5.5. Should draw on other monitoring tools but also can help Should draw on other monitoring tools but also can help

identify where in depth monitoring needs to take place;identify where in depth monitoring needs to take place;6.6. Participatory monitoring techniquesParticipatory monitoring techniques most appropriate most appropriate

way of understanding whether change happening and to way of understanding whether change happening and to get an understanding of negative influences as well as get an understanding of negative influences as well as unintended consequences; e.g. Most significant change unintended consequences; e.g. Most significant change technique, stories of change;technique, stories of change;

7.7. Indicators should be reviewedIndicators should be reviewed to incorporate improved to incorporate improved understanding and changing context and focusunderstanding and changing context and focus

E.g. of use in reporting:E.g. of use in reporting:

Evidence of positive change: Evidence of positive change: Following CARE Ethiopia’s training of women and customary leaders on early Following CARE Ethiopia’s training of women and customary leaders on early

warning and response, communities were observed to have increased hay warning and response, communities were observed to have increased hay making, diversified livestock species, buying and storing food grains when the making, diversified livestock species, buying and storing food grains when the market is good, and diversification of livelihood assets.market is good, and diversification of livelihood assets.

Following the LINKS training on EW/ER in Borana CIFA is collecting market Following the LINKS training on EW/ER in Borana CIFA is collecting market information more regularly and in a more standardised form. Government information more regularly and in a more standardised form. Government offices are now using to plan interventions e.g. when grain prices increased offices are now using to plan interventions e.g. when grain prices increased DPPC used to lobby to increase the number of safety net beneficiaries.DPPC used to lobby to increase the number of safety net beneficiaries.

In Negelle SC/US staff observed that as a result of supplementary feeding In Negelle SC/US staff observed that as a result of supplementary feeding interventions and mobilisation communities are no longer burning crop interventions and mobilisation communities are no longer burning crop residues but are feeding them to cattle (Mieso) as well as cutting grass (korati) residues but are feeding them to cattle (Mieso) as well as cutting grass (korati) and buying teff stalks (Adeo).and buying teff stalks (Adeo).

Following the Mandera workshop, three concept notes were developed, two of Following the Mandera workshop, three concept notes were developed, two of which were funded (1 for VSF-S and 1 for SADO).which were funded (1 for VSF-S and 1 for SADO).

Evidence of no change: Evidence of no change: The Laisamis contingency plans are still not fully developed with assistance The Laisamis contingency plans are still not fully developed with assistance

from CARE Kenya/CIFA due to lack of capacity and government officials from CARE Kenya/CIFA due to lack of capacity and government officials stationed far from new districts;stationed far from new districts;

Successes:Successes:

1.1. Helped in early stages of the program to get Helped in early stages of the program to get agreement on what teams were trying to do and agreement on what teams were trying to do and communicating with others; e.g. feedback from communicating with others; e.g. feedback from Mandera workshopMandera workshop

2.2. Helped improve implementation Helped improve implementation e.g. agreement e.g. agreement on selection criteria for fodder farmers;on selection criteria for fodder farmers;

3.3. Helped focus monitoring tools: Helped focus monitoring tools: reduced a fodder reduced a fodder monitoring form from 21 to 7 pages!monitoring form from 21 to 7 pages!

4.4. Improved reporting: Improved reporting: evidence of change section evidence of change section of report became the focus of later synthesis of report became the focus of later synthesis documents;documents;

5.5. People found it quite People found it quite intuitive and relativelyintuitive and relatively easy easy to understand – people using in everyday to understand – people using in everyday language;language;

Outcome mapping: Outcome mapping: basisbasis1.1. Development actors as a part of an Development actors as a part of an

interconnected web of relationships and interconnected web of relationships and systems;systems;

2.2. Change is Change is complex, multi-directional, non complex, multi-directional, non linear, non controllablelinear, non controllable;;

3.3. Development actors Development actors influence rather than influence rather than control change;control change; recognizes that there are recognizes that there are multiple influences;multiple influences;

4.4. Behavioural change is keyBehavioural change is key to sustainable to sustainable development;development;

www.outcomemapping.cawww.outcomemapping.ca

Outcome mapping v Outcome mapping v evidence of changeevidence of changeOutcome mapping Evidence of change

Concentrates more on clarifying intent Focus on monitoring and review

Focuses on behavioral change; Open to different manifestations of change including unanticipated, positive and negative/no change (outcome challenges and progress markers can be prescriptive); includes programming principles/cross cutting issues

Sophisticated language: boundary partners, outcome challenges rather than change indicators and identifies ‘expect to see’, ’like to see’ and ‘love to see’ progress markers rather than positive and negative/no change;

Simple and easy to understand and use –more intuitive and minimal jargon

Focuses on personal journals for recording the change rather than a range of monitoring tools;

Different monitoring tools can be drawn on

Analysis and link to implementation built into approach

Challenges:Challenges:

Lack of interest/priorityLack of interest/priority for monitoring/program for monitoring/program qualityquality;;

Activity/output bias in reporting and monitoring;Activity/output bias in reporting and monitoring; Lack of time for reflection and learning Lack of time for reflection and learning

especially between filed and senior staff;especially between filed and senior staff; Getting to the Getting to the evidence:evidence: not unsubstantiated not unsubstantiated

assertions – quotes, case studies, quantitative assertions – quotes, case studies, quantitative information;information;

Lack of L, M and E capacity.Lack of L, M and E capacity. M and E staff M and E staff drawn into program management roles rather drawn into program management roles rather than capacity building and facilitating change than capacity building and facilitating change reviews;reviews;

Recommendations:Recommendations:

Get Get commitment early on the commitment early on the importance of L, M and Eimportance of L, M and E and and promoting program quality: build into promoting program quality: build into plans/budgets/job plans/budgets/job descriptions/appraisals/recruitment descriptions/appraisals/recruitment particularly at the highest levelsparticularly at the highest levels

Build in Build in semi-annual program reviews semi-annual program reviews with managers AND field staffwith managers AND field staff;;

Devoted L, M and E staff – ring fenced;Devoted L, M and E staff – ring fenced;

Other learning Other learning approachesapproaches Technical working groupsTechnical working groups: good mechanism : good mechanism

but generally under-resourced;but generally under-resourced; Sharing good practice and lessons learntSharing good practice and lessons learnt: good : good

practice bibliographies (too late), technical practice bibliographies (too late), technical briefs, (not systematic enough) bi-annual briefs, (not systematic enough) bi-annual newsletter; monthly electronic bulletin;newsletter; monthly electronic bulletin;

WebsiteWebsite for sharing 100+ documents for sharing 100+ documents www.elmt-relpa.org;www.elmt-relpa.org;

Open days and lessons’ bazaarsOpen days and lessons’ bazaars;; PIAs and technical reviewsPIAs and technical reviews – dropped or poorly – dropped or poorly

donedone Review of consortium functioning and in-depth Review of consortium functioning and in-depth

final evaluationfinal evaluation – on website; – on website;

The vicious circle of The vicious circle of development: Chris Roche: development: Chris Roche: Impact AssessmentImpact Assessment

Other lessons from Other lessons from ELMT for CAREELMT for CARE Management of consortium programs:Management of consortium programs: serious serious

deficiencies: no oversight/conflict resolution deficiencies: no oversight/conflict resolution mechanism; lack of attention to relationships mechanism; lack of attention to relationships and process; lack of interest in/mechanisms to and process; lack of interest in/mechanisms to promote program quality; lack of accountability promote program quality; lack of accountability (particularly downward) and transparency;(particularly downward) and transparency;

Cost: Cost: only 21% of $10million went anywhere only 21% of $10million went anywhere near the client group despite being the ground near the client group despite being the ground piece for RELPA – no mechanisms or interest in piece for RELPA – no mechanisms or interest in this downward accountability;this downward accountability;

CARE CARE systems prevented much innovative systems prevented much innovative programmingprogramming: bureaucracy in supporting CBO’s, : bureaucracy in supporting CBO’s, time spent on chasing contracts and payments; time spent on chasing contracts and payments; focus on structures rather than capacity building. focus on structures rather than capacity building.

CARECARE

We can either be We can either be part of this circlepart of this circle or we can or we can challenge it internally and externally and challenge it internally and externally and break break outout;;

Needs more than a change in impact assessment Needs more than a change in impact assessment needs a needs a change in values, views on change in values, views on collaboration; thinking on development; types of collaboration; thinking on development; types of programs we take on, portfolio size; programs we take on, portfolio size; organisational priorities, program and organisational priorities, program and finance/risk balance;finance/risk balance;

P-shift is one way of doing this, but needs far P-shift is one way of doing this, but needs far more resources and prioritisation and the more resources and prioritisation and the commitment of everyone – serious change commitment of everyone – serious change management strategymanagement strategy