M&E PresentationStrengthening the Dairy Value Chain Project
CARE Bangladesh
5th September 2012
Presented By
Toufique AhmedApurba Kumar Datta
PartnershipIFPRI Schulich School of Business Individual Researcher
SDVC M&E System
Project Management(MIS Support)
Project Monitoring• TPF- Monthly• LPF- Monthly• CPF-
Quarterly• GPF- Semi-
Annually• PPT- Semi-
Annually• Case-Study- Need
Base
Inputs, Progress, output and
Outcome Indicators
Data Sources
(For all Indicators)
Project M&E Unit
(Analyzed By)
Outcome and Impact Indicators
Evaluation• Baseline
Survey• Mid-Term
Evaluation• End line
Evaluation
Information
Product
Donor Report(Progress update)
SDVC Information Flow
Technical Coordinator-M&E
Technical Coordinator-M&E
Technical Officer-M&ETechnical Officer-M&EM&E Support OfficerM&E Support Officer
Project OfficersProject Officers
Field FacilitatorsField Facilitators
Project participantsProject participants
CARE-BCARE-B SDVC Staffs & Mgt.
SDVC Staffs & Mgt.
DONORDONORCARE-USACARE-USA Other International AudiencesOther International Audiences
Team level
Field level
Region & National level
International level
GOB/Private sectors/INGOGOB/Private sectors/INGO
Tools Used
Tools Respo. Coverage Freq.
Team Progress Assessment Format (TPF)
Project Participants
Teams’ activity progress and output
Monthly
Livestock Health Workers Progress Assessment (LPF)
Livestock Health Worker (LHW)
Service, Income, expenditure, linkages
Monthly
Collectors’ Progress Assessment (CPF)
Collector Collection, service area, Income
Quarterly
Cont…
Tools UsedTools Respo. Coverage Freq.
Participatory Performance Tracking (PPT)
Producer Group members
Individual practice tracking and groups’ maturity scoring
Semi-annually
Group Members’ Progress Assessment (GPF)
Producer Group members
Production, consumption & sales, Income
Farm mgt. technical Knowledge & Practice
Input Service used Client satisfaction- LHW, collector Women access and control over
resources Unintended success
Semi-annually
Case Study Producer, LHW, Collector, Farmer Leader, others
Success and failure of System , progress.
Need based
Videos, Photos Successful and challenging actors
Success and failure of System , progress.
Need based
How do we support to integrate
6
Collecting information through-·M&E formats, Other formats
·Success case, learning & Challenges (Qualitative Information)
Team level Documenting & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)·Other formats (Price, Training, Etc.)
As per M&E & Other schedule
TASKSTASKS FREQUENCYFREQUENCY
Regional mgt. team documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)·Other formats (Price, Training, Etc.)
Regional all staff level documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)
·Other formats (Price, Training, Etc.)
SDVC Key Mgt. level documentation & Learning·M&E Reports compilation (TPF, LPF, CPF, GPF, CPS, PPT)
·Other formats (Price, Training, Etc.)
Monthly
Quarterly
By-monthly
Six-monthly
[
CARE-Bangladesh
·
UBORA – PQAT
·
30-minutes or other informal way of reflection
Six-monthly
PartnershipIFPRI Schulich School of Business Individual Researcher
SDVC M&E System
Project Management(MIS Support)
Project Monitoring• GPF- Semi-
Annually• TPF- Monthly• LPF- Monthly• CPF-
Quarterly• PPT- Semi-
Annually• Case-Study- Need
Base
Outcome and Impact Indicators
Inputs, Progress, output and
Outcome Indicators
Data Sources
(For all Indicators)
Project M&E Unit
(Analyzed By)
Evaluation• Baseline
Survey• Mid-Term
Evaluation• End line
Evaluation
Information
Product
Donor Report(Progress update)
SDVC M&E Partnership
Partnership help us to learn different new things and bring our learning into working strategy.
Schulich School of Business, York
University
ILRI-IFPRI University of Michigan Business
Georgia Tech University
Analyze SDVC findings and Showcasing the success stories and learning globally through a win-win partnership with SCHULICH PhD scholar and faculty.
Gender Agriculture and Asset project (GAAP). To enhance control over resource and access to resource by women and measuring the contribution factor in achieving the target.
Worked for developing Business plan for Krishi Utsho. 4 MBA student came here and did the rigorous things for SDVC.
Develop and implement EMS system for shop performance reporting
SDVC M&E Partnership
Partnership Model
Gender, Agriculture and Asset Project ( GAAP)
GAAP Focus Area
• How the project is impacting key, tangible asset ownership (livestock, cash) for men and women
• How the project is impacting asset disparities• How the project modalities (for example group mobilization and
farmer education) impact intangible assets• How these impacts combine to sustainably effect household and
community gender norms and women’s empowerment
The Tools We Used to research Tools Purpose Tool type
FGD Explore women’s access to asset ownership, to mkt & credit and project impact on WE
Research and M&E
Life History Analysis Explore project impact and WE process Research and M&E
PPT Group performance assessment (ranking) by members & develop improvement plan
Research and M&E
Group Progress Survey Regular monitoring on milestones including gender Research and M&E
Gender equity format analysis
To aware on gender discrimination and importance of equity
Gender Awareness
24 hr clock analysis To reduce women’s workload Gender Awareness
Asset ownership pattern analysis
To aware on importance of asset ownership and access to income
Gender Awareness
Women barrier Checklist
Follow up on barriers for women in DVC Gender Awareness, research /M&E
Barrier Tree analysis To aware on barrier, its cause, consequences Gender Awareness
Peer review To assess men and women’s perception on their need and document project impact on the change
Gender Awareness, research and M&E
The Major challenges for SDVC Social norms and customs of rural community limits women with some
barriers for that SDVC face challenges to include women in VC
Barriers Affects
Barriers with women’s mobility • Face difficulty to join jobs outside home• Difficulty to purchase input and services , sale milk• To join training, meeting workshop
Lack of recognition of women’s contribution
• Lose of encourage in dairying
Limited access to asset and income management
• Can hardly make any vital decision• Face difficulty in purchasing input and services
Overburdened with Household work
• Can allocate less time for IGA• Can’t take care of child and personal health
Key Findings
Economic interventions have high spillover ratio, empowerment interventions do not – IFPRI MTE
Change at agency level fosters an increase in asset ownership ( 7.4% increase in cattle owner ship)
Cattle keeping can be used to empower women to step into new spaces traditionally closed off by ensuring participation in various parts of the value chain. (GAAP baseline study)
Men’s engagement can be the strategy to ensure women’s participation
• Project theme new, thus needed to set M&E by trial & error method.• Project strategy changed over time.• Large area covered vs. previously M&E staffing strength• Respondents (Collector, LHW) are mostly indirect participants, hesitates in
giving correct data• Various dairy-related registry systems not strong, thus info flow not systematic
and reliable and SDVC needs to invest directly, distracting field staff from implementation
• Collectors are not fully dependent on SDVC participants, so their register don’t reflect full picture
• Collectors and LHWs don’t want to disclose their business secrecy • Group members are not literate and aware enough to keep their records• Institution based M&E-PM&E system introduction• Donor focused more with numbers, thus required more info as per milestones.
Challenges we have experienced
Track market trends and secondary data not only project performance
When in doubt, triangulate
Design data collection tools to make it easy and valuable for participants
Align data collection processes with partner – or target partner – priorities and project needs
Value chain projects evolve and learn over time. The M&E system needs to be flexible and dynamic.
All project staff are the part of the M&E Team.
Use M&E data to guide implementation and project strategy purpose
Learning about M&E for VC projects
SDVC M&E Cost
Cost Area Cost Share (%)
Monitoring 3%
Evaluation 10%
Total 13%
THANKS
SDVC Evaluation System• International Food Policy Research Institute (IFPRI) is our
evaluation partner• They completed Baseline survey and produced report• Double-difference method used to compare the change
between project participants and non participant• Propensity Score Matching (PSM) approach will be used for
constructing the comparison.• For better comparison the study took the following system-
Treatment Group Control-1 Control-2
SDVC Group which was developed on Year 1
Village nearer to SDVC group
Village from another Upazila of the SDVC working district
Tool Description - TPFDescription• Overall activity progress information collected.• First introduced May 2009.• Format revised 2 time.
Outcome• Overall project activity progress
Tool Description - LPFDescription• Used to collect LHWs’ overall progress.• All trained LHW covered.• First introduced January 2009.• Format revised 2 time. Also frequency changed.
Outcome• Service coverage and linkage• Income growth
Tool Description - CPFDescription• Used to track collectors overall progress.• All collector (trained or not) engaged with SDVC
group to purchase milk covered.• First introduced February 2009.• Format revised 2 time. Also frequency changed.
Outcome• Income and milk collection growth
Tool Description - GPFDescription• To Grab Household level overall progress• Questionnaire survey. Mostly quantitative and proxy
qualitative• First introduced March 2009.• Revised 2 time. Frequency- 3 month to 6 month. Content
based on requirement.• Used Multi-Stage Random Sampling. 1st Group, 2nd
member• External people done survey and data entry. SDVC M&E
done analysis and reporting
Outcome• Household dairy income expenditure• Other achievement
Tool Description - PPTDescription• Participatory Performance Tracking (PPT)• Done in semi-annually by group members.
CARE staff only facilitate it.• First introduced on March 2010.• Two major revision done. Frequency And
scoring guideline.
Outcome• Overall practice level of individual producer• Group Maturity score
Cont…
Tool Description – PPT
Cont…
Step- 1
Tool Description - PPT Step- 2
• A Category- 70% & above• B Category- 50% 69%• C Category- 30% - 49%• D Category- 0 - 29%
eMIS-Krishi Utsho M&E
Field Staff
Sales & Clients submitted each week
Routine shop performance monitoring on smart
phones
Shop Owners