Date post: | 05-Jun-2015 |
Category: |
Technology |
Upload: | africa-rising |
View: | 212 times |
Download: | 1 times |
Africa RISING Monitoring and Evaluation activities in West Africa
Justice Ajaari, IFPRI
Africa RISING–CSISA Joint Monitoring and Evaluation Meeting, Addis Ababa, Ethiopia, 11-13 November 2013
oAR-WA ObjectivesoAR-WA ActivitiesoAR Systems & Siteso Expected ResultsoM&E FocusoPerformance IndicatorsoCustomized IndicatorsoData QualityoM&E Reflections
Outline of Presentation
oTransform agricultural systems through sustainable intensification (SI)
oSI:- producing more (agricultural) output from same area of land, while:
• reducing negative environmental impacts
• increasing contributions to natural capital and flow of
environmental services
AR-WA Objectives
Systems & Siteso Cereal-based farming systems - Sudano-Sahelian zone of West Africa (WA -AR)o Crop-livestock systems - Ethiopian highlandso Maize-legume-livestock systems - Eastern & Southern Africa
Activitieso Diagnosis & design of technology combinations o On-farm & on-station trials of new combinations of existing
technologieso Institutional and/or value chain improvements
oSustainable higher productivityoReduced negative environmental impactsoIncreased contributions to natural capital & flow of
environmental servicesoImproved Value chain conduct and performance??oImproved market efficiency??oImproved Agric. Extension Effectiveness??
Expected Results
oMonitoring• Field Visits (Mali & Ghana Field Visits)• USAID Feed the Future Indicators• Customized Indicators
oCapacity Building• Mali Partners M&E Workshop (September, 2013)• Ghana Partners M&E Workshop (November, 2013)• Partner Driven Studies-Qualitative Research
o Evaluation• Baseline Evaluation-Household/ Community Survey
Ghana-November/December, 2013 & Mali-January/February,2014
• Endline Impact Evaluation (2016)
Current M&E Focus
o Number of Hectares under improved technologies or management practices as result of USG assistance
o Number of Farmers and others who have applied new technologies or management practices as a result of USG assistance
o Number of individuals who have received USG Supported short-term agricultural sector or food security training
o Number of food security private enterprises (for profit), producer organizations, water users associations, women’s group, trade and business associations and Community-based organization (CBO) receiving USG assistance.
Performance Indicators-FTF/AR
o Number of Public-Private Partnership Formed as a result of FTF assistance
o Number of members of Producer Organizations and Community based Organizations receiving USG assistance
o Number of private enterprises (for profit), producers organizations, water users associations, women's groups, trade and business associations, and community-based organizations (CBOs) that applied new technologies or management practices as a result of USG assistance
AR-WA FTF Indicators-Cont.
o Number of new technologies or management practices in one of the following phases:
• Phase 1: Number of new technologies or management practices under research as a result of USG assistance
• Phase 2: Number of new technologies or management practices under field testing as a result of USG assistance
• Phase 3 Number of new technologies or management practices made available for transfer as a result of USG assistance
AR-WA FTF Indicators-Cont.
oNumber of Vulnerable Households Benefiting directly form USG
oNumber of individuals who have received USG Supported long-term agricultural sector or food security training
Proposed additional FTF indicators for in House Use
oEarly Warning Indicators:• Rainfall• Fuel• Food Prices• Input Costs
oAgronomic indicators:• Yield • Pest and disease resistance
Customized indicators
What Next?
What should occur in the next two years to
improve M&E
USAID:
• ADS 203.3.5.1: “To be useful in managing for results and credible for reporting, data need to meet quality standards”
• ADS 203.3.5.2: “Purpose of DQA: aware of the extent to which the data integrity can be trusted to influence management decisions”
MCC: • Section 5.4.1- M&E policy: ‘’Good data quality is essential to maintain a high
level of confidence in the decisions that are made using the data’’
World Bank: • Data Quality Assessment Framework (DQAF):..” assessing data quality that
brings together best practices and internationally accepted concepts and definitions”
Data Quality
Implementing Partner Level (Primary Data Source)
Intermediate aggregation level (District, Region)
M&E unit(aggregation at the highest level of a program -PMP)
M&E System
DATA QUALITY Accuracy, Reliability, Completeness,
Precision, Timeliness, Integrity
M&E SYSTEM
• Appropriate data management systems are in place (from lowest to the highest level)
• Data Verification to Verify the accuracy of reported data for key indicators
• M&E Tools
AR-WA Field Data M&E System
Data Quality
1. Accuracy
2. Reliability
3. Completeness
4. Precision
5. Timeliness
6. Integrity
AccuracyData should clearly and adequately represent the intended results.
AR-WA requires that each level of data is aggregated correctly is documented through source data
ReliabilityThe data are measured and collected consistently.
AR-WA requires the use of consistent and standardized data collection tools to collect data
Completeness
Completely inclusive: an information system represents the complete list of eligible names and not a fraction of the list.
AR-WA requires comprehensive beneficiaries’ level information
Precision
The data have sufficient detail.
AR-WA requires that indicators have standardized definitions and are disaggregated by gender, location and other key variables
Timeliness
Data are up-to-date (current), and information is available on time.
AR-WA requires timely reporting
IntegrityThe data are protected from deliberate bias or manipulation for political or personal reasons.
AR-WA requires all datasets to be of the highest integrity and quality
If you do not measure results, you cannot tell success from failure
If you can not see success, you can not reward it If you can not reward success, you are probably rewarding
failure If you can not see success, you can not learn from it If you can not recognize failure, you can not correct it If you can demonstrate results, you can win public
support
M&E Reflections