+ All Categories
Home > Education > Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

Date post: 22-Jan-2015
Category:
Upload: ceci1982lia
View: 105 times
Download: 5 times
Share this document with a friend
Description:
Guidelines for M&E (quantitative) for SCAMPIS project. Additional info: www.scampisblog.blogspot.com www.ifad.org/water/english/scampis Or write to: [email protected]
16
SCAMPIS M&E Guidelines 1 SCAMPIS M&E Guidelines Section A. ........................................................................................................................................................... 2 Why the M&E? ................................................................................................................................................ 2 Section B. ........................................................................................................................................................... 3 Overview of the SCAMPIS M&E structure ...................................................................................................... 3 Section C. ........................................................................................................................................................... 4 M&E Practical Guidelines ................................................................................................................................ 4 1. General Information..................................................................................................................................... 4 2. Outputs ........................................................................................................................................................ 5 3. Outcomes .................................................................................................................................................... 9 4. Impacts ..................................................................................................................................................... 13 Section D. ......................................................................................................................................................... 14 FAQ & Suggestions ....................................................................................................................................... 14 Acronyms MIS micro-irrigation system Sqmt square metres # number INR Indian national coin Rupies (for Madagascar you will refer to Ar. -Ariary and Guatemala Qtz - Quetzales) M&E monitoring and evaluation NA not applicable AWPB annual working plan and budget M male F female DRAFT VERSION December 2010
Transcript
Page 1: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 1

SCAMPIS M&E Guidelines

Section A . ........................................................................................................................................................... 2

Why the M&E? ................................................................................................................................................ 2 Section B . ........................................................................................................................................................... 3

Overview of the SCAMPIS M&E structure ...................................................................................................... 3 Section C . ........................................................................................................................................................... 4

M&E Practical Guidelines................................................................................................................................ 4 1. General Information..................................................................................................................................... 4 2. Outputs ........................................................................................................................................................ 5 3. Outcomes .................................................................................................................................................... 9 4. Impacts..................................................................................................................................................... 13

Section D . ......................................................................................................................................................... 14 FAQ & Suggestions....................................................................................................................................... 14

Acronyms MIS micro-irrigation system Sqmt square metres # number INR Indian national coin Rupies (for Madagascar you will refer to Ar. -Ariary and Guatemala Qtz - Quetzales) M&E monitoring and evaluation NA not applicable AWPB annual working plan and budget M male F female

DRAFT VERSION December 2010

Page 2: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 2

Section A.

Why the M&E?

A functional M&E system will provide information on the status of project implementation and the data needed to prepare progress report (see SCAMPIS Progress Report Guidelines). This tool is indispensable to improve the project implementation as well as understanding it sustainability. The principal characteristics of the SCAMPIS M&E system are: 1) verifiable information acquired through a participative methodology; 2) flexibility and the customization and 3) various levels of analysis.

1. Participatory methodology and concrete indicator s

The M&E format provides a number of indicators identified through a participatory methodology. IFAD organized 3 missions to set up a shared and harmonized SCAMPIS M&E system among the 3 targeted countries. An initial mission was undertaken in June 2010. With the SCAMPIS India team a preliminary version of M&E consolidated through the experience on the field was discussed and prepared. A modification of the proposed set of indicators took place during the second mission to Madagascar (August 2010) with help from the SCAMPIS Madagascar team. Final modifications have been made during the mission to Guatemala (October/November 2010). In December 2010 a final discussion with the SCAMPIS project coordinator was undertaken to share the various changes (question and answers shared in the paragraph “FAQ & Suggestions”) and finally the M&E format that had been harmonized and agreed upon by all intervention partners.

2. Flexibility & Customization

The indicators identified relate directly to the activities to be undertaken. If a certain activity has not been undertaken, the related indicator information will simple be filled in as NA (not applicable). For example: - SCAMPIS Guatemala is not implementing 20 sqmt MIS or pumps, so all the information related to this indicators will have a “NA” under the voice “achieved”. - Madagascar and India are not developing (at least up to now) activities directly related to nutrition, so “Nutrition” outputs in section 8 will be filled in as NA until the activities are developed. If there is a need to provide more information, who is filling the document can add rows in the most appropriate section. When row are added, the changes made will be highlighted marking the new indicators and their related unit of measurement (in yellow).

3. Various level of measurement Each level of the M&E analysis follows different means of measurement as described below.

� General Information: based on national statistics that provide an overview of certain characteristics of an area where the project is being developed.

� Outputs: quantitative information based on simple indicators related to project implementation. Data are collected each year and are presented in relationship to yearly goal as well as the global project goals.

� Outcomes: are based on composite indicators thematically grouped. Information will be collected though the analysis of constantly monitored a representative sample. The information will indicate

Page 3: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 3

impact of MIS technologies on households, by comparing “before MIS introduction” data and “after MIS introduction” data.

� Impacts: will provide descriptive information on probable more long-term impacts resulting from the project. The information related to each impact will come from the previous 2 level of analysis plus the report content in the yearly progress report.

The following approach will display in an accessible fashion both the quantitative aspects of the project implementation (Outputs) and the qualitative changes (Outcomes and Impacts) that the SCAMPIS project is creating within the targeted beneficiaries (the sample group used for the OUTCOME excel sheet). Combing various data types (quantitative and qualitative) will help define the most likely long-term project impacts.

Section B.

Overview of the SCAMPIS M&E structure The M&E will display synthetic information which is more extensively detailed in the Progress Report (sections 3. “Detailed implementation by component” and 4. “Performance assessment”) The main goals of the SCAMPIS M&E are to:

- perform a systematic collection of information from the 3 project countries - present a clear view of the differences of the 3 SCAMPIS projects in Guatemala, India

and Madagascar - facilitate the comprehension and definition of each country SCAMPIS model

Annual Progress Reports will directly refer to M&E data to analyse the various component and activities in the project implementation. In this way the M&E data will be contextualized and… Through the M&E data and the contextualized description of that data presented in the progress report, it will be possible to set up the 3 different SCMAPIS models that show how the MISs 1) have been introduced in the 3 countries, 2) the problem faced and 3) the achievements. Data will also facilitate an end-of-project pre-view that will access impact and sustainability of the intervention.

Caring out activities and AWPB

Delivering SCAMPIS OUTPUTS to meet the

annual targets

Achieving the SCAMPIS purposes: OUTCOMES

Contributing to an overall goal: SCAMPIS IMPACTS

Quantitative analysis through simple indicators.

Qualitative analysis through composite

indicators

Evidences for possible

future impacts

SC

AM

PIS

M&

E

Page 4: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 4

Section C.

M&E Practical Guidelines

1. General Information Use national data sources that refer to the project intervention zone. Add Information: If you need to add any information please add the indicators and the related measurement unit at the end of the sheet and highlight the new indicators, measurement units and explanation (in yellow).

Indicators Unit Explanation

Population of intervention area # Number of RURAL population that lives in the project area.

Use national statistics. Project surface # Sum of the surface of the municipalities were SCAMPIS works

Days with adequate water/year # Use the national statistics Days dry/year # Number of days of the dry season

Family # Average of people in a family Seasons months

List the seasons (adding rows) and for each season list in which months it runs (e.g. Summer June-July-August)

Product cultivated List List the various products usually cultivated in the project areas

without micro-irrigation systems Technologies prices INR

Pump INR MIS x 20sqmt INR MIS x 50sqmt INR MIS x 100sqmt INR

Others information (add rows)

Real market cost of the SCAMPIS technology (without subsidies)

List the documents from which comes the data for "O utputs"

Page 5: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 5

2. Outputs The Outputs Sheet provides yearly information as well as identified yearly goal (from the AWPB) and overall project goals. The achieved goal is the sum of what have been concretely achieved year by year. Lack of information: if an activity is not being developed, please insert NA (not applicable). Add Information: If you need to add any information please add in the form of indicators and related measurement unit at the end of the most appropriate section and highlight these new indicators. In this section only simple (to measure) and quantitative indicator should be introduced. Annual Report: In the annual report is highly recommended to use the data provided in the M&E document providing a contextualization and an explanation of them. The annual report should inform on the progress implemented in the last year using the M&E data in a descriptive manner.

Meaning Indicator Unit Explanation

Households that adopt SCAMPIS technology #

Total number of families that are using the SCAMPIS technologies (MIS 20 sqmt+ MIS

50Ssqmt + Pump) Villages # Number of villages involved in the project Blocks/districts # Number of districts involved in the project Municipalities # Number of municipalities involved in the project

1. Beneficiaries

Regions # Number of regions involved in the project

Others information (add rows)

Demonstration plots #

Number of plots where the technology has been installed for

free (to demonstrate) Replication plots using technologies free of cost for beneficiaries #

Number of plots where the technology has been installed for

free (Replicate)

Plots with MIS system bought with subsidies #

Number of plots where the farmer has bought the technology with the

subsidies

Plots with MIS system bought without subsidies #

Number of plots where the farmer has bought the technology without

subsidies Householders adopting MIS (20 sqmt) #

Number of families that are using MIS technology

2. Micro-irrigation

technology adoption:

20/50/100 m2 + pumps

Women owner/responsible for the MIS T

hese

indi

cato

rs a

re th

e sa

me

for

each

type

of

tech

nolo

gy. F

ill in

form

atio

n re

late

d to

the

spec

ific

tech

nolo

gy

Number of women responsible for the technology (primary users of

MIS and those that purchased the system)

IF YOU HAVE A DIVERSIFICATED SYSTEM OF SUBSIDIES AD D SPECIFIC INFORMATION RELATED TO THE NUMBER OF Householders that used the subsidy A, subsidy B, subsidy C

Plots using pump and MISx20sqmt in combination #

Number of 20 sqmt plots where MIS technology is used in combination with Pump

Plots using pump and MISx50sqmt in combination #

Number of 50 sqmt plots where MIS technology is used in combination with Pump

6. Adoption of technologies in combination

Plots using pump and MISx100sqmt in combination #

Number of 100 sqmt plots where MIS technology is used in combination with Pump

Natural liquid fertilizer # Number of plots where “home made” NLF is

Page 6: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 6

prepared and used

Natural solid fertilizer # Number of plots where “home made” NSF is

prepared and used

7. Natural fertilization production

Use of natural pesticide #

Number of plots where “home made” natural pesticide is prepared and used

Others information (add rows)

Food cooked with vegetables cultivated with MIS #

Number of different recipes taught to cook food with the vegetables cultivated with MIS

(PROGRES REPORT: provide more detailed info) Food prepared for long-term conservation # Number of recipes taught to conserve food Families that use clean water to cook their food # Number of family that use clean water to cook

8. Nutrition Others information (add rows)

PUMP: Local manufacturers # Number of local pump manufacturers

PUMP: produced #

Number of pump produced to date (add a comment in the cell that shows the period taken in

consideration “from-to”)

PUMP: Working days/year/worker #

Number of working days spent by each manufacturer to manufacture the pumps (is an average: total working days in the time frame

considered, divided by all the pump manufacturers involved)

PUMP: total earned INR Total amount earned (multiply the amount earned each pump for the total No. of pumps produced)

MIS: Local manufacturers # Number of local manufacturers of MIS MIS: produced # Number of MISs (for SCAMPIS) produced

MIS: Working days/year #

Number of working days spent by each manufacturer to manufacture the pumps (as an average: total working days in the time frame considered, divided by all the manufacturers

involved)

9. Technologies manufactory

MIS: total earned €

Total amount earned (multiply the amount earned for each MIS by the total No. of MISs produced)

Others information (add rows)

National suppliers for SCAMPIS # Number of national MIS suppliers

SCAMPIS Products imported # Numbers of products imported (add a row for each parte imported and provide related info)

SCAMPIS Products produced locally #

Number of MIS products produced locally (add row and insert info for each product e.g. micro-

tube � number of pieces produced locally)

Promoters M # Numbers of male promoters (not paid by

SCAMPIS) of SCAMPIS technologies

Promoters F # Numbers of female promoters (not paid by

SCAMPIS) of SCAMPIS technologies Days of promotion/year/promoters #

Number of days of promotion per year for each promoter

Distributors (Men responsibilities) #

Number of distributors (primarily male involvement)

Distributors (Women responsibilities) #

Number of distributors (primarily female involvement)

10.

Distribution Chain

Technologies sold by distributors

# Number of technologies sold with subsidies (if you have various level of distributors add row to

Page 7: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 7

specify the number of technologies sold by each level of subsidy)

Days of promotion/year/distributors #

Number of days of promotion per year by each distributor

Total earnings by distributors though SCAMPIS technologies INR

Total earnings by all the distributors in the analysed period selling SCAMPIS technologies

Others information (add rows)

Subsidies used # Number of subsidies used in the period

considered

Discount percentage %

How much is the discount percentage (if various level of discount add rows specifying the related percentage and the number of subsidies for each

discount percentage) Total amount of subsidies utilized INR Total amount of the subsidies Subsidies for women # Number of subsidies given to women

11. Subsidies Subsidies for men # Number of subsidies given to men

Others information (add rows)

Trainings for technicians to install/use MIS # Number technicians trainings for MIS installation Technicians participating # Number of people that participated in trainings

% women participating % Percentage of women of the total number of

participating individuals Trainings for users to install/use MIS #

Number of trainings for farmers to use the technologies

Users participating # Number of farmers that participated in trainings

12. Capacity building:

trainings for MIS

% women participating %

Percentage of women farmers of the total number of participating individuals in trainings

Others information (add rows)

Trainings for natural liquid fertilizer #

Number of trainings to prepare natural liquid fertilizer

Trainings for natural solid fertilizer # Number of trainings to prepare solid fertilizer Total participating # Number of people participating % women participating % Percentage of women participating Trainings for natural pesticide # Number of trainings to prepare natural pesticide Total participating # Number of people participating

13. Capacity building:

trainings for natural

fertilizers and natural

pesticides % women participating % Percentage of women participating

Others information (add rows)

Trainings for nutrition aspects # Number of trainings for nutrition Trainings to elaborate foodstuff # Number of training to cook produced food Trainings for hygiene # Number of trainings for improve hygiene Total participating # Total people participating % women participating % Percentage of women participating

14. Capacity building

trainings for Nutrition

Others trainings

Insert row to add other kind of trainings, specify participation and woman %

Others information (add rows)

Page 8: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 8

Promotion events # Number events to promote SCAMPIS technology

Total participating #

Total people participating (specify for each event how many participation and % of women adding

rows) % women participating % Percentage of women participating

Info material # Total quantity of material distributed (specify

quantity for each kind of material) Mass media promotion (radio, TV, internet) #

Number of promo activities though mass media (list the various type of promo activities)

OTHERS Add rows to add more info related to this section

15. Promotion

activities for SCAMPIS

Total cost of promotional activities INR

Total expenditures for SCAMPIS promotion (from the budget)

Others information (add rows)

Kind of material with title info List documentations produced and provide very

short description (in the cell of related data) 16.

Researches, studies, technical material

Total cost for research, technologies material, studies INR

Total expenditures for this section (from the budget)

Others information (add rows)

Final price at the market for each technology INR

Price at the market for each technology (adding rows) without subsidies

Institutions involved with SCAMPIS #

Number of institutions, programmes, associations that are involved and supporting SCAMPIS (Specify in the report)

Activities developed and undertaken by involved institutions #

Number of activities developed and undertaken by each organization (in the report specify which are and when were developed)

17. Sustainability and scalig up of SCAMPIS

project

SCAMPIS activities developed in schools # Activities developed in the Schools

Others information (add rows)

E.g. conferences, congress, workshops. # Add information you think appropriate

18. Others

List the documents from which comes the data for "O utputs"

Page 9: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 9

3. Outcomes This sheet analyses the changes measured after the introduction of the MIS systems. For this reason the collected information will be categorized as “before MIS system introduction ” and “after MIS system introduction ”. The data will be collected monitoring a sample of beneficiaries through the local SCAMPIS technicians. Lack of information: if you have not been able to collect the related information, please simply add NA (not applicable) in the related result cell. Annual Report: consider that it is highly recommended to use the M&E data in the progress report providing explanation and context description. It is also required to explain how the analysis has been undertaken. Add Information: If you need to add information please add the indicators and the related measurement unit at the end of the most appropriate section and highlight the new indicators. In this section are utilized composite indicators that give qualitative information through the monitoring of a sample.

� How to set up the sample: The analysis will be conducted through a °nonprobability sampling° meaning that the information:

• does not have a strict scientific basis and cannot be generalized to all the beneficiaries of the project;

• Facilitate a better understanding of the meaning of changes observed (if any) and the dynamics put in place by the SCAMPIS project related to productivity, water saving, food security, market chain etc.. dynamics

The reason for choosing this methodology is because it is:

1. Extremely flexible but also fixed to a minimum of info required; 2. Compensate (partially) the lack of baseline study, analyzing 2 samples one that use MIS and the

other one not using MIS 3. Economical (both financially and concerning time investment); 4. Easy and quick to implement (this M&E system is being introduced after the project was launched); 5. Applied composite indicators build off of already existing indicators used by in-field partners to

understand (as internal M&E) the dynamics originated by their project.

The sample for the OUTCOMES analysis will be structured as follows:

� 10% of the villages involved in the project (of the total number of the villages involved at the reporting date) must be analysed. As the number of the villages involved grows, as will the number of the villages to be included in the OUTCOMES analysis.

� For each villages 2 randomly selected families for each technology (MIS and NLF) used will

be included in the sample

� The villages and families will be selected via RANDOMIZATION (casual extraction of the name of the villages and families monitored) and REPRESENTATIVITY (all the areas of the project should be covered and the different kind of social groups must be represented).

� The list of the name and characteristics of the people that are part of the outcomes analysis has

to be provided.

Page 10: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 10

Example The project at the reporting date covers 150 villages in xx region of yy country. The sample will be composed as follows: • 15 villages equally distributed throughout the project area • For each village two MIS owner/operators (could be a single family or a group of

individuals) for each technology (20 sqmt; 50 sqmt; Surface treadle pump) • The sample would then include 90 households The following year the number of villages and subsequent MIS owner/operators that comprise the sample populations would increase according to the growth of the initiative; for example, if the number of villages in the initiative grows from 150 to 300, 15 more villages will be included in the analysed sample. � 3 villages (2 MIS owner/operators for each technology disseminated)

Productive cycle: is the amount of time from sowing to harvesting of an agricultural product Products: choose at most 4 different products (the most commonly cultivated) on which to perform the analysis. Provide information separated for each type of product (by adding rows). For example:

Kg products/family/productive cycle/20sqmt

Kg of eggplants/ family/productive cycle/20sqmt

Kg of lettuce/ family/productive cycle/20sqmt

Kg of zucchini/ family/productive cycle/20sqmt

1. Food

production for plots

Quantity of products produced

using MIS

Kg of carrots/ family/productive cycle/20sqmt

Page 11: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 11

Meaning Indicators Unit Explanations

New products cultivated

Numbers of new ag. products introduced using MIS

If any special products have been introduced (for food security) that could

not be cultivated previously

INR from selling/productive cycle/20sqmt

Amount earned for the establish size of plot selling the products at the market (if

any) for all 1 productive cycle

INR for consume/productive cycle/20sqmt

Kg of product consumed by the family from the 20 sqmt plot/ economic value of

that product at the market/during one productive cycle � this indicator

represent how much a family don’t have to spend at the market to buy the vegetables for self consume (income saving and food

security) the amount INR from selling/productive

cycle/50sqmt See above but referring to 50 sqmt

INR for consume/productive cycle/50ssqmt

See above

INR from selling/productive cycle/100sqmt See above

Increase of the production

value

INR for consume/productive cycle/100sqmt

See above

New foodstuff consumed

foodstuff for family/productive cycle

Amount of food cooked (list how much (units?) for each foodstuff) in a productive

cycle

Kg products/family/productive cycle/20sqmt

Kg produced in a productive cycle for each family in the plot (add rows to focus

on at least 4 different products) Kg products/family/productive

cycle/50sqmt See above

Quantity of products

produced using MIS

Kg products/family/productive cycle/100sqmt

See above

1. Food

production for plots

Longer food availability

weeks/year Number of weeks where the families

perceive a difference in food availability

Add other info related to this section adding new rows

INR earned selling products/family/20m2

Total earnings per family selling the products cultivated with MIS at the market

by related plot size

Corresponding INR for products

consumed/family/20m2

Equivalent in local currency of the quantity of vegetable consumed for the

subsistence for each family (if a family would buy at the market how much it

would have spent?) INR earned selling

products/family/50m2 See above

Corresponding INR for products

consumed/family/50m2 See above

INR earned selling products/family/100m2

See above

2. Increase of

family budget

Increase of

income using MIS

Corresponding INR for products

See above

Page 12: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 12

consumed/family/100m2

Add other info related to this section adding new rows

Lt of water consumed/20sqmt/season

Lt of water consumed/50sqmt/season

Use of water

Lt of water consumed/100sqmt/quarterly

Total litres of water consumed to irrigate the plot (20/50/100 sqmt) during each

productive cycle. Refer to the same crop cultivation and specify in the notes which crops you are referring to. If there is big

differences between the various productive cycle, add rows adding the

various info specific for each productive cycle.

3. Water

consume for irrigation

Add other info related to this section adding new rows

Hours of work per person/20

sqmt plot/season Hours of work per person/50

sqmt plot/quarterly Use of working

time Hours of work per person/100

sqmt plot/quarterly

Numbers of hours per person spent in the plot each season (preparation of land, seeding, weeding and irrigating).Divide the total time spent on the plot for the numbers of people involved. Provide

information for each season (when is used the technology) adding rows.

4. Time

Add other info related to this section adding new rows

Natural pesticide use

Week/productive cycle/plot Number of time that the natural pesticide

have been used per week for each productive cycle

Expenditures for chemical

pesticide Rupies/productive cycle/plot

Equivalent in Rupies of the amount people would spend if instead of using natural home-made pesticide would have been

using the chemical one

5.

Diseases control

Add other info related to this section adding new rows

Manufacturer sales

Minimum quantity required/manufacturer/year

Minimum quantity of pieces that a manufacturer needs to produce to

maintain the production at same price

Suppliers selling

Minimum quantity required/supplier/year

Minimum quantity of pieces that a supplier needs to distribute to maintain the

distribution at same price

Distributors selling

Minimum quantity required/distributor/year

Minimum quantity of pieces that a distributor needs to sell to maintain the

product in the shop at same price

6. Minimum quantity

technologies for the supply market

Add other info related to this section adding new rows

List the documents from which comes the data for "O utputs"

Page 13: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 13

4. Impacts PROJECT Impacts Project impacts cannot be expected and therefore measured before a reasonable period has passed since project interventions outputs have been realized. The project will start analysing whether outputs that are being produced are actually leading to changes and benefits (environmental, economical and/or social) among the target group. At the early stages of the intervention any major conclusions that go beyond delivery those associated with tangible outputs would be unwarranted. However, this type of information does provide “pointers” for effects that project interventions appear to create and in turn can help inform and direct project strategy during annual planning. During the analysis period the use of case studies, focus group discussions and mini-surveys would yield the type of information that is needed in the progress report and in general to explain the data provided. Progress report: Case studies are a good tool for qualitative analysis, and the possibility of systematically using case studies to collect impact-related data should be strongly considered. Providing such case studies in boxes in annual reports, possibly accompanied by “before” and “after” photographs, may be an effective way of conveying messages. When: By the third year at the latest, a more formal quantitative impact assessment using baseline study results should be conducted, ideally in preparation for a Mid-Term Review so that the findings can be used in refocusing the project.

Indicators COMMENTS

Diet improving Increase of vegetable production Family income increase Change in the use of resources (Water, Soil, Time) MIS technologies market chain development Women increased participation and involvement in productive activities SCAMPIS project sustainability

This section will provide descriptive comments related to the key indicator based on the data

pointed out in OUTPUTS and OUTCOMES sheets

Page 14: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 14

Section D.

FAQ & Suggestions Following your questions and the related answers grouped by topic.

� Technologies Question: MIS -50 sq mt Kit (OUTPUTS SHEET) - Is it a part of the project in other countries? Because we at India do not using this even do nth v the same. Answer: Yes it is used in Madagascar and in Guatemala – IDEI as doesn’t use 50sqmt MIS, so you will write in the related cell NA (not applicable) SCAMPIS technologies costs meaning (GENERAL INFORMA TION SHEET): here we refer to the cost of the SCAMPIS technology at the market (not considering subsidies). You propose to add more specific information at this step (General Info sheet) and this is possible adding rows. This is “nice to know” but not “need to know” (not mandatory for other partners). Please remember that we already have a section on subsidies in the “outputs” sheet, so we do not need to repeat the price “with/without subsidies” in the “general information” sheet (we can calculate it directly knowing the percentage of discount). For sure if you have different level of subsidies for each technology it should be inserted in the “outputs” sheet in the section of subsidies adding rows.

� Technologies Market Chain (OUTPUTS SHEET) Question: Supply Chain What you intend to say by National suppliers? Answer: The supplier is the organization/person that physically supplies the local distributors. Question: Promoter: - Do u mean Business Associates in our case (India)? Answer: Promoter is the person that promotes the technologies to improve the selling of the distributor. In your case yes they are the BA Manufacturing chain and distribution: at number 9 there is the section on manufacturing. We divided manufacturing and distribution. Suppliers are the one that supply the products, they are like the distributors but work on larger scale (not only 1 village as the distributor does) Products imported: is fine if you want to add info for each supplier you can just add rows, please provide also the total amount. Don’t confuse the role of the suppliers (similar to distributor but on larger scale) and the manufacturer (who make the products but doesn’t directly distribute them). Promoters: are the one who promote the technologies (your TC). The technicians are the one who, paid by SCAMPIS, teach how to install maintain MIS technologies (your TA). In your case the TC are promoters but also have technical skills, but they are not paid by SCAMPIS so they are not technicians. If you gave formation also to TC add a row for “formation for Promoters” (TC) in the section “12. Capacity building” Promotion activities: any kind of activity put in place to promote technologies at village level, for example market exhibitions, shows, fests etc.

� Subsidies (OUTPUTS SHEET) Question: Subsidies There is a part containing subsidies to men & women. If we are capturing the data at beneficiary level the gender aggregation then why to repeat the same data. We can calculate from that figures

Page 15: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 15

Answer: We need to repeat the information because there could be the case in which 1 technology is managed by a group of people BUT the subsidy is given only to 1 person. In this case the data for “Beneficiaries M/F “ are not the same of “subsidies M/F” Subsidies used: Is the number of the subsidies allocated Discount percentage: shows the percentage of discount you use. If you have various different kind of subsidies, you should add rows and provide info for each type of subsidies and how many were allocated.

� Capacity building (OUTPUTS SHEET) Question: Capacity Building Training on Solid Fertiliser & nutrition aspects & schools should it be country/region specific or Now SCAMPIS wants it in all localities? As you know here we are not taking up such activities. Regarding solid fertilizer. Is it a project component or other partners are doing by their own? So far as I understand we have to promote Liquid natural fertilizer. Answer: In the other countries they are implementing this 3 different aspects so we inserted the indicators. If SCAMPIS India doesn’t develop such activities you will write NA (not applicable) in the related data cell.

� Change in use of the resources (IMPACT SHEET) Question: Change in resources: - How you suggest to measure the change in soil resources. Water & Time saved or conserved can be measured directly or by some tools. But measuring the soil quality needs scientific methods of study. We can indirectly measure that from increase in organic use & reduction of chemical use. Answer: The Impact sheet will provide indicators that show evidences for the most possible impacts of SCAMPIS (as real impacts can be calculated only some years after the end of the project). To each indicator will correspond a descriptive answer based on the information collected through the years through outputs/outcomes info. Soil quality: You are right: the information will come from use of organic fertilizer and diversification of vegetables.

� To add the indicator “Agriculture surface/family” ( GENERAL INFORMATION SHEET) I agree it is interesting. Does indicator refers to general statistics (not to m2 cultivated with the technology) how can you get this information? You could add this indicator adding a row in the general information sheet.

� New products cultivated (OUTCOMES SHEET) if you are introducing new products in line with diet diversification, native products, or products that normally farmers don’t cultivate, here you should list them. The way of understanding this indicator is to compare it to the indicator “Product cultivated” presented in the “general information sheet” that shows the vegetables cultivated in general in the project areas (not the one cultivated with MIS technology). If we compare the 2 indicators and we see a larger diversification of products using the SMI compared the general one, this goes in the line of food security.

� Food production (OUTCOMES SHEET) Question: “I suggest we’ll thinking about the interest to separate the family’s consumption and family’s selling for increase of production value.” Answer: In the sheet we keep separated family consumption and family sales. For this reason we have - INR for selling/productive cycle/20sqmt here we understand how much the family normally use to earn selling products at the market, before/after the introduction of the SMI technology. - INR for consume/productive cycle/20sqmt here we understand how much the family used to spend for their self consume at the market before and after the introduction of the SMI technology.

Page 16: Monitoring and evaluation guidelines for scampis - By Cecilia Ruberto

SCAMPIS M&E Guidelines 16

It is very difficult to monitor how much in kg a family consume, but using the “kg produced” and comparing to how much the family sell at the market we can see how much of their production they consume. If you think you can monitor how much each family consume you can add an indicator, but I would not give this indicator as mandatory because it is very difficult to track it.

� Longer food availability (OUTOCMES SHEET)

It shows if there is any difference in the availability of food for a family using the technology. For example if before the introduction of the technology they used to have 3 critical month in a year for the scarcity of food, maybe thanks to the introduction of the technology the number of month in which they have scarce food are less (thank to, for example, more food availability, for a longer period, or also more income to buy food, capacity to conserve the food produced for a longer period).

� Water use and pesticides (OUTCOMES SHEET) All the calculation on use of water for irrigation and use of pesticides , (as I will explain in the guidelines) should be done considering fixed numbers and kind of vegetables (I was thinking at 4-5 varieties) that will be identified by you and communicated in separate notes (annex) to better understand the M&E format. You can choose 100 m2 but another country (eg. India) should to the work considering they also are working on 20 m2 and 50 m2. This aspect will be deeply analyzes on the guidelines.

� Working time (OUTCOMES SHEET) Referring the indicator you proposed “Time for working field ” I think it would be difficult monitor it specifically for each kind of crop (and not very much useful at general SCAMPIS M&E level, maybe more useful for your internal work) so it would be better to give a general amount of time/size of plot.


Recommended