JMP Methodology and reconciling national and international monitoring of the MDG drinking water and sanitation target SADC/ECA Workshop By: Rolf Luyendijk, UNICEF Kampala, Uganda, 5-8 May, 2008. WHO/UNICEF Joint Monitoring Programme for Water Supply and Sanitation (JMP). This presentation. - PowerPoint PPT Presentation
WHO/UNICEF WHO/UNICEF Joint Monitoring Programme Joint Monitoring Programme for Water Supply and Sanitation (JMP) for Water Supply and Sanitation (JMP) JMP Methodology and reconciling JMP Methodology and reconciling national and international national and international monitoring of the MDG drinking monitoring of the MDG drinking water and sanitation target water and sanitation target SADC/ECA Workshop SADC/ECA Workshop By: Rolf Luyendijk, UNICEF By: Rolf Luyendijk, UNICEF Kampala, Uganda, 5-8 May, 2008 Kampala, Uganda, 5-8 May, 2008
for Water Supply and Sanitation (JMP)for Water Supply and Sanitation (JMP)
JMP Methodology and reconciling national and JMP Methodology and reconciling national and international monitoring of the MDG drinking international monitoring of the MDG drinking
water and sanitation targetwater and sanitation target
Kampala, Uganda, 5-8 May, 2008Kampala, Uganda, 5-8 May, 2008
1.1. IntroductionIntroduction2.2. Data sourcesData sources3.3. JMP MethodologyJMP Methodology4.4. Reconciling national and Reconciling national and
international monitoringinternational monitoring
This presentationThis presentation
WHO-UNICEF WHO-UNICEF Joint Monitoring Program (JMP)Joint Monitoring Program (JMP)
Responsible for monitoring progress Responsible for monitoring progress towards the MDG 7 Target 7Ctowards the MDG 7 Target 7C Global accountability and advocacyGlobal accountability and advocacy
Biennial updates of coverage estimatesBiennial updates of coverage estimates Water supply, sanitation, urban, rural, Water supply, sanitation, urban, rural,
total, household connections, by country, total, household connections, by country, region and globalregion and global
Halve, by 2015, the proportion of people without Halve, by 2015, the proportion of people without sustainable access to safe drinking water and sustainable access to safe drinking water and basic sanitationbasic sanitation
Indicators: Indicators: Proportion of population that Proportion of population that usesuses an improved an improved
drinking water source, urban and ruraldrinking water source, urban and rural Proportion of population that Proportion of population that usesuses an improved an improved
sanitation facility, urban and rural sanitation facility, urban and rural
MDG definitions of improved/unimproved sources of drinking water and sanitation facilities
Improved water supplyImproved water supply •Piped into dwelling, plot or yard
•Public tap/standpipe
•Tube well/borehole
•Protected dug well
•Protected spring
•Rainwater collection
Improved sanitationImproved sanitation
•Flush/pour flush to:
• piped sewer system
•septic tank
• pit latrine
•Ventilated improved pit (VIP) latrine
• Pit latrine with slab
• Composting toiletUnimproved water Unimproved water supplysupply•Unprotected dug well
•Unprotected spring
•Cart with small tank/drum
•Tanker truck
• Surface water (river, dam, lake, pond, stream, canal, irrigation canal)
• Bottled water
Unimproved sanitationUnimproved sanitation
• Flush/Pour flush to elsewhere
• Pit latrine without slab/open pit
• bucket
• Hanging toilet/hanging latrine
• No facilities, bush or field
Water: Urban and rural disparities 2006Water: Urban and rural disparities 2006 84% without access live in rural areas 84% without access live in rural areas
WHO/UNICEF JMP, 2008WHO/UNICEF JMP, 2008
Urban Rural
0% - 50%
50% - 75%
76% - 90%
91% - 100%
No or insufficient data
Data reports and advocacy materialData reports and advocacy material
Sanitation ladderSanitation ladder
2631
18
14
24
23
3628
Sub-Saharan Africa
1990 2006
Open
Defecation
Unimproved
Shared
Improved
1.1. IntroductionIntroduction
2.2. Data sourcesData sources
3.3. JMP MethodologyJMP Methodology
4.4. Rationale for Rationale for monitoringmonitoring
Data sources on access to water Data sources on access to water supply and sanitationsupply and sanitation
1980 – 1997 Reported data from Governments1980 – 1997 Reported data from Governments 1997 – data from household surveys and censuses1997 – data from household surveys and censuses
JMP data sources are JMP data sources are primaryprimary sources: sources: National household sample surveys (DHS, MICS, LSMS, National household sample surveys (DHS, MICS, LSMS,
CWIQ, WHS, HBS, H&N, RHS, PAPFAM etc)CWIQ, WHS, HBS, H&N, RHS, PAPFAM etc) National censusNational census Note: Note: JMP is not involved in primary data JMP is not involved in primary data
Data for +/- 170 countriesData for +/- 170 countries 600+ results of HH surveys + Censuses 600+ results of HH surveys + Censuses
from 1985 – 2006from 1985 – 2006 Bulk of surveys for LDCs, SSA, larger Bulk of surveys for LDCs, SSA, larger
developing countriesdeveloping countries 30 - 40 new survey results per year30 - 40 new survey results per year Frequency for most developing countries Frequency for most developing countries
one survey every three yearsone survey every three years
How does the JMP obtain data?How does the JMP obtain data?
UNICEF Country offices – annual submission of UNICEF Country offices – annual submission of new survey/census data to HQnew survey/census data to HQ
MICS/DHS/WHS - through UNICEF, ORC-MICS/DHS/WHS - through UNICEF, ORC-MACRO and WHOMACRO and WHO
IHSN – International Household Survey NetworkIHSN – International Household Survey Network Web-searches from NSO websitesWeb-searches from NSO websites Direct contact with NSO’sDirect contact with NSO’s
Survey validationSurvey validation
Do we know the survey and survey Do we know the survey and survey authorities?authorities?
Is the survey nationally representative?Is the survey nationally representative? Do we have the original source Do we have the original source
documentation?documentation? Reliability check against other indicatorsReliability check against other indicators
1.1. IntroductionIntroduction
2.2. Data sourcesData sources
3.3. JMP MethodologyJMP Methodology
4.4. Reconciling national Reconciling national and international and international monitoringmonitoring
Monitoring MDG drinking water and Monitoring MDG drinking water and sanitation targetssanitation targets
A country’s responsibilityA country’s responsibility At global level: JMPAt global level: JMP
Challenges:Challenges: Track progress over timeTrack progress over time Track progress towards the MDG target vs. Track progress towards the MDG target vs.
baseline year 1990baseline year 1990 Ensure comparability over timeEnsure comparability over time Ensure comparability of data among Ensure comparability of data among
countries (countries (JMP specific challengeJMP specific challenge))
JMP methodologyJMP methodology
Collection survey informationCollection survey information Validate survey informationValidate survey information Ensure comparability among different surveys Ensure comparability among different surveys
(including some country level consultations)(including some country level consultations) Plot survey data on time scale (urban + rural)Plot survey data on time scale (urban + rural) Draw linear regression lineDraw linear regression line Calculate total coverage based on urban & rural Calculate total coverage based on urban & rural
coverage datacoverage data
Adjustments made to survey or Adjustments made to survey or census data set (1)census data set (1)
Example:Example: HBS ‘86: Latrine: 58%HBS ‘86: Latrine: 58% Improved Improved DHS ‘89: Pit: 62% DHS ‘89: Pit: 62% Improved ?Improved ? Census ‘92: Open pit: 59%Census ‘92: Open pit: 59% Not improvedNot improved MICS ‘95: Traditional latrine: 60%MICS ‘95: Traditional latrine: 60% Improved?Improved?
How to interpret these categories?How to interpret these categories?
Suggested re-classification:Suggested re-classification: Pit latrine with a slabPit latrine with a slab Pit latrine without a slab/open pitPit latrine without a slab/open pit
Adjustments made to survey or Adjustments made to survey or census data set (2)census data set (2)
Example:Example: DHS ‘98: Well: 22%DHS ‘98: Well: 22% Improved?Improved? Census ‘00: Protected dug well: 14%Census ‘00: Protected dug well: 14% ImprovedImproved Census ’00: Unprotected dug well: 6% Census ’00: Unprotected dug well: 6% Not ImprovedNot Improved
Did coverage drop by 22 -14 = 8% over the period 1990-2000?Did coverage drop by 22 -14 = 8% over the period 1990-2000?
Suggested re-classification:Suggested re-classification: Tube well/boreholeTube well/borehole Protected wellProtected well Unprotected wellUnprotected well
Proportion using an improved sanitation facilityProportion using an improved sanitation facilityEstimated Coverage
2004 = 50% = 49%
2006 = 52%
Added Fictive data point 2005 :49%
JMP MethodologyJMP Methodology
Per country:Per country: Trendlines for urban and rural sanitation coverageTrendlines for urban and rural sanitation coverage Trendlines for urban and rural drinking water Trendlines for urban and rural drinking water
coveragecoverage
Population data from UN Population DivisionPopulation data from UN Population Division Total populationTotal population proportion urban populationproportion urban population
Calculate total national coverageCalculate total national coverage Note: JMP does not take total coverage data directly Note: JMP does not take total coverage data directly
from surveys or census datafrom surveys or census data
1.1. IntroductionIntroduction
2.2. Data sourcesData sources
3.3. JMP MethodologyJMP Methodology
4.4. Reconciling national Reconciling national and international and international monitoringmonitoring
Data discrepanciesData discrepancies
Use of different definitions of accessUse of different definitions of access Use of different population data Use of different population data JMP always uses projections – countries JMP always uses projections – countries
often report on latest census or survey often report on latest census or survey findingsfindings
Difference in denominator population vs. Difference in denominator population vs. householdshouseholds
QuestionsQuestionsHow to reconcile definitional issues between national and How to reconcile definitional issues between national and
international monitoring?international monitoring? Should international definitions take into account (some) national Should international definitions take into account (some) national
definitions? E.g. shared facilities, traditional latrines?definitions? E.g. shared facilities, traditional latrines? Should national data (and definitions) be published alongside Should national data (and definitions) be published alongside
international estimates?international estimates? At what point should line ministries get involved in the discussion At what point should line ministries get involved in the discussion
on definitions and what if they propose additional access on definitions and what if they propose additional access criteria?criteria?
How to ensure survey data compatibility for national and How to ensure survey data compatibility for national and international monitoring?international monitoring?
Reporting of latest survey data or use of projections?Reporting of latest survey data or use of projections? How to ensure international monitoring uses all available How to ensure international monitoring uses all available
survey data?survey data?
JMP Methodology - SummaryJMP Methodology - Summary Primarily based on user data derived from
household surveys and censuses rather than data reported by governments
Adjustments made to full historical series to ensure comparability over time and between countries
Use linear regression to extrapolate and interpolate reference years instead of using the latest household survey data
JMP country filesJMP country files Four graphs with regressions lineFour graphs with regressions line All HHS + census data per countryAll HHS + census data per country
Regional and global coverage estimatesRegional and global coverage estimates Core questions on water supply and Core questions on water supply and
sanitation for household surveyssanitation for household surveys Standard indicatorsStandard indicators Definitions of service categoriesDefinitions of service categories
