Transcript JMP Methodology - United Nations

JMP
and data reconciliation
Workshop on Millennium Development Goals Monitoring
14-16 January 2009, Bangkok
Rifat Hossain
Public Health and Environment
World Health Organization
Rolf Luyendijk
Statistics and Monitoring
United Nations Children's Fund
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
This presentation covers…
 What is JMP
 How JMP estimates
 Methodologies
 JMP challenges
 Multiple data sources
 JMP's approach to reconcile
 The ladder
 JMP's reconciliation efforts
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP Monitors…
MDG 7 Target 7c:
 Halve, by 2015, the proportion of people
without sustainable access to safe drinking
water and basic sanitation
Indicators:
uses
 Proportion of the population that has access to an
improved drinking water source (urban and rural)
uses
 Proportion of population that has access to an
improved sanitation facility (urban and rural)
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP definitions of improved/unimproved
Drinking Water
Sanitation
Piped into dwelling, plot or yard
Tube well/borehole
Protected dug well
Protected spring
Rainwater collection
 piped sewer system
IMPROVED
Public tap/standpipe
Flush/pour flush to:
Tanker truck
 Surface water (river, dam, lake, pond,
stream, canal, irrigation canal)
 Bottled water (unless 2nd Improved source)
Ventilated improved pit (VIP) latrine
 Pit latrine with slab
 Flush/Pour flush to elsewhere
UN-IMPROVED
Cart with small tank/drum
 pit latrine
 Composting toilet
Unprotected dug well
Unprotected spring
septic tank
 Pit latrine without slab/open pit
 Bucket
 Hanging toilet/hanging latrine
Shared sanitation of any type
 No facilities, bush or field
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
100
WHO90
Coverage
90
distribution
80
% Coverage
70
JMP93
60
JMP96
50
JMP99
40
Reported data
30
Survey data
20
DHS99
DHS94
WHO88
EMP85
EMP86
10
0
1980
MICS00
1982
1984
1986
1988
1990
1992
1994
1996
1998
2000
2002
2004
2006
Year
WHO/UNICEF
Joint Monitoring Programme
WHO
UNICEF
JMP uses National survey/census
because…
More objective and reliable
 Some facilities fallen out of order
 Avoid double counting by not considering
upgrading of improved facilities
Allows for analyses
 Disaggregated into wealth quintiles
 Comparable across countries
 Monitor trends over time
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP cookbook !
Coverage (%)
100
90
2 Years
4 Years
max. max.
80
48 Years <
5 Years NO REGRESSION LINE !
>
70
6 Years max.
60
6 Years
2 Years
max.
max.
50
40
- 2 data points scenario
30
20
- 4 year apart
10
- > 5 years extrapolation
0
1985
1990
1995
2000
2005
2010
≤
Year
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
How JMP estimates
% Coverage
100
90
80
DHS96
70
XX
x
X
X
NFHS03
DHS01
60
X
X
50
Estimated coverage
Estimated coverage
1990: 52% (new baseline)
DHS87 Estimated coverage
2003 ≠ NFHS03
1990: 50% 2002: 75%
40
30
20
2002: 77% 2006: 82%
10
0
1980 1982
WHO
Year
1984 1986 1988
1990 1992 1994 1996
1998 2000 2002 2004 2006
WHO/UNICEF Joint Monitoring Programme
UNICEF
A bold step…
Joint Monitoring Programme
Between WHO and UNICEF
…and Country X
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
A complex sector
 Data needs of a wide range of stakeholders
 Multiple stakeholders with varying methodologies
Multiple data sources = Confusion
Reconciliation needed to bolster mutual
cooperation and confidence building to
strengthen national monitoring
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Major reasons for discrepancies
 Differing sources of data
 NSO – user based data
 Sector – provider based data
 Differing methodologies
 Even with user based data
• Countries sometimes use single data point
 Differing population estimates
 Most recent census vs. UNPD estimates
 Differing definitions of urban/rural
 NSO and Sectors not always agree
 Differing definitions
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Reconciliation through
dialogue/cooperation/coordination
 Key players
 National
• NSO
• Sectoral ministries
 International (IHSN etc.)
 Reconciliation
 Development of framework and guidelines
 Help implement the framework
• JMP as a player
• JMP as an honest broker
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Framework for reconciliation
 Fill data gaps (with NSOs, sectors,
regional bodies, other int. orgs)
 Liaise with National authorities (in
collaboration with regional bodies)
• NSO as national data clearing house
 Liaise with other international organizations
 For greater synergy
 Explain methodologies
• Website
• Workshops
• National stakeholders' meeting
 Promote the use of standardized data
collection tools
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Framework for reconciliation (cont'd)
Data reconciliation
 Consultation with national bodies
• JMP website
• Wiki style portal
• Etc.
 Reconcile sectoral and statistical
datasets?
 Agree on a single set of datasets
• Construct a single ladder (possible?)
• Show discrepancies through this ladder
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP2008: The ladder approach…
Sanitation
(4 rungs)
Improved
sanitation facilities
 Moving from
Improved/Unimproved
dichotomy to a more
refined situation
Unimproved
sanitation facilities
Open defecation
Improved
as per
MDG
Shared sanitation
facilities
Water
(3 rungs)
Piped water in
dwelling,
plot or yard
Other improved
drinking water
sources
Unimproved
drinking
water sources
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Reconciliation with a more refined Ladder
Progress in Sanitation
MDG Definition
 With access
 Sewer connection
 Septic tank
 VIP/improved pit
100%
80%
60%
40%
 Without access
 Shared facilities
 Unimproved
facilities
 Open defecation
20%
0%
1990
Year
2006
Open defecatio n
Unimpro ved
Shared
Impro ved pit
Septic tank
Sewer
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Comparing JMP and national definitions
(after closing data gaps)
MDG Definition
 With access
 Sewer connection
 Septic tank
 VIP/improved pit
 Without access
 Shared facilities
 Unimproved
facilities
 Open defecation
Progress in Sanitation
100%
80%
60%
40%
20%
0%
1990
Year
2006
Open defecatio n
Unimpro ved
Shared
Impro ved pit
Septic tank
Sewer
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Comparing JMP and national definitions
(after closing data gaps)
MDG Definition
 With access
 Sewer connection
 Septic tank
 VIP/improved pit
 Without access
 Shared facilities
 Unimproved
facilities
 Open defecation
Progress in Sanitation
52% 80%
National Definition
100%
 With Access
 Sewer connection
 Septic tank
 VIP/improved pit
Differences  Shared facilities
due to differing
 Unimproved
definitions
facilities
80%
60%
40%
20%
0%
1990
Year
2006
Open defecatio n
Unimpro ved
Shared
Impro ved pit
Septic tank
Sewer
 Without Access
 Open defecation
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Bangladesh puzzle
Urban Sanitation
Year
1990 1995 2000 2006
IMPROVED
 piped sewer system
0
septic tank
10
 pit latrine
Ventilated improved pit (VIP) latrine
20
 Pit latrine with slab
30
UN-IMPROVED
 Flush/Pour flush to elsewhere
 Pit latrine without slab/open pit
% Coverage
 Composting toilet
Unimproved
40
50
 Bucket
60
 Hanging toilet/hanging latrine
70
Shared sanitation of any type
80
 No facilities, bush or field
Open
defecation
Shared
48%
Improved pit
Septic tank
Sew erage
Disaggregation
and ladder
Flush/pour flush to:
90
100
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Can we agree on the ladder?
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP's Reconciliation efforts
 Campaign to fill data gaps
 Through workshops,
 Cooperation with NSOs
 Major International data gathering/disseminating institutions
(IPUMS etc.)
 Through workshops (capacity building, stat+sector)
 Past workshops
• Anglophone Western Africa (Abuja, September 2007)
 Gambia, Ghana, Liberia, Nigeria, Sierra Leone
• Anglophone Eastern Africa (Nairobi, November 2007)
 Ethiopia, Kenya, Rwanda, Zambia, Zimbabwe
• South Asia (Kathmandu, August 2008)
 Bangladesh, Bhutan, Nepal (multiple data sources)
• Central America (Santo Domingo, November 2008)
 Dominican Republic, Guatemala, Honduras, Nicaragua,
Panama
• Francophone Africa (Bamako, December 2008)
 Benin, Burkina Faso, Madagascar, Mali, Senegal
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP's Reconciliation efforts (cont'd)
Through workshops (capacity building,
stat+sector)
 Planned activities/workshops
•
•
•
•
Follow-up to past workshops
South-east Asia (Jakarta, April 2009)
India (June 2009)
East Asia (to be decided)
Through national stakeholders meetings
 Follow-up to workshops (involving all actors)
• Bangladesh, Nepal
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
JMP's Reconciliation efforts (cont'd)
Through communication with
country authorities
• Senegal, Madagascar

Presentation in Stockholm
• India
Through coordination with
international organizations
 Use of core questions through IHSN
 UNSD pilot project
 Reconciliation efforts by regional
commissions
 Joint workshops…
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF
Thank you!
www.wssinfo.org
WHO/UNICEF Joint Monitoring Programme
WHO
UNICEF