Transcript PARTNERSHIP FOR POLIO ERADICATION PROJECT (PPEP): NPHCDA

NOW MORE THEN EVER: STOP POLIO FOREVER
www.thephss.org
PERFORMANCE AUDIT FOR TRIGGERING IDA BUY-DOWN
Dr.Mizan Siddiqi, Principal Investigator
PUBLIC HEALTH SERVICES AND SOLUTIONS (PHSS)
NOW MORE THEN EVER: STOP POLIO FOREVER
BACKGROUND
• PARTNERSHIP FOR POLIO ERADICATION PROJECT
(PPEP) was funded by WB since 2003 through “IDA
Buy-down mechanism”
• The buy-down will be triggered based on the
results of performance audit by an independent
auditor
•
PHSS has been awarded to conduct the audit
NOW MORE THEN EVER: STOP POLIO FOREVER
•
•
•
•
STAKEHOLDES MEETING: PURPOSE
Present objective, methodology, timeline and
details of the plan
Agree on the plan, objective, methodology and
timeline
Define Roles and Responsibilities of partners in
the exercise
Provide feedback on the instruments, analysis
and outcome of the exercise
NOW MORE THEN EVER: STOP POLIO FOREVER
APPROACH
• Participatory
• Consultative
• Objective: Evidence Based
Both qualitative and qualitative information will be used
to analyze performance and conclude findings
NOW MORE THAN EVER: STOP POLIO FOREVER
OBJECTIVE
• To determine if the IDA funds achieved
intended results against agreed indicators.
• The achievement will be measured by two
indicators. These are:
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATORS
• INDICATOR A: Timely arrival of OPV vaccine
at national level (3 weeks before SIA)
• INDICATOR B: OPV Immunization coverage of
SIA (at least 80 percent in endemic states)
NOW MORE THAN EVER: STOP POLIO FOREVER
METHODOLGY: INDICATOR A
Timely arrival of OPV vaccine at national level (3 weeks before SIA)
• Review of documents
• Stake-holders’ Interview
• Analysis of Vaccine Arrival Report (VAR)
LIST OF STAKEHOLDERS
S/N
Organization
Position
1
2
3
4
5
6
7
8
9
10
11
12
13
NPHCDA
NPHCDA
ICC
Unicef
Unicef
Unicef
Unicef
Unicef
Rotary International
WHO
WHO
DfID
BMGF
ED
Director, DC and Imm.
Member
EPI Team Leader
EPI Logistics
Country Represntative
Contract Specialist
Sharif S Alam
Team Leader, Polio Plus
Team Leader, EPI
Country Represntative
Health Specialist
Health Specialist
14
BMGF
Health Specialist
15
16
17
18
19
20
World Bank
World Bank
World Bank
JAICA
USAID
CDC
Health Specialist
Health Specialist
Health Specialist
Health Specialist
Polio Team Leader
NOW MORE THAN EVER: STOP POLIO FOREVER
EXPECTED OUTPUT (INDICATOR A): VACCINE ARRIVAL TIME
The analysis of Vaccine Arrival Time will be influenced by external and internal
factors:
Factor
External/Internal
Delay in forecasting
Delay in fund transfer
Availability of vaccine in global market
Change in epidemiology of WPV
Registration of new type of vaccine
Delay in transportation of vaccine (availability of flight)
Delay in clearing of vaccine on arrival
Storage capacity in the country
Internal
Internal
External
External
Internal
External
Internal
Internal
The assessment will look into these factors of vaccine procurement
to determine if the IDA funds achieved intended results against the
Indicator A (Vaccine Arrival Time). External Factors will not be
considered as a failure by GON for delay in vaccine arrival.
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B
OPV Coverage of SIA
(at least 80 percent in selected endemic states)
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: OBJECTIVE
• To determine OPV coverage among 0-59
months old children in four high risk
endemic states
-Katsina, Zamfara, Kano and Borno (19th ERC)
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY
• Four individual cluster surveys one for each state
will be conducted during the week of October 29,
2010 (October 29-31) after the IPD is completed
(Oct 23-28, 2010)
• WHO 30-cluster coverage survey methodology
will be used to select sample at the household
level
(WHO Immunization Coverage Cluster Survey- Reference Manual 2005)
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY
SAMPLE SIZE
State
Number of survey Number
unit
Clusters
of Number of 0 to 59 Months Old Children
(OPV coverage in October 2010 IPD)
Katsina
1
30
210
Zamfara
1
30
210
Kano
1
30
210
Borno
1
30
210
Total
4
120
840
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY
SELECTION OF CLUSTERS
• 30 clusters will be selected using stratified cluster
sampling method from three strata of wards i.e.
VHR, HR and LR wards.
• The number of clusters in each stratum (sample
size of each stratum) will be allocated
proportionally to size of the strata .
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY (contd.)
SELECTION OF HOUSEHOLD
• Households
randomly.
will
be
selected
strictly
• WHO-30 cluster methodology will be used to
select starting and subsequent household.
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY (CONTD.)
SELECTION OF RESPONDENT AND CHILD
• One child under five years of age per household will be
selected
• The vaccination status of the child will be checked from
the marking on the little finger of the child’s left
• For all eligible children (one per household), the
parent/caregiver will be interviewed of the selected
child questions.
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY (CONTD.)
SURVEY INSTRUMENT
The questionnaire will be developed based on
the recent LQAS and Outside monitoring
survey.
In addition to OPV status, few additional
questions will be asked to find reasons for
non-vaccination.
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B: METHODOLOGY (CONTD.)
FIELD WORK
Training
• A one day training will be given to interviewers on sample
selection and data collection instrument.
• An operational manual will be developed to guide training
and filed work.
Data Collection
Six teams (one interviewer and one recorder) will collect
data in each state. They will be supervised by State
Coordinator and Senatorial District Monitors.
NOW MORE THAN EVER: STOP POLIO FOREVER
MONITORING
PHSS Real Time Monitoring System using web/sms will be deployed
Dashboard
Sender
SMS Receiver
Modem
SMS Sent to
Web
Data analysis
Public Health Services and Solutions (PHSS) www.thephss.org
NOW MORE THAN EVER: STOP POLIO FOREVER
FILED WORK (Contd.)
Quality Control
• The state monitor will conduct supervised interviews in
his/her designated clusters with the teams on a daily basis
• State coordinator will conduct random spot checks for all
teams in the state.
NOW MORE THAN EVER: STOP POLIO FOREVER
Data Management and Analysis
• All data will be entered in a computerized data
base and analyzed using Epi-Info software
• Various tables and charts will be produced using
MS Excel and MSWord
• The analysis will be limited to key indicators and
expected output
NOW MORE THAN EVER: STOP POLIO FOREVER
INDICATOR B:Expected Output
OPV Coverage in 4 Endemic States
(Katsina, Zamfara, Kano and Borno)
Report Outline
The report will have 4 chapters:
• Chapter 1 Background, objectives, design and implementation of
the audit
• Chapter 2 Analysis of the findings of Indicator A including comments
on results against target
• Chapter 3 Analysis of the findings of Indicator B received from
cluster survey in four states including comments on results against
target
• Chapter 4 Discussions and Conclusion
TEAM
Principal Investigator
Dr.Mizan Siddiqi
Co-Principal Investigator
Garry Presthus
Other Staffs:
-M&E Specialist
-Immunization Specialist
-Biostatistician
-Data Management Specialist
-State Coordinators, State Monitors, Interviewers.
WORKPLAN
Item No.
Activity
WK
1
1.
Presentation of work plan, methodology, reporting format and timeline to WB and
FGoN and make adjustments as necessary, recruitment of staff
X
WK
2
WK
3
WK
4
Indicator A (Vaccine Arrival)
2.
Review of documents
X
3.
Key Informant Interview
X
4.
Analysis of information
X
X
Draft Report on Indicator A
X
X
Indicator B (Cluster Survey)
5.
Collection of population data by ward and risk category from states for sampling
X
6.
Design, develop and host web site and survey monitoring software
X
7.
Training of field staff
X
8.
Data Collection in 4 states
9.
Design of data entry screen
10.
Data entry
X
11.
Data Cleaning and analysis
X
12.
Draft Report on Indicator B
X
13.
Presentation of overall draft report
X
14.
Final Report
X
X
X
Assistance from Stakeholders
NPHCDA
1. Leadership, Coordination and Facilitation of the study
2. Support at the State and LGA level
WHO
1.
2.
3.
4.
5.
6.
Review of methodology, sampling frame and data collection instruments
Out side and inside monitoring data of OPV coverage (2007-2010 by SIA) four states
LQAS data of OPV coverage for four selected states (2009-2010 by SIA)
Support for survey at the State and LGA level
ERC Recommendations and SIA schedule (2007-2010)
Assign Technical Staff to support the team
Unicef
1. VAR report (2007-2010) and information surrounding global vaccine market, availability and reasons
for delay in arrival due to external factors
2. Stakeholder Interview
3. Documents related to vaccine procurement
4. Assign Technical Staff to support team
World Bank
1. Project Documents
2. Coordination with stakeholders
All partners
1. Stakeholder Interview
2. Review of draft report
NOW MORE THAN EVER: STOP POLIO FORVER
Please visit

www.thephss.org/ppep
 Register
Join the forum and post comments
 If we can not meet you because of your busy schedule/travel etc.
please fill up the online questionnaire and submit.
 All materials related to the exercise are posted for your
information and support.
 For any question please send an e-mail to:
[email protected] or call 07067275270