Transcript Slide 1

PEPFAR OVC
Survey Toolkit
Janet Shriberg, EdD
Senior Evaluation Advisor
Office of HIV/AIDS
USAID
**please note that slides were created with work
done by MEASURE Evaluation
PEPFAR Mission & Goal (OVC)
 Mission: To mitigate the social, emotional and
economic impacts of HIV/AIDS on children and to
reduce their risk and vulnerability while
increasing their resilience
 A goal: To care for 5 million orphans and
vulnerable children
 10% funding earmark for OVC
The problem
 High investment in OVC programs BUT impact
is unclear & questions regarding “what works”
in improving household well-being
 Part of the challenge: lack of standardized
measures and tools for child and household
outcomes (well-being)
3
A proposed solution
Standardized questionnaires for use in a survey of
children ages 0-17 years and their adult caregivers
Who are these tools for?
 Local and international
research institutions
and other implementing
organizations with
evaluation agenda
 USAID Forward –
supporting local
researchers
The purpose
 Standardize population-level child and caregiver wellbeing data beyond what is available from routine
surveys
 Produce actionable data to inform programs and
enable mid-course corrections
 Enable comparative assessments of child and
caregiver well-being and household economic status
across a diverse set of interventions and regions
Focus on PEPFAR OVC programs
 Indicators need to reflect
& be amenable to change
by PEPFAR program
intervention
 HH interventions led by
home visitors
 Community interventions
 Low direct funding per
target, focus on linkages
 Often inadequate
services in vicinity
How did we start…
 Two step, participatory process:
 Build consensus around core impact indicators for
PEPFAR-funded OVC programs
 Develop OVC program evaluation (survey) tools
Distilling the core indicators
 Our starting point: 6+1 domains of PEPFAR OVC
programming
 Step 1: Extensive literature search
 Step 2: Gaps (HES, PSS) filled through targeted
research
 Result: >600 child/HH wellbeing
questions/indicators
 Step 3: Analysis against 8 criteria
 Result: shorter list of questions for discussion
9
Finalizing the core indicators
 External working group: solicited review from 49
stakeholders
 Finalized core set of 12 child and 3 household
measures
10
Developing the tools
 Tools drafted with
strong stakeholder input
 Draft tools piloted in
Zambia and Nigeria
 Cognitive interviews to
test key concepts (e.g.
social support)
 Household pre-test of
full tools, procedures
Structure and content
1. Caregiver questionnaire (including questions on
household)
2. Child questionnaire (ages 0-9 years),
administered to caregiver
3. Child questionnaire (ages 10-17), administered
to child with parental consent & child assent
Caregiver questionnaire
Sections
Section 1: Household
schedule
Core questions


Optional modules
Section 2: Background

Information on Caregiver and 
Household


Household schedule* (10)
Changes in household
composition (4)
Demographic information* (7)
Work* (3)
Access to money (3)
Shelter (1)

Section 3: Food Security

Household food security (6)

Section 4: Caregiver Wellbeing and Attitudes



General health (2)
Caregiver support (4)
Parental self-efficacy (1)

Section 5: HIV/AIDS Testing,
Knowledge, Attitudes



Basic HIV/AIDS knowledge* (7)
HIV testing* (3)
Attitudes to condom educ (1)

Section 6: Access to HIV
Prevention, Care & Support

Household access to services (1)
*DHS, bold=core indicator


Household Economic Status
(forthcoming)
Progress out of Poverty
Index or similar (country
specific)
Dietary Diversity (1)
Perceptions and experience
of child discipline, violent
discipline (forthcoming)
Gender roles and
decisionmaking power* (9)
HIV/AIDS attitudes* (4)
Child questionnaire (ages 0-9)
Sections
Core questions
Optional modules
Section 1: Child Health and
Welfare













Section 2: Education and
Work
Section 3: Food
Consumption
Section 4: Access to HIV
Prevention, Care & Support
Section 5: Anthropometric
Measures (of Children)
*DHS, bold=core indicator



Confirm demographics (5)
General health & disability (4)
Birth certificate (2)
Vaccinations (11)
Fever (<5 years)* (1)
Diarrhea (<5 years)* (1)
Experience of neglect (2)
Slept under mosquito net* (1)
HIV testing experience* (2)
School attendance*,
progression/repeats, drop-outs,
missed school days (5+ years) (9)
Work for wages (2)
Early childhood stimulation (2)
Food consumption (2+ years) (8)

Child access to services (1)

Weight*, Height*, MUAC
•
Fever: extended* (4)
Diarrhea: extended* (3)
Health for children
living with HIV/AIDS
(forthcoming)
Dietary diversity (1)
Child questionnaire (ages 10-17)
Sections
Core questions
Section 1: Background
Information on Child
Section 2: Diary
Section 3: Education




Section 4: Chores & Work







Confirm demographics* (5)
Identity of caregiver (1)
Daily log (6)
School attendance*,
progression/repeats, dropouts (9)
Chores (3)
Work (7)
Food consumption (8)
Alcohol consumption (3)
Birth certificate (2)
General health & disability (3)
General support (4)


Basic HIV/AIDS knowledge* (7) 
HIV testing * (3)

Section 8: Sexual Experience
Section 9: Access to HIV

Prevention, Care & Support
Section 10: Anthropometric

Measures: Weight and Height
•
Section 5: Food & Alcohol
Consumption
Section 6: Health, Support &
Protection
Section 7: HIV Testing,
Knowledge, and Attitudes
Child access to services (1)
Weight, Height, MUAC
Optional modules

Dietary diversity (1)

Health for children living with
HIV/AIDS (forthcoming)
Perceptions/experience of
violence (forthcoming)
Child development knowledge (6)
HIV/AIDS attitudes and beliefs (4)

Sexual behavior (13-17 yrs) (5)
Using the Tools
 There is no single data collection tool that can
meet all OVC program M&E requirements.
Situation analysis
Targeting
Case management
Yes
x
X
X
Program monitoring
Evaluation
No
X
x
What’s in the toolkit?
 Tools & Manual
 Template protocol with
consent/assent forms
 Methodological guidance
 Data analysis guide
 Data collector training
manual and materials
 French translations
Global Monitoring, Evaluation and
Reporting (“ the MER”)
 PEPFAR shift towards outcomes and impact
 All technical areas participating (CARE,
PREVENTION, TREATMENT)
 Specific Changes for OVC Programs
 2 indicators at Level 1 (required, reported to HQ)
 Outcomes Package at Level 2 (required, reported at country
level; indicators elevated from survey toolkit)
 2 Education indicators: attendance and progression
 Systems Strengthening and Social Protection at Level 3
(recommended)
Where can I find out more?
Go to MEASURE Evaluation
website:
http://www.cpc.unc.edu/measure/
our-work/ovc
Email:
Janet Shriberg
[email protected]
Special Thanks to…
 Dr. Jenifer Chapman, MEASURE Evaluation*
(*Technical Lead for Toolkit, slideset creator)
 Dr. Lisa Parker, MEASURE Evalution
 OVC TWG Working Group, HQ and Missions
 Stakeholders globally working on OVC
programming
 IATT Education for Guidance on education
questions