Transcript 20090609_sie_et_sws2_010609_en.ppt

Second Independent
Evaluation of UNAIDS
Second Stakeholder
Workshop
Evaluation Team:
Derek Poate, Kathy Attawell,
Paul Balogun
1
Purpose

To assess the efficacy, effectiveness
and outcomes of UNAIDS (including
UNAIDS Secretariat, the PCB and
Cosponsors) at the global, regional
and country levels
2
Questions in the TOR
a)
b)
c)
d)
e)
f)
g)
h)
i)
j)
k)
l)
The evolving role of UNAIDS within a changing
environment
Governance of UNAIDS
The response to the Five Year Evaluation of UNAIDS
The Division of Labour between the Secretariat,
Cosponsors, Agencies and Countries
Strengthening Health systems
The administration of the Joint Programme
Delivering as One
Involving and working with civil society
Gender dimensions of the epidemic
Technical support to national AIDS responses
Human rights
The greater and meaningful involvement of People living
with HIV
3
Evaluation Framework tables
Question: a)
The evolving role of UNAIDS within a changing environment
Hypothesis: UNAIDS has evolved in response to the changing global environment and has
remained relevant and effective
1
Issues & detailed
questions
Indicators
Sources of data
Methods
The evolving role and
priorities of the Joint
Programme
 Clear and unambiguous
policy statements in PCB
documents and public
information
Review of governing
body and operational
documents
Document
review
against
structured
checklist
Policy timeline
Working relationships
with institutions like the
Global Fund, PEPFAR,
UNITAID, bilateral
donors, private sector,
civil society, regional
organizations and
others
 Existence of a written
statement about working
relationships
 Perceptions of
UNAIDS/Cosponsors and
other institutions about the
working relationship
Review of governing
body and operational
documents
Interviews with policy
advisors, officials and
representatives
Document
review
against
structured
checklist
Topic-list semistructured interviews
To what extent does
UNAIDS generate and
take advantage of
synergies with its
partners including HIV
vaccine and other
appropriate
technologies,
advocacy, and
development partners
and organizations of
vulnerable populations
and people living with
HIV?
 Examples of synergies
Interviews with key
informants
Appreciative enquiry
A special focus will be
placed upon the role of
UNAIDS in monitoring
and evaluation of
different interventions,
policies and strategies
implemented across
many partners.
 Extent to which UNAIDS
M&E programmes cover
these issues
Review of planning
documents and M&E
reports for Secretariat
and Cosponsors
Document
against
checklist
review
structured
4
Completed framework
Indicators
Narrative:
Major HIV donors fund
programmes and
activities for health
systems
strengthening.
Findings
Major HIV donors in Ethiopia – GF and PEPFAR – are funding health systems strengthening programmes
and activities. This has been driven by the MOH, which views HIV funding as an opportunity to strengthen
the health sector, and the UN has had little influence on MOH engagement with the GF or PEPFAR. The
extent to which donor funding for the health sector takes account of HIV issues is more difficult to
determine.
Evidence
Interviews with MOH, WHO, UNAIDS Secretariat and USAID, GOE-PEPFAR-GF MOU, data provided in
presentations confirm that HIV funding is being used to strengthen the health system.
PEPFAR total budgets for FY 2007 and FY 2008 are US$354 million and US$344 million, approx. 25% is
allocated for HSS. Funds are being used for e.g. construction and renovation of health centres and health
posts, strengthening logistics, supply chain management and laboratory capacity, provision of equipment.
PEPFAR support during FY 2007 included secondment of staff to the MOH for development of the National
Pharmaceutical Logistics Master Plan (PEPFAR Ethiopia Annual Progress Report, January 2008).
Of GF Round 2 total grant of $129.2 million disbursed, $57.6 million has been disbursed to MOH. Of GF
Round 7 Year 1 grant, US$ 17.5 million is allocated to health systems strengthening (HR $3.97 million; HM
$2.85 million, PSM $7.54 million, M&E $3.2 million). GF grant allocation for HSS is being used to construct
and renovate health centres and health posts, procure basic laboratory equipment, improve staff
competencies and skills, provide generic commodities and supplies e.g. CTX, gloves, and strengthen
management systems. Round 8 GF proposal also includes allocation of US$50 million for HSS.
Clinton Foundation (approx. $20 million/year) is focusing on paediatric treatment and hospital management;
World Bank EMSAP II (approx. US$10 million/year) focusing on funding at local level & for civil society.
GAVI funds include allocation for HSS. GOE is also proposing allocation of 19% of GAVI HSS funds for
strengthening human resources for delivery of basic health services; 61% to improving supply, distribution
and maintenance systems, and 21% to enhancing the organisation and management of health services
5
delivery.
Conceptual organisation of the evaluation questions
Overarching issue
From 5-year
evaluation
c) The way in which UNAIDS
has responded to the
recommendations of the
first 5 year evaluation
How UNAIDS is responding to the
changing context
a) The evolving role of UNAIDS within a
changing environment
e) Strengthening health systems
g) Delivering as One
How UNAIDS is fulfilling its
Mandate
ECOSOC mandate and core objectives
d) The Division of Labour between the
Secretariat, Cosponsors, Agencies and
Countries (global coordination role)
h) Involving and working with civil society
i) Gender dimensions of the epidemic
j) Technical support to national AIDS
responses
k) Human rights
l) The greater and meaningful involvement
of people living with HIV
How UNAIDS works
b) Governance of UNAIDS
d) The Division of Labour between the
Secretariat, Cosponsors, Agencies and
Countries (operational relationships)
f) The administration of the Joint
Programme
Looking forward
How has past performance
prepared and enabled
UNAIDS to deal with future
Challenges?
To the future
6
Work accomplished to date







Visits to 12 countries
Consultation with offices in the Pacific
region
Visits to regional offices
Interviews at headquarters of the
secretariat and cosponsors
Interviews with civil society organisations
Interviews with a sample of donors
Two surveys: PCB and general
7
The consultation document



Structured according to the
evaluation questions
Statement of hypothesis and our
finding
Bulleted key statements and brief
supporting text
8
Health warning!



This is a preliminary analysis
The team is still cross-referencing
documents and interview notes
This workshop is part of the
evaluation process and statements
are designed to help stimulate
discussion
9
Questions to guide the evaluation



Do the findings and statements in
the document resonate with your
own experience?
If not, how do they differ and what
evidence can you direct the team to
review?
Which of the findings offer scope for
strategic recommendations?
10
End
11