Transcript Document 7485286

Good Practice Guidelines and Examples
for Evaluating Global and Regional
Partnership Programs (GRPPs)
Mark Sundberg, Chair
Manager, IEG – World Bank
November 13, 2009
http://www.globalevaluations.org
Objectives of the Session
►To present good practice guidelines and examples for
evaluating Global and Regional Partnership Programs
(GRPPs), drawn from a systematic review of 60 recent
evaluations
►The first of two multi-paper sessions on this topic:
•
•
Today’s session on “substance” – for evaluators who are
conducting such evaluations
Tomorrow’s session on “process” – for board members and
program management who are planning, designing, and
overseeing such evaluations
GRPPs Are Growing Rapidly
in Number and Size
►GRPPs have become increasingly important instruments
of organized collective action in a globalizing world,
particularly in environment, health, trade and finance
►For example, the World Bank Group is involved in about
125 global programs and 45 regional programs, which
together spent around $6.0 billion in fiscal year 2009
►Bilateral donors are the principal financiers, followed by
foundations (Gates, Rockefeller, Ford, etc.)
►International organizations – such as FAO, UNICEF and
WHO – are contributing legitimacy and expertise
3
What are GRPPs?
►Programmatic partnerships in which:
• The partners contribute and pool resources (financial,
technical, staff, reputational, etc.) toward achieving agreed
objectives over time
• The activities of the program are global, regional, or multicountry (not single country) in scope
• The partners establish a new organization with a governance
structure and management unit to deliver these activities.
►The majority of GRPPs are housed in existing (host)
organizations, such as the World Bank
4
IEG’s Work on Developing Consensus
Standards for Evaluating GRPPs
►Collaboration with OECD/DAC Evaluation Network
►GRPP Evaluation Sourcebook, published 2007
• Drew on existing evaluation principles and standards
• Adapted standards to special characteristics of GRPPs
• Reviewed at a Consultative Stakeholder Workshop in Sept 2006
►GRPP Evaluation Guidebook
•
•
•
•
•
5
Builds on the Sourcebook
Provides good-practice guidelines and examples
Draws from a systematic review of 60 GRPP evaluations
Supported by a Technical Advisory Panel
First draft for external review, by end December 2009
Other IEG Work on GRPPs
►Global program reviews (GPRs)
• Reviews of programs based on an existing
evaluation
• Parallel to IEG’s review process for investment
projects and country programs
• 12 completed in FY07, FY08 and FY09; 6 more
ongoing in FY10
►Providing advice on evaluation planning, including
commenting on draft TORs for GRPP evaluations
6
Representative Sample of 60 Programs,
by Type and Location . . .
Housed in
World
Bank
Total
Knowledge and
advocacy networks
2
9
9
20
Providing country-level
technical assistance
8
10
3
21
Financing country-level
investments for NPGs
1
4
3
8
Financing country-level
investments for GRPGs
Financing global/regional
investments for GRPGs
Total
7
Housed in
Independent
Another
Legal
Organization
Entity
2
2
1
3
5
9
12
28
20
60
. . . And by Size and Maturity
Before
1990
1991–2000
2001–
present
Total
< $5 million
1
12
5
18
$5-10 million
3
8
4
15
$10-20 million
2
8
2
12
$20-50 million
2
2
2
6
$50-100 million
2
2
CGIAR
GAVI, GEF,
UNAIDS
Global
Fund
5
11
35
14
60
>$100 million
Total
8
4
Outline of This Session
►Chris Gerrard: Assessing Relevance
►Lauren Kelly: Assessing Efficacy
►Anna Aghumian: Assessing Governance and
Management
►Elaine Ooi: Assessing Sustainability of Outcomes
9
12 Minutes for Each Presentation.
Only questions of clarification after each
presentation, followed by comments and
questions after all four presentations have been
completed.