Transcript Document

Overview and Introduction
to RAPID Lessons and Tools
John Young
6 lessons from our work
2
Policy processes
and social
realities are
complex
Research plays
a minor role in
policy and
practice
But it is possible
for research to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary!
Policy processes are not...
Identify the problem
Commission research
Analyse the results
Choose the best option
Establish the policy
Implement the policy
Evaluation
3
Policy processes are more like ...
Cabinet
Donors
Policy
Formulation
Agenda
Setting
Parliament
Decision
Making
Civil Society
Monitoring and
Evaluation
4
Private
Sector
Ministries
Policy
Implementation
Policy and complexity
• Interconnected
• Feedback
• Emergence
•
•
•
•
•
•
•
5
Nonlinearity
Sensitivity
Changing
Edge of chaos
Adaptive agents
Self-organising
Co-evolution
The gap between
research and policy
gap
Research
Policy
Bridge
6
No gap between research and policy
Crowded
Technocratic
networks
Universities
Political
NGOs
Ideological
parties
think tanks
Think
Internal Regulatory
tanks
bodies
think
tanks
UN Think
Lobbies
tanks
Executive
Public
think tanks
corporations
Map
The six lessons
8
Policy processes
and social
realities are
complex
Evidence plays a
minor role in
policy and
practice
But it is possible
for research to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary!
Policy makers are…
…practically incapable of
using evidence because of
the 5 Ss…
• Speed
• Superficiality
• Spin
• Secrecy
• Scientific Ignorance
Vincent Cable – Lib. Democrat MP & Shadow Minister of Finance
More at: www.odi.org.uk/RAPID/Meetings/Evidence
9
There are many factors
Experience &
Expertise
Pragmatics &
Contingencies
Lobbyists &
Pressure Groups
Judgement
Evidence
Resources
Habits &
Tradition
10
Values and
Policy
Context
Source: Phil Davies Impact to
Insight Meeting, ODI, 2005
Different notions
of evidence
Researchers
Policy Makers
• ‘Scientific’ (Context free)
• Colloquial (Contextual)
• Proven empirically
• Anything that seems
reasonable
• Theoretically driven
• As long as it takes
• Caveats and
qualifications
11
• Policy relevant
• Timely
• Clear Message
Source: Phil Davies Impact to Insight Meeting, ODI, 2005
The six lessons
Policy processes
and social
realities are
complex
Research plays
a minor role in
policy and
practice
But it is possible
for evidence to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary!
Health Care in Tanzania
“The results of household
disease surveys informed
processes of health service
reform which contributed to a
43 and 46 per cent reduction
in infant mortality between
2000 and 2003 in two districts
in rural Tanzania.”
TEHIP Project, Tanzania: www.idrc.ca/tehip
Some IE Examples
• Progresa-Oportunidades (2004)
– IFPRI – Mexican Government
– Direct impact on programme
– Popularised RCTs
• Deworming in Kenya (2004)
– International Child Support Africa + Kenyan
Government
– JPAL
• Microcredit in Bangladesh (2008)
– Highly contested
– Political controversy re Microcredit
14
The six lessons
Policy processes
and social
realities are
complex
Research plays
a minor role in
policy and
practice
But it is possible
for research to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary!
15
An analytical framework
External Influences
Socio-economic and
cultural influences,
donor policies etc
The links between policy
and research communities –
networks, relationships, power,
trust, knowledge etc.
16
The political context – political
and economic structures and
processes, culture, institutional
pressures, incremental vs radical
change etc.
The evidence – credibility, the
degree it challenges received
wisdom, research approaches
and methodology, simplicity of
the message, how it is packaged
etc
A practical framework
External Influences
Politics and
Policymaking
Campaigning,
Lobbying
Scientific
information
exchange &
validation
17
political context
Media,
Advocacy,
Networking
links
Policy analysis, &
research
Research,
learning &
thinking
evidence
The six lessons
Policy processes
and social
realities are
complex
Research plays
a minor role in
policy and
practice
But it is possible
for research to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary!
18
Policy and social entrepreneurs
Storyteller
Engineer
19
Networker
Researcher
Fixer
The six lessons
Policy processes
and social
realities are
complex
Research plays
a minor role in
policy and
practice
But it is possible
for research to
play a role
Must understand
landscape
Policy and social
entrepreneurs
need a set of
skills
Intent is
necessary
20
To maximise impact you need to:
• focus more on policy
• establish different incentives
• establish different systems
• spend more on communications
• engage with different actors
• produce different products
• be ready to seize unexpected policy
opportunities and move very fast
21
Any questions?
RAPID Outcome Mapping Approach
23
Different time, different approaches
Media strategy
Online
communications
Develop a network
or partnership
Academic research
communications
Policy advocacy
coalition
More research
24
Different roles and functions
Message
based on
Ideology, values
or interests
Applied, empirical
Theoretical or
or synthesis
academic research
research
Mode of work
The Media
Independent research
Consultancy
Influence/advocacy
25
.
Applied
research
centers in
Universities
Oxbridge
Internal
think tanks,
ideological
“Independent
centers,
Think tanks”
interest
groups,
Consultancies
NGOs,
lobbies
Political parties
Chief scientific advisors,
Academic/Opinion
leaders
Types of policy change
Procedural
changes
26
The steps
Start by defining
your policy
objectives –
constantly review
them during the
process
27
The RAPID Framework
External Influences
Socio-economic and
cultural influences,
donor policies etc
The links between policy
and research communities
– networks, relationships,
power, competing
discourses, trust,
knowledge etc.
28
The political context –
political and economic
structures and processes,
culture, institutional pressures,
incremental vs radical change
etc.
The evidence – credibility,
the degree it challenges
received wisdom, research
approaches and
methodology, simplicity of
the message, how it is
packaged etc
Political economy analysis
29
The steps
Start by defining
your policy
objectives –
constantly review
them during the
process
30
Identifying audiences
1. Identify all
stakeholders
2. Map them onto the
alignment / interest
matrix
3. Identify who has
power
4. Identify who you
can influence
31
High
General level
of alignment
AIIM Matrix
Develop
enthusiasm
to address
topic
Learn in
partnership
Develop
awareness
and
enthusiasm
Challenge
existing
beliefs
Low
Low
Interest in
specific
topic
High
The steps
Start by defining
your policy
objectives –
constantly review
them during the
process
32
Progress Markers
• Move from initial to more
profound changes in behaviour
• Show transformation in a
single boundary
partner
• More informative than
a single indicator
33
Outcome Mapping
OUTCOME
MAPPING:
Building
Learning and
Reflection into
Development
Programs
Sarah Earl, Fred
Carden, and Terry
Smutylo
http://www.idrc.ca/en/ev-9330-201-1-DO_TOPIC.html
34
The steps
Start by defining
your policy
objectives –
constantly review
them during the
process
35
Force Field Analysis
Your influence
on the force
Positive forces
Negative forces
Plan:
36
4
4
Funds
5
1
CSOs
2
2
Public demand
?
?
?
Minister of
Trade puts
forward propoor trade and
complementary
policy
programme to
the cabinet by
April 2008
Your influence
on the force
MEF
5
*
Time
3
?
?
?
?
5
1
?
?
Assessing internal capacity
Start by defining
your policy
objectives –
constantly review
them during the
process
37
SWOT Analysis
• What type of policy
influencing skills and
capacities do we have?
• In what areas have our staff
used them more effectively?
• Who are our strongest allies?
• When have they worked with
us?
• Are there any windows of
opportunity?
• What can affect our ability to
influence policy?
38
Strengths
Weaknesses
Opportunities
Threats
Monitoring and Evaluating
Start by defining
your policy
objectives –
constantly review
them during the
process
39
Stories
Stories of change
1. Situation
2. A change or challenge
3. Action
4. Result
5. Lesson
40
After Action Review
An after action review asks 4
simple questions:
• What was supposed to happen?
• What actually happened?
• Why was there a difference?
• What can we learn from it?
41
15 minute team
debrief, conducted
in a “rank-free”
environment.
Other tools
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
RAPID Framework
Drivers of Change
Power Analysis
SWOT
Influence Mapping
Force Field Analysis
Start by defining
your policy
objectives –
constantly review
them during the
process
Log Frame (flexible)
Outcome Mapping
Journals or impact logs
Internal monitoring tools
• Policy entrepreneur questionnaire
• SWOT
• Internal performance frameworks
42
AIIM
Stakeholder analysis
Influence Mapping
Social Network Analysis
Force Field Analysis
• Progress Markers
• Opportunities and
Threats timeline
• Policy Objectives
• AIIM
• Force Field Analysis
• Force Field Analysis
•
•
•
•
•
Publications, public relations
Media and events
Negotiation and advice
Develop a network or coalition
Research
Resources
•
Bridging Research and Policy in International Development. An analytical and practical framework.
ODI/RAPID Briefing Paper 1. 2004 - http://www.odi.org.uk/resources/details.asp?
id=159&title=bridging-research-policy-international-development-analytical-practical-framework
•
Helping researchers become policy entrepreneurs. How to develop engagement strategies for
evidence-based policy-making. John Young and Enrique Mendizabal. ODI Briefing Paper 53. 2009 http://www.odi.org.uk/resources/details.asp?id=1127&title=become-policy-entrepreneur-roma
•
3ie Clinic IE Case Studies - ?????
•
Tools for Policy Impact: A Handbook for Researchers, ODI Toolkits, September 2004 http://www.odi.org.uk/resources/details.asp?id=156&title=tools-policy-impact-handbook-esearchers
•
Tools for Knowledge and Learning: A Guide for Development and Humanitarian Organisations ODI
Toolkits, June 2006 - http://www.odi.org.uk/resources/details.asp?id=153&title=tools-knowledgelearning-guide-development-humanitarian-organisations
•
Problem-driven governance and political economy analysis, Good Practice Framework, Verena Fritz,
Kai Kaiser, Brian Levy, World Bank 2009 - http://www.odi.org.uk/events/docs/3791.pdf
•
DFID Political Economy Analysis How To Note – July 2009 - http://www.odi.org.uk/
events/docs/3797.pdf
•
Outcome Mapping: Building Learning and Reflection into Development Programs. Sarah Earl, Fred
Carden, and Terry Smutylo IDRC http://www.idrc.ca/EN/Resources/Publications/Pages/
IDRCBookDetails.aspx?PublicationID=121
•
Knowledge to Policy. Making the Most of Development Research. Fred Carden. IDRC 2009.
http://www.idrc.ca/EN/Resources/Publications/Pages/IDRCBookDetails.aspx?PublicationID=70
•
3ie/ODI Policy Impact Toolkit - http://policyimpacttoolkit.squarespace.com/
Any questions?