Transcript Document

Evaluating Policy and Advocacy Grants
Tanya Beer, The Colorado Trust
Ehren Reed, Innovation Network
The State of Advocacy
Evaluation
 Until recently:
Policies won/lost
 Anecdotal support
 Disconnected field

 No structured way to connect one’s actions
with desired impacts
Slide 2
Advocacy vs. Program Evaluation
1. Time Frame
 Policy change may take 5, 10, 15 years
 Grants are made on an annual basis
2. Complexity
 Involves much more than changing policies
 Many players: allies and opponents
Slide 3
Advocacy vs. Program Evaluation
3. Role of External Factors
 Many factors will be outside of your control
 Watch for “windows of opportunity”
4. Shifting Strategies and Milestones
 Pay attention to your environment
 Strategies and outcomes will need to be adjusted
Slide 4
What’s driving the evaluation?
Assessing impact
 Retrospective approach
 Pros & Cons
Capacity building and strategic learning
 Real time approach
 Pros & Cons
Slide 5
Defining success:
Changing the Landscape
http://www.flickr.com/photos/farlane/35902996/
Slide 6
Defining success:
Changing the Landscape
Implement
Champion
Fund
Support
Pass
Aware
Draft
http://www.flickr.com/photos/jason_burmeister/2082521273/
Slide 7
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
Slide 8
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
http://www.flickr.com/photos/kumon/1103892455/
Slide 9
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
http://www.flickr.com/photos/kumon/1103892455/
Slide 10
http://www.flickr.com/photos/53366513@N00/67046506/
Defining success:
A Climate for Change
http://www.flickr.com/photos/craighatfield/376122220/
Slide 11
Defining success:
Flexibility
http://www.flickr.com/photos/craighatfield/376127650/
Slide 12
Defining success:
Movement Building
Slide 13
http://www.flickr.com/photos/roblisameehan/1517897844/in/set-72157602324899031/
Defining success:
Movement Building
Aware
Support
http://www.flickr.com/photos/krossbow/189056285/
Champion
Slide 14
Defining success:
Sustaining Effectiveness
Slide 15
http://www.flickr.com/photos/glennharper/219589534/
Defining success:
Achieving Impact
http://www.flickr.com/photos/batega/1310456660/
http://www.flickr.com/photos/farlane/127551550/
Slide 16
Data Collection Tools
 Monitoring and Tracking
 Qualitative Support
 Unique Methods
Slide 17
Who will do the evaluation?
 Internal vs. External Evaluators






Purpose
Cost
Capacity
Sustainability
Objectivity
Expertise
 Consider an external/internal combination
Slide 18
Communication and Reporting
 Changing the way we talk
 Developing formal and informal reports
 Improving communication with the evaluator
Slide 19
Lessons and Challenges
 Clarity of purpose
 General operating support
 Realistic timeframes and expectations
Slide 20