Transcript Document
Evaluating Policy and Advocacy Grants
Tanya Beer, The Colorado Trust
Ehren Reed, Innovation Network
The State of Advocacy
Evaluation
Until recently:
Policies won/lost
Anecdotal support
Disconnected field
No structured way to connect one’s actions
with desired impacts
Slide 2
Advocacy vs. Program Evaluation
1. Time Frame
Policy change may take 5, 10, 15 years
Grants are made on an annual basis
2. Complexity
Involves much more than changing policies
Many players: allies and opponents
Slide 3
Advocacy vs. Program Evaluation
3. Role of External Factors
Many factors will be outside of your control
Watch for “windows of opportunity”
4. Shifting Strategies and Milestones
Pay attention to your environment
Strategies and outcomes will need to be adjusted
Slide 4
What’s driving the evaluation?
Assessing impact
Retrospective approach
Pros & Cons
Capacity building and strategic learning
Real time approach
Pros & Cons
Slide 5
Defining success:
Changing the Landscape
http://www.flickr.com/photos/farlane/35902996/
Slide 6
Defining success:
Changing the Landscape
Implement
Champion
Fund
Support
Pass
Aware
Draft
http://www.flickr.com/photos/jason_burmeister/2082521273/
Slide 7
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
Slide 8
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
http://www.flickr.com/photos/kumon/1103892455/
Slide 9
Defining success:
Detractors and Opponents
http://www.flickr.com/photos/gillesgonthier/2034591440/
http://www.flickr.com/photos/kumon/1103892455/
Slide 10
http://www.flickr.com/photos/53366513@N00/67046506/
Defining success:
A Climate for Change
http://www.flickr.com/photos/craighatfield/376122220/
Slide 11
Defining success:
Flexibility
http://www.flickr.com/photos/craighatfield/376127650/
Slide 12
Defining success:
Movement Building
Slide 13
http://www.flickr.com/photos/roblisameehan/1517897844/in/set-72157602324899031/
Defining success:
Movement Building
Aware
Support
http://www.flickr.com/photos/krossbow/189056285/
Champion
Slide 14
Defining success:
Sustaining Effectiveness
Slide 15
http://www.flickr.com/photos/glennharper/219589534/
Defining success:
Achieving Impact
http://www.flickr.com/photos/batega/1310456660/
http://www.flickr.com/photos/farlane/127551550/
Slide 16
Data Collection Tools
Monitoring and Tracking
Qualitative Support
Unique Methods
Slide 17
Who will do the evaluation?
Internal vs. External Evaluators
Purpose
Cost
Capacity
Sustainability
Objectivity
Expertise
Consider an external/internal combination
Slide 18
Communication and Reporting
Changing the way we talk
Developing formal and informal reports
Improving communication with the evaluator
Slide 19
Lessons and Challenges
Clarity of purpose
General operating support
Realistic timeframes and expectations
Slide 20