Transcript Workshop title - Habitat for Humanity of Ohio

Presentation to Ohio SSO Conference
What We Measure Matters:
Moving From Outputs to Impact
Stephen Seidel, HFHI
Wednesday, November 12, 2014
Jul-15
1
Jul-15
2
Charity Navigator Concept Note –
Results Reporting Evaluation Criteria
• Five Rating Criteria
1. Alignment of mission, Solicitations,
Resources
2. Results Logic and Measures
3. Validators
4. Constituent Voice
5. Published Evaluation Reports
Jul-15
3
Charity Navigator Results Logic
and Measures
Model Test – 4 questions
• Is Logic Model Plausible?
• Is there an indication of how much
activity is needed to produce the results?
• Is Logic Model based on reasonable
evidence?
• Are there measures for outputs and
outcomes and a plan for collecting them?
Jul-15
4
Logic Model Development Guide
Program Implementation Template
INPUTS/
RESOURCES
ACTIVITIES
In order to
accomplish our
set of activities,
we will need the
following:
In order to
address our
Problem, or
asset, we will
carry out the
following
activities:
OUTPUTS
SHORTTERM
OUTCOMES
LONG-TERM
OUTCOMES
IMPACT
Once these
activities are
accomplished,
we expect that
they will
produce the
following:
Once these
outputs are
produced, we
expect that
they
will lead to the
following
changes within
the first 12
months:
Once these
short-term
outcomes are
achieved, we
expect that
they will lead to
the following
changes in 1–5
years:
If these longterm outcomes
are achieved,
we expect that
they will lead to
the following
changes in 7–
10 years:
IBOD
Program
Committee May 2013
6
HFH Development Approach
Outputs
Outcomes
Household/Community
Access
to
Finance
Access
to
Tenure
Access to
Products
&
Services
Improved
housing
conditions
Community
Development
Market
Development
Advocacy
Broader
Sector
actors
& advocates
Society
Impact
Volunteers
&
Advocates
Family & community
HEALTH & SAFETY
Family & community
EDUCATION
Family & community
LIVELIHOODS / ASSETS
Contribution
Sector
Impact
Policy &
System
change
Scale
Attribution
Community
Impact
Awareness
Poverty
Reduction
ImpactInitiative-November2012
-7-
Main Pillars of Impact Strategic Initiative
Promote Logic
model
approach
Develop
system for
capturing data
Identify
research
The Global
Metrics Tool
Validate the
linkage between
HFH
interventions
and likely
outcomes
Outputs
Outcomes
Impact
8
7/18/2015
9
GOAL EXAMPLE: BUILD A SUSTAINABLE ORGANIZATION
Mobilize resources and steward them faithfully
Strategic objective F.1: Fund the mission
Outputs
Resources raised to meet strategic
goals.
Indicators
Outcomes
HFHI works
With NOs
and affiliates
to meet
requirements
Short
Medium
Long
HFHI
requirements
Industry
standards
Best
practices
Indicators
Indicators
Indicators
HFHI board and senior leadership
regularly track and review the
following:
Cash inflows from all sources to
fund the mission, including:
A.
B.
C.
Resources raised from in-country
resource development efforts.
Resources transferred within HFHI
by very high-income countries and
U.S. tithe contributions.
Other income.
Jul-15
Identified required
indicators met and
plan to meet
industry standards.
10
Identified industry
standard indicators
met and plan to
meet
best practices.
Identified best
practices indicators
met.
GOAL EXAMPLE: BUILD COMMUNITY IMPACT
Improve housing conditions
Strategic objective 1.1: Serve families through sustainable construction and housing support services
Output
Sustainable construction and
Housing Support Services
Outcomes
Linking data
with intended
outcomes
Indicators
Short
Improved quality
of housing
conditions
Medium
Reduction in
housing-related
disease
Long
Improved health,
education,
livelihood/assets
Decreased
absenteeism
# of new homes
# of rehabs
Indicators
# of repairs
Percent of
interventions
meeting local building
codes or Housing
Quality Standards.
# of incremental constructions
# of home improvements
# of construction technical
assistance provided
Housing Quality
Standards include:
1. Design
2. Durability
3. Secure tenure
4. Water
5. Sanitation
# of trainings
# secured tenure
Jul-15
11
Indicators
Aligned with thirdparty research
Indicators
Aligned with thirdparty research
GOAL EXAMPLE: BUILD SECTOR IMPACT
Partner to increase shelter access
Strategic objective 2.2: Promote policies and systems that advance access to adequate, affordable housing
Outcomes
Short
Sustainable construction and
Housing Support Services
Medium
Reduction in
housing-related
disease
Indicators
Long
Improved health,
education,
livelihood/assets
Decreased
absenteeism
# of new homes
# of rehabs
Indicators
# of repairs
Percent of
interventions
meeting local building
codes or Housing
Quality Standards.
# of incremental constructions
# of home improvements
# of construction technical
assistance provided
Housing Quality
Standards include:
1. Design
2. Durability
3. Secure tenure
4. Water
5. Sanitation
# of trainings
# secured tenure
Jul-15
12
Indicators
Aligned with thirdparty research
Indicators
Aligned with thirdparty research
GOAL EXAMPLE: BUILD SOCIETAL IMPACT
Inspire action to end poverty housing
Strategic objective 3.1: Serve as a leading voice in growing awareness of housing as a critical foundation for breaking the cycle of poverty
Outcomes
Short
Sustainable construction and
Housing Support Services
Medium
Reduction in
housing-related
disease
Indicators
Long
Improved health,
education,
livelihood/assets
Decreased
absenteeism
# of new homes
# of rehabs
Indicators
# of repairs
Percent of
interventions
meeting local building
codes or Housing
Quality Standards.
# of incremental constructions
# of home improvements
# of construction technical
assistance provided
Housing Quality
Standards include:
1. Design
2. Durability
3. Secure tenure
4. Water
5. Sanitation
# of trainings
# secured tenure
Jul-15
13
Indicators
Aligned with thirdparty research
Indicators
Aligned with thirdparty research
PROGRAM LOGIC FOR RESULTS-BASED MANAGEMENT
Example:
1. Inputs
•
•
•
•
2. Activities
Volunteers
Materials
Donations
Resources
Jul-15
3. Outputs
• Wallraisings
• Blitz builds
• Construction
• Completed
home(s)
14
4. Outcomes
• Access to
water and
sanitation
facilities
• Improved
health
conditions
5. Impact
• How we
contribute
to wider
change
• How we
directly
impact
wider
change
Logic Model Exercise
• Populate Logic Model Development
guide – teams of two
• Large group discussion
• Small teams (of four) develop draft logic
models
• Share with large group
• Discuss
Jul-15
15
HFH Development Approach
Outputs
Outcomes
Household/Community
Access
to
Finance
Access
to
Tenure
Access to
Products
&
Services
Improved
housing
conditions
Sector
Impact
Market
Development
Advocacy
Policy &
System
change
Broader
Sector
actors
& advocates
Society
Impact
Volunteers
&
Advocates
Scale
Family & community
HEALTH & SAFETY
Family & community
EDUCATION
Family & community
LIVELIHOODS / ASSETS
Awareness
Poverty
Reduction
ImpactInitiative-November2012
Contribution – validated by RESEARCH
Community
Development
Attribution
Community
Impact
-16-
Main Pillars of Impact Strategic Initiative
Promote Logic
model
approach
Develop
system for
capturing data
Identify
research
The Global
Metrics Tool
Validate the
linkage between
HFH
interventions
and likely
outcomes
Outputs
Outcomes
Impact
17
Global Metrics Tool (GMT): http://impact.habitat.org/
18
Main Pillars of Impact Strategic Initiative
Promote Logic
model
approach
Develop
system for
capturing data
Identify
research
The Global
Metrics Tool
Validate the
linkage between
HFH
interventions
and likely
outcomes
Outputs
Outcomes
Impact
19
Research Contributes to Logic Models
• Validates link between outputs and
outcomes
• Attribution – direct causality of
intervention to a particular outcome
• Contribution – one component of several
that produces a particular outcome
• Attributable outcomes: Short term
• Contributed outcomes: Long term
Jul-15
20
Research Resources
• MacArthur Foundation:
http://www.macfound.org/press/article/howhousing-matters-research-briefs
• Joint Center for Housing Studies, Harvard
University: http://www.jchs.harvard.edu
• Urban Institute: www.urban.org
• National Housing Conference, center for
Housing Policy: www.nhc.org
• Federal Reserve Bank of San Francisco:
http://www.frbsf.org/community-development/
Jul-15
21
Research Contributes to Logic Models
Jul-15
22