Transcript Slide 1

Performance Measurement and PM-OTOOL
Presented at the Abandoned Infants Assistance
Grantee Kick-Off Meeting
Washington, DC
December 4, 2008
icfi.com
© 2006 ICF International. All rights reserved.
$$, Mission, Guidance
Resource and Information Flow
Congress
Federal Program
Grantee
2
icfi.com
Context: Accountability
• Federal Context
 Government Performance and Results Act (GPRA)
 The President’s Management Agenda
 Program Assessment Rating Tool (PART)
• Agency Context




Specify key results based on agency strategic plan
Measure achievement of results by programs
Apply performance standards
Implement system to collect and report program results
3
icfi.com
Focus of Accountability
Designed to measure five Children’s Bureau discretionary
grant programs:
•
•
•
•
•
Abandoned Infants Assistance
Adoption Opportunities
CAPTA Research and Demonstration Projects
Child Welfare Training
Infant Adoption Awareness Training
Does not measure individual grant performance.
4
icfi.com
Measurement and Evaluation
Feature
Performance
Measurement
Evaluation
Question
How much?
What does it mean?
Example
Game score
Game analysis
Offers
A tally
Causality
Timeframe
Continuous (Ongoing)
Interval (Discrete)
Cost
Less expensive
More expensive
Performance measurement is necessary, but not
sufficient, for evaluation.
5
icfi.com
Elements of a Logic Model
Problem
Subproblem
Activities
Tasks
conducted by
grantee’s
staff,
subcontractor
or volunteers.
Outcomes
Outputs
Products
and
services
delivered.
Activities are
directly linked
to outputs.
Changes in individuals, agencies,
systems, and communities.
Outcomes may be intended or
unintended.
Short-Term
Intermediate Long-Term
Learning
Awareness
Knowledge
Attitude
Skills
Opinions
Aspirations
Motivations
Action
Behavior
Practice
Policies
Social Action
DecisionMaking
Conditions
Social
Economic
Civic
Environment
Adapted from: GAO-02-923 –Strategies for Assessing How Information Dissemination Contributes to Agency Goals; GAO-03-9 –
Efforts to Strengthen the Link between Resources and Results at the Administration for Children and Families; GAO/GGD-00-10 –
Managing for Results: Strengthening Regulatory Agencies' Performance Management; Taylor-Powell, E. (2000). A Logic Model: A
Program Performance Framework. University of Wisconsin-Cooperative Extension Program Evaluation Conference.
6
icfi.com
Elements of a Logic Model
• \
Problem
Subproblem
Activities
Tasks
conducted by
grantee’s
staff,
subcontractor
or volunteers.
Outcomes
Outputs
Products
and
services
delivered.
Activities are
directly linked
to outputs.
7
Changes in individuals, agencies,
systems, and communities.
Outcomes may be intended or
unintended.
Short-Term
Intermediate Long-Term
Learning
Awareness
Knowledge
Attitude
Skills
Opinions
Aspirations
Motivations
Action
Behavior
Practice
Policies
Social Action
DecisionMaking
Conditions
Social
Economic
Civic
Environment
icfi.com
Elements of a Logic Model
Problem
Subproblem
Activities
Tasks
conducted by
grantee’s
staff,
subcontractor
or volunteers.
Outcomes
Outputs
Products
and
services
delivered.
Activities are
directly linked
to outputs.
8
Changes in individuals, agencies,
systems, and communities.
Outcomes may be intended or
unintended.
Short-Term
Intermediate Long-Term
Learning
Awareness
Knowledge
Attitude
Skills
Opinions
Aspirations
Motivations
Action
Behavior
Practice
Policies
Social Action
DecisionMaking
Conditions
Social
Economic
Civic
Environment
icfi.com
Roles
• Children’s Bureau
• Developed performance measures
• Review and approve indicator selections and data submissions
• Analyze and submit aggregated performance data to higher levels
• Grantees
• Use the Performance Measurement Online Tool (PM-OTOOL) to select
performance indicators and report data
9
icfi.com
Indicator Selection
• Grantees must select at least one indicator from each of
the following categories:
• Outputs
• Short-term outcomes
• Intermediate outcomes
• Grantees are encouraged, however, to select as many
indicators as are applicable to their projects.
10
icfi.com
Data Reporting
• Grantees report performance data twice per year:
• Data are due April 30 for the period of October 1 – March 31
• Data are due October 31 for the period of April 1 – September 30
• Grantees can also upload their semi-annual and final
reports via PM-OTOOL
• Note: This is not the official way to submit reports. You should continue
to submit your reports in the manner designated by your FPO, but you
are encouraged to also upload the report to PM-OTOOL so your FPO
can have an electronic copy.
11
icfi.com
Contact Information
For more information about PM-OTOOL and the performance
measurement process, please contact:
Matthew Shuman, MSW
ICF International
[email protected]
703-279-6257
PM-OTOOL web address: http://cbportal.acf.hhs.gov/pm-otool/
12
icfi.com