Transcript ADCANP/CTF Program Evaluation: Grantee Training August 30

ADCANP/CTF
HHS/OFA Partner Program
Performance Measurement
Training
November 16, 2012
Debra Nelson-Gardell, Ph.D., LCSW
M. Felicia Woerner, MA
The University of Alabama School of Social Work
Overview of the Contract
Structure
•
HHS/OFA


ICF International
DCAP/CTF
•
•
Partner Programs
University of Alabama School of Social Work
Program Evaluation Team
UA Evaluation Project Mission
•
To support DCAP/CTF in the
successful delivery of child abuse
and neglect prevention services
through an effective, efficient, and
feasible data collection,
management, analysis, and reporting
system.
All data points listed are taken
directly from the documents
provided by ICF International
for performance
measurements purposes.
HHS/OFA Performance
Measure Implementation
•
Two stages of implementation:


Stage 1 (complete)
Stage 2 (effective December 1)
HHS/OFA Performance
Measure Implementation –
Stage 1
•
Additional client-level data:

•
Partner programs began collecting
enrolled and completed dates if they
had not already.
Additional agency-level data:

Several new data points were added
and listed for all programs and for each
authorized activity .
This stage is complete.
HHS/OFA Performance
Measure Implementation –
Stage 2
•
Additional client-level data:


New client demographic form (required)
New outcome instruments (required)
•
•
Reduction in client-level data:

•
Drafts
Contact hours, contact sessions, parental status
Reduction in agency-level data:


Number of children with special
needs/disabilities served
Number of fathers temporarily or permanently
unemployed
This stage is effective December 1, 2012.
HHS/OFA Partner Program
Performance Measurement
Workbook
•
This workbook will be updated two
weeks after today’s meeting.


•
•
Instruments attached are drafts.
User Guide will be available once
website updates are complete.
The entire updated workbook will be
emailed upon completion.
What’s in the workbook?
New Client & Agency Forms
•
•
•
Available the first week of January
for the December 2012 monthly
report
What will they look like?
HHS/OFA User Guide forthcoming
Important Definitions
•
Pre-test

•
Post-test


•
Any instrument administered beyond the two
week pre-test time-limit
Administered to clients at end of service delivery
(as determined by your program)
Enrolled

•
Administered at intake or during first
session/meeting
Clients have completed intake process
Completed

Clients have completed core requirement as
determined by program
Important Reminders
•
•
Due dates have changed!
Read the website User Guide.

It will save you time.
•

Supporting your ability to serve clients
It will save evaluation staff time.
•
•
Supporting timely report generation
Supporting potential website enhancements
Important Reminders
•
How do I know my program’s
monthly report has been successfully
submitted and received by the UA
evaluation team?
•
•
The online forms tell you.
How do I make corrections?


Send email detailing needed corrections
to [email protected].
Include either your program’s contract
number and/or agency ID.
Outcome Data Analysis
•
•
•
•
Your diligence in obtaining and
entering data is crucial.
If enough data are not entered, we
cannot do a meaningful analysis.
This affects the credibility of what
ADCANP can claim regarding the
effectiveness of its programs.
Your actions affect everyone!
We need your feedback!
Please provide feedback on the 3 posttest drafts via email by November 26,
2012.
(Don’t forget your program’s contract number or
agency number)
Thank you!
•
Debra Nelson-Gardell, Principle
Investigator


•
M. Felicia Woerner, Project Manager


•
[email protected]
205-348-2990
[email protected]
205-348-8011
This presentation will be available on
the evaluation website in January
2013.