Transcript Document

DCF Kidstat: How PerformanceStat can
Work for You
Fredi-Ellen Bove
Division of Safety and Permanence Administrator
Department of Children and Families
1
The Importance of Data
“In God we trust;
all others must bring data”
•
--W. Edwards Deming
•
dcf.wisconsin.gov
Presentation Topics
I.
What is KidStat/PerformanceStat?
II.
Overview of DCF KidStat
III. Does KidStat Work? A Case Study
IV. Lessons Learned and Benefits
dcf.wisconsin.gov
3
What is KidStat/PerformanceStat?
• The DCF KidStat is a type of PerformanceStat system
• PerformanceStat is a leadership strategy designed to achieve specific public
purposes. PerformanceStat:
 Involves regular, frequent, integrated meetings that include chief
executive, the leadership team, and directors of subunits
 Uses current data to analyze specific, previously defined performance
measures;
 Provides feedback on recent progress compared with targets
 Follows up on previous decisions and commitments
 Promotes learning from efforts to improve performance
 Identifies and seeks to solve performance-deficit problems
 Sets and achieves the next performance targets
(From Robert Behn, The PerformanceStat Potential)
dcf.wisconsin.gov
History of PerformanceStat/KidStat
• First PerformanceStat system, called “CompStat”, started in New York
Police Department in 1994
• Another relatively early and signficant adopter was Baltimore, Maryland
which implemented “CitiStat” in 2000
• Wisconsin DCF initiated KidStat in 2009
• Many public agencies at the state and local levels now use a
PerformanceStat system
dcf.wisconsin.gov
Overview of DCF KidStat
•
A KidStat system is in place for each Division
•
The Division, in collaboration with the Secretary’s Office has identified the results
it is seeking to achieve and the performance measures for those results
•
Bimonthly meetings are held for each Division’s KidStat
 Members of the Secretary’s Office, managers of key support functions (e.g.,
HR, IT, Budget), and Division Administrator, managers, and staff attend
 For the Division of Safety and Permanence KidStat, which addresses child
welfare issues, counties or other external partners often attend
•
Meetings are intended to be collaborative problem-solving forums
•
Data on each performance measure is compiled by an office external to the Division
 Division reviews the data prior to the meeting
 Data is displayed via powerpoint at the meeting and discussed
Division of Safety and Permanence KidStat Results
and Core Performance Measures
•
Children are safe from abuse and neglect
 How timely are initial contacts completed?
 How timely are Initial Assessments (IAs) completed?
 What percentage of monthly caseworker contacts are made in a timely manner?
 How many children are victims of maltreatment while in out-of-home care?
 What percentage of children who are substantiated victims of maltreatment are
not revictimized within 6 months?
dcf.wisconsin.gov
Division of Safety and Permanence KidStat Results
and Core Performance Measures
•
Children achieve permanency
 At what rate are children reaching legal permanency?
 Of the children who discharge to reunification, what percentage do so within
12 months?
 How many children are discharging to Guardianship and Subsidized
Guardianship?
 Of the children who discharge to adoption, what percentage do so within 24
months?
 Of the children who have finalized adoptions, what is the average length of
time from removal to adoption?
dcf.wisconsin.gov
Division of Safety and Permanence KidStat Results
and Core Performance Measures
•
Children experience stability in their out-of-home placement
 What percentage of children experience placement stability in care for 0-12
months?
 In BMCW, how many children experience 3 or fewer placements while in outof-home care (as defined by the lawsuit agreement)?
•
Children spend minimal time in out-of-home care
 What percent of children re-enter out-of-home care within 12 months from the
date of discharge?
dcf.wisconsin.gov
Division of Safety and Permanence KidStat
Measures
•
Other measures added on a quarterly basis
 How timely is the Critical Incident 90 day summary report process?
 How many children are aging out of care?
•
On annual basis, review WI performance versus other states
•
Additional analysis that represents a “deeper data dive” is often included
dcf.wisconsin.gov
Benchmarks
•
Benchmarks used
 State requirements (e.g., 60 days for completion of Initial Assessment)
 Federal requirements (e.g., 90% compliance for monthly caseworker contacts)
 Federal targets (e.g., 76.1% of children who discharge to reunification do so
within 12 months)
•
Other possible benchmarks
 Peer Group Performance
 Best Practice
dcf.wisconsin.gov
Additional Features of DSP KidStat
•
In addition to core measures, a special focus area is presented at each KidStat
 A pilot program or program that is not yet statewide (e.g., Trauma Project); due
to small scale the program effects are not reflected in the broad-based KidStat
measures
 Programs that are outside the scope of the current KidStat measures (e.g.,
educational outcomes of children in out-of-home care)
•
External partners, such as counties and other state agencies, are invited to
participate in the KidStat meetings
•
DSP managers and relevant staff meet in the month in between KidStat to discuss
follow-up from previous KidStat and prepare for upcoming KidStat
Does KidStat Work?
Re-entry Case Study
Safety and Permanence
Statewide
Target Direction:
Children spend minimal time in out of home care.
How many children re-enter OHC within 12 months from the date of discharge?
Analysis
Reentry within 12 Months of Reunification
25%
In the month of October:
•
The federal 25th percentile target of
9.9% is represented by the red line.
•
Statewide performance of
20.6% (blue line) did not
achieve the target in October.
20%
15%
10%
•
Only one of the 18 driver counties met
the 25th percentile standard on this
measure:
•
Rock 8.6%
•
All five of the largest counties failed to
achieve the 25th percentile target:
•
Racine 14.4%
•
Brown 16.7%
•
Milwaukee 19.3%
•
Dane 22.5%
•
Kenosha 25.2%
5%
0%
Oct-10 Nov-10 Dec-10 Jan-11 Feb-11 Mar-11 Apr-11 May-11 Jun-11 Jul-11 Aug-11 Sep-11 Oct-11
Milw aukee 15.4% 15.6% 15.6% 16.7% 17.9% 18.4% 18.8% 19.0% 19.2% 19.0% 18.2% 18.5% 19.3%
BOS
19.2% 19.4% 19.0% 18.7% 19.2% 20.5% 20.7% 20.8% 21.5% 21.4% 21.3% 21.5% 20.9%
Statew ide
18.2% 18.4% 18.1% 18.2% 18.9% 20.0% 20.2% 20.4% 21.0% 20.9% 20.6% 20.9% 20.6%
Statewide, Wisconsin did NOT achieve this
measure for October 20.6% > 9.9%.
14
Does KidStat Work?
Re-entry Case Study
•
KidStat Re-entry measure in 2011
 WI performance consistently at 20%, versus federal benchmark of 9.9%
 Re-entry exposes children to repeated trauma, which hinders the healthy
development of the brain and has lifelong negative physical health and
social-emotional consequences
•
DSP engaged in deeper data dive
 Analyzed whether high re-entry was driven by juvenile justice population
 Analyzed data entry errors
 Analysis showed that after accounting for these factors, high re-entry rate
remained for child welfare population
•
Concluded that a stronger program intervention was needed
 2012: DCF applied for and received federal approval to implement a 12month Post-Reunification Support program through a Title IV-E waiver
DSP KidStat: Lessons Learned
•
Secure commitment by organization’s leadership to PerformanceStat
•
Develop measures that are meaningful and aligned with organization’s strategic
plan
•
Develop a culture that uses PerformanceStat meetings as problem-solving
meetings where entire agency owns the performance and seeks improvement
 “PerformanceStat is not about them, PerformanceStat is about us” (Robert
Behn)
•
Seek to integrate PerformanceStat into ongoing program and practice
 Involve staff in PerformanceStat meetings and follow-up
DSP KidStat: Lessons Learned
• Use the PerformanceStat measures to drive deeper data analysis
 Focus additional analysis on priority issues
 Avoid giving undue attention to a single monthly change, as it may not
represent a trend
•
Determine meeting frequency that balances workload of preparation with benefit
of maintaining focus and momentum
•
Participation in PerformanceStat meetings by external partners brings added
insights
•
Understand limitations of PerformanceStat
 Does not pick up changes caused by pilot programs, due to small scale
 Does not capture all aspects of outcomes, (e.g., quality of work)
Benefits of KidStat
•
Effectively identifies areas of performance deficits and strengths
•
Strengthens focus at all levels of the organization on priority areas needing
improvement
•
Can be a tool to facilitate productive problem-solving and collaboration across
units to improve the priority performance areas
•
Fosters overall culture change in the organization to be more data-driven in all
aspects of work
Implementing PerformanceStat at the County Level
•
Implementing PerformanceStat at the county level has the same potential benefits
as at the state level
•
Performance on many child welfare measures are reported by county on the DCF
dashboards on the web
•
DCF dashboards also provide data that can be used as benchmarks:
 Federal benchmarks
 Wisconsin statewide performance
 Performance by a peer group of WI counties (e.g., similar sized counties)
•
Let a PerformanceStat system work for you!
Questions
Comments
Discussion
dcf.wisconsin.gov