Transcript Lessons Learned in Washington State: Implementing and

Lessons Learned in Washington State:
Implementing and Sustaining EvidenceBased Juvenile Justice Programs
Minnesota Juvenile Justice Forum
June 19, 2008
Elizabeth K. Drake
Washington State Institute for Public Policy
www.wsipp.wa.gov
[email protected]
360.586.2767
Washington State Institute for
Public Policy
 Created
in 1983 by the state Legislature
 Mission: Carry out non-partisan research
on projects assigned either by the
legislature or the Institute’s Board of
Directors.



8 legislators
4 higher education provosts or presidents
4 state agency directors
1 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Presentation Outline
 Discuss
Washington State’s experience
with evidence-based juvenile justice
programs
2 of 17
Overview
Quality
Assurance
Research
Costs &
Benefits
Lessons
Learned
Juvenile Justice System in WA
 Determinate


sentencing since 1977
Current offense
Criminal history
 Decentralized


system
County - juvenile court, detention, probation
State - juvenile correctional institutions,
parole; distributes state funds to counties
(Juvenile Rehabilitation Administration, JRA)
3 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Evidence-Based Initiative
 Intensive

probation program in 1995.
Institute conducts outcome evaluation and
results are not good.
 Community
Juvenile Accountability Act
(CJAA) was passed in 1997.

Goal: Reduce crime, cost-effectively, by
establishing “research-based” programs in
the juvenile court.
4 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
CJAA
 A CJAA committee
was established.
 Institute examined literature to identify
programs that reduce recidivism.

Meta-analysis
 Four




CJAA programs were selected.
Functional Family Therapy (FFT)
Aggression Replacement Training (ART)
Coordination of Services (COS)
Multi-Systemic Therapy (MST)
5 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Assessment
 The
Institute worked with Juvenile Court
Administrators to develop the WA State
Juvenile Court Assessment
 Assessment



Measures risk and protective factors.
Classifies youth as low, moderate, or high
risk for reoffense.
Screens youth for program eligibility.
 Program
implementation began in 1999.
6 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Two Types of Research
1.
Meta-analysis
• Combines the results of many studies.
• Studies must meet a standard of rigor.
• Results of meta-analysis produce an effect
size.
2.
Outcome evaluation
• Valid comparison group.
• Intent to treat (not just completers).
7 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
35%
Program
30%
(Competent
Therapists)
32%
27%
25%
Recidivism Rate
Lessons
Learned
Control
27%
25%
20%
15%
19%
Program
(Not Competent
Therapists)
17%
10%
5%
1%
3%
0%
FFT
ART
COS
8 of 17
Overview


Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Experts
 Statewide quality assurance steering
committee

Statewide program experts

Regional consultants
Training
 On-going consultation, feedback, and training

Assess therapists’ level of competent
program delivery
9 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Evidence-Based Public Policy Options to
Reduce Future Prison Construction (2006)

“Study options to stabilize future prison populations.”

“Study the net short-run and long-run fiscal savings to
state and local governments of implementing…
 evidence-based treatment human service and
corrections programs and policies, including
prevention and intervention programs”

“Project total fiscal impacts under alternative
implementation scenarios.”
10 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
Evidence-Based Programs for Juvenile Offenders:
Selected Results
Expected
Change In Crime
Juvenile Program
Benefits Minus
Costs
(# of EB Studies) (per-person, life cycle)
FFT
-18.1% (7)
MDTFC (foster care)
-17.9% (3)
ART
-8.3% (4)
Restorative Justice (low risk)
-8.0% (21)
MST
-7.7% (10)
Intensive Probation (surveillance)
0.0% (3)
Scared Straight
+6.1%(10)
$49,776
$88,953
$23,015
$8,702
$17,694
-$1,650
-$17,470
11 of 17
Background
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
What Does This Mean?
 Many
juvenile justice options produce
favorable long-run economic returns.

Reduce need for up to two prisons if an
aggressive portfolio of evidence-based options
were implemented.
 In
2007, the Legislature expanded funding
for evidence-based programs.
$26.2 million
 One future prison eliminated from agenda.

12 of 17
Overview
Research
Quality
Assurance
Costs &
Benefits
Lessons
Learned
 Research


Select programs scientifically shown to work.
Conduct a valid outcome evaluation.
 Assessment

Develop an assessment to identify
appropriate program for each youth.
 Quality Assurance

Implement standards to ensure adherence to
the model.
13 of 17
Research
Overview
 Costs

Quality
Assurance
Costs &
Benefits
Lessons
Learned
and Benefits
Determine if the investment produces positive
returns to taxpayers.
 People


Develop relationships with stakeholders.
People make decisions, not reports.
14 of 17
Juvenile Justice History in WA
1995
Intensive probation program funded.
1996
Intensive probation outcomes are not good.
1997
Determine if evidence-based programs exist that can be
implemented in Washington State juvenile courts.
1998
Move funding from intensive probation to evidence-based
programs in juvenile courts: Aggression Replacement Training
(ART) and Functional Family Therapy (FFT).
2002
Preliminary evidence-based program outcomes are positive and
emphasize competent delivery (Doc. No. 02-08-1201).
2003
Develop adherence and outcome standards for evidence-based
programs.
Cost-benefit analyses of prevention and intervention programs
beyond juvenile offenders.
15 of 17
Juvenile Justice History in WA (cont’d)
2004
Outcome evaluation of Washington State’s research-based
programs for juvenile offenders. ART, FFT, & COS.
Benefits and Costs of Prevention and Early Intervention Programs
for Youth - 6 outcomes of interest.
2006
Reinvesting in Youth legislation: State reimburses counties for
implementing evidence-based programs.
Evidence-Based Public Policy Options to Reduce Future Prison
Construction, Criminal Justice Costs, and Crime Rates.
2007
Today
Expanded Funding for evidence-based programs: ART, FFT, MST,
COS, MDTFC, FIT, Restorative justice for low risk offenders, and
drug courts.
Working on increasing the number of youth served by evidencebased programs and tracking agency implementation of
expansion dollars.
16 of 17
Institute Reports of Interest
Aos, S., Lieb, R., Mayfield, J., Miller, M., & Pennucci, A.
(2004). Benefits and costs of prevention and early
intervention programs for youth.
Aos, S., Miller, M. & Drake, E. (2006). Evidence-based
public policy options to reduce future prison construction.
Barnoski, R. (1999). The Community Juvenile
Accountability Act: Research-proven interventions for the
juvenile court.
Barnoski, R. & Aos, S. (2004). Outcome evaluation of
Washington State’s research-based programs for
juvenile offenders.
Barnoski, R., Aos, S. & Lieb, R. (2003). Recommended
quality control standards: Washington State researchbased juvenile offender programs.
17 of 17