Implementing Issues Related to Evidence
Download
Report
Transcript Implementing Issues Related to Evidence
Targeted RECLAIM
Initiative
May 14, 2009
Center for Innovative
Practices
Institute for the Study and
Prevention of Violence
Kent State University
Acknowledgement to:
Karen A. Blase, Ph.D.
National Implementation Research Network
Frank Porter Graham Child Development
Institute at UNC- Chapel Hill
1
Science supports outcomes
High level of training and coaching
Clear set of program standards
Support with implementation
Ultimately can be ‘cost effective’
All systems are moving to an ‘outcome
based’ approach to funding
2
A program or practice that has been
demonstrated through scientific studies to
be effective in improving outcomes for a
specific population.
3
Evidence-based programs have demonstrated
effectiveness through research
Promising practices have some evidence for benefits to
consumers
Common practices have no data to support their use but
over many years they have been built into a series of
laws, regulations, funding mechanisms, professional
and organizational accreditation standards, etc. that
sustain them
Harmful practices have evidence indicating harm to
clients but often still are supported as a common
practice
4
No evidence
Expert consensus
Formal Evaluation
Comparison studies
Randomized clinical trials
Meta-analysis
Replicable in real world settings
5
Some higher Level of Evidence of effectiveness
Reliability of Treatment Application
Treatment Manual and Uniform Training
Treatment Fidelity
Coaching, Consultation, Quality Assurance and
Support
Validity: Strong theoretical and research basis
Consumer responsiveness; Salience
True clinical sample of intended treatment
population
Ethical delivery of service
A balanced focus on strengths as well as needs
6
Multisystemic Therapy = MST
Intensive Home Based Treatment = IHBT
Multidimensional Treatment Foster Care = MTFC
Integrated Co-Occurring Treatment = ICT
Wrap Around = WA
Functional Family Therapy = FFT
Cognitive Behavior Therapy = CBT
Appropriate medication intervention
But all need to be based on:
Multi factored Screening, Assessment, and
Diagnosis for MH and Substance Abuse
7
MST-Intensive family based
intervention for youth with
externalizing behavior
IHBT-Intensive home based
treatment model for families with
youth with a wide range of
emotional and behavioral
disorders
Incredible Years-Parent and
Teacher modeling and behavior
management skills
Functional Family Therapy-Family
therapy and structure model for
youth with disruptive behaviors
disorders
Positive Behavior Supports-Youth
specific and environment general
techniques to minimize problem
behaviors
Multidimensional Treatment Foster
Care-Specialized foster care
linking foster and home to focus
on disruptive behaviors in youth
Integrated Co-Occurring
Treatment-Intensive home and
community integrated MH & SA
treatment
Nurse-Family Partnership- Home
visiting model by RNs for
newborns focusing on child-parent
interaction and child development
WrapAround-A process technique
to develop en ecological treatment
plan for families with multiple
systems needs
Columbia Teen Screen-Science
based voluntary youth screening
tool for depression and other
mental health
School based Mental Health
Strategies-Specifically focusing on
school based approaches to
prevention and intervention
Strengthening Families: Ages 1014, designed to reduce substance
abuse and other problematic
behaviors in youth, is a seven week
course for parents and youth
8
Provider
Counties Served
# of Teams
Crisis Intervention Center *
Family Resource Centers
Applewood Centers *
Family Life Counseling
Children’s Hospital *
Buckeye Ranch
Rosemont Center
Counseling Center
Family and Community Svcs
Justice Affairs
TBD
Stark
Hancock
Lorain and Cuyahoga
Richland
Franklin
Franklin
Franklin
Columbiana
Portage
Cuyahoga
Lucas
1
1
2
1
2
2
2
1
1
1
1
Total
9 counties
15
* (piloting an MST-PSB team)
Franklin, Stark, Lorain, Cuyahoga
4
593 cases July 1Dec 31 2008
U.S Average
CIP Average
% of youth living at
home
84.1%
89.5%
% of youth in school
or working
83%
86.9%
% of families
completing
treatment
78.8%
86.3%
% of cases
discharged due to
lack of engagement
8.4%
4.4%
% of youth placed
during treatment
12.8%
8.4%
Average LOS
129.5 days
146 days
Ultimate Outcomes
10
COST
LOS
PER DIEM
IHBT/MST
$7000-9000 5-6 months
$70-90.00
Secure Res
Tx
$122,000
12 months
$335.00
ODYS
$82,600
11.5 months $236.00
11
12
Who are the key populations we are trying to
address
What are the key problem or challenge areas
we are trying to address
What is already in our continuum
What is the capacity of that continuum
Do we need more of the same
Do we need something different
Do we need to stop doing some things
13
Assess the Potential Match Equation
Community Needs +
Cross System Support +
Community Resources +
Readiness +
Options for evidence-based/best practice
=
Decision to proceed (or not).
14
What process do we use to identify the
possible service options
What other partners do we want/need at the
table
What role do other youth serving systems
have in our exploration
15
What are the services, strategies, practices
that might address our identified needs and
build local continuum
What criteria do we use to ‘nominate’ or
identify potential services
What outcomes are the most important
What level of evidence do we want for
programs we select
What are the reliable lists/sources of
information on effective practices
16
What services or practices ‘match’ our criteria
and targeted outcomes
What details about the treatment do we need
information on:
Cost
Training
Licensing requirements
Coaching
Level of research
Workforce needs
Feasibility factors
Outcomes
17
http://www.colorado.edu/cspv/blueprints/m
odelprograms.html
18
Midwestern Prevention Project (MPP)
Big Brothers Big Sisters of America
Functional Family Therapy (FFT)
Life Skills Training (LST)
Multisystemic Therapy (MST)
Nurse-Family Partnership (NFP)
Multidimensional Treatment Foster Care (MTFC)
Olweus Bullying Prevention Program
Promoting Alternative THinking Strategies
(PATHS)
The Incredible Years: Parent, Teacher and Child
Training Series (IYS)
Project Towards No Drug Abuse (Project TND)
19
ATLAS (Athletes Training and Learning to Avoid
Steroids)
Behavioral Monitoring and Reinforcement
Program
Brief Strategic Family Therapy (BSFT)
CASASTART
FAST Track BPP06
Good Behavior Game (GBG)
Guiding Good Choices (GGC)
I Can Problem Solve (ICPS)
Linking the Interests of Families and Teachers
(LIFT)
20
Perry Preschool Project BPP12
Preventive Treatment Program (PTP)
Project ALERT
Project Northland
BASICS (Brief Alcohol and Intervention of
College Students)
Seattle Social Development Project (SSDP)
Strengthening Families Program For Parents
and Youth 10-14
Strong African American Families (SAAF)
Program
21
Not an event but an ongoing process
Typically takes 2-4 years to take hold
The treatment effectiveness is in direct
proportion to the effectiveness of
implementation at ALL levels
22
Effective intervention practices and programs
+
Effective implementation practices
=
Good outcomes for children and their families
No other combination of factors reliably produces
desired outcomes for children, families, and caregivers
23
IMPLEMENTATION
Effective
INTERVENTION
Effective
Performance
Implementation
(High Fidelity)
NOT Effective
Paper & Process
Implementation
(Low or No Fidelity)
NOT Effective
It’s hard to land here and harder to stay here!
24
What will implementation of an EBP mean to
the local system of care
What organizational changes will need to be
made to accommodate
What intersystem relationships/processes
need to be created/changed/modified
Can we identify the challenges that will be
inevitable
Do our system stakeholders have the patience
needed for successful implementation
25
Can we afford it without ‘special’ funding
and/or when special funding ends
Can we identify ways to embed the service
within the local financing
Can we ‘repurpose’ existing funds
What is the collective public youth serving
systems’ investment strategy to keep their
money and keep their kids, at home
What is the cost-benefit
26
Clinical & Programmatic
Systemic
Financial
27
Changing practices for both clinicians
and organizations
Rigorous supervision/coaching;
ongoing training
Focus on Quality Improvement and
Assurance
Staffing; training; retraining
Outcomes driven
28
The allure of ‘the list’
Identifying and selecting practices within
a context of a community planning
process
Shift to an outcomes /results based
(qualitative) system
Developing local evaluation capacity
Going to scale…making effective
practices the rule
29
‘Bridge’ funding to finance start up
Reinvesting current resources to new
programs
Anticipating all the costs: what funds will
pay for what, e.g., Medicaid does not pay
for staff training
Mechanics of reimbursement and
limitations of fee for service
Potential ‘conflict’ with productivity
approach
30
‘Over-promise’ of the intervention
Expectation of “instant” results
Lack of adequate advance strategic
planning
Provider is the only champion
Limited stakeholders at the table
High level of resistance to change
Workforce issues
Organizational issues
Short term plan for financing
31
Interventions selected on solid data
Outcomes that impact JJ, BH and CW
Feasibility: what can and will the local
system support
‘Real world’ data to capture clinical and
cost effectiveness
Diversion from more costly, more
restrictive level of care
Systems that are ‘saving’ reinvest some
funds back into the program
Full table of participants
32
Investigate need
Identify change agents, stakeholders, and
champions
Identify Programs and Practices that look
promising to meet target needs
Establish key outcomes across stakeholders
Measure qualitatively and quantitatively, including
$$
Begin ‘sustainability planning’ from the beginning
Use multiple funding sources from multiple
systems
33
Systems Can Trump Programs!
- Patrick McCarthy, Annie E. Casey Foundation
Goes on at:
practice
program
agency
and systems levels
34
Center for Innovative Practices www.cipohio.org
National Center for MH/JJ
www.ncmhjj.org
OJJDP Model Programs Guide
www.dsgonline.com/mpg_non_flash/mpg_index.ht
m
Federation of Families
www.ffcmh.org
NAMI
www.nami.org/youth
CMHS-Center for
Mental Health Services
www.mentalhealth.org
Surgeon General
www.surgeongeneral.gov
Center for the Study and
Prevention of Violence
www.colorado.edu/cpsv
OJJDP-Comp Strategies
www.ncjrs.org/strategy/index/html
GAINS Center
www.prainc.com/gains
35
Washington State Institute
of Public Policy
www.wsipp.wa.gov
OJJDP Parent Resource
www.parentingresource.ncjrs.org
Children’s Defense Fund
www.childrensdefense.org
National MH Assoc.
www.nmha.org
Annie E. Casey Foundation
www.aecf.org
Center for Effective
Collaboration
www.air-dc.org/cecp
Search Institute
www.searchinstitute.org
Nat’l Academies of Science
www.academies.org
Institute for the Study
And Prevention of Violence
www.kent.edu/violence
36
Rand
www.promisingpractices.org
CWLA
www.cwla.org
MST
www.mstservices.org
Oregon Social Learning Center (Multidimensional TFC)
www.oslc.or
Functional Family Therapy
www.fftinc.com
SAMHSA Model EBP Project
www.modelprograms.samhsa.gov/template
Dept. of Ed
www.ed.gov
Nat’l Center on MH and JJ
www.ncmhjj.org
Center for Education, Disabilities and JJ
www.edjj.org
Data Trends (Resource Center)
www.rtc.pdx.edu/DataTrends
Georgetown Childrens MH TA Center
www.georgetown.ed/research/gucdc.cassp
37
Florida MH Research Center
www.rtckids.fmhi.usf.edu
President’s Freedom Commission
www.mentalhealthcommission.gov
Chestnut AOD
www.chestnut.org
NIDA
www.drugabuse.gov/nidahome
Tech Assist Collab-TAC (EBP Manual)
www.tacinc.org
School Based Mental Health
http://smhp.psych.ucla.edu/resource.htm
State of New York articles on EBP:
http://www.omh.state.ny.us/omhweb/EBP/practicesforchildren.htm
Date Trends Newsletter: http://www.childtrendsdatabank.org /
DHHS Best Practices: http://www.osophs.dhhs.gov/ophs/BestPractice/
SAMHSA Model Programs:
http://www.modelprograms.samhsa.gov/template.cfm?CFID=540873&C
FTOKEN=20095080
38
Psychosocial therapies
Chambless and Hollon (1998). Defining empiricallysupported
therapies. Journal of Consulting & Clinical
Psychology, 66, 7-18
◦ Kazdin, Psychotherapy for children and adolescents
◦
Oxford, 2000
◦ Weisz & Jensen, Mental Health Services Research, 1999
School-Based Interventions
Psychopharmacology
◦ Rones & Hoagwood, School-based mental health services,
◦ Clinical Child and Family Psychology Review, 2000
◦ Journal of the Am. Academy of Child/Adol. Psychiatry special issue
on psychopharmacology, 1999
◦ Weisz & Jensen, Mental Health Services Research, 1999
39
Community-based Interventions
Surgeon General’s Mental Health Report, 1999
Surgeon General’s Youth Violence Report, 2001
Burns & Hoagwood (2002) Eds. Community treatments for
youth. Oxford University Press
Burns, Hoagwood, & Mrazek (2000) Effective
treatments
for mental disorders in children and
adolescents. Child
Clinical and Family Psychology
Review, 2000
Greenberg, et al., Review of the Effectiveness of Prevention
Programs, 1999 (CMHS)
Olds et al., Review of Preventive Interventions, 1999 (CMHS)
40
Patrick J. Kanary [email protected]
Center for Innovative Practices
www.cipohio.org
41