Transcript Evidenced Based Programs

Evidenced Based Programs
Agenda

Review of Programs in Missouri

How to Select Programs of Your Own
Rigorously Defining EBP



Evaluation research shows that the program
produces the expected positive results;
The results can be attributed to the program itself,
rather than to other extraneous factors or events;
The evaluation is peer-reviewed by experts in the
field;
AND

The program is “endorsed” by a federal agency or
respected research organization and included in their
list of effective programs.
Practically Defining EBP
Included on Federal Lists or Registries of
evidence based interventions (as an
effective program);
OR
 Reported (with positive effects) in peerreviewed journals / government publications;
OR
 Convincing scientific research proving the
intervention’s effectiveness.

WHAT IS GOING ON IN
MISSOURI?
Programs Used in Missouri


Regional Support Centers were asked which
programs they used
12 total responses, 59 programs
Statewide Programs

Mental Health First Aid

QPR (Question, Persuade, and Refer)
Programs Used in Missouri (>33%)
Evidenced Based Program (EBP)
Currently
Implementing
Implemented in the
Past but not Now
Life Skills Training
33%
42%
All Stars
Strengthening Families Program (SFP)
33%
42%
33%
25%
Project Alert
17%
42%
HALO
33%
8%
Signs of Suicide (SOS)
33%
0%
Peace Builders
17%
8%
Too Good For Drugs and Violence
17%
17%
Guiding Good Choices
8%
42%
Project Towards No Drug Abuse
8%
25%
Programs Used in Missouri (<33%)






Love and Logic
Olweus
BASICS (Brief Alcohol Screening and
Intervention of College Students)
Lifelines
Project Northland
Above the influence
Programs Used in Missouri (<33%)






Al’s Pals
Building Strong Families
Families and Schools Together (FAST)
SMART Moves (Skills Mastery and
Resistance Training)
Wyman’s Teen Outreach Program (TOP)
Protecting You / Protecting Me
Programs Used in Missouri (1 RSC)






ABC’s of Secondhand Smoke
Alcohol: True Stories
Ask Listen Refer
Aggressors, Victims, and Bystanders (AVB)
Big Brothers, Big Sisters Mentoring Program
Communities Mobilizing for Change on
Alcohol
Programs Used in Missouri (1 RSC)







Choose Respect
How to Cope (youth & adult versions)
Creating Lasting Family Connections (CLFC)
Curriculum-Based Support Group (CBSG)
Good Behavior Game (GBG)
Not On Tobacco
Parents and the Law
Programs Used in Missouri (1 RSC)






Parents as Teachers
Positive Action
Project Toward No Tobacco Use
Second Step
Short, Brief Intervention and Referral to
Treatment (SBIRT)
SmokeBusters
Programs Used in Missouri (1 RSC)




Too Smart to Start
SISTA
The Seven Challenges
Why Try
LOOKING AT A FEW EBPs
Note: This is a very brief overview of
each program designed to illustrate
some things to consider. It is not
intended to fully describe the program.
If you are considering choosing an EBP,
please fully review all literature.
Mental Health First Aid - Design

What is it supposed to do?


Potential to reduce stigma, improve mental
health literacy, and empower individuals
Who is the target audience?

Friends and family of individuals with mental
illness or addiction, key professionals (such as
police officers, human resource directors and
primary care workers), school and college
leadership, faith communities, or anyone
interested in learning more about mental illness
and addiction
Mental Health First Aid - Evidence

Research showing:




Improved mental health in those who attend the
training
Decreases in stigmatising attitudes
Increases in the amount and type of support
provided to others
Publication in peer reviewed journals
QPR - Design

What is it supposed to do?


Teach "gatekeepers” the warning signs of a
suicide crisis and how to respond by following
three steps
Who is the target audience?

Parents, friends, neighbors, teachers, coaches,
caseworkers, police officers, etc.
QPR - Evidence

Research showing:




Increases in declarative and perceived
knowledge about suicide; maintained at the 3month follow-up
Higher gatekeeper self-efficacy score
Higher knowledge of suicide prevention
resources
Publication in peer reviewed journals
Life Skills - Design

What is it supposed to do?


Prevent alcohol, tobacco, and marijuana use
and violence
Who is the target audience?

Separate programs offered for elementary,
middle, and high school; the research studies
and outcomes reviewed involved middle school
students
Life Skills - Evidence

Research showing:




Significant decrease in cigarette smoking,
alcohol use (drunkenness), and polydrug use
Lower normative expectations than control
students for peer smoking and drinking
Significant reductions in violence and
delinquency at 3-month follow-up
Publication in peer reviewed journals
All Stars - Design

What is it supposed to do?


Prevent and delay the onset of high-risk
behaviors such as drug use, violence, and
premature sexual activity
Who is the target audience?

Middle school students (11-14 years old)
All Stars - Evidence

Research showing:




Average scores for personal commitment
increased from pre- to posttest
Average scores for lifestyle incongruence
increased from pre- to posttest
Average scores for school bonding increased
from pre- to posttest
Publication in peer reviewed journals
Strengthening Families - Design

What is it supposed to do?


Designed to increase resilience and reduce risk
factors for behavioral, emotional, academic, and
social problems in children 3-16 years old
Who is the target audience?

Parents & Children
Strengthening Families - Evidence

Research showing:



Children who received SFP had lower scores on
conduct disorder symptoms, oppositional
defiance symptoms, and behavior problems
than children in the control group.
Improvements in positive parenting, parental
involvement, parenting skills, parental
supervision, and parenting efficacy
Publication in peer reviewed journals
NREPP DEMONSTRATION
Picking Your Own Programs
NREPP

SAMHSA’s tool

Good place to look for Behavioral Health

Not the only list out there!
http://www.nrepp.samhsa.gov/
NREPP Limitations

From NREPP’s website


“NREPP ratings do not reflect an intervention's
effectiveness. Users should carefully read the
Key Findings sections in the intervention
summary to understand the research results for
each outcome.”
“Use of NREPP as an exhaustive list of
interventions is not appropriate, since NREPP
has not reviewed all interventions.”
Not on NREPP!? Next Steps

Do a web search

Check for Program Website




Do they claim EBP? How?
Do they have positive evaluation results?
May pop up on another list (CDC, Dept of Ed, etc)
Google Scholar for Peer Reviewed Journals

Call Program Developer

Pilot test it yourself (Service to Science)
One Size does NOT Fit All

Targeted towards a particular problem

Targeted towards a particular population

(A cheesy comparison)
Start Small (if you can)

Get 1 copy of all materials to review

Pilot test with 1-2 groups
Fidelity


Programs are EBP based on implementing
them as designed
The more modifications made, the less EBP
they are


Possibly still effective but no proof
Care should be taken when calling it EBP
Contact Information
Susan Depue, Ph.D.
Research Assistant Professor
Missouri Institute of Mental Health
University of Missouri - St. Louis
5400 Arsenal St., St. Louis, MO 63139-1403
PHONE: (314) 877-5942
E-MAIL: [email protected]