Transcript Slide 1

The Big Picture:
“Getting in Going” and
“Keeping it Going”
Susan Barrett
Implementer Partner,
OSEP Center on PBIS
Problem Statement
“We give schools strategies & systems for
developing positive, effective, achieving, &
caring school & classroom environments,
but implementation is not accurate,
consistent, or durable. Schools need more
than training.”
Sustainability + Scaling
Organizational capacity for &
documentation of accurate (90%) &
expandable implementation of evidencebased practice across desired context
(e.g., district, classroom, school-wide, nonclassroom)
over time w/ local resources & systems
for continuous regeneration.
Education
•
•
•
•
•
65 million kids
6 million teachers and staff
100,000 schools
3,143 counties
60 states & U.S. jurisdictions
Expansion
7,800 Schools !!!
Maryland
600 schools
Illinois
744 schools
Colorado
405 schools
Florida
250 schools
New York
322 schools
Michigan
248 schools
New Hampshire 141schools
Virginia
Missouri
210 schools
300 schools
North Carolina
Ohio
548 schools
221 schools
West Virginia 215 schools
Louisiana
Oregon
285 schools
398 schools
Start with the end in mind…
• What will it take to have 100,000
replications that produce increasingly
effective outcomes for 100 years?
– Fixsen
Creating Implementation
Capacity
• Start with too many overqualified people
• “Generation 1” practitioners become:
– Generation 2 interviewers, trainers, coaches,
evaluators
– Generation 3 administrators, directors, and
leaders
– Generation 4 state and federal officials
Fixsen 2008
Educational Initiatives
• Guiding Principles (Coyne 2008)
– Promoting evidence based practices
– Supporting change at the systems level
(feasible, consistent and relevant to local
needs)
– Developing local capacity to sustain effective
practices over time
SWPBS Implementers’ Blueprint Elements
Visibility
Funding
Political
Support
Leadership Team
Training
Coaching
Evaluation
Local School Teams/Demonstrations
Need to Know
• Cultural fit
• Building on “What works”
• Focus on the Staff
Worry #1
• Do we live in a
punishing work
environment ?
• How do we create
systems that support
staff?
Predictable work environments are
places where employees:
•
•
•
•
•
•
•
Know what is expected
Have materials & equipment to do job correctly
Receive recognition each week for good work
Have supervisor who cares & pays attention
Receive encouragement to contribute & improve
Can identify person at work who is “best friend”
Feels mission of organization makes them feel like their
jobs are important
• See people around them committed to doing good job
• Feel like they are learning new things
• Have opportunity to do the job well
(Buckingham & Coffman 2002, Gallup)
Many Begin, Many Leave
Adelman and Taylor
Preparing All Education Personnel to Address Barriers to
Learning and Teaching2008
Predictions of shortages of 2 million educators
over the next decade…
Data in the U.S. indicate about
15% of new teachers leave in the first year,
30% within three years and
40-50% within the first five years.
(Smith and Ingersoll, 2003)
On school reform…
Kauffman states “…attempts to reform
education will make little difference until
reformers understand that schools must
exist as much for teachers as for student.
Put another way, schools will be
successful in nurturing the intellectual,
social, and moral development of children
only to the extent that they also nurture
such development of teachers.” (1993, p.
7).
Worry #2
• Too much to do
• We add more and more each year
• How can we be better prepared to
integrated into existing programs?
Memo
To: School Administrators
From: District Administrators
In keeping with the new state initiative, this fall
we will be implementing an exciting new district
initiative of SNI in place of LYI. All in-service
days previously scheduled for LYI will be
rescheduled as staff development for SNI. The
$500 for release time and materials for LYI will
be discontinued and provided instead for SNI.
By the way, you will need to create local SNI
teams that meet weekly. The former members of
your LYI team would be perfect for this new
team. Your new SNI binders will be coming next
week. Have a great year!!!
14 Initiatives
•
•
•
•
•
•
•
•
•
•
•
•
•
•
School Counseling Services
Second Step
FBA/BIP’s
School Health
Social Skills
Bully proofing
Anger Management
Student Intervention Plans
Behavioral Contracting
Character Education
504 Plans/IEP
CICO
Responsive Classroom
Expanded School Mental Health
Competing or Coordinated
• Need for a framework, the anchor, for all
school improvement efforts
• Common language, Common logic
INTENSIVE
TARGETED
UNIVERSAL
School counseling services
Student Intervention Plans
Section 504 Plans and/or IEPs
Second Step
FBAs/BIPs
School health services
Health Education Voluntary State Curriculum
Check-in/Check-out
Alternative programs
Expanded School Mental Health Initiatives and Interagency Partnerships
Social skills, bully proofing, and/or anger management groups
Behavioral contracting
Responsive counseling
Character Education
School mental health services
Bullying Prevention
Supporting Social Competence &
Academic Achievement
4 PBS
Elements
OUTCOMES
Supporting
Decision
Making
Supporting
Staff Behavior
PRACTICES
Supporting
Student Behavior
Empower Educators
• We need to be better consumers!
• Say “No”, unless….
Show evidence of need
Office referrals are increasing every
day!!!
“Minor disrespect and disruption are
increasing over time and are most likely
during the last 15 minutes of our block
periods when students are engaged in
independent seatwork. This pattern is
most common in 7th and 8th grades,
involves many students, and appears to
be maintained by peer attention.”
The playground is out of control !!!!
The students won’t listen to anyone
and are fighting all of the time!!!
“Major & minor referrals have increased by
50% during on the playground. The
referrals are mostly 4th and 5th graders,
and disrespect and aggressive behavior
are the highest problem behaviors. Peer
attention is the motivation.”
DATA is your friend
• 3 Parts
– Coherent office referral procedures
– Computer Application
– Decision Making
Using Data • Does your Data give you an accurate
picture? Reliable? What is your confidence
level? Do you share with all staff?
• General Data Decision Rules
• Are you able to make precision statements ?
Do you present to faculty to get buy in?
• How do you know when to move “up the
triangle”?
Improving Decision-Making
From
Solution
Problem
Problem
To
Problem
Solving
Information
Solution
Key features of data systems
that work.
• The data are accurate and valid
• The data are very easy to collect (1% of staff
time)
• Data are presented in picture (graph) format
• Data are used for decision-making
• The data must be available when decisions need to be
made (weekly?)
• Difference between data needs at a school building
versus data needs for a district
• The people who collect the data must see the
information used for decision-making.
Why Collect Discipline
Information?
• Decision making
• Professional Accountability
• Decisions made with data (information)
are more likely to be (a) implemented,
and (b) effective
What data to collect for
decision-making?
• USE WHAT YOU HAVE
– Office Discipline Referrals/Detentions
• Measure of overall environment. Referrals are affected
by (a) student behavior, (b) staff behavior, (c)
administrative context
• An under-estimate of what is really happening
• Office Referrals per Day per Month
– Attendance
– Suspensions/Expulsions
– Vandalism
Office Discipline Referral
Processes/Form
• Coherent system in place to collect office
discipline referral data
– Faculty and staff agree on categories
– Faculty and staff agree on process
– Office Discipline Referral Form includes needed
information
•
•
•
•
Name, date, time
Staff
Problem Behavior, maintaining function
Location
Observe Problem Behavior
Warning/Conference with Student
No
Use Classroom
Consequence
Complete Minor
Incident Report
Does student
have 3 MIR slips
for the same
behavior in the
same quarter
Write the
student a
REFERRAL to
the main office
Is behavior
office
managed?
Yes
Classroom
Managed
Office
Managed
•Preparedness
•Calling Out
•Classroom Disruption
•Refusal to Follow a
Reasonable Request
(Insubordination)
•Failure to Serve a
Detention
•Put Downs
•Refusing to Work
•Inappropriate
Tone/Attitude
•Electronic Devices
•Inappropriate
Comments
•Food or Drink
•Weapons
•Fighting or Aggressive
Physical Contact
•Chronic Minor
Infractions
•Aggressive Language
•Threats
•Harassment of Student
or Teacher
•Truancy/Cut Class
•Smoking
•Vandalism
•Alcohol
•Drugs
•Gambling
•Dress Code
•Cheating
•Not w/ Class During
Emergency
•Leaving School
Grounds
•Foul Language at
Student/Staff
Write referral to
office
Administrator
determines
consequence
Administrator
follows through
on consequence
Administrator
provides teacher
feedback
SIDE BAR on Minor Incident Reports
•Issue slip when student does not respond to pre-correction, re-direction, or verbal warning
•Once written, file a copy with administrator
•Take concrete action to correct behavior (i.e. assign detention, complete behavior reflection
writing, seat change)
When Should Data be
Collected?
• Continuously
• Data collection should be an embedded part of
the school cycle not something “extra”
• Data should be summarized prior to meetings
of decision-makers (e.g. weekly)
• Data will be inaccurate and irrelevant unless
the people who collect and summarize it see
the data used for decision-making.
Organizing Data for “active
decision-making”
• Counts are good, but not always useful
• To compare across months use “average office
discipline referrals per day per month”
Total Re f ve rs us Re f/Day/M o
NV High School
70
January 10
R efer r als
60
50
40
30
20
10
0
Aug Sept Oct Nov Dec Jan
Feb
School Month
Mar
Apr
May Jun
Change
Report Options
3.49
2.75
2.5
2.7
1.8
1.4
0
.00
Using Data for On-Going
Problem Solving
• Start with the decisions not the data
• Use data in “decision layers” (Gilbert, 1978)
– Is there a problem? (overall rate of ODR)
– Localize the problem
– (location, problem behavior, students, time of day)
– Get specific
• Don’t drown in the data
• It’s “OK” to be doing well
• Be efficient
Is there a problem?
• Office Referrals per Day per Month
• Attendance
• Faculty Reports
SWIS Data Summary
06-07
SWIS summary 06-07 (Majors Only)
1974 schools; 1,025,422 students; 948,874 ODRs
Grade
Range
Number of
Schools
K-6
1288
Mean
Mean
Enrollment ODRs per
per school 100 per
school day
446
.34 (sd=.37)
(1 / 300 / day)
6-9
377
658
.98 (sd=1.36)
(1/ 100 / day)
9-12
124
1009
.93 (sd=.83)
(1/ 107 / day)
K-(8-12)
183
419
.86
(sd=1.14)
(1/ 120 / day
Interpreting Office Referral
Data:
Is there a problem?
• Absolute level (depending on size of school)
– Middle, High Schools (> 1 per day per 100)
– Elementary Schools (> 1 per day per 300)
• Trends
– Peaks before breaks?
– Gradual increasing trend across year?
• Compare levels to last year
– Improvement?
N= 495
Office Referrals per Day per Month
Last Year and This Year
A v e R e fe r r a l s p e r D a y
Middle
School
20
15
10
5
0
Sept Oct
Nov Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
What systems are problematic?
• Referrals by problem behavior?
– What problem behaviors are most common?
• Referrals by location?
– Are there specific problem locations?
• Referrals by student?
– Are there many students receiving referrals or only
a small number of students with many referrals?
• Referrals by time of day?
– Are there specific times when problems occur?
Tardy
Forge/Theft
Dress Code
Tobacco
Alcohol
Combustibl
Bomb
Arson
Weapons
Other
Unknown
Drugs
Tech
Iapp
Out bounds
Gang
Minor
M-Prpty
M-Other
M-Dress
M-Tech
M-Tardy
M-Unknown
Inapp lan
Lying
Vandal
M-Disruption
Harass
Prop dam
M-Inapp lan
M-Contact
M-Disrespt
Skip
Disrespt
Agg/Fight
Disruption
Number of Referrals
Defining the Problem
What Problem Behaviors Are
Occurring?
Referrals by Problem Behavior
20
15
10
5
0
Referrals: 52
Clarifying the Problem
When Are Problem Behaviors
Occurring?
Referrals by Time
16
12
10
8
6
4
2
Referrals: 138
5:00 PM
4:00 PM
3:00 PM
2:00 PM
1:00 PM
12:00 PM
11:00 AM
10:00 AM
9:00 AM
8:00 AM
0
7:00 AM
Number of Referrals
14
Referrals: 166
Plygd
Bus
Class
Gym
Hall
Library
Café
Stadium
Off-Campus
Locker rm
Office
Unknown
Other
Special evt
Park lot
Bus Zn
Bathrm
Common
Number of Referrals
Clarifying the Problem
Where Are Problem Behaviors
Occurring?
Referrals by Location
100
80
60
40
20
0
1
2
3
5
10
11
12
13
17
18
20
21
22
23
24
25
34
35
37
38
39
40
42
47
48
49
50
52
54
56
57
60
62
65
72
73
75
78
79
85
86
88
89
93
94
96
97
99
100
95
84
91
98
87
67
26
55
51
36
41
Number of Referrals
Clarifying the Problem
Who Is Engaging in Problem
Behaviors?
Referrals by Student
12
10
8
6
4
2
0
Student No.
Students: 60
Referrals: 96
Data Based Decision Making
• Is there a problem?
• What areas/systems are involved?
• Are there many students or a few
involved?
• What types of problem behaviors are
occurring?
• When are the behaviors most likely to
occur?
• What is the most effective use of
Team Initiated
Problem Solving
(TIPS) Model
Review
Status and
Identify
Problems
Develop and
Refine
Hypotheses
Evaluate and
Revise
Action Plan
Collect
and Use
Data
Develop and
Implement
Action Plan
Discuss and
Select
Solutions
Problem Solving
Foundations
Precision Problem Statements
(What are the data we need for a decision?)
• Precise problem statements include
information about the five core “W”
questions.
– What is problem, and how often is it
happening
– Where is it happening
– Who is engaged in the behavior
– When the problem is most likely
– Why the problem is sustaining
Primary versus Precision
Statements
• Primary Statements
– Too many referrals
– September has more
suspensions than last
year
– Gang behavior is
increasing
– The cafeteria is out of
control
– Student disrespect is
out of control
• Precision
Statements
– There are more
ODRs for aggression
on the playground
than last year, and
these are most likely
to occur during first
recess, with a large
number of students,
and the aggression is
related to getting
access to the new
playground
equipment.
What are the data you are most likely to
need to move from a Primary to a Precise
statement?
• What problem behaviors are most common?
– ODR per Problem Behavior
• Where are problem behaviors most likely?
– ODR per Location
• When are problem behaviors most likely?
– ODR per time of day
• Who is engaged in problem behavior?
– ODR per student
• Why are problem behaviors sustaining?
– No graph
What other data may you want?
•
•
•
•
•
•
•
•
ODR by staff
ODR by IEP
ODR by grade
ODR by gender by grade
Faculty subjective impressions
Academic performance
Attendance
Information about home status
Decision Making
• Is there a problem?
• What areas/systems are involved?
• Are there many students or a few
involved?
• What kinds of problem behaviors are
occurring?
• When, where and with whom are these
behaviors most likely?
• What is the most effective use of our
resources to address this problem?
Primary to precise
• Primary
– Kids are noisy in the hallway going to reading
• Precise
– Many second graders coming from reading
are too loud from room 13 to room 22 and
their noise is maintained by peer attention.
We also have very little adult supervision
available
Using Data to Build Solutions
•
Prevention: How can we avoid the problem context?
–
–
•
Who, When, Where
Schedule change, curriculum change, etc
Teaching: How can we define, teach, and monitor what we want?
–
–
Teach appropriate behavior
Use problem behavior as negative example
•
Recognition: How can we build in systematic reward for desired
behavior?
•
Extinction: How can we prevent problem behavior from being
rewarded?
•
Consequences: What are efficient, consistent consequences for
problem behavior?
•
How will we collect and use data to evaluate (a) implementation
fidelity, and (b) impact on student outcomes?
5:1 Ratio of tickets to
referrals
• Our data tells us that we should be giving 5
positives to each corrective response
• How is that measured?
– Number of coupons versus number of referrals.
Number of RRR
Tickets
Quarter
K
1
2
3
4
5
Total
One
306
289 278 236 110
193
1412
Two
678
526 423 278 147
191
2243
Overall
984
815 701 514 257
384
3655
ry
y
r
r
l
ne
ay
il
To
ta
Ju
M
Ap
r
ar
ch
ua
M
Fe
br
nu
ar
em
be
Ja
De
c
em
be
No
v
r
be
r
mb
e
to
te
Oc
Se
p
Ratio of Tickets: Referrals
6.0
5.0
4.0
3.0
2.0
1.0
0.0
Triangle of Student
Referrals
Intensive, Individual Interventions
Individual Students
Assessment-based
High Intensity
Targeted Group Interventions
Some Students (at-risk)
High Efficiency
Rapid Response
Universal Interventions
All Students
Preventive, proactive
1-5%
1-5%
5-10% 5-10%
80-90%
80-90%
6+ referrals
2-5 referrals
0-1 referral
Triangle of Student Referrals:
August/September 2005
Intensive, Individual Interventions
Individual Students
Assessment-based
Intense, durable procedures
Targeted Group Interventions
Some Students (at-risk)
High Efficiency
Rapid Response
Universal Interventions
All Settings
All Students,
Preventive, proactive
1-5%
07%
%
03%
Students with 2 or
more referrals
Students with 1
referral
10-15%
90%
80-90%
Students with 0
referrals
Triangle of Student Referrals:
April 2006
Theory
Actual data
Intensive, Individual Interventions
Individual Students
Assessment-based
Intense, durable procedures
1-5%
4%
Students with 1
referral
Targeted Group Interventions
Some Students (at-risk)
High Efficiency
Rapid Response
Universal Interventions
All Settings
All Students,
Preventive, proactive
Students with 2 or
more referrals
3%
10-15%
93%
80-90%
Students with
0 referrals
Cost-Benefit Analysis
COST/BENEFIT ANALYSIS WORKSHEET
3000
Enter info below
2640
2500
2000
School name
Robert
Moton
Elementary
School
1000
1420
1220
1500
660
355
305
500
6
Average # of
minutes student is
out of class due to
referral
Average #
of
Average # of
minutes staff need
to process referral
Time
Regained
This Year
61
6
5
22
4
3
3
2
1
1
1
5
0
This
Year
Number of referrals
April 2006
132
Last
Year
Number of referrals
November 2005
Last Year
0
What is the
academic/behavior
connection in your school?
• What information do you need to answer
this question?
• What types of data do you currently use?
• How often? Is it working?
• What would make it better?
• What are your goals when you leave to
return to your building?
Evaluation
Questions
School
Improvement
Goals and
Objectives
Marketing and
Dissemination
•Presentations
Newsletters
Annual Reports
Data Base
SWIS
Decision
Making
•Precision
Statements
•Build
Solutions
Educational Initiatives
• Guiding Principles (Coyne 2008)
– Promoting evidence based practices
– Supporting change at the systems level
(feasible, consistent and relevant to local
needs)
– Developing local capacity to sustain effective
practices over time
Keep it Going!!
• Create Useful Systems of Data Collection
• Establish Community of Practice
– We will be more efficient and effective if we share and
learn together- Local NETWORKs
• Apply three tiered logic to your work
• Showcase and celebrate outcomes!!
– Cost benefit
• Fidelity!!
• Action Plan, process tools like BOQ, staff surveys!!!