Transcript Using Office Referral Data for Decision Making

Using ODR Data for
Decision Making
Rob Horner, George Sugai,
Anne Todd, Teri Lewis-Palmer
Marilyn Nersesian, Jim Watson
Goals



Define sources of data related to
student problem behavior
Define a process for initial use of data
for active problem solving.
Build fluency
Assumptions




School has team focused on school-wide
behavior support.
Team has an action plan
Team meets regularly (weekly, every two
weeks)
Team has access to information about
student behavior
Why Collect Discipline
Information?



Decision making
Professional Accountability
Decisions made with data (information)
are more likely to be (a) implemented, and
(b) effective
Improving Decision-Making
From
Solution
Problem
Problem
To
Problem
Solving
Information
Solution
Key features of data systems that
work.




The data are accurate and valid
The data are very easy to collect (1% of staff
time)
Data are presented in picture (graph) format
Data are used for decision-making



The data must be available when decisions need to be
made (weekly?)
Difference between data needs at a school building
versus data needs for a district
The people who collect the data must see the
information used for decision-making.
Office Discipline Referral
Processes/Form

2
Coherent system in place to collect office
discipline referral data



Faculty and staff agree on categories
Faculty and staff agree on process
Office Discipline Referral Form includes
needed information




Name, date, time
Staff
Problem Behavior, maintaining function
Location
Organizing Data for “active
decision-making”


Counts are good, but not always useful
To compare across months use “average
office discipline referrals per day per
month”
Total Re f ve rs us Re f/Day/M o
NV High School
70
R efer r als
60
50
40
30
20
10
0
Aug Sept Oct Nov Dec Jan
Feb
School Month
Mar
Apr
May Jun
M ean R efer r als per D ay
Total Re f ve rs us Re f/Day/M o
5
4
3
2
1
0
Aug Sept Oct
Nov Dec
Jan
Feb
School Month
Mar
Apr
May
Jun
Using Data for On-Going
Problem Solving


Start with the decisions not the data
Use data in “decision layers” (Gilbert, 1978)


Is there a problem? (overall rate of ODR)
Localize the problem





(location, problem behavior, students, time of day)
Get specific
Don’t drown in the data
It’s “OK” to be doing well
Be efficient
?
Beh
Proble m
Location
?
Time
of
Day
Student
Setting
A
B
C
D
E
F
G
H
I
J
Loc ations
1
2
3
4
5
6
7
8
9 10
Tim es
A
B
C
D
E
F
G
H
I
Students
1
2
3
4
5
6
7
8
J
9 10
K
K
11
Problem ?
—
System s ?
—
—
—
—
— — — — — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — — — — — — — — — — — — — — — — — — Loc al/Individua l ?
— — — — — — —— — — — — — — — — — — — — — — —— — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — — —— —
Problem ?
—
System s ?
—
—
—
—
— — — — — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — — — — — — — — — — — — — — — — — — Loc al/Individua l ?
— — — — — — —— — — — — — — — — — — — — — — —— — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — — —— —
Problem ?
—
System s ?
—
—
—
—
— — — — — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — — — — — — — — — — — — — — — — — — Loc al/Individua l ?
— — — — — — —— — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — — —— —
Problem ?
—
System s ?
—
—
—
—
— — — — — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — — — — — — — — — — — — — — — — — — Loc al/Individua l ?
— — — — — — —— — — — — — — — — — — —— — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — — — — — —— — — — — — — —
— — — — — — — — — — —— — — — — — — — — — — —— — — — — — — — — — — —— —
Is there a problem?



Office Referrals per Day per Month
Attendance
Faculty Reports
Interpreting Office Referral Data:
Is there a problem?

Absolute level (depending on size of
school)



Trends



Middle Schools (>5 per day)
Elementary Schools (>1.5-2 per day)
Peaks before breaks?
Gradual increasing trend across year?
Compare levels to last year

Improvement?
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last year
2
1.5
1
0.5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last Year and This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last Year and This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Is There a Problem? #1
Maintain - Modify - Terminate
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
School Months
Mar
Apr
May
Is There a Problem? #2
Maintain - Modify - Terminate
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
T his year (Middle)
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Is There a Problem? #3
Maintain - Modify - Terminate
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last Year and This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
Is There a Problem? #4
Maintain - Modify - Terminate
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
Last Year and This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
What systems are problematic?

Referrals by problem behavior?


Referrals by location?


Are there specific problem locations?
Referrals by student?


What problem behaviors are most common?
Are there many students receiving referrals or
only a small number of students with many
referrals?
Referrals by time of day?

Are there specific times when problems occur?
Referrals by Problem Behavior
N um ber of R efer r als
Re fe rr als pe r Prob Be havior
50
40
30
20
10
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
Referrals by Problem Behavior
N um ber of R efer r als
Re fe rr als pe r Prob Be havior
50
40
30
20
10
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
Referrals by Problem Behavior
N um ber of R efer r als
Re fe rr als pe r Prob Be havior
15
10
5
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
Referrals per Location
N um ber of O ffic e R efer r als
Referrals by Location
50
40
30
20
10
0
B ath R B us A
B us
C af
C lass C omm
Gym
H all
School Locations
Libr
P lay G S pec
Other
Referrals by Problem Behavior
N um ber of R efer r als
Re fe rr als pe r Prob Be havior
15
10
5
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
Referrals by Problem Behavior
N um ber of R efer r als
Re fe rr als pe r Prob Be havior
15
10
5
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
N um ber of O ffic e R efer r als
Referrals by Location
50
40
30
20
10
0
B ath R B us A
B us
C af
C lass C omm
Gym
H all
School Locations
Libr
P lay G S pec
Other
N um ber of R efer r als per S tudent
Referrals per Student
20
10
0
Students
N um ber of R efer r als per S tudent
Referrals per Student
Stude nts pe r Num be r of Re fe rrals
20
10
0
Students
Referrals by Time of Day
N um ber of R efer r als
Re fe rrals by Tim e of Day
30
25
20
15
10
5
0
7 : 0 0 7 : 3 0 8 : 0 0 8 : 3 0 9 : 0 0 9 : 3 0 1 0 : 0 01 0 : 3 01 1 : 0 01 1 : 3 01 2 : 0 01 2 : 3 0 1 : 0 0 1 : 3 0 2 : 0 0 2 : 3 0 3 : 0 0 3 : 3 0
Time of Day
Referrals by Time of Day
N um ber of R efer r als
Re fe rrals by Tim e of Day
30
25
20
15
10
5
0
7 : 0 0 7 : 3 0 8 : 0 0 8 : 3 0 9 : 0 0 9 : 3 0 1 0 : 0 01 0 : 3 01 1 : 0 01 1 : 3 01 2 : 0 01 2 : 3 0 1 : 0 0 1 : 3 0 2 : 0 0 2 : 3 0 3 : 0 0 3 : 3 0
Time of Day
Decision-making
•
•
•
•
Is there a problem?
What areas/systems are involved?
Are there many students or a few involved?
What kinds of problem behaviors are
occurring?
• When are these behaviors most likely?
• What is the most effective use of our
resources to address this problem?
Examples




Trevor Test
Phoenix Elementary
Crone Middle
ODR Summary
Action:
Review data and respond



Is there a problem?
What system(s) are in need of
attention?
What intervention options would you
recommend be considered?
Trevor Test Middle School
565 students
Grades 6,7,8
Office Re fe rrals pe r Day pe r M onth
A v e R efer r als per D ay
This Year
20
15
10
5
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
Jun
N um ber of R efer r als
Re fe rrals pe r Prob Be havior
50
40
30
20
10
0
L a n g Ac h o l Ars o n Bo m bCo m b sDe f i a nDi s ru p tDre s sAg g / f g tT h e f tHa ra s sPro p D Sk i p T a rd y T o b a c Va n d W e a p
Types of Problem Behavior
Students by Major Referrals
25
20
15
10
5
Students
31
29
27
25
23
21
19
17
15
13
11
9
7
5
3
0
1
Number of Referrals
30
N um ber of O ffic e R efer r als
Re fe rrals by Location
80
60
40
20
0
B ath R B us A
B us
C af
C lass C omm
Gym
H all
School Locations
Libr
P lay G S pec
Other
N um ber of R efer r als
Re fe rrals by Tim e of Day
50
40
30
20
10
0
7 : 0 0 7 : 3 0 8 : 0 0 8 : 3 0 9 : 0 0 9 : 3 0 1 0 : 0 01 0 : 3 01 1 : 0 01 1 : 3 01 2 : 0 01 2 : 3 0 1 : 0 0 1 : 3 0 2 : 0 0 2 : 3 0 3 : 0 0 3 : 3 0
Time of Day
Action:
Review data and respond



Is there a problem?
What system(s) are in need of
attention?
What intervention options would you
recommend be considered?
Phoenix Elementary
Using Data For Decision-Making
You are the EBS team for
Phoenix Elementary. 265 students k-5





Do you have a problem?
Where?
With Whom?
What other information might you want?
Given what you know, what considerations
would you have for possible action?
M e a n S tu d e n t C o n ta cts p e r
Phoenix
Student DisciplineContacts
5
4
3
Year 2
Year 1
2
1
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
School Months
Apr
May
June
N u m b e r o f Stu d e n t C o n ta
Phoenix Elementary
Locations
140
120
100
80
Year 1
60
Year 2
40
20
0
Playgd
Class
Restrm
Location
Caf
Other
Students
49
46
43
40
37
34
31
28
25
22
19
16
13
10
7
4
1
Number of Student contacts
Phoenix Elementary ODR per Student
16
14
12
10
8
6
4
2
0
7:
00
7:
30
8:
00
8:
30
9:
00
9:
30
10
:00
10
:30
11
:00
11
:45
12
:15
12
:45
1:
15
1:
45
2:
15
2:
45
3:
15
Number of Referrals
Phoenix Elementary ODR per Time of Day
30
25
20
15
10
5
0
Time of Day
Action:
Review data and respond



Is there a problem?
What system(s) are in need of
attention?
What intervention options would you
recommend be considered?
Crone Middle School
Simulation
416 students
6,7, 8th grades
Av e R e fe r r a ls p e r D a y
Crone Middle School
Ave Referrals Per Day
20
15
10
5
0
Aug
Sept
Oc t
N ov
D ec
J an
Feb
School Months
Mar
Apr
May
J un
Crone Middle School
N u m b e r o f R e fe r r a ls
Referrals by Location
200
150
100
50
0
Bus LunchFields Class Comm Gym Lockr Hall LMC Other
Locations
Crone Middle School
N u m b e r o f R e fe r r a s l
Referrals by Problem Behavior
200
150
100
50
0
Lang Insub D isrup A gres Theft H aras C omb V andel S kip
Problem Behaviors
Fight
S afe Tardy Other
Crone Middle School
N u m b e r o f R e fe r r a ls
Referrals by Students (2+)
14
12
10
8
6
4
2
0
f
j
l
n
p
t
ac ae
e
r
Students
y
ab
h
b
m
a
ODRs per Teacher/Staff: Crone Middle School
Number of referrals
30
25
20
15
10
5
0
1
2
3
4
5
6
7
8
9 10 11 12 13 14 15 16
Teachers/Staff
Action:
Examine your own school data

USE ODR ORGANIZATION TEMPLATE

Fill in the data patterns for your school



Is there a problem?
What system(s) are in need of attention?
What intervention options would you
recommend be considered?