Transcript Slide 1

The Compelling Display of Data to
Achieve
Desired Decision Making
Robert Emery, DrPH, CHP, CIH, CSP, RBP, CHMM, CPP, ARM
Assistant Vice President for Safety, Health, Environment & Risk Management
The University of Texas Health Science Center at Houston
Associate Professor of Occupational Health
The University of Texas School of Public Health
University Risk Management & Insurance Association
Why Training on Data Presentation ?
• An interesting dilemma:
 Almost all programs thrive on data
 Virtually every important decision is based on data to
some extent
 Formal training in the area of compelling data
presentations is rare for many professionals
 The ability to compellingly display data is the key to
desired decision making
University Risk Management & Insurance Association
Why Training on Data Presentation (cont.)?
• The safety profession is particularly awash in
bad examples of data presentations!
• We’ve all endured them at some point in our
careers!
• Commentary: This may be the reason for
repeated encounters with upper
management who do not understand what
their EH&S programs do.
University Risk Management & Insurance Association
Evolution of EH&S Measures and Metrics
• First step:
ultimate outcomes – OSHA 300 log,
inspection non-compliance
• Second step:
EH&S activities prior to first order events –
injuries and non-compliance
University Risk Management & Insurance Association
Evolution of EH&S Measures and Metrics
(cont.)
• Third step:
Relating activities to larger institutional
parameters – true metrics
• Fourth step:
The compelling display of relationships so that
the desired decision by upper management
becomes obvious
University Risk Management & Insurance Association
Achieving EH&S Data
Display Excellence
• The presentation of complex ideas and
concepts in ways that are
Clear
Precise
Efficient
• How do we go about achieving this?
University Risk Management & Insurance Association
Go to The Experts On Information Display
•
Tukey, JW, Exploratory Data Analysis, Reading, MA 1977
•
Tukey, PA, Tukey, JW Summarization: smoothing; supplemented views, in
Vic Barnett ed. Interpreting Multivariate Data, Chichester, England, 1982
•
Tufte, ER, The Visual Display of Quantitative Information, Cheshire, CT,
2001
•
Tufte, ER, Envisioning Information, Cheshire, CT, 1990
•
Williams, R The Non-Designers Book: Design and Typographic Principles
for the Visual Novice. Berkley, CA, 1994
•
Tufte, ER, Visual Explanations, Cheshire, CT, 1997
University Risk Management & Insurance Association
Recommendations
• Don’t blindly rely on the automatic graphic
formatting provided by Excel or Powerpoint!
• Encourage the eye to compare different data
• Representations of numbers should be directly
proportional to their numerical quantities
• Use clear, detailed, and thorough labeling
University Risk Management & Insurance Association
Recommendations (cont.)
• Display the variation of data, not a
variation of design
• Maximize the data to ink ratio – put most
of the ink to work telling about the data!
• When possible, use horizontal graphics:
50% wider than tall is usually best
University Risk Management & Insurance Association
Compelling Remark by Tufte
• “Visual reasoning occurs more effectively
when relevant information is shown
adjacent in the space within our eye-span”
• “This is especially true for statistical data
where the fundamental analytical act is to
make comparisons”
• The key point: “compared to what?”
University Risk Management & Insurance Association
Four UTHSCH “Make Over” Examples
• Data we accumulated and displayed on:




Nuisance Fire Alarms
Workers compensation experience modifiers
First reports of injury
Corridor clearance
• But first, 2 quick notes:
 The forum to be used:
• The “big screen” versus the “small screen”?
• In what setting are most important decisions made?
 Like fashion, there are likely no right answers – individual tastes
apply, but some universal rules will become apparent
University Risk Management & Insurance Association
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
8
Number of Alarms
7
6
5
4
3
2
1
0
Spontaneous
Maintenance
Aug
Smoke/Fire
Jul
Jun
May
Apr
Mar
Feb
Jan
Dec
Nov
Oct
Sept
Contractor
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
Number of Alarms
9
8
7
6
5
4
3
2
1
0
Aug
Jul
Spontaneous
Jun
May
Apr
Smoke/Fire
Mar
Feb
Jan
Dec
Nov
Oct
Sept
Contractor
Maintenance
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
Number of Alarms
9
8
7
6
5
4
3
2
1
0
Aug
Jul
Spontaneous
Jun
May
Apr
Smoke/Fire
Mar
Feb
Jan
Dec
Nov
Oct
Sept
Contractor
Maintenance
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
Number of Alarms
9
8
7
6
5
4
3
2
1
0
Aug
Jul
Spontaneous
Jun
May
Apr
Smoke/Fire
Mar
Feb
Jan
Dec
Nov
Oct
Sept
Contractor
Maintenance
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
9
Number of Alarms
8
7
6
5
4
3
2
1
0
Sept
Oct
Nov
Dec
Jan
Contractor
Smoke/Fire
Spontaneous
Maintenance
Feb
Mar
Apr
May
Jun
Jul
Aug
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
9
Number of Alarms
8
7
6
5
4
3
2
1
0
Sept
Oct
Nov
Dec
Jan
Contractor
Smoke/Fire
Spontaneous
Maintenance
Feb
Mar
Apr
May
Jun
Jul
Aug
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
10
Maintenance
Spontaneous
Smoke/Fire
Contractor
9
Number of Alarms
8
7
6
5
4
3
2
1
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
Apr
May
Jun
Jul
Aug
Results of the Great
UTHSC-H Nuisance Fire Alarm Challenge (FY04)
10
9
Number of Alarms
8
Caused by UTHSCH Facilities work
Caused by detector malfunction or dust accumulation
Caused by actual smoke or fire
Caused by outside contractor work
7
6
5
4
3
2
1
0
Sept
Oct
Nov
Dec
Jan
Feb
Mar
Fiscal Year 04
Apr
May
Jun
Jul
Aug
Results of the Great UTHSC-H Nuisance Fire Alarm
Challenge
8
Number of Alarms
7
6
5
4
3
2
1
0
Spontaneous
Maintenance
Aug
Smoke/Fire
Jul
Jun
May
Apr
Mar
Feb
Jan
Dec
Nov
Oct
Sept
Contractor
Employee Worker’s Comp Experience Modifier
compared to other UT health components, FY 98-FY 04
1
0.8
Rate of "1" industry average, representing $1 premium per $100
0.6
0.4
0.2
0
98
99
UT-Tyler
2000
UTMB
2001
2002
2003
2004
UT-SA
MDA
UT-H
UT-SW
WCI Premium Adjustment for UTS Health Components
(discount premium rating as compared to a baseline of 1)
1
0.9
0.8
0.7
0.6
0.5
UT Health Center Tyler (0.40)
UT Medical Branch Galveston (0.38)
0.4
0.3
UT HSC San Antonio (0.27)
UT Southwestern Dallas (0.24)
0.2
UT HSC Houston (0.17)
UT MD Anderson Cancer Center (0.14)
0.1
0
1998
1999
2000
2001
2002
2003
Fiscal year
2004
2005
2006
2007
2008
Losses – Personnel
Reported Injuries by Population
800
690
694
715
675
623
608
511
600
400
200
0
98
99
Employee
00
01
02
Resident
03
04
Student
Number of First Reports of Injury, by Population Type
800
700
600
Total (n = 513)
500
400
300
Employees (n = 284)
200
Residents (n = 140)
Students (n = 89)
100
0
FY98
FY99
FY00
FY01
FY02
FY03
FY04
FY05
FY06
FY07
MSB Corridor Blockage in Cumulative Occluded Linear Feet,
by Month and Floor
(building floor indicated at origin of each line)
2000
7th
1800
Cumulative Occluded linear feet
1600
6th
1400
1200
5th
1000
800
4th
600
3rd
400
2nd
1st
200
0
G
Mar
Apr
May
Jun
Jul
2004
Aug
Sep
Oct
Nov
Dec
Jan
Feb
2005
Mar
Important Caveats
• Although the techniques displayed here are
powerful, there are some downsides to this
approach
 Time involved to create assemble data and create nonstandard graphs may not mesh with work demands
 Relentless tinkering and artistic judgment
• Suggested sources for regular observations to
develop an intuitive feel for the process
 Suggested consistent source of good examples:
• Wall Street Journal
 Suggested consistent source of not-so-good examples:
• USA Today “char-toons”
University Risk Management & Insurance Association
Summary
• The ability to display data compellingly is the key to
desired decision making
• Always anticipate “compared to what?”
• Maximize the data-to-ink ratio – e.g. eliminate the
unnecessary
• Think about what it is you’re trying to say
• Show to others unfamiliar with the topic without speaking
– does this tell the story we’re trying to tell?
University Risk Management & Insurance Association
Your Questions at This Point?
Now Let’s Look at
Some Other Examples
University Risk Management & Insurance Association
COLLABORATIVE LABORATORY INSPECTION PROGRAM (CLIP)
•During October 2005, 80 Principle Investigators for a total of 316 laboratory
rooms were inspected
•A total of 30 CLIP inspections were performed
Total PI’s
#Without Lab
Violations
# With Lab
Violations
%Without Lab
Violations
%With Lab
Violations
May 2005
94
53
41
56.38
43.62
June 2005
78
40
38
51.28
48.72
July 2005
84
54
30
64.29
35.71
August 2005
74
54
20
72.97
27.03
September 2005
69
39
30
56.52
43.48
October 2005
80
50
30
62.50
37.50
PI Inspections:
Comprehensive Laboratory Inspection Program (CLIP)
Activities and Outcomes, 2005
Month in
Year 2005
Number of Principle
Investigators Inspected
Inspections
Without Violations
Inspections
With Violations
May
94
53 (56 %)
41 (44%)
June
78
40 (51%)
38 (49%)
July
84
54 (64%)
30 (36%)
August
74
54 (73%)
20 (27%)
September
69
39 (56%)
30 (44%)
October
80
50 (62%)
30 (38%)
2005 Collaborative Laboratory Inspection Program (CLIP)
Inspection Activities and Compliance Findings
No. of Principal Invesitgator Inspections
100
90
80
70
Number without violations
60
50
40
30
Number with violations
20
10
0
May
Jun
Jul
Aug
Sep
Oct
Months within Calendar Year 2005
Nov
Dec
2005 Collaborative Laboratory Inspection Program (CLIP)
Inspection Activities and Compliance Findings
No. of Principal Invesitgator Inspections
100
90
80
70
Number without violations
60
50
40
30
20
Number with violations
10
0
May
Jun
Jul
Aug
Sep
Oct
Months within Calendar Year 2005
Nov
Dec
Figure 3. Receipt of Radioactive Material
Number of Receipts
6000
5000
4000
Non-Medical
Medical
Total
3000
2000
1000
0
FY00
FY01
FY02
FY03
FY04
Fig. 3. Receipts of Radioactive Materials
6,000
Number of receipts
5,000
4,000
Number of non-medical use
radioactive material receipts
3,000
2,000
Number of medical use
radioactive material receipts
1,000
0
FY 00
FY 01
FY 02
FY 03
Fiscal Year
FY 04
FY 05
FY 06
Fig. 3. Receipts of Radioactive Materials
6,000
Number of receipts
5,000
4,000
Number of non-medical use
radioactive material receipts
3,000
2,000
Number of medical use
radioactive material receipts
1,000
0
FY 00
FY 01
FY 02
FY 03
Fiscal Year
FY 04
FY 05
FY 06
OSHA LAB STANDARD &
EPA COMPLIANCE
350
325
300
275
250
225
200
175
150
125
100
75
50
25
0
2004
labs audited
2005
Total # of labs
# in compliance
Results of University EH&S Lab Inspection Program,
2003 to 2005
350
Number of labs existing
but not inspected
300
Number of Labs
250
Number of labs inspected
and one or more violation
detected
200
150
100
Number of labs inspected
and no violations detected
50
0
2003
2004
2005
Calendar Year
2006
2007
Note: 33 labs added to campus
in 2005, increasing total from
269 to 302.
$45,000.00
$40,000.00
$35,000.00
$30,000.00
$25,000.00
$20,000.00
$15,000.00
$10,000.00
$5,000.00
$0.00
Avg/Claim
ve
ru
se
n.
.
/o
ve
re
xt
en
si
Il l
on
ne
/..
ss
.
–
du
e
to
re
pe
at
e.
..
ob
je
ct
–
O
an
dl
in
g
in
cl
ud
in
g.
..
Li
fti
ng
/h
ob
je
ct
(
St
ri k
in
g
an
d/
or
fa
ll
fa
ll
–
–
ou
ts
...
in
si
d.
..
#
Sl
ip
/tr
ip
an
d/
or
Sl
ip
/tr
ip
Cost of Claim
Average Cost of Workers Compensation Claims By Cause
Period FY01 - FY06
Type of Claim
Average Cost of Workers Compensation Claims, by Cause, for Period FY01 - FY06
$45,000
$40,000
Slips, trips, falls – inside
$35,000
Cumulative trauma
$30,000
Overextension, twisting
$25,000
Slips, trips, falls – outside
$20,000
Lifting/handling
$15,000
Uncontrolled object
$10,000
$5,000
$0
Average
cost from
total of 3
events
Average
cost from
total of 10
events
Average
cost from
total of 4
events
Average
cost from
total of 3
events
Average
cost from
total of 4
events
Average
cost from
total of 4
events
2005 Workers' Compensation
by Injury Type
30
Burn/Scald
Caught In
Cut, Puncture, Scrape
20
Fall, Slip, Trip
MVA
15
Strain
Strike Against
10
Struck By
Rub/Abraded
5
Misc.
Month
De
c
No
v
Au
g
Se
pt
O
ct
Ju
ly
Ap
ril
M
ay
Ju
ne
ar
ch
M
Fe
b
0
Ja
n
Number of Cases
25
2005 Total Number of Monthly Workers Compensation Claims
inclusive of the three most frequent identifiable classes of injuries
80
Number of events
70
60
50
Total
40
30
20
Fall
Strain
Cut, Puncture
10
0
Jan
Feb
Mar
Apr
May
Jun
Jul
Year
Aug
Sep
Oct
Nov
Dec
45
40
35
30
25
20
15
10
5
0
2001
2002
2003
2004
2005
IBC Applications
IACUC Protocols
Annual Reviews
IBC Modifications
Special Animal Safety Protocols
Lab Inspections
Lab Decommissionings
DOD Grants
ATCC Authorizations
Material Transfer Agreements
Miscellaneous
Growth in U of L Research Enterprise and
Concurrent Growth in Committee and EH&S Workload, 2001 to 2005
Research Committees Workload
Number of Activities
Millions of Dollars
Annual Research Expenditures in Millions of Dollars
$150
$100
$50
$0
2001
2002
2003
2004
100
80
New IBC Protocols
60
40
IBC Amendments
20
IACUC Protocols
0
2001
2005
2002
60
50
40
30
20
10
0
Lab inspections
Lab close outs
Special Animal
Safety Protocols
2003
Years
2005
Other EH&S Biosafety Associated Activities
2004
2005
Number of Activities
Number of Activities
EH&S Biosafety Program Workload
2002
2004
Years
Years
2001
2003
25
20
15
ATCC Attestation
10
5
MTA’s
DOD Certification
0
2001
2002
2003
Years
2004
2005
Ju
A u ly
Se gu
pt st
em
b
O er
ct
o
No be
ve r
De mb
ce e r
m
b
Ja e r
nu
Fe a ry
br
ua
ry
M
ar
ch
Ap
ril
M
ay
Ju
ne
To
ta
l
Number of Exposures
2006 Dental Injuries by Type
25
20
15
10
Puncture cut
laceration
Needlestick
5
0
Month
Reported Sharps Injuries by Type for Academic Year 2006 (total n = 22)
10
Number caused by non-needle sharps
9
8
Number of reported events
Number caused by hollow-bore needles
7
6
5
4
3
2
1
0
JUL
Start of
Academic Year
AUG
SEP
OCT
NOV
DEC
JAN
FEB
Month of academic year 2006
MAR
APR
MAY
JUN
Building Related Programs
500
400
Percent Growth
300
Fire Ext. Systems
Fire Extinguishers
Fire Related Incidents
Asbestos Projects
200
100
0
1986
1996
1998
2003
-100
Years
Fire Extinguisher
Systems
Fire Extinguishers
Fire Related
Incidents
Asbestos
Projects
1986
0
0
0
0
1996
203
19
91
55
1998
208
25
15
68
2003
437
46
-18
191
Growth in Occupational Safety Responsibilities 1986 to 2003
Required Portable Fire Extinguishers
250
4,000
200
3,000
Number
Number
Building Fire Systems to be Serviced
150
100
50
0
2,000
1,000
0
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
Years
Years
Asbestos Projects
Fire Related incidents
1500
60
Number
40
20
0
1000
500
Years
20
04
20
02
20
00
19
98
19
96
19
94
19
92
19
90
Years
19
88
0
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
19
86
Number
80
Growth in Occupational Safety Responsibilities 1986 to 2003
Required Portable Fire Extinguishers
250
4,000
200
3,000
Number
Number
Building Fire Systems to be Serviced
150
100
50
0
2,000
1,000
0
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
Years
Years
Asbestos Projects
Fire Related incidents
1500
60
Number
40
20
0
1000
500
Years
20
04
20
02
20
00
19
98
19
96
19
94
19
92
19
90
Years
19
88
0
1986 1988 1990 1992 1994 1996 1998 2000 2002 2004
19
86
Number
80
Figure 1: Laboratory Waste verses Total Waste Generated
200,000
180,000
160,000
140,000
120,000
100,000
80,000
60,000
40,000
20,000
0
1999
2000
2001
Wastes Generated from Laboratory Operations
Waste Generated from Administrative Departments
Waste Generated from Renovation Projects
Total Waste Generatation
2002
2003
2004
2005
Figure 1: Hazardous Waste Generation in Pounds by Type of Institutional Activity
200,000
Total hazardous waste
generation in pounds
180,000
Weight in Pounds
160,000
140,000
120,000
Amount from
laboratory operations
100,000
80,000
Amount from renovation projects
60,000
40,000
Amount from administrative
departments
20,000
0
1999
2000
2001
2002
2003
2004
Fiscal Year
2005
2006
2007
2008
Figure 1: Laboratory Waste verses Total Waste Generated
$300,000
$250,000
$200,000
$150,000
$100,000
$50,000
$0
FY00/01
FY01/02
FY02/03
FY03/04
Cost of Wastes Generated from Laboratory Operations
Cost of Waste Generated from Administrative Departments
Cost of Waste Generated from Renovation Projects
Total Cost of Waste Generatated by the University of Delaware
FY04/05
FY05/06
Figure 2: Annual Hazardous Waste Disposal Cost by Type of Institutional Activity
$300,000
Total cost
$250,000
Cost of waste
from lab operations
Dollars
$200,000
$150,000
$100,000
Cost of waste from
renovation projects
Cost of waste from
administrative departments
$50,000
$0
2001
2002
2003
2004
2005
Fiscal Year
2006
2007
2008
UCR EH&S Staff,
Extramural Research Funding and Grant Awards
900
180
$166
816
800
800
160
Number of Awards
$143
735
Grants in Millions $
710
EHS Career Staff
140
610
583
600
120
559
529
$106
523
498
484
500
100
457
$82
$87
418
400
80
$65
$58
300
60
$51
$43
$40
200
$33
$23
$45
$39
$36
40
$28
$26
18.5
100
$45
19
19
20
19
19
18.5
15
17
18
20
22
Campus Sq. Footage & EHS Staffing
60.00
70,000
60,000
50,000
GSF in Tens of Thousands
72,964
50.00
40.00
55,200
30.00
40,000
30,000
29,700
20.00
20.5
17
15
20
20,000
10.00
1990
2005
2010
Fiscal Year
2008
2007
2006
2005
2004
2003
2002
2001
2000
1999
1998
1997
1996
1995
1994
1993
1992
0
1991
0
Fiscal Year
EH&S Staffing Trends
60
25
20,000
EHS Staffing & Student Growth
55
20,140
20
50
15,000
All Students
45
15,666
EHS Staff
40
35
10,000
30
Career FTE
15
10
25
8,006
5
5,000
20
15
2005
Fiscal Year
2010
EHS Staff
Budget Augments
Budget Cuts
Fiscal Year
20
04
20
02
20
00
19
98
19
96
19
94
10
1990
19
92
0
-
19
90
1990
Number of Grant Awards
619
$123
EHS Staff; Extramural Awards-Million $
622
EHS FTE
700
UCR Campus Growth Indicators
Compared to EH&S Staffing
Campus Gross Square Footage
Student Population
Numbers of Students
Square Footage
80,000,000
60,000,000
40,000,000
20,000,000
0
1990
1995
2000
2005
25,000
20,000
15,000
10,000
5,000
0
2010
1990
1995
Years
Extramural Research Funding
2005
2010
EH&S Staffing
25
Number of Staff
100,000,000
80,000,000
Dollars
2000
Years
60,000,000
40,000,000
20,000,000
0
20
15
10
5
0
1990
1995
2000
Years
2005
2010
1990
1995
2000
Years
2005
2010
2006 Epilepsy Foundation Range of Donations by a Sampling
of Drug Companies
$1,000,000
$900,000
$500,000 to
$999,999
Sample includes:
Eisai
GalxoSmithKline
UCB
$800,000
Dollars Donated
$700,000
$600,000
$500,000
$100,000 to $499,999
Sample includes:
Abbott Laboratories
Novartis Pharmceuticals
Ortho-McNeil Neurologics
Pfizer
$400,000
$300,000
$200,000
$100,000
$25,000 to $49,999
Sample includes:
PhRMA (trade group)
$0
Low
Medium
Category of Donors
High
Figure 2. Improvement in compliance after the implementation of the Program for the Management of Radioisotopes
(PMRI) in 20 sites across Canada
Level of compliance before PMRI
Level of improved compliance after PMRI
100
90
70
60
50
40
30
20
10
it
lim
ex
ce
ed
s
ac
tiv
ity
Po
ss
es
s
La
b
cl
as
si
fic
at
io
n
ns
fe
rl
og
Tr
a
te
st
s
W
ip
e
te
st
s
Le
ak
Tr
a
in
in
g
re
co
rd
s
s
0
In
ve
nt
or
ie
Percent Compliancy
80
Requirements
Journal of Environmental
Health, September 2006,
page 49
Quat-Safe and Cotton
Food Service Towel Quanternary Ammonium Chloride Solution
Concentration Compared Over Time*
Quat-Safe Solutions
Cotton Towel Solutions
400
350
300
250
EPA Limit
200
150
100
50
0
ppm Quanternary Ammonium Chloride
ppm Quanternary Ammonium Chloride
400
350
300
250
EPA Limit
200
150
100
50
0
0
15
30
60
45
75
0
Time in minutes
*Towels removed and rinsed at each interval
15
30
45
Time in minutes
60
75
ANNUAL SPH FACULTY ACTIVITIES PEER REVIEW RESULTS FOR ROBERT
EMERY 15% FACULTY APPOINTMENT
Outstanding
10
9
Excellent
8
Good
7
Acceptable
YEAR
6
1
2
3
1999 2000 2001
TEACHING 8.86 8.33 8.16
RESEARCH 8.56 9.33 8.85
SERVICE
8.78 8.33 9.06
OVERALL
8.62 8.5 8.78
4
5
Note:
Emery
ranked as
Assistant
Professor
1999-2000,
promoted to
Associate
Professor in
2002.
6
7
8
2002 2003 2004
8.25 8.5 8.85
8.65 8.44 6.75
9.28 9.2
8.6
8.63 8.8 8.09
Annual SPH Faculty Activities Peer Review Results for Emery
(15% Faculty Appointment)
Research
Teaching
Outstanding 10
10
Assoc Professor
Asst Professor
9
9
8
8
Good
7
7
Acceptable
6
Excellent
1999
2000
2001
2002
2003
2004
2005
6
1999 2000
Service
10
9
9
8
8
7
7
6
6
2001 2002 2003
2004 2005
Overall
10
1999 2000
2001 2002 2003
2004 2005
1999 2000
2001 2002 2003
2004 2005