Transcript Visual Thesaurus Webinar

Webinar Attendee Instructions
Please read the following while waiting for the webinar to start:
• Duration: ~ 60 minutes of presentation and ~30 minutes of discussion
• Dial 1-866-227-1607 (International 1-703-639-1130) to access audio
– Meeting support: *0 for operator
• Please mute your phone unless speaking to the webinar
– Muting your phone is important to avoid disturbing the webinar with extraneous
noises from conversations, keyboard operation, construction, pets and family
members, on-hold music, etc.
• If you need to ask an immediate question, please do so over the phone.
– Otherwise please wait for Q&A at the end or use the contact information on the last
slide to follow up after the webinar
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
1
Using Qualitative Display Shapes for
Improving Operator Situation
Awareness
Jason Laberge
Honeywell Labs
Dr. Peter Bullemer
Human Centered Solutions
(HCS)
ASM Consortium Webinar Series
This publication is designed to provide accurate and authoritative information in regard to subject matter covered. The information is
provided, however, “as is” and without any warranty of any kind. Use of the information is at the user’s risk and the user is responsible for any
results obtained by using the information provided in this publication. The publication is sold with the understanding that the author and
publisher are not engaged in rendering legal, accounting or other professional services. If legal advice or other expert assistance is required,
the services of a competent professional person should be sought.
Requests for permission to reproduce or translate this publication or requests for further information should be addressed to the ASM
Consortium, Director, Honeywell Process Solutions, 2500 W. Union Hills Blvd., Phoenix, AZ 85027. Copyright © 2010 by Honeywell
International Inc.
Webinar Presenters
• Jason Laberge
– Principal Investigator for the Abnormal Situation
Management® (ASM®) Consortium
– Lead human factors researcher for ASM since 2005
– Research focuses on understanding the factors that
influence human performance in complex systems
• Dr. Peter Bullemer
– Senior partner, HCS, human factors consulting group
– Ph.D. in Cognitive Science
– Participation in ASM program since 1993, including
roles as Director and Principle Investigator
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
3
Webinar Overview
• This webinar aims to:
– Introduce the ASM Consortium
– Review the Console Operator Display Hierarchy
– Present the Design Motivation for using Overview Displays
– Discuss what Makes an Effective Overview Display Design
– Establish a Relationship between Situation Awareness, Human
Perception, and Overview Display Design
– Introduce Qualitative Shapes Designed for Overview Displays
– Describe Results of an Evaluation of the Benefits of Using Qualitative
Display Shapes for Improving Operator Situation Awareness
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
4
Abnormal Situation Management
A Joint Research & Development Consortium
Founded in 1994
Human Centered Solutions
Helping People Perform
Creating a new paradigm for
the operation of complex
industrial plants, with solution
concepts that improve
Operations’ ability to prevent
and respond to abnormal
situations.
www.asmconsortium.org
UCLA
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
5
ASM Consortium
What is an Abnormal Situation?
• Consequently, the
operations team must
intervene to supplement
the control system.
Loss of Life
Personal Injury
Equipment Damage
Environmental Release
Public Relation
Product Throughput
Product Quality
Job satisfaction
An Abnormal Situation Impacts Process Safety
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
6
Business Impact
• An industrial process is
being disturbed and the
automated control system
can not cope
ASM Consortium
Cost of Abnormal Situations
Days per Year
Plant Operating Target
Operational Constraints
Plant Incidents or
Abnormal Situations
< 60%
Daily Production Level
Plant Capacity Limit
95%
100%
• Unexpected Events Cost 3-8% of Capacity
• At least >$10B annually lost in production*
*Based on North America operations ~1992
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
7
ASM Consortium
Sources of Abnormal Situations
• The ASM Consortium develops solutions primarily to
address ‘People’ sources of abnormal situations
Almost Always
Preventable
Mostly
Preventable
Process
20%
People
40%
Equipment
40%
7/15/2015
Often
Preventable
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
8
Console Operator Display Hierarchy
An Introduction
• The Console Operator Interface is one solution for
supporting operators in preventing and managing
abnormal situations
• The recommended Console Operator (CO) display
hierarchy is made up of four levels:
Overview
Display
LEVEL 1
– Level (1) Overview
• Summarizes critical variables
– Level (2) Summary
LEVEL 2
Extraction
Display
Conversion
Display
Blending Display
Furnaces
Coker
Fractionator
• Display for each major process area
(e.g., PFD level)
– Level (3) Equipment
LEVEL 3
• Display for equipment detail
information (P&ID level)
– Level (4) Details
LEVEL 4
Furnace Display
of Individual
Burners
Environmental
Exhaust Results
• Selected details, help, or faceplates
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
9
Managing Abnormal Situations
Supervisory Control Responsibilities
Process
State
Operator Mental & Physical Activities
Orienting
Inputs from Process
(sensors, analyzers, radios,
video, instructions, sounds &
smells)
(1) Sensing,
Perception,
and/or
Discrimination
Evaluating
(2) Analysis,
Interpretation,
and/or
(3) Projection
Acting
Physical and/or
Verbal
Response
Outputs to Process
(SP, OP%, Manual
adjustments)
Situation Awareness (1 --3)
3)
Internal Feedback
Assessing
External Feedback
• This model operationalizes the activity types in the
operator’s supervisory control responsibilities for
managing abnormal situations
Adaptation of Supervisory Control Activity models of Jens Rasmussen and David Woods - CMA.
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
10
Display Hierarchy and ASM
How the HMI Supports ASM
• Effective supervisory control
involves processing information
at multiple levels of detail “Big Picture”
Process
Overview
Status
Display
Changes
LEVEL 1
– From the “big picture”
(Orient or Assess) to the “details”
(Evaluate, Act or Assess)
and back and forth
LEVEL 2
Conversion
Display
Blending Display
Investigating
and Troubleshooting
LEVEL 3
– The display hierarchy allows
an operator to move between
the “big picture” to the “details”
as the task or situation requires
Extraction
Display
Furnaces
Coker
Fractionator
LEVEL 4
Furnace Display
Environmental
Adjustments
of Individual
Exhaust Results
Burners
and Control Moves
“Details”
The Display Hierarchy is a Critical Solution for ASM
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
11
Overview Displays
Design Rationale
• Old pneumatic boards supported at a glance awareness:
– Hearing a gauge moving
– Pulling out a component
to remind you it was in manual
– Having trend information from strip charts
– Seeing alarm status on a fixed alarm panel
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
12
Overview Displays
Design Rationale
• Old pneumatic boards supported at a glance awareness:
– Hearing a gauge moving
– Pulling out a component
to remind you it was in manual
– Having trend information from strip charts
– Seeing alarm status on a fixed alarm panel
• Modern DCS show process values across several
screens and many hidden displays
– Difficult to know where the process has gone, how it got there, or what
should be done to recover
– Effective arrangement and visualization of process values is required
– Operators must actively navigate to find critical information
The DCS Must Include a Mechanism to Support Awareness
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
13
Overview Displays
Maintaining the “Big Picture”
• Incident investigations often identify a root cause that
operators lost track of the “big picture” of plant status
– Operators had to rely on error-prone processes such as:
• Memory of process plant status across (often hidden) displays
• Mental representations of the current/future state of the process
• Other tools and displays that were not designed for the purpose of
maintaining the “big picture”
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
14
Overview Displays
Maintaining the “Big Picture”
• Incident investigations often identify a root cause that
operators lost track of the “big picture” of plant status
– Operators had to rely on error-prone processes such as:
• Memory of process plant status across (often hidden) displays
• Mental representations of the current/future state of the process
• Other tools and displays that were not designed for the purpose of
maintaining the “big picture”
• An Overview Display can provide operators with at-aglance situation awareness similar to pneumatic boards
– Overview displays are on a dedicated screen (always available)
– Overview displays are specifically designed to help operators keep
track of the “big picture”
– Overview displays support operators in determining how the process
is running and what direction it is heading
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
15
Overview Displays
Common Failure Modes
• There may be numerous reasons why just having an
overview display is not effective:
–
–
–
–
Incorrect information displayed
Poorly displaying the correct information
Inadequate navigation hierarchy
Operations has the choice to display the overview or not
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
16
Overview Displays
Common Failure Modes
• There may be numerous reasons why just having an
overview display is not effective:
–
–
–
–
Incorrect information displayed
Poorly displaying the correct information
Inadequate navigation hierarchy
Operations has the choice to display the overview or not
• Critical Question to ask = What role is the overview
display meant to serve?
– Summary for console operator, operations supervision, or field
– Support communication between console positions
– Support additional operations during start-up or upsets
• The answer to the critical question above should
determine what to display in the Overview Display
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
17
Effective Overview Displays
What Information to Show to Operators?
• From ASM Guidelines = Guideline 1.1  Use a process
overview display for operator span of control
– Potential information to include:
• “Critical Few” process variables that provide an “at-a-glance” summary
• Calculated process conditions that depict the health of high-level process
areas such as a furnace, reactor or distillation column
• Critical variables from upstream, downstream and utilities that could
impact the console’s operations
•
•
•
•
Alarm status for “critical alarms” (emergency and high priority)
The disturbance propagation paths
Time-based patterns (i.e., trends) of critical variables
Summary status of shutdown systems, critical bypasses, and interlocks
should be included (or accessible from the overview)
How Do You Determine the Information to Show?
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
18
Effective Overview Displays
User Centered Design Lifecycle
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
19
Effective Overview Displays
User Centered Design Lifecycle
Operations
Team Reviews
& OTS
HMI Shape
Libraries
ASM Effective
Operator Display
Design
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
20
Effective Overview Displays
User Centered Design Lifecycle
How to determine
information to
show?
Operations
Team Reviews
& OTS
Interaction
Requirement
Analysis
HMI Shape
Libraries
ASM Effective
Operator Display
Design
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
21
Effective Overview Displays
Interaction Requirements Analysis
What operators
need to know
Information
requirements
– Information Requirements = The
data and information needs of an
operator to make decisions or
perform specific tasks
Collaboration
requirements
Action
requirements
Interaction
Requirements
What operators
need to do
7/15/2015
• Interaction Requirements
What operators
need to share
– Action Requirements = The
software applications,
procedures, or DCS “control
handles” needed to perform
specific tasks
– Collaboration Requirements =
Communications (e.g., telephone,
radio, and verbal) needed to
complete the work
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
22
Effective Overview Displays
Interaction Requirements Analysis
• Interaction Requirements Analysis
Methods
– www.asmconsortium.org  Resources 
White Papers  Operator Interface
Requirements
– Describes how an interaction requirements
analysis is necessary to design an overview
display to support operator situation
awareness
•
•
•
•
7/15/2015
Team methods
Procedure methods
Strategy methods
Process methods
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
23
Effective Overview Displays
Interaction Requirements Analysis
• Interaction Requirements Analysis
Methods
Interface Type
Control Room
Console station
Level 1 display
Level 2 display
Level 3 display
– www.asmconsortium.org  Resources 
TeamWhite Papers
Procedures
Strategies
 Operator
Interface Process
 Requirements


Level 4 display
Task display
Applications

Work tools

7/15/2015

– Describes how an interaction requirements
 analysis is necessary to design


an overview
display to support
operator

 situation 
awareness
•
•
•
•
Team methods
 methods
Procedure
Strategymethods
Process methods








ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
24
Designing for Situation Awareness
ASM Supervisory Control Model*
• Designing for situation awareness is the basis for
effective overview display design
– Perceiving and ‘Orienting’ to changes / deviations in the process
– Comprehending and ‘Evaluating’ where the process is running
– Projecting where the process will move if ‘Actions’ are taken
Process
State
Operator Mental & Physical Activities
Orienting
Inputs from Process
(sensors, analyzers, radios,
video, instructions, sounds &
smells)
Evaluating
(1) Sensing,
Perception,
and/or
Discrimination
(2) Analysis,
Interpretation,
and/or
(3) Projection
Acting
Physical and/or
Verbal
Response
Outputs to Process
(SP, OP%, Manual
adjustments)
Situation Awareness (1 --3)
3)
Internal Feedback
Assessing
External Feedback
*Adaptation of Supervisory Control Activity models of Jens Rasmussen and David Woods
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
25
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
26
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
ORIENTING
Operator scans the Level
1 overview and other
displays in the display
hierarchy
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
27
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
ORIENTING
Operator regularly
glances back to
dedicated Level 1
Advanced
Appsdisplay
overview
to monitor process
Window
plant status
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
28
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
ORIENTING
Operator identifies a
process deviation
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
29
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
EVALUATING
Operator drills in to
Level 2+ displays for
more details Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
30
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
EVALUATING
Operator
uses detail
Notifications
displays to troubleshoot
Displayand
Window
deviation
form a
hypothesis of the cause
Level 2
Level 3
Faceplate Level 4
7/15/2015
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
31
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ACTING
Operator makes control moves
to manage the process
deviation based on their
hypothesis of the cause
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
32
Designing for Situation Awareness
Effective Operator Monitoring and Control
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
7/15/2015
ASSESSING
Operator continues to
glance back to
dedicated Level 1
overview display to
Operating
Displays
determine
if actions
had
desirable effects
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
33
Designing for Situation Awareness
Proactive Monitoring Strategy
• Proactive monitoring is actively maintaining awareness
of the current situation and status of the process unit
– Regularly reviewing major process
functions + critical variables in
the overview display
– When deviations from normal occur,
operators respond before alarms
Trend Displays
Window
Trend Displays
Window
Level 1 Overview
Display Window
Documentation
Window
Goals / Plans / Actions
Window
Operating Displays
– Proactive monitoring and responding
gives operators more time to act before
major consequences occur
Notifications
Display Window
Level 2
Level 3
Faceplate Level 4
Operating Displays
Level 2
Level 3
Advanced Apps
Window
Faceplate Level 4
• Visualizing process information in a way that operators
can perceive and ‘orient’ to process changes is critical to
supporting proactive monitoring
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
34
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
Stall Margin
5
Flaps
Airspeed
0
7/15/2015
Bank
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
Stall Margin
5
Flaps
Airspeed
0
7/15/2015
Bank
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
Stall Margin
5
Flaps
Bank
Airspeed
0
7/15/2015
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
38
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
39
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
40
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
41
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
42
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
43
Designing for Situation Awareness
Direct Perception Displays and Objects
• Direct perception displays and graphical objects:
– Allows the operator to directly perceive process state, relative to
boundaries, at a glance
– The need for mental calculations is reduced, thereby reducing the
opportunities for human error
– Situation Awareness is supported to avoid cognitive tunnel vision and
helps maintain the ‘big picture’
10
X1 Avg(X1,X2) X2
Stall Margin
5
Flaps
D1
Bank
Airspeed
0
7/15/2015
D2
5
10
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
44
Designing for Situation Awareness
Design Guidelines for Direct Perception
• Trend charts, bar charts, and
divided bars are more effective than
pie charts, stacked bars, and tree
maps
• Divided bars are the most effective
for supporting judgments about
proportions
• Grouped bar charts (or dot charts)
are more effective than Stacked,
Divided Bar charts
7/15/2015
Better
50
40
30
20
10
Vs.
0
1
2
3
4
Vs.
Vs.
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
45
Designing for Situation Awareness
Design Guidelines for Direct Perception
• Keep display objects consistent
when possible
– “Mental cost” associated with
switching between techniques
Better
Vs.
• Use consistent display object
orientations
– Judgments of length for vertical
lines are better than for horizontal
• There will be reasons to use
horizontal bars or other graphing
techniques
Vs.
Vs.
– e.g., Uniqueness, Space limitations
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
46
Qualitative Display Shapes
Design Motivation
• Previous ASM attempts to visualize process information
• Complex, highly custom
• Unit-specific
• Labor intensive
• Not reusable, repeatable
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
47
Qualitative Display Shapes
Design Strategy
• Strategy: Identify process functions for equipment types
and the critical variables for those process functions
– Determine the interaction requirements required
– Create qualitative display shapes that can be reused
Equipment
General Class Different Designs
Furnace
Generic
Common Functions
Energy
Product Spec
Constraints
Modes of operation
Distillation
Natural Draft
Forced Draft
Induced Draft
Generic
Commonality across Designs
Variables for Common Functions
Efficiency
Outlet Temp, Composition, Steam
Production
Fuel side - O2, Draft Pressure, Steam drum
level, stack temp, arch temp, firebox temp,
stack analysis (NOx, CO, O2), firing rate,
fuel qualiy (heating value, sulphur level),
fuel header / burner pressure,
Operational concerns
Individual Functions
Differences across Designs
Variables for Individual Operational concerns
Functions
Incomplete combustion, insufficient air
flow/mixing, burner operating limits,
overfiring (during upsets or startup /
shutdown procedures)
Process side - TMT (Tube metal
temperatures aka skin temperatures), tube
dP, feed valve pos.
Startup, shutdown, decoking, offline, normal Manage production rates while transitioning
production
furnace operation (i.e. steady increase or
steady production if swinging furnaces)
Damper position
ID/FD Fan Speed
ID Fan Speed
Energy
Exchanger duties
Product Spec / Quality
Tower top, bottom (and side stream - if
Feed Quality
applicable) compositions (inferred,
analyzed), temperature profile, Reflux ratio,
mass balance
Delta Pressure, Max Reboiler and/or
Reboiler Fouling, Tower Flooding
Condensor Duty, overhead temperature &
pressure, dewpoints
Startup (inventoring, total reflux), shutdown,
normal operation
Constraints
Modes of operation
Heat Integration with compressors (Heat
Pumps, Wet gas Comps, Turbo Expanders)
Fractionator
Atmospheric
Vacuum
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
48
Qualitative Display Shapes
Design Strategy
Visualization Requirements for Coker Unit Type 1 Display
• Strategy: Identify
process functions for equipment types
Visualization Requirements
Parameter Example
and the critical Item
variables
forcurrent
those
1
Show parameter's
qualitativeprocess
state with
Cokerfunctions
Furnace Operating
respect to equipment area
Coke Drum Operating
– Determine the interaction
requirements required Modes;
Modes
2
Show parameter's current qualitative state and
Interlock violations
– Create qualitative display
shapes
that
betoreused
location
of all equipment
areascan
contributing
that
Equipment
General Class Different Designs
Furnace
Generic
Common Functions
Energy
Product Spec
Constraints
Modes of operation
Distillation
Natural Draft
Forced Draft
Induced Draft
Generic
Energy
Product Spec / Quality
Constraints
Modes of operation
Fractionator
Atmospheric
Vacuum
7/15/2015
state
Commonality across Designs
Differences across Designs
3
Show parameter's current
value relative to Individual Functions
Coke Drum
charge rate
Variables for Common Functions
Operational concerns
Variables for Individual Operational concerns
configurable target value and (if appropriate alarm
Functions
Efficiency
limits)
Outlet Temp, Composition, Steam
4
Show parameter's current value relative to
Furnace Feed valve output
Production
Fuel side - O2, Draft Pressure, Steam drum Incomplete combustion, insufficient air
configurable
target
range
and
(if
appropriate
alarm
percentage; Furnace Steam
level, stack temp, arch temp, firebox temp, flow/mixing, burner operating limits,
stack analysis (NOx,
CO, O2),-firing
rate, outside
overfiring (during
upsets or
startup / be more
limits)
value
of range
should
valve output percentage;
fuel qualiy (heating value, sulphur level),
shutdown procedures)
salient.
Furnace Coil Outlet
fuel header / burner pressure,
temperature
Process side - TMT (Tube metal
5
Show
parameter
estimated
value
at
end
of
time
Stack NOx and CO cumulative
temperatures aka skin temperatures), tube
dP, feed valve pos. period based on actual value of parameter relative
emissions, Estimated
Startup, shutdown, decoking, offline, normal Manage production rates while transitioning
to configurable target
value.
production for 12 hour coke
production
furnace operation
(i.e. steady increase or
steady production if swinging furnaces)
cycle.
6
Show the ratio of two parameter's current values
Damper position Tower draw rate to pump
ID/FD
Fan Speedaround rate
relative to configurable target value; need to
see
ID Fan Speed
individual
contributions
to
ratio.
Exchanger duties
Heat Integration with compressors (Heat
Pumps, Wet gas Comps, Turbo Expanders)
7
Show parameter's
current value as deviation from
Vacuum Tower Condenser
configurable
value either in one or two
Intermediate pressure;
Tower top, bottom (and
side stream - if target
Feed Quality
applicable) compositions (inferred,
direction
Fractionator differential
analyzed), temperature profile, Reflux ratio,
mass balance
pressure; Fractionator cutpoint
Delta Pressure, Max Reboiler and/or
Reboiler Fouling, Tower Flooding
temperature
Condensor Duty, overhead temperature &
pressure,
… dewpoints
Startup (inventoring, total reflux), shutdown,
13operation Show estimate of (storage) capacity in hours
Feed tank levels, intermediate
normal
based on rate parameter (i.e. production or
product tank levels and final
consumption rate).
product tank levels
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
49
Qualitative Display Shapes
Shape Design
• Eight qualitative display shapes have been developed to
support operator monitoring of overview displays:
– Gauge objects:
Level
– Qualitative objects:
– Controller objects :
7/15/2015
Temperature
Deviation
Flow
Quality
Pressure
Trend
Controller
Output
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
50
Qualitative Display Shapes
Shape Functionality
• Information in the new display shapes is presented in
such a way that operators can qualitatively perceive:
– normal operating limits
– alarm limits
Range High
High Alarm Limit
– how close the process is
relative to the limits
– how quickly the process is
moving towards / away from
the limits
7/15/2015
Setpoint
Normal Operating
Limits
Current Value
Low Alarm Limit
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Range Low
51
Qualitative Display Shapes
Shape Functionality
• The new display shapes can be configured to show when
variables are outside a normal operating range and in an
abnormal condition
– Useful when operators want to
know that a variable has deviated
more than expected
– When a variable exceeds a normal
operating limit, the border
surrounding the object is changed
to a pink color
Normal Operating
Limits
• During proactive monitoring activities, operators are
primarily interested in detecting process deviations
(abnormal variation) before alarms occur
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
52
Qualitative Display Shapes
Shape Functionality
• The new display shapes can be configured to show when
variables are outside a normal operating range and in an
abnormal condition
– Useful when operators want to
know that a variable has deviated
more than expected
– When a variable exceeds a normal
operating limit, the border
surrounding the object is changed
to a pink color
Normal Operating
Limits
• During proactive monitoring activities, operators are
primarily interested in detecting process deviations
(abnormal variation) before alarms occur
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
53
Qualitative Display Shapes
Shape Functionality
• The new display shapes can be configured to show when
variables are outside a normal operating range and in an
abnormal condition
– Useful when operators want to
know that a variable has deviated
more than expected
– When a variable exceeds a normal
operating limit, the border
surrounding the object is changed
to a pink color
Normal Operating
Limits
• During proactive monitoring activities, operators are
primarily interested in detecting process deviations
(abnormal variation) before alarms occur
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
54
Qualitative Display Shapes
Shape Functionality
• The new display shapes can be configured to show when
variables are outside a normal operating range and in an
abnormal condition
– Useful when operators want to
know that a variable has deviated
more than expected
– When a variable exceeds a normal
operating limit, the border
surrounding the object is changed
to a pink color
Normal Operating
Limits
• During proactive monitoring activities, operators are
primarily interested in detecting process deviations
(abnormal variation) before alarms occur
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
55
Qualitative Display Shapes
Examples of Different Process Situations
Level Gauge
Normal
Abnormal
Condition
Pressure Gauge
Alarm Condition
Normal
Flow Gauge
Normal
7/15/2015
Abnormal
Condition
Abnormal
Condition
Alarm Condition
Temperature Gauge
Alarm Condition
Normal
Abnormal
Condition
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Alarm Condition
56
Shape Evaluation Study
Introduction and Purpose
• An evaluation study was completed to assess the
benefits of using the new qualitative shapes
– Purpose: Evaluate the effectiveness of an overview display designed
using qualitative shapes that support operator situation awareness
during process monitoring activities
Functional/Qualitative Overview Display
Schematic/Numeric Overview Display
vs.
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
57
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Crude
Feed
Crude
Feed
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
58
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Crude
Heater
Crude
Heater
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
59
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Crude Tower
Crude
Tower
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
60
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Vacuum Heater
Vacuum Heater
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
61
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Vacuum Tower
Vacuum Tower
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
62
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Hydrotreater
Hydrotreater
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
63
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Stripper
Stripper
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
64
Shape Evaluation Study
Overview Display Designs
• Compare Schematic and Functional overview displays
– Variables are the same
– Main equipment areas are the same
– Differences are visualization technique and functional arrangement
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Debutanizer
Debutanizer
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
65
Shape Evaluation Study
Detecting Process Deviations
• Detecting deviations to variables can be supported in
different ways in the Level 1 overview displays:
Schematic/Numeric Overview Display
Operators must
assess process
variation relative to
their memory of
operating ranges and
alarm limits
7/15/2015
45.01
43.34
45.80
48.75
46.99
45.98
47.12
44.44
42.76
45.32
Functional/Qualitative Overview Display
Normal variation
50
40
Operators can
perceive normal and
abnormal variation
relative to visual
elements (operating
range and/or alarm
limits) in the shape
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
66
Shape Evaluation Study
Detecting Process Deviations
• Detecting deviations to variables can be supported in
different ways in the Level 1 overview displays:
Schematic/Numeric Overview Display
Operators must
assess process
variation relative to
their memory of
operating ranges and
alarm limits
Operators must
judge whether an
abnormal condition is
occurring (cognitively
demanding, error
prone)
7/15/2015
45.01
43.34
45.80
48.75
46.99
45.98
47.12
44.44
42.76
45.32
Functional/Qualitative Overview Display
Normal variation
50
40
55.05
52.31
50.01
48.75
46.99
45.98
47.12
44.44
42.76
45.32
Abnormal
process
deviation
50
40
Operators can
perceive normal and
abnormal variation
relative to visual
elements (operating
range and/or alarm
limits) in the shape
Operator attention is
drawn to abnormal
process deviations
and alarms using
visual cues
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
67
Shape Evaluation Study
Detecting Process Deviations
• Detecting deviations to variables can be supported in
different ways in the Level 1 overview displays:
Schematic/Numeric Overview Display
Functional/Qualitative Overview Display
Operators can
Operators must
perceive normal and
assess process
Normal variation
45.01
43.34
45.80
48.75
46.99
45.98
47.12
44.44
42.76
45.32
50
abnormal variation
variation relative to
relative to visual
their memory of
40
Hypothesis:
New
display
shapes
should
support
qualitative
elements (operating
operating ranges and
range and/or alarm
perception
of process conditions, resulting in improved
alarm limits
limits) in the shape
operator situation awareness while monitoring overview
displays
Operators must
judge whether an
abnormal condition is
occurring (cognitively
demanding, error
prone)
7/15/2015
55.05
52.31
50.01
48.75
46.99
45.98
47.12
44.44
42.76
45.32
Abnormal
process
deviation
50
40
Operator attention is
drawn to abnormal
process deviations
and alarms using
visual cues
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
68
Shape Evaluation Study
Dual Task Evaluation Approach
• Dual-Task Evaluation Approach
– Rationale: Operators rarely monitor without simultaneously doing
other critical tasks (e.g., completing standard operating procedures,
managing field activity, etc.)
Schematic/Numeric
OR
Functional/Qualitative
Overview Displays
(Repeated Measure)
2nd Task: Monitor
Level 1 Overview
Primary Task:
Matching Task
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
69
Shape Evaluation Study
Primary Task
• Primary task was a visual-spatial (flag) matching task:
– Requires similar cognitive
processes as console operations
activities (Pringle, 2000)
• Working memory
• Visual search
• Attention
– Reduced operator training time
compared to a more realistic
primary task such as a procedure
– Reduced the complexity and
cost of developing
the evaluation protocol
– Is a measurable and quantifiable cognitive test
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
70
Shape Evaluation Study
Secondary Process Monitoring Task
• Secondary task was to monitor process scenarios
created using a commercial process simulator
– Four scenarios were developed by introducing upsets in the plant
• Two levels of complexity based on number of process deviations
• A process deviation was defined as a condition where a process variable
changes either from normal to abnormal, abnormal to alarm condition, a
low to a low-low alarm, or a high to a high-high alarm, and vice versa
– Short steady state scenarios were also created for reference
– Scenarios were presented as pre-recorded videos on a laptop
• Operator monitored the videos and were tasked with maintaining
awareness of the process deviations
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
71
Shape Evaluation Study
Experimental Design
• Repeated Measures Experimental Design
2 (Display: Schematic, Functional) X 2 (Scenario Complexity: Low, High)
Operators completed one of four experimental orders
Repeated Measures Counter-Balancing Scheme
Complexity Order 1
Low
High
Low
High
Display Order 1
Schematic
Schematic
Functional
Functional
Display Order 2
Functional
Functional
Schematic
Schematic
High
Low
High
Low
Display Order 1
Schematic
Schematic
Functional
Functional
Display Order 2
Functional
Functional
Schematic
Schematic
Complexity Order 2
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
Primary
task completed
for all trials
72
Shape Evaluation Study
Evaluation Protocol
2. Informed
Consent
1. Study
Overview
4. Overview
of Process
Unit
5. Overview of
Both Displays and
Training on New
Shapes
3. Demographic
Questionnaire
6. Primary Task
Training
7. New Shape
Comprehension
Test
8. Steady State
Monitoring
(1st Display)
9. Upset Scenario
Monitoring + Primary
Task Practice Scenario
(1st Display)
10. Upset Scenario Monitoring
+ Primary Task Scenarios X2
(1st Display)
11. Steady State
Monitoring
(2nd Display)
12. Upset Scenario
Monitoring + Primary
Task Practice Scenario
(2nd Display)
13. Upset Scenario Monitoring
+ Primary Task Scenarios X2
(2nd Display)
14. Post-Session Questionnaire
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
73
Shape Evaluation Study
Participant Demographics
• Participant Demographics
– 18 professional operators from two ASM member refining sites
– All operators were familiar with simulated process plant operations
Demographic Variable
Mean or N
SD or %
Age (years)
42.56
8.48
Current Unit Experience (years)
10.11
8.35
Other Unit Experience (years)
6.11
7.30
Field Experience (years)
6.03
7.04
DCS Experience (years)
6.67
4.80
Computer Experience (hours/day)
4.28
4.17
17
1
94.4%
5.6%
Normal Vision
Yes
No
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
74
Shape Evaluation Study
Evaluation Scoring Method
• Primary Task
– Total number of correct flags matched during scenarios
• Secondary Task
– Operators’ situation awareness (SA) was measured
• Detection of process deviations (Orienting) by talking aloud
• Probes (Evaluating) at pre-determined pauses during the scenarios
Example of the ‘Evaluating’ probes:
When the freeze happened, ATB flow in the vacuum heater was:
– In normal state
– In abnormal state
– In alarm state
• The accuracy of operator responses was an indicator of situation
awareness
– Accuracy was assessed relative to what was scripted in each scenario video
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
75
Shape Evaluation Study
Evaluation Results: Level 1 SA
• Accuracy of talk aloud responses relative to actual
process changes that occurred (Orienting)
– Significant Findings
• More changes detected
during Low complexity
scenarios (p < .0001)
• Higher relative performance
improvement using the
Functional/Qualitative display
during Low complexity
scenario (p < .001)
7/15/2015
Display X Scenario Complexity
Percent Changes Detected
• More changes detected
using Functional/Qualitative
display (p < .0001)
50
45
40
35
30
25
20
15
10
5
0
Functional/Qualitative
Schematic/Numeric
Low
High
Scenario Complexity
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
76
Shape Evaluation Study
Evaluation Results: Level 2 SA
• Accuracy of responses to probe questions averaged
across two pauses in each scenario (Evaluating)
– Significant Findings
• More accurate probe
responses during
Low complexity
scenarios (p < .004)
7/15/2015
Percent Accuracy to SA Probes
• More accurate probe
responses using
Functional/Qualitative
display (p < .05)
Display X Scenario Complexity
70
60
50
40
30
20
Functional/Qualitative
Schematic/Numeric
10
0
Low
High
Scenario Complexity
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
77
Shape Evaluation Study
Evaluation Results: Primary Task
• Number of correct flag matches made during the
scenario (Primary Task)
– Significant Findings
• More flag matches
during Low complexity
scenarios (p < .004)
– No differences
between displays
(p > .05)
• Operators maintained
equivalent primary task
performance with
both displays
7/15/2015
Primary Task Matches
Display X Scenario Complexity
25
20
Functional/Qualitative
Schematic/Numeric
15
10
5
0
Low
High
Scenario Complexity
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
78
Shape Evaluation Study
Discussion and Implications
• Using the Functional/Qualitative Overview Display
improved operator situation awareness
– Qualitative shapes and Functional arrangement together improved
performance – but which is more impactful?
• Subjective feedback from operators suggests shape design was the
contributing factor to the performance improvement
• Validates previous studies that show direct perception of process
constraints (alarms, targets, setpoints) improves monitoring performance
• Performance improvement using Functional display despite more operator
familiarity and experience with traditional schematic displays
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
79
Shape Evaluation Study
Discussion and Implications
• Using the Functional/Qualitative Overview Display
improved operator situation awareness
Situation Awareness Performance
Schematic /Numeric Functional/Qualitative
Difference (%)
Percentage of changes
detected (Level 1 SA)
11.9%
28.8%
+16.9%
Percentage Accuracy to
Probes (Level 2 SA)
56.4%
62.8%
+6.4%
Practically significant according to ASM member companies
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
80
Shape Evaluation Study
Conclusions
• Operator situation awareness can be improved using
qualitative display shapes in an overview display
–
–
–
–
Situation awareness is the foundation of proactive monitoring
Proactive monitoring is critical to identifying abnormal situations
Abnormal situations cost the industry billions annually
Using qualitative shapes is easy to cost justify
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
81
Shape Evaluation Study
Conclusions
• Operator situation awareness can be improved using
qualitative display shapes in an overview display
–
–
–
–
Situation awareness is the foundation of proactive monitoring
Proactive monitoring is critical to identifying abnormal situations
Abnormal situations cost the industry billions annually
Using qualitative shapes is easy to cost justify
– Choice of Functional versus Schematic display layout
driven by amount of data needed to support interaction
requirements relative to display space available
– Results of this study suggest that schematic information (vessels, flow
lines) may not be value added in a Level 1 Overview display for
supporting operator situation awareness
• Current deployment status
– Both Honeywell and HCS have HMI libraries that include qualitative
display shapes that support operator monitoring of overview displays
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
82
Q & A Session
Please Ask Us Your Questions
• Questions?
– Remember to un-mute your phone to ask a question
• Thank you for attending this webinar
– A recording of this webinar will be made available soon
– We will send an email with a link to all registered attendees
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
83
Contact Information
• Have additional questions or comments?
• Please contact us at:
– Jason Laberge – [email protected]
– Peter Bullemer - [email protected]
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
84
Some References
• For more information about this and related work:
–
–
–
–
–
–
–
Reising, D. C., & Bullemer, P. T. (2008). A direct perception, span-of-control overview display to
support a process control operator's situation awareness: A practice-oriented design process.
Proceedings of the 51st Annual Meeting of the Human Factors and Ergonomics Society, New York
City, NY, USA
Tharanathan, A., Bullemer, P., Laberge, J., Reising, D. & Mclain, R. (2010). Functional versus
schematic overview displays: Impact on operator situation awareness in process monitoring.
Proceedings of the 54th Annual Meeting of the Human Factors and Ergonomics Society, San
Francisco, CA, USA
Bullemer, P., Reising, D.V., Burns, C., Hajdukiewicz, J. & Andrzejewski, J. (2008). Effective Operator
Display Design. ASM Consortium Guidelines (Version 4.00). Minneapolis, MN: ASM Consortium.
Available at createspace.com
Endsley, M. R. (1988). Design and evaluation for situation awareness enhancement. Proceedings of
the 32nd Annual Meeting of the Human Factors Society. Santa Monica, CA, USA
Endsley, M. R. (1995). Measurement of situation awareness in dynamic systems. Human Factors,
37(1), 65-84
Jamieson, G. A., & Vicente, K. J. (2001). Ecological interface design for petrochemical applications:
Supporting operator adaptation, continuous learning, and distributed, collaborative work. Computers
and Chemical Engineering, 25, 1055-1074
Jessa, M., & Burns, C. M. (2000). Visual sensitivities of dynamic graphical displays. International
Journal of Human-Computer Studies, 65, 206-222
7/15/2015
ASM Webinar Presentation
ASM and Abnormal Situation Management are registered trademarks of Honeywell International, Inc.
85