Transcript User-System Interaction

User-System Interaction
a challenge for the present and the future
Prof. dr. Matthias Rauterberg
IPO Center for User-System Interaction
Eindhoven University of Technology
Two approaches for Ergonomics
limits
attractors
assessment
design principles
Interdisciplinary Research Approach
Design relevant
knowledge
Empirical
evaluation
Interactive systems
What is an Interactive System (IS) ?
perception
action(s)
user
interaction
system
IS := {IS*, Human, ICT component, [additional component]}
What are the research topics of USI?
• Communication / Co-operation
• Home / Office Environment
• Financial / Medical Sector
• Knowledge Management
• Product / Process Industry
• Transportation / Logistic
• Teaching and Learning
Working domain
Working system
Goal:
user
Science
• perception
• cognition
• action
system
Application
• user-centered
design
Engineering
• audio interfaces
• computer vision/graphics
• speech interfaces
• tactile interfaces
Pa => Pd
Cooperation with Industry
The optimization problem
costs
user
system
optimum
degree of usability
What are the technical challenges?
• New interaction styles
–
–
–
–
speech input/output
computer vision based input (e.g., gestures)
audio interfaces (e.g., non-speech audio)
tactile and force feedback
• New interface concepts
– adaptive and intelligent software
– natural user interfaces
Trends in User Interface Technology
Ubiquitous and Mobile computing
Ambient rooms and
Cooperative buildings
What is design relevant knowledge?
• Perception Space
– The physical space where
the user’s attention is.
• Action Space
– The physical space where
the user acts in.
• Design Principle:
– perception space and action
space must coincide!
the complete action cycle
t ask(s)
goal-, subgoal-setting
planning of execution
feedback
control of
action
selection of means
mental operation
physical operation
synchronisation in time
synchronisation
in space
Electronic Performance Support System
• Food processing plant worker
with a first-generation
prototype wearable computer.
• Possible applications include
support for quality control data
collection or assistance with
environmental auditing.
• This system gives its users the
information the users need to
perform a task as they actually
perform the task.
Airline Applications
•
This remarkable ultra-lightweight
computer, worn as a belt, delivers
maximum information to users with a
minimum of work.
•
Designed for individuals who demand
mobility, this computer offers voice
control and heads up display for
complete, hands-free operation.
•
Users can enter or retrieve information
while going about their jobs, instead of
constantly returning to the shop area to
check a stationary computer, or stopping
work to punch keys.
The Virtual Workbench
The KOSIMA project
at the TU Aachen
Head-up Displays in Cars
•
More information and less
distraction
Information on the state of the road,
on the speed of the vehicle in front
(supplied by the intelligent cruise
control), on obstacles lying around the
next bend in the road identified by the
remote detection system, or direction
arrows sent by the driver guidance
system... drivers will be receiving
more and more information from
"intelligent" vehicle systems.
Natural User Interfaces (NUI)
1. design principle
No technical equipment inside
the body space of the user!
2. design principle
Perception space and
action space must coincide!
NUI: The First Round
Design principle
Field test
NUI (1): The Digital Playing Desk
overhead
projector
video
camera
virtual
player
virtual chips
real chip
NEW button
Digital Playing Desk: Playing time per game
500
Cell Line Chart for "playing time"
Grouping Variable(s): Interface type
450
Error Bars: ± 1 Standard Deviation(s)
400
Cell Mean for time of user (s)
350
300
250
200
150
100
50
0
CI
MI
P<.001
TI
P<.01
P<.001
P<.001
P<.001
P<.001
DPD
Digital Playing Desk: winning chance per dialog technique
user win
Cell Line Chart for "winning chance"
Grouping Variable(s): Interface type
Error Bars: ± 1 Standard Deviation(s)
remis
computer win
CI
MI
P<.020
TI
P<.080
P<.001
P<.802
P<.001
P<.007
DPD
NUI: The Second Round
Design principle
Experiments
BUILD-IT: an integrative design tool
• design team with
different domain
knowledge
• unconstrained
social interaction
• integration of
form and content
• intuitive
interaction style