Transcript Video Retrieval Evaluation and Testing, Multimedia

Exemplary Flash 5.0 Examples from Students
• Lissa Guttman
• John Dittmar
• Dennis Yuan
• Amy Chung
• Kwang-Duck Kim
• Jonathan Grady
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
1
Carnegie
Mellon
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
2
Carnegie
Mellon
Multimedia Interface Design Issues
• Traditional usability attributes
• Learnability
• Efficiency
• Memorability
• Errors
• Satisfaction
• Modal Perception, e.g., color, fidelity, timing
• Bandwidth
• Load time
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
3
Carnegie
Mellon
References
User-Centred Design for Multimedia Applications, by
Alistair Sutcliffe. In Proc. IEEE Multimedia Systems ‘99
Vol. 1 (Florence, Italy, June 1999), pp. 116-123.
“Myths, Messages and Effective Learning with
Multimedia,” online slide presentation by Alistair
Sutcliffe, City University, U.K. at
http://www.city.ac.uk/teaching/sem16/index.htm
• sources of information for guideline slides to follow
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
4
Carnegie
Mellon
UCD-MA (User Centred Design for
Multimedia Applications) Method
• Suitable for task-based applications: effective
information delivery is the prime goal
• education and training addressed indirectly
• interactive multimedia, e.g., for entertainment and
dialogue, not addressed
• Consists of 4 components:
•
•
•
•
information modeling
media selection
presentation planning
design for attention within a medium and between media
Uses cognitive models of Human Information Processing
based on experimental psychological research
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
5
Carnegie
Mellon
Human Information Processor
Working Memory
Visual
STM
Aural
STM
1. Capacity overflow information overload
2. Integration
2
1
1
3
Cognitive
Processor
----------------Attention
Scheduler
Motor
processor
5
4
Long-Term Memory
4. Comprehension
3. Contention conflicting channels 5. Multitasking I/O
Implications for Multimedia Interfaces for
Learning
• Schema integration: learning will only be effective if the
user has sufficient existing knowledge to make sense of
the new material (!! - resolve with active
learning/engagement though; Piaget learning theory)
• Self-paced learning: people need time to reflect and
assimilate new information (e.g., add “replay”, “seek”)
• Active learning: interaction in the key; learning by doing
and problem-solving are more effective than passive
comprehension
• Engagement: learners have to be motivated
Malone, T.W. Toward a Theory of Intrinsically Motivating
Instruction. Cognitive Science 4 (1981), 333-369.
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
7
Carnegie
Mellon
Usage Principles
• Thematic Congruence: different parts of the message
should be easy to integrate and comprehend
• Manageable Information Loading: give users time to
assimilate the necessary information
• Viewpoints: present different aspects of the
object/information by combination of media
• Redundancy and Reinforcement: present same
information in different ways/modes to help learning
• Avoid Attention Conflicts: make sure user can
assimilate information without being distracted
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
8
Carnegie
Mellon
Media Types
still image
photograph of person
visual
moving image
realistic
aural
video of person running
natural recorded sound
bird song
synthetic sound
aural
non-realistic
visual
language-based
still image
diagram, sketch
moving image
aural
visual
9
cartoon
spoken narrative
formal
language
text
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
music
mathematical
formulae
book
Carnegie
Mellon
Media Selection Guidelines
Info. Type
Preferred Media
Example
Physical
still or moving image
building diagram
Abstract
text or speech
explain sales policy
Descriptive
text or speech
chemical properties
Visio spatial
realistic media - photo
person’s face
Value
text/tables/number lists
pressure reading
Relationships/
values
design images graphs, charts
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
10
histogram of
rainfall/month
Carnegie
Mellon
Media Selection Guidelines
Info. Type
Preferred Media
Procedural
images, series, text
Discrete Action still image
Continuous
Action
moving image
Events
sound, speech
States
still image, text
Composition
Causal
still/moving image
moving image, text,
speech
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
11
Example
evacuation instructions
make coffee
maneuvers while skiing
fire alarm
photo of weather
conditions
exploded parts diagram
video of rainstorm
causing flash flood
Carnegie
Mellon
Attention-Directing Effects for Different Media
Still image
Change of shape, size, color of object; use of bold outline; add mark like
arrow or icon; draw boundary; use color/shape/size/texture to
distinguish important objects from the surrounding components
Moving image
Freeze frame followed by applying a still image highlight; zoom, close-up
shot of the object; cuts, wipes, dissolve effects and cinematic principles
Text
Bold, font size, type, color or underlining
Speech/sound
Amplitude (loudness); variations in pitch (frequency); silence followed by
onset of sound; different voices or change in voice prosody (tonality)
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
12
Carnegie
Mellon
Implications
• ISO 14915, Multimedia User Interface Design Ergonomic Requirements for Human Computer
Multimedia Interfaces
• http://www.iso.ch/
• http://www.system-concepts.com/stds/ISO14915
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
13
Carnegie
Mellon
References for Next Few Slides
The Ten Golden Rules for Providing Video Over the Web
or 0% of 2.4M (at 270k/sec, 340 sec remaining) by
Chris Johnson
http://crete.dcs.gla.ac.uk/~johnson/papers/video.html
Ten Usability Heuristics by Jakob Nielsen
http://www.useit.com/papers/heuristic/heuristic_list.html
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
14
Carnegie
Mellon
Video over the Web, via “Ten Golden Rules…”
• Avoid Video for Video's Sake
• Make Sure That Users Can Access the Video
• Maximize the Production Quality
• Edit The Clip to Maximize Content and Minimize File
Size
• Use Mirror Sites if Necessary
The Ten Golden Rules for Providing Video Over the Web
or 0% of 2.4M (at 270k/sec, 340 sec remaining)
http://crete.dcs.gla.ac.uk/~johnson/papers/video.html
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
15
Carnegie
Mellon
Video over the Web, via “Ten Golden Rules…”
• Cater for Differences Between Browsers and Directed
Users
• Use Page Layouts To Indicate The Quantity and Quality
of Video Material
• Assess the Impact of Retrieval Delays Upon Overall
Task Satisfaction
• Never Underestimate the Element of Surprise
• Never Take A Designer's Word For It...
The Ten Golden Rules for Providing Video Over the Web
or 0% of 2.4M (at 270k/sec, 340 sec remaining)
http://crete.dcs.gla.ac.uk/~johnson/papers/video.html
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
16
Carnegie
Mellon
Ten Usability Heuristics from J. Nielsen
• Visibility of system status
The system should always keep users informed about what is
going on, through appropriate feedback within reasonable time.
• Match between system and the real world
The system should speak the users’ language, with words,
phrases and concepts familiar to the user, rather than systemoriented terms.
• User control and freedom
Mistakes happen; support undo and redo.
• Consistency and standards
Follow platform conventions.
• Error prevention
Even better than good error messages is a careful design which
prevents a problem from occurring in the first place.
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
17
Carnegie
Mellon
Ten Usability Heuristics from Nielsen, continued
• Recognition rather than recall
Make objects, actions, and options visible.
• Flexibility and efficiency of use
Create system that can cater to both inexperienced and
experienced users. Allow users to tailor frequent actions.
• Aesthetic and minimalist design
Dialogues should not contain information which is irrelevant or
rarely needed.
• Help users recognize, diagnose, and recover from errors
Error messages should be expressed in plain language.
• Help and documentation
Even though it is better if the system can be used without
documentation, it may be necessary to provide help and
documentation. Any such information should be easy to search,
focused on the user's task, list concrete steps to be carried out,
and not be too large.
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
18
Carnegie
Mellon
Interface Design References
• Designing the User Interface: Strategies for Effective
Human-Computer Interaction, Ben Shneiderman, 1997.
Addison-Wesley Publishing ISBN 0-201-69497-2
• The Design of Everyday Things, Don Norman, 1990.
Doubleday ISBN 0-385-26774-6 (paperback).
• Usability Engineering, Jakob Nielsen, 1993. Academic
Press ISBN 0-12-518406-9 (paperback).
• The Alertbox: Current Issues in Web Usability, Jakob
Nielsen of the Nielsen Norman Group
http://www.useit.com/alertbox/
• Vincent Flanders’ Web Pages that Suck
http://www.webpagesthatsuck.com/
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
19
Carnegie
Mellon
Critiques of Flash Animations on the Web
• Animation: Uses and Abuses by Amy Gahran
http://www.contentious.com/articles/V2/2-5/rw2-5.html
• Flash: 99% Bad by Jakob Nielsen
http://www.useit.com/alertbox/20001029.html
CAUTION: Consider users, purpose, current state of
technology. Don’t animate for animation’s sake.
© Copyright 2000 Michael G. Christel and Alexander G. Hauptmann
20
Carnegie
Mellon