Transcript Computer-Mediated Communication Media Richness and Visual Interfaces Coye Cheshire & Andrew Fiore // 15 February 2012

Computer-Mediated
Communication
Media Richness and Visual Interfaces
Coye Cheshire & Andrew Fiore
//
15 February 2012
Projects and Assignment #1
 Assignment 1 is a short 2-3 page description of your group
project idea and the division of labor within the group.
 Due Feb. 22 at beginning of class (one assignment per
group, 2 printed copies)
 Groups will be signing up for a meeting with us to discuss
the project the following Wednesday.
 http://courses.ischool.berkeley.edu/i216/s12/assignment1.php
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
1
Theories
of mediated
communication
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
2
Cues Filtered Out
 Social presence:
Lower bandwidth  Less warm,
others seem less salient
 Lack of non-verbal cues —
disinhibition and hostility (e.g., flaming)
unsealedprophecy.wordpress.com
Is this the experience of online interaction?
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
3
Social Identity/Deindividuation Theory
(Cues About Us, Not You or Me)
Visual anonymity
 “deindividuation”
 salience to group identity
“Overinterpreting” based on
limited info could lead to
greater social attraction based
on in-group status,
stereotyping.
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
4
Media richness —
“ formation of shared
[C]apacity to facilitate the
meaning within a given time
interval.
2/15/12
”
— Dennis & Kinney
Cheshire & Fiore — Computer-Mediated Communication
5
A plausible ranking?
Richer
Face-to-face
Synchronous video
Synchronous audio / asynch. video
Synchronous text / asynch. audio
Asynchronous text
Leaner
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
6
Rich
2/15/12
Elements of richness
 Multiplicity of cues (bandwidth)
 Immediacy of feedback
 Use of natural language
 Personal focus
Cheshire & Fiore — Computer-Mediated Communication
7
Lean
2/15/12
Elements of richness
 Multiplicity of cues (bandwidth)
 Immediacy of feedback
 Use of natural language
 Personal focus
Cheshire & Fiore — Computer-Mediated Communication
8
Channels, cues, and signals
Channel conduit for a particular type of info,
Channel:
e.g., for voice or text
Cue
Cue: “any feature of the world, animate or
inanimate, that can be used ... as a guide to
future action” (Donath 2007) —
i.e., informative, not necessarily intentional
Signal a cue meant to indicate an otherwise
Signal:
hidden quality
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
9
Some types of social cues
Verbal
Non-verbal
Beyond FTF?
Textual
 Production cost to encode
meaning equivalent to FTF in text
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
10
Feedback
Type of feedback
 Acknowledgment — understanding
 Repair — correction or clarification
 Proxy — completion
Immediacy of feedback
 Concurrent: synchronous nods, mm-hmms
 a.k.a. backchannel
 Sequential: brief interjection
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
11
Media choice vs. use
(Cues to Choose By)
What medium would you choose for a given task?
vs. What medium “performs” best?
 Media Richness (the theory) originally examined
media choice and use in organizations.
Claim: Managers should choose medium based
on task to be effective. More ambiguous tasks
need richer medium.
But when might we want a “less rich” medium?
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
12
Media choice vs. media use
Types of tasks
 “Uncertain” — missing information
 “Equivocal” — ambiguous
interpretations
“Best” medium for an (un)equivocal task
 What do managers choose?
 What do they say they would choose?
 What yields the best performance?
P.S.: What is “best performance”?
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
13
Dennis & Kinney hypotheses
 H1a: Performance improves as
multiplicity of cues increases …
 H1b: … more for more equivocal tasks.
 H2a: Performance improves as
immediacy of feedback increases …
 H2b: … more for more equivocal tasks.
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
14
Dennis & Kinney experiment
Tasks
 Low-equivocality: SAT-type questions
 High-equivocality: College admissions
Media
2/15/12
Cues: Low
Cues: High
Feedback:
Delayed
Text chat
(turn-based)
Video
(half-duplex)
Feedback:
Immediate
Text chat
(live typing)
Video
(full-duplex)
Cheshire & Fiore — Computer-Mediated Communication
15
Mean decision time (D&K)
Task
High cues (AV)
Low cues (CMC)
Immed. Delayed Immed. Delayed
Low equiv.
12.21
17.00
26.29
31.53
High equiv.
13.14
14.35
18.71
23.71
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
16
— Clark & Brennan (1991)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
17
Social Information Processing
(Cues Filtered In)
Walther (1992) re-examined early CMC research:
“Given sufficient time and message exchanges for
interpersonal impression formation and relationship
development to accrue, and all other things being equal,
relational [quality] in later periods of CMC and F2F
communication will be the same.”
 Users compensate for attributes of CMC (e.g.,
emoticons to replace non-verbal affective displays)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
18
Hyperpersonal communication
(Cues Bent and Twisted)
Contributing factors:
 Selective self-presentation
 Shared group membership
 Channel effects
 Feedback effects
Bottom line: Perceptions more extremely positive (or
negative) than FTF in the face of limited information
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
19
“
The sensorial parsimony of plain text
tends to entice users into engaging their
imaginations to fill in missing details while,
comparatively speaking, the richness of
stimuli in fancy [systems] has an opposite
tendency, pushing users’ imaginations
into a more passive role.
— Curtis (1992)
”
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
20
Walther, Slovacek, & Tidwell 2001
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
21
Social attraction
Long-term, no photos
Short-term, photos
Long-term, photos
Short-term, no photos
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
22
Farnham & Riegelsberger 2004
Photo profiles
Count
Text profiles
Gaming partner preference
(1 = Don’t want to play with, 7 = Want to play with)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
23
“
The study of CMC effects is not best served by
blanket statements about technology main
effects on social, psychological, and
interpersonal processes, nor by proclamations
that online relationships are less rewarding
than FTF ones. Rather, qualities of CMC are …
more often the product of interesting and
predictable interactions of several mutual
influences than main effects of media.
— Walther et al. (2001)
”
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
24
Abstract visual
interfaces
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
25
Social translucence
 Visibility: make social information apparent
 Awareness: knowing based on what you see
 Accountability: knowing that I know you know
 Why? To recreate a “social physics.”
 Why not “social transparency”?
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
26
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
27
“[T]ranslucence … stands in for the notion
that, in the physical world, cues are
differentially propagated through space —
something which, as social creatures, we
understand and make use of in governing
our interactions. Thus, we know that those
across the room may see we are talking,
but will be unable to hear what we say; and
we adjust our interactions to take
advantage of this.”
— Erickson et al.
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
28
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
29
Babble social proxy
“provide cues about the presence and activity of those
in the current conversation”
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
30
“Socially useful ambiguity”
 Pretending to pay attention, e.g., clicking
the Babble proxy to feign attention to the
conversation
 Plausible deniability: consider the fallibility
of cell phones, email/spam filtering, etc. —
tech. limitations, not design decisions, but
the social utility of these devices would
change without them.
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
31
Lecture proxy
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
32
Auction proxy
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
33
Waiting-in-line proxy
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
34
Chat Circles 2
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
35
The Chat Circles avatar
 Vaguely humanoid form, but
stylized, not realistic — no faces!
 Words centered in/around the form
— ties words to identity, “face”
 2D location allows proximity
 Size tied to length of utterance
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
36
Temporality and spatiality
 Utterances vanish after a few seconds
 Hearing range: can see only nearby utterances
 What is the real-world effect mimicked here?
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
37
Movement
 Rhythm of conversation:
growing and shrinking circles set the pace
 Proximity:
friendliness, intimacy, or aggression
 Expressivity:
fidgeting, dancing, leading, following,
playing
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
38
Traces
 Movement traces
 Speech traces
 Visual indicator of
social history of
the chat space
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
39
History
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
40
Faces
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
41
What are faces good for?
Conveying, among other things:





Social presence
Individual identity
Social identity
Emotion
Gaze
Source: galante.com
By means of:
 Structure
 Dynamics
 Decorations
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
42
Ekman (1999)
Ekman, Friesen, & Ellsworth (1972)
(and many others)
Basic emotions
Anger
Disgust
Fear
Characteristics of basic emotions
Joy
1. Distinctive universal signals
Sadness
2. Distinctive physiology
Surprise
3. Automatic appraisal
Contempt
4. Distinctive universals in antecedent events
5. Distinctive appearance developmentally
6. Presence in other primates
7. Quick onset
8. Brief duration
9. Unbidden occurrence
10. Distinctive thoughts, memories images
11. Distinctive subjective experience
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
43
Facial muscles
2/15/12
Action units
Cheshire & Fiore — Computer-Mediated Communication
44
Facial expressions:
Emotions revealed
http://www.youtube.com/watch?v=-PFqzYoKkCc
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
45
Representing the face:
“Being close
may be worse.”
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
46
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
47
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
48
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
49
The Uncanny Valley
http://www.youtube.com/watch?v=FKTAJBQSm10
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
50
“being there” vs.
“beyond being there”
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
51
Chernoff faces
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
52
The New York Times and Prof. Steve C. Wang
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
53
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
54
Indeed, the 2007 managerial statistics, as presented in an
annual register published by the baseball analyst Bill James,
are a relatively dull grid of digits. But the facial maps make
comparisons much easier to grasp.
The St. Louis Cardinals’ Tony La Russa, known as a
constant tinkerer, had his National League-leading 150
different batting orders (in 162 games) translate into an
elongated head and wider eyes.
By contrast, the Philadelphia Phillies’ Charlie Manuel — who
said this spring that he used far fewer lineups because he
preferred to “get into a routine and stay with it” — had a much
squatter face and dots for eyes.
— The New York Times
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
55
Designing with faces and bodies
We read meaning in lots of things,
but especially human forms!
 There is no such thing as neutral.
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
56
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
57
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
58
Faces in
interfaces
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
59
Chit Chat Club
(Karahalios and Dobson)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
60
Chit Chat Club
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
61
Second Life facial expressions
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
62
Second Life expression plug-in
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
63
Facial Expression Analysis
(Mateos: http://dis.um.es/~ginesgm/fip/problems.html#expression)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
64
Eyes
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
65
2/15/12 & Kohshima
Cheshire
& Fiore — Computer-Mediated Communication
Kobayashi
2001
66
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
Kobayashi & Kohshima 2001
67
Video chat
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
68
The gaze angle problem, or…
Why so glum?
Source: http://staffx.webstore.ntu.edu.sg/personal/astjcham/Web/Research/percepter.htm
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
69
Source: http://www.freepatentsonline.com/7126627.html
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
70
Yang & Zhang 2004
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
71
Source: D. Nguyen
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
72
Cameras
Projectors
MultiView
Display
2/15/12
Source:
D. NguyenCheshire & Fiore — Computer-Mediated Communication
73
Lag, lip synch, social judgments
 When audio precedes video by 5 video fields, viewers
evaluate people on television more negatively (e.g. less
interesting, more unpleasant, less influential, more
agitated, less successful).
 Audio-video asynchrony has no effect on viewer's
memory for audio information.
 Viewers can accurately tell when a television segment is
in perfect synch, and when it is 5 fields out of synch.
Viewers cannot accurately tell the same segments are 2.5
fields out of synch.
 Even though detection is low when asynchrony is
moderate (2.5 fields), viewer evaluations are still affected.
(Reeves and Voelker 1993)
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
74
For next Wednesday…
Visualizations and Visual Interfaces
 Monmonier, M. (1996) Chapters 3 and 10. In How to Lie with Maps.
Chicago, Ill.: University Of Chicago Press.
 Erickson, T. (2003) Designing visualizations of social activity: six
claims. In Extended abstracts of ACM Computer-Human Interaction.
 Donath, J. (2011) Visualizing Conversation.
 Narayan, S., Cheshire, C. (2010) Not too long to read: The tldr
Interface for Exploring and Navigating Large-Scale Discussion
Spaces. In Proceedings of the 43rd Annual Hawaii International
Conference on System Sciences. (HICSS). Computer Society Press.
Remember to write your review!
2/15/12
Cheshire & Fiore — Computer-Mediated Communication
75