Transcript how to create patrick baudisch :: gerry chu ? nanoTouch touch d-pad touch.

how to create
patrick baudisch
:: gerry chu
?
nanoTouch
touch
d-pad
touch
touch
touch
fat finger
fat finger
fat finger
fat finger
fat finger
fat finger
touch
touch
fat finger
touch
touch
touch large
touch
touch
back touch
touch
pointer
related work
back-of-device
interaction
1gestures
HybridTouch
[Sugimoto & Hiroki '06]
1gestures
[Wobbrock at al]
2buttons
behind
behind
touch
(Hiraoka et al. IPSJ 2003)
2buttons
Apple patent (filed jan 5, 2007)
gestures + buttons select from
a finite number of choices
how can we can
do pointing?
touch
pointer
lucidtouch
pseudo
transparency
[2002]
pseudo
transparency
under-the-table
Under the Table (Wigdor et
[wigdor at al 2006]
al. UIST 2006)
requires 4.5cm targets
[wigdor, forlines, baudisch, barnwell, chen 07]
borrowing from
augmented reality
physical see-through
camera see-through
physical see-through
occlusion remained; fat finger problem remained
physical see-through
electroluminescence panel
(instead of LCD)
[Teraokaseiko 2008]
lucidTouch
great device,
but not optimal for testing very small
nanoTouch
nanoTouch
buttons on top of finger
fake highlight
flat finger tip
buttons on top of finger
fake highlight
flat finger tip
finger tip turns white
drop multi-touch
drop the camera & boom
press to click
press
nanoTouch
 thumb buttons
left
right
tether
can we go that small?
verify our assumption:
“back-of-device interaction is the key
to pointing input on very small devices”
> Gerry Chu
user study 1
1screen sizes
2.4”
1.2”
0.6”
0.3”
2interfaceback
2interfaceshift
shift
[vogel & baudisch, CHI 2007]
3commit
same-hand
vs.
other-hand
left
right
design
[2 x Commit Method (between subjects)
× (2 Interface
× 4 Screen Size
× 16 Target Position)]
3 repetitions for each cell
16 participants
results
shift same-hand
shift other-hand
back same-hand
back other-hand
error rate
shift same-hand
shift other-hand
2.4”
40%
30%
1.2”
0.6”
20%
0.3”
10%
0%
st sb bp bb
0.3”
st sb bp bb
0.6”
st sb bp bb
1.2”
st sb bp bb
2.4”
back same-hand
back other-hand
error rate
shift same-hand
shift other-hand
2.4”
40%
30%
1.2”
0.6”
20%
0.3”
10%
0%
st sb bp bb
0.3”
st sb bp bb
0.6”
st sb bp bb
1.2”
st sb bp bb
2.4”
back same-hand
back other-hand
task time
shift same-hand
shift other-hand
3s
2s
1s
0s
st sb bp bb
0.3”
st sb bp bb
st sb bp bb
st sb bp bb
0.6”
1.2”
2.4”
back same-hand
back other-hand
screen size independent
so, how can we interact with
very small touch devices?
like this…
II. the practical part
help designers design for back-of-device
what target sizes to use?
(no hypothesis)
user study 2
all conditions
use back
1target size
0.6mm
4px
1.4mm
2.8mm
5.5mm
11mm
9px
18px
36px
72px
2commit
same-hand
vs.
other-hand
left
right
error rate
30%
20%
same-hand
other-hand
10%
0%
0.6mm
4px
1.4mm
2.8mm
5.5mm
11mm
9px
18px
36px
72px
task time
3s
same-hand
other-hand
2s
1s
0s
0.6mm
4px
1.4mm
2.8mm
5.5mm
11mm
9px
18px
36px
72px
task 2land-on
error rate
land-on
error rate
land-on
100%
all targets
80%
60%
2 center targets
40%
post-calibrated
20%
0%
6.1mm
40px
12.2mm
80px
18.3mm
120px
error rate
land-on
e.g. 2% error
on 12mm target
opens up a new space of devices
devices
pendant
watch
ring
clip-on
<formula>
front = screen
sides = buttons
back = touch
thanks to our group
at microsoft research
thanks to my new group at
hasso plattner institute
in berlin/potsdam
fachgebiet human-computer interaction
Gerry
University of Toronto
annikaChu
hupfeld
microsoft research cambridge
Tao Ni Virginia Tech
gerry chu
university of toronto
nano touch
back-of-device interaction allows creating very small touch devices
hasso
plattner
institute
offset
shift
offset cursor
Pen
Offset Cursor
(Potter et al. 1988)
3. backside
the smaller the screen
fat finger
the bigger the finger
d
a
b
c
the more fingers
the further reach
interactions
precision, land-on, escalation
precision
precision
1. touch
2. drag
3. commit
precision
1. touch
2. drag
3. commit
precision
1. touch
2. drag
3. commit
precision
1. touch
2. drag
3. commit
land-on
land-on
1. touch
2. lift-off
land-on
1. touch
2. lift-off
land-on
1. touch
2. lift-off
combine land-on and precision
into a single interaction
escalation
escalation
1. land-on
2. escalate
3. precision
4. commit
escalation
1. land-on
2. escalate
3. precision
4. commit
escalation
1. land-on
2. escalate
3. precision
4. commit
escalation
1. land-on
2. escalate
3. precision
4. commit
escalation
1. land-on
2. escalate
3. precision
4. commit
precision
touch
drag
commit
land-on
escalate
land-on
lift-off
escalate
touch
precision
when to escalate?
shift
nanoTouch
 it is save to escalate right away
2technique
"take-off"
"land-on"
touch
drag
and
touch
commit
lift-off