Transcript Document

New Interaction Techniques
Visualization for
Temporal events
Grigori Evreinov
Department of Computer Sciences
University of Tampere, Finland
www.cs.uta.fi/~grse/
September – December, 2003
… … …  Time perception
Temporal Events
a sequential appearance of events, entities, or their properties leads to the
time perception [1, 2]
in-/decrement of some parameter with time can be transformed into the
spatial pattern of discrete or analogous signals
spatial distribution of these signals can be proportional, or non-
proportional, to the initial temporal intervals – depends on conventions
in any case, spatially-distributed signals will be perceived like a sequence
of similar or different events which are stimuli for human perception
there are two main metaphors for time presentation:
Time-line and Clock Face /Dial
both “absolute” time imaging and perception have difference /error
between real temporal parameters of the event, presented value and
perceived moments: onset /start, offset /stop and duration of some interval
TAUCHI MMIG
G. Evreinov
01_15
31.10.2003
Temporal Events
time is the most important dimension in music
its representation and manipulation is crucial for the
expressiveness of a composition environment [3]
therefore imaging for temporal events was especially
developed for Musical Instrument Digital Interface
(MIDI) [4]
TAUCHI MMIG
G. Evreinov
02_15
31.10.2003
Temporal Events
Peter Hanappe [3] gives the following list of some of the issues in time
representation concerning music events and objects:
the description of timing information
the construction of composite temporal objects
the use of composite objects as basic elements
the definition of temporal relations between objects
the manipulation and transformation of composite objects
the interactive, dynamic control of a composition
the relations between continuous time and event time
time and hierarchy in musical structures
the manipulation of continuous time functions
the relation between composed time and performance time
the representation of temporal information during runtime
the relation between ``out-of-time'' structures and ``in-time'' realization
TAUCHI MMIG
G. Evreinov
03_15
31.10.2003
Temporal Events
there are many other examples when user is in time-dependent situation
and must evaluate short intervals to make a decision, change own
behavior or interaction strategy
the systems, based on head /eye /finger tracking, use temporal window to
simulate mouse actions
herewith, spatial or temporal (sound) time imaging can influence onto the
experimental data due to attention & perception features [5, 6, 7]
[7]
[8]
TAUCHI MMIG
G. Evreinov
04_15
31.10.2003
Temporal Events
[8]
[10]
“an attention shift can be easily elicited by a stimulus appearing in the
periphery (e.g., Theeuwes, 1991)
an attention shift takes time (e.g., Müller & Findlay, 1988)
a phenomenal representation of a stimulus is not available before the
end of an attention shift (e.g., Van der Heijden, 1992)” (cit. on [7])
TAUCHI MMIG
G. Evreinov
05_15
31.10.2003
Temporal Events
to be an effective, visualization
first should concentrate user
attention on the task, target or
whatever
noise is interference of signals
with
similar
distract
and
parameters
not
that
allow
to
accomplish the task effectively
http://www.inference.phy.cam.ac.uk/djw30/dasher/movies.html
TAUCHI MMIG
G. Evreinov
06_15
31.10.2003
Temporal Events
[11]
[13]
[12]
TAUCHI MMIG
G. Evreinov
07_15
31.10.2003
Usability-testing software for…
the task is
Temporal Events
Time Indicator 1
how to synchronize the user behavior regarding temporal window (dwell
time, scan interval or whatever) not only to help in visual search, but
the time imaging should aid the user in planning the motor actions and with
a decision making
TAUCHI MMIG
G. Evreinov
08_15
31.10.2003
Temporal Events
600
Time, ms
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
ERA DHL GWV
the special test showed that visualization of the
temporal process sometimes does not add useful
information for user but distracts and throws out of
time
while an average error rate was inessential
increased, latent period and dispersion of reactions
increased up to 30%
TAUCHI MMIG
G. Evreinov
09_15
31.10.2003
Temporal Events
fraData
Open
lblTestSymb
lblDrawGraph lblComm
Save
txtTest comments…
Shape1
Shape4
Shape2
Shape5
Shape3
Shape6
String1
Timer1
lblGrid1
picGraph1
CommPort
lblGrid2
Clear
Grid
EditTools
String2
lblRTime
lblError
lblError2
String3
lblTimeS
lblMode
lblMode1
scan interval
delay
Timer2
lblScan
TestStop
Timer3
Clear
Statistics()
Rtime, ms
s (st.dev), ms
DrawError
ShapeSize
DrawGraph1
to change ind.
BtnInput
TAUCHI MMIG
G. Evreinov
10_15
10.10.2003
Temporal Events
the task is
Time Indicator 2
how to present a temporal window (dwell time) in eye-gaze interface
adhering to the principle of minimal distraction
TAUCHI MMIG
G. Evreinov
11_15
31.10.2003
Temporal Events
TAUCHI MMIG
G. Evreinov
12_15
31.10.2003
Temporal Events
Form_MouseMove()
shpKey1
shpKey2
Timer2
Delay (150ms)
Shape2
DwStart()
time per segment
Timer1
ArrowPos()
Shape1
Save
chkTrack1
lblTestTime
chkTrack2
lblGraph
optArrow
lblAnim
optCircle
lblInterval
chkCircleV
lblPause
lblVisCursor
DrawTrack()
imgAnim
Open
txtTest comments…
DwStop()
Arrow1
fraData
PictureRefresh()
lblSzCircle
lblSizeInd
Animation of user
tracks
Timer3
lblTime
lblStart
EditControls()
TAUCHI MMIG
G. Evreinov
13_15
31.10.2003
Temporal Events
References
[1] The Experience and Perception of Time. Stanford Encyclopedia of Philosophy,
http://plato.stanford.edu/entries/time-experience/
[2] William James (1890) The Principles of Psychology. Chapter XV[J. of Speculative Philosophy, vol. XX.
p. 374] The perception of time. Cit. on http://psychclassics.yorku.ca/James/Principles/prin15.htm
[3] Hanappe, P. Design and implementation of an integrated environment for music composition and
synthesis. PhD Theses, 1999, available at:
http://www.ircam.fr/equipes/repmus/Rapports/PeterHanappe99/
[4] MIDI Timing Concepts, http://music.northwestern.edu/links/projects/midi/pages/miditmcn.html
[5] Perception of Space and Time. Task dependent timing of perceptual events. Project site on
http://www.mpipf-muenchen.mpg.de/CA/RESEARCH/raumzeit_e.htm
http://www.mpipf-muenchen.mpg.de/CA/PROJECTS/DFG_event_timing_e.html
[6] Thornton, I.M.: Exploring the onset repulsion effect. Investigative Ophthalmology & Visual Science 41, #
4221 (2000), http://www.kyb.tuebingen.mpg.de/publications/pdfs/pdf1994.pdf
[7] Müsseler, J. & Aschersleben, G. (1998). Localising the first position of a moving stimulus: The Fröhlich
effect and an attention-shifting explanation. Perception & Psychophysics, 60, 683-695, http://www.mpipfmuenchen.mpg.de/CA/PEOPLE/MUJO/POSTER/Poster_Chicago.pdf
[8] Stork, S., Müsseler, J. & Neggers, B. (2001). The influence of eye movements on the perceived
vanishing point of a moving stimulus. Poster präsentiert auf der 4. Tübinger Wahrnehmungskonferenz,
Tübingen, März 2001. http://www.mpipf-muenchen.mpg.de/CA/PEOPLE/MUJO/POSTER/TWK2001.pdf
[9] Wu Jing-Ling, Nobuki, O. and Sakai, Y. Human Characteristic on Phase Discrimination between Visual
and Auditory Sine-Wave Stimuli. Available at: http://www.sccs.chukyo-u.ac.jp/ICCS/olp/o1-11/o1-11.htm
TAUCHI MMIG
G. Evreinov
14_15
31.10.2003
Temporal Events
[10] Müsseler, J., Stork, S., & Kerzel, D. (2000) Vergleich von Lokalisationsfehlern am Anfang, in der Mitte
und am Ende einer Bewegung (Fröhlich Effekt, Flash-Lag Effekt und Repräsentationales Momentum)
Poster präsentiert auf der 41. Meeting der Psychonomic Society, New Orleans, 16.-19. November
2000, http://www.mpipf-muenchen.mpg.de/CA/PEOPLE/MUJO/POSTER/Poster_NewOrleans.pdf
[11] Lankford, C. 2000. Effective Eye-Gaze Input Into Windows, in Proceedings of the Eye Tracking
Research & Applications Symposium 2000 (ETRA'00), Palm Beach Gardens, FL, ACM Press, 23-27.
[12] Hansen, J.P., Johansen, A.S., Hansen, D.W., Kenji Itoh and Satoru Mashino. Language Technology in
a Predictive, Restricted On-screen Keyboard with Ambiguous Layout for Severely Disabled People.
Paper submitted to the EACL 2003 Workshop on Language Modeling for Text Entry Methods, April 13,
2003, Budapest, Hungary.
http://www.it-c.dk/research/EyeGazeInteraction/Papers/Hansen_et_al_2003a.pdf
[13] Majaranta, P., MacKenzie, I. S., Aula, A., & Räihä, K.-J. (2003). Metrics for text entry research: Auditory
and visual feedback during eye typing. Proceedings of the ACM Conference on Human Factors in
Computing Systems - CHI 2003, pp. 766-767. New York: ACM. http://www.yorku.ca/mack/chi03d.html
[14] Fabre, J., Howard, S. and Smith, R. Designing time at the user interface. Behaviour & Information
Technology, 2000, Vol. 19(6), 451-463.
[15] Carlis, J.-V. and Konston, J.-A. Interactive visualization of serial periodic data. In Proc. Of the ACM
Conference on User Interface Software and Technology (UIST), San Francisco, CA, 1998.
[16] Mizobuchi, S., Wanobe, E. How long is a “long” key press? In Proceedings of INTERACT’01, Michitake
Hirose (Ed.), IOS Press, IFIP, 2001, pp.735-736.
TAUCHI MMIG
G. Evreinov
15_15
31.10.2003