Optically Sensing Tongue Gestures for Computer Input T. Scott Saponas Daniel Kelly Babak A.

Download Report

Transcript Optically Sensing Tongue Gestures for Computer Input T. Scott Saponas Daniel Kelly Babak A.

Optically Sensing Tongue
Gestures for Computer Input
T. Scott Saponas
Daniel Kelly
Babak A. Parviz
Desney S. Tan
University of Washington
University of Washington
University of Washington
Microsoft Research
Computer Input for People with
Brain and Spinal Cord Injuries
Sip ‘n Puff
Voice
Brain-Computer
Interface
Eye Tracking
Head Tracking
What about tongues?
Tongue Based Interfaces
Peng and Budinger,
Wireless 5 Button Pad
Ghovanloo , et al. Tongue Drive
NewAbilities, Tongue Keypad
Optically Sensing Tongue
Gestures for Computer Input
+
= ?
Optically Sensing Tongue
Gestures for Computer Input
+
+
=?
Optically Sensing Tongue
Gestures for Computer Input
infrared
proximity sensor
Optically Sensing Tongue
Gestures for Computer Input
Gesture Recognition
Right
Front
Left
Back
Right
Sliding
Average
Filter
Front
Left
Back
Left
Right Tap
Swipe Swipe
Hold
Tongue Tetris
Tongue Tetris
Left
Swipe
Right
Swipe
Tap
Hold
Tongue Tetris (Video)
Hardware
Proximity
Amplifier
Sensor
ADC
Microcontroller
Remote
Computer
Proximity Sensors
Fabrication
Four Person Experiment
Free Exploration
• Look at visualization
• Tune sensors
• Practice gestures
Stimulus Response
Average accuracy 92%
Tetris
•
•
•
•
5 minutes
180 moves
56 pieces placed
10 lines cleared
What’s Next?
What’s Next?
Thanks for Listening
Optically Sensing Tongue
Gestures for Computer Input
T. Scott Saponas
Daniel Kelly
Babak A. Parviz
Desney S. Tan
University of Washington
University of Washington
University of Washington
Microsoft Research