New Interaction Techniques
Department of Computer SciencesUniversity of Tampere, Finland
Department of Computer SciencesUniversity of Tampere, Finland
Grigori Evreinov
www.cs.uta.fi/~grse
Data Input throughFriction and Vibration
Data Input throughFriction and Vibration
September – December, 2003
TAUCHI MMIG G. Evreinov p 01_23 11.11.2003
data input through friction & vibration• how many buttons do you need????
http://www.gkos.net/
Smartquill of British Telecom http://oud.refdag.nl/weet/981013weetfo07.html
Fossil Wrist PDA with Palm OShttp://www.fossil.com/
http://www.spbsoftwarehouse.com/products/fsk/
TAUCHI MMIG G. Evreinov p 02_23 11.11.2003
Body Coupled FingeRing: Wireless Wearable Keyboard [Fukumoto & Tonomura, CHI’97]
data input through friction & vibration
Samsung Scurry wearable keyboard http://www.futurelooks.com
www.n-scribe.com/
TAUCHI MMIG G. Evreinov p 03_23 11.11.2003ANOTO pen http://www.anoto.com
VPenTM
http://www.otmtech.com/vpen3.asp
XWpen http://www.research.microsoft.com/users/lyn/
SmartQuill http://www.neoambiental.com.br/html/terceiromilenio/html/texto_terc_tecnologia04.htm
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 04_23 11.11.2003
ANOTO Pen
• the digital pen writes on ordinary paper
printed with a special pattern that is
almost invisible to the naked eye
• the dots have a nominal spacing of 0.3
mm (0.01 inch)
• a minute portion of the total pattern
uniquely defines its position in the full
pattern
http://www.anotofunctionality.com/navigate.asp
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 05_23 11.11.2003
chessboard grating
Optical Translation Measurement
OTM™
• OTM™ sensor measures the relative
motion of surfaces placed adjacent to
its aperture
• it includes a laser diode, detectors
and optics integrated into a small
transistor-style package
• the grating reflected beam serves as
a local oscillator, which interferes with
the reflected surface light for coherent
homodyne detection by the detector relief profile of the chessboard grating http://www.otmtech.com/otm.asp
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 06_23 11.11.2003
InkLinkTM
binaural technology the InkLink™ Data Clip continuously
listens for communications from the InkLink pen while it
tracks the natural movement of the hand
http://www.jdjstore.com/jdjstore/inhansys.html
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 07_23 11.11.2003
a pair of ear-microphones output signals were examined to detect
the side of teeth-chattering, right or left [Hashimoto, Yonezawa and Itoh, 5th Int. Conf. ICCHP’96]
data input through friction & vibration
homogenous texture with definite angle of ribs
TAUCHI MMIG G. Evreinov p 08_23 11.11.2003
II
discrete textured input as a prototype of command mode for menu pointing task
continuous variable textures with definite decrement of roughness
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 09_23 11.11.2003
• potential of diverse effects depends on pressuring force and
speed of relative motion between end effector and surface
• when the size of the end of the pen is commensurable to the ribs,
increasing applied force will increase the magnitude of recorded
roughness
• if vibratory signals take place during fingers manipulations along
of texture they can be recorded through piezoelectric transducer
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 10_23 11.11.2003
• diverse textures can produce different sound patterns by
strengthening primary feedback during finger manipulation along
of textured surfaces
• these signals and their combinations could be used to input
commands or add new functions to keyboard, mouse, joystick or
another controls
• texture recognition has various interesting applications which
include both medical and more autonomous mobile robotics
ScrollStrip http://www.synaptics.com/products/index.cfm
data input through friction & vibration
18 common materials were explored through a
sensing “finger” with an piezoelectric
microphone, covered by a rugged material
a system for tactile texture detection achieved
more than 93% of recognition
Mayol-Cuevas et al, 1998
TAUCHI MMIG G. Evreinov p 11_23 11.11.2003
Mayol-Cuevas, W.W., Juárez-Guerrero, J. & Muñoz-Gutiérrez, S.
The first approach to tactile texture recognition
http://ganso5.fi-b.unam.mx/ligasdoc/TCTSMC98.PS.gz
data input through friction & vibration
x.wavinput device and the experimental setup
TAUCHI MMIG G. Evreinov p 12_23 11.11.2003
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 13_23 11.11.2003
data input through friction & vibration
spectrums of vibration patterns during a linear motion across four textures
TAUCHI MMIG G. Evreinov p 14_23 11.11.2003
• Unistroke and Graffiti alphabet characters were used to simulate
gestures with definite structure (uninterrupted hand motion)
data input through friction & vibration
• the goal of our experiment was to evaluate spatial-temporary
segmentation of vibration patterns formed by handwriting
• segmented textured layout (modulator) and miniature
microphone (M294) performed spatial-temporal coding of pen
position
TAUCHI MMIG G. Evreinov p 15_23 11.11.2003
data input through friction & vibrationA B C D E F G H I J K L M
Unistroke
adapted
combinedcontinuous
N O P Q R S T U V W X Y Z
Unistroke
adapted
combinedcontinuous
vibratory patterns of the adapted unistrokes and combined continuous gestures (B, G, W)
TAUCHI MMIG G. Evreinov p 16_23 11.11.2003
data input through friction & vibration
.
.
.
.
.
.
TAUCHI MMIG G. Evreinov p 17_23 11.11.2003
• the proposed method has a potential for development new
interaction techniques for wearable computers
• 52 sound patterns during input of continuous gestures coding the
characters of English alphabet were registered and had a
recognizable structure
• diverse textures were assembled and explored to shape vibration
patterns when pen rubs over textured layout
• spectral averaging over the frequency range was found to be
effective tools for segmentation of vibration patterns received on
the textured layout
data input through friction & vibration
h.wav
SoundPen
TAUCHI MMIG G. Evreinov p 18_23 11.11.2003
data input through friction & vibration
assume, Freq.N = 400 Hz, then
at average speed of the pen motion
Vf = 25 mm/s
d = Vf / Freq.N , i.e., d = 0.06 mm
if = 65 then
dV = dN / cos dV = 0.14 mm
dH = dN / sin dH = 0.066 mm
correspondingly
Freq.V 180 Hz Freq.H 380 Hz
thus, if we shall provide texture with given
polarization, vibratory patterns will have
recognizable structure
d
Freq.V
Freq.H
Freq.N
TAUCHI MMIG G. Evreinov p 19_23 11.11.2003
data input through friction & vibration
vibratory patterns of the characters
TAUCHI MMIG G. Evreinov p 20_23 11.11.2003
a.wav
d.wav
h.wav
b.wav
o.wav
f.wav
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 21_23 11.11.2003
• western script has several handwriting styles for elementary
school-aged children
• loops and other groups can provide systematic steps for letter
analysis and are often used for learning of the recognition system
• for designing of diverse gestures, we have selected seven
segments, which are most often used in handwriting sheets for
learning to write characters in cursive
data input through friction & vibration
vibratory patterns of handwriting
elements for cursive performance
TAUCHI MMIG G. Evreinov p 22_23 11.11.2003
_.wav
_.wav
_.wav
_.wav
_.wav
_.wav
_.wav
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 23_23 11.11.2003
• this method was not intended for text entry, but has a potential
for human-computer interaction through special gestures along
textured surface
• while the size of the end of the pen was commensurable to the
ribs, sound patterns during input of handwriting characters were
registered and had recognizable structure
• the ribbed polarized textures similar to the diffraction grid were
proposed and explored to shape sound patterns when pen rubs
over these surfaces
• the vertical and horizontal components of the vibration frequency
had difference in two times
data input through friction & vibration
TAUCHI MMIG G. Evreinov p 00_00 11.11.2003
data input through friction & vibration