Vibro-Tactile feedback during Pen Vibro-Tactile feedback during Pen Manipulation in SpaceManipulation in Space

Fareed Ahmed

Fareed.Ahmed@uta.fi

Project for the course New Interaction TechniquesFall 2003

OverviewOverview

What is Tactile FeedbackProject OverviewApparatusApplications / ConclusionFuture InvestigationReferencesQuestions

Tactile FeedbackTactile Feedback

Tactile Means

– Perceptible by touch: TANGIBLE

– Relating to the sense of touch Referring to the sense of contact with the object, mediated by

the responses of low-threshold mechanoreceptors innervating the skin, within and around the contact region.

Mechanoreceptors

– Human being and other animals have several types of receptors of mechanical stimuli. Each initiates nerve impulses in sensory neurons when it is physically deformed by an outside force such as:

touch, pressure, stretching, sound waves, motion

Project OverviewProject Overview

Three Main Parts

– Capture Video– Process Image– Produce Tactile Feedback

Apparatus UsedApparatus Used

WebCam Logitech Tactile Feedback Mouse Tactile Pen

Form Load

WebCam:

Connect and initialize

Picture Control:

Display green pixel if RGB value in green

range

Col.R < 80 And Col.B < 180 And

Col.G > 190

CaptureImage

ImmersionControlPicFrame_Mou

seMove()

CapEditCopy to copy single frame to

clipboard

PSet

Timer1

Vibro-Tactile feedback

StartEffect

ClipBoardGetData

Video CaptureVideo Capture Capture Videos using Logitech webcam

Private Sub Form_Load()

Retrieves driver info

capGetDriverDescriptionA 0, lpszName, 100, lpszVer, 100

lwndC = capCreateCaptureWindowA(lpszName, WS_CHILD Or WS_VISIBLE, 0, 0, 160, 120, picVideo.hwnd, 0)

capSetCallbackOnVideoStream lwndC, AddressOf MyFrameCallback

End Sub

Public Sub captureImage()capEditCopy lwndC picFrame.Picture = Clipboard.GetDataEnd Sub

Video ProcessingVideo Processing

Capture Video as Frames Process each Frame as Image Detect green colour in Image Highlight One of Nine sectors on Screen

Produce Tactile FeedbackProduce Tactile Feedback

Generate Tactile Feedback Using– Tacticons created by Immersion Soft– Tactile impact redirected from Mouse to

Pen/Stick

ApplicationsApplications

Applications for the disabled people

– for example, presenting information or models with a tactile display when the user does not see well

Tactile feedback as a part of graphical user interface

– for example, to be used to give feedback on specific events

Games, virtual reality

– the simulated world feels more real when the user can really touch it

Future InvestigationsFuture Investigations

Study Subjects behavior with Application

Addition of Sound with tactile feedback

Creation of a Game with Tactile Feedback

Application Integration with mobile Devices

[3, 4]

Future Investigations (Cont.)Future Investigations (Cont.)[2]

ReferencesReferences

[1] Corde Lane and Jerry Smith: Force and Tactile Feedback

http://www.hitl.washington.edu/scivw/EVE/I.C.ForceTactile.html [2] Cao, X., Balakrishnan, R. VisionWand: Interaction Techniques for

Large Displays using a Passive Wand Tracked in 3D. http://www.cs.toronto.edu/~caox/uist2003_visionwand.pdf

[3] Zack Rosen: Creating a Web Browser For The Blind Using Tactile Feedback http://www.darktide.nu/nwa/zack/flash/PJAS10.ppt

[4] Roope Raisamo: Tactile User Interfaces http://www.cs.uta.fi/kurssit/Interact/interact5-2001.ppt

[5] Jeonghun Ku, Richard Mraz: Implementing a Data Glove with Tactile Feedback http://www.swchsc.on.ca/~virtualreality/downloads/IWVR%202003%20Abstract.pdf

QuestionsQuestions

?