Physically Realistic Interface for a User Inside VR

Masahide Hashimoto Kenji Miyamoto

Faculty of EngineeringHosei University (Japan)

What is User Inside VR ?

• Bodily Interaction with Virtual Objects

　 Stepping-in presentation.

(Yoshino.A, Mitsumata.H, and Miyamoto.K. 2003)

User Inside VR: Researches (1/3)

• A Mirror Metaphor Interaction System: Touching Remote Real Objects in an Augmented Reality Environment. （ Hosoya.E, et al. 2003 ）

User Inside VR: Researches (2/3)

• Virtually Touchable Video Communication. (Kanehata.S, Yoshino.A, and Miyamoto.K. 2004)

User Inside VR: Researches (3/3)

• EYETOY. (SONY.2003)

Various InteractionsInteraction System

Colored area stays

Stepping-in presentation

Colored area touches

A Mirror Metaphor …

Overlap Virtually Touchable Video Communication

Move EYETOY

Which Interaction ?Difficult to use at sight.

Framework

Events

Object-1

Object-N

Real

Event DetectionDispatcher

Tool-1 Tool-2 Tool-N

Events

System

.....

Event Action

Rule

Example

Dial

Events Events

Dial Tool ・ Overlap Opaque

・ Release Translucent

・Move Rotate

Touch

Rub

Release

Move

Release

Overlap

Applications

V-Rimokon: Controls Consumer Electronic 　　　　　　　　　　（ Using Dial Object ）

V-VolleyBall: Game　　　　（ Using Bouncing Object ）

Discussion

Related works (1/3)

• 5DT Data Gloves (http://www.5dt.com/hardware.html\#glove)

Related works (2/3)

• Ubi-Finger: Gesture Input Device for Mobile Use (Tsukada, K. and Yasumura, M.2002)

Related works (3/3)

• Wii Remote (Nintendo,2006)

Future work

• Extending to 3D

• Clayish Object

Conclusion

• A framework that forces reality was proposed.

• Tools built in this framework can be used easily at sight.

Thank you for your attention !

ImplementationInput: Video Camera

Background Subtraction

Event Detection & Dispatching

Object Action Invocation

Output

Image Composition

Comparison with AR

DevicelessCG in the Real World

Augmented Reality

Virtual Manipulation

User feels in the Real

World

Comparison with AV

Virtual Manipulation

•Interacting Image

User in VR•User live Image

Augmented Virtuality•Image