1MSC IT Multimedia Module VR & AR
Virtual and
Augmented Reality
Phil Gray
2MSC IT Multimedia Module VR & AR
OutlineWhat is VR?Types of VRVR technologies
DIVEVRMLQTVR
VR Issues
3MSC IT Multimedia Module VR & AR
OutlineWhat is AR?Related ConceptsAR ExamplesMixed Reality
4MSC IT Multimedia Module VR & AR
VR:Defining characteristics
Computer simulations that use 3D graphics and devices such as the data glove to allow the user to interact with the simulation. (FOLDOC)SimulationSense of presenceInteractivity
Direct manipulation
3D?
5MSC IT Multimedia Module VR & AR
VR:Types of VR
ImmersiveGenerate representation that surrounds the user
VR headsetsData glovesHaptic input devicesCAVEs
Desktop VRGive user “window” onto a 3D worldSpatialised soundHaptic input & feedback
6MSC IT Multimedia Module VR & AR
VR:VR Hardware Technology
Head mounted displays3D displaysData gloveHaptic devicesCAVEs(CAVEAutomaticVirtualEnvironment)
7MSC IT Multimedia Module VR & AR
VR:CAVE
CAVE at UCL
Training devicefor speakers
Also used to treat phobias
8MSC IT Multimedia Module VR & AR
VR:VR Software Technology
VRMLQTVRDIVE
9MSC IT Multimedia Module VR & AR
VR:VRML
Virtual Reality Modelling Language“an open standard for 3D multimedia and shared virtual worlds on the Internet”Scene description languageRequires a viewer
Stand-alonePlug-in
Demo
10MSC IT Multimedia Module VR & AR
VR:VRML
VRML 1.0 – static environmentsVRML 97 (VRML 2.0)
InteractionAnimation
X3DMaking VRML XML compliant
11MSC IT Multimedia Module VR & AR
VR:VRML: A Simple Example#VRML V1.0 ascii
Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0
rotation 1 0 0 3.14159265}
Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97
height 4}
Define a colour(RGB value)
12MSC IT Multimedia Module VR & AR
VR:VRML: A Simple Example#VRML V1.0 ascii
Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0
rotation 1 0 0 3.14159265}
Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97
height 4}
Create a primitive shape
13MSC IT Multimedia Module VR & AR
VR:VRML: A Simple Example#VRML V1.0 ascii
Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0
rotation 1 0 0 3.14159265}
Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97
height 4}
move & rotate
14MSC IT Multimedia Module VR & AR
VR:VRML: A Simple Example#VRML V1.0 ascii
Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0
rotation 1 0 0 3.14159265}
Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97
height 4}
Change the colour
15MSC IT Multimedia Module VR & AR
VR:VRML: A Simple Example#VRML V1.0 ascii
Material{ diffuseColor 1 1 1 }Sphere { radius 1 }Transform{ translation 0 -2.2 0
rotation 1 0 0 3.14159265}
Material{ diffuseColor 1 1 0 }Cone { bottomRadius 0.97
height 4}
Add anotherprimitive shape
16MSC IT Multimedia Module VR & AR
VR:QTVR
System for generating low-cost simplified pseudo-3D desktop virtual environmentsBased on the QuickTime software architecture3 variants
panoramasobjectsscenes
17MSC IT Multimedia Module VR & AR
VR:DIVE
Distributed Interactive Virtual EnvironmentProvides
software infrastructureFile formatsApplications
Used for large-scale collaborative virtual reality applications
18MSC IT Multimedia Module VR & AR
19MSC IT Multimedia Module VR & AR
VR:VR Issues
Fatigue & nausea with head-mounted displaysComputational challenge of achieving fidelity and sufficient performanceSupporting interactivity
Avatars3D interaction techniques
20MSC IT Multimedia Module VR & AR
AR:Augmented Reality
AR – systems that enhance interaction between a user and his/her physical environment by placing computational capabilities in and around the physical environment
21MSC IT Multimedia Module VR & AR
AR:Related Concepts
Ubiquitous computingPervasive computingAmbient intelligenceContext-aware systemsContext-sensitive systems
22MSC IT Multimedia Module VR & AR
AR:Tangible Media
Hiroshi IshiiTangible MediaGroup, MIT Media LabAdding computationto ordinary physicalobjects
23MSC IT Multimedia Module VR & AR
AR:The SenseTable (MIT Media Lab)
24MSC IT Multimedia Module VR & AR
AR:SandScape (MIT Media Lab)
25MSC IT Multimedia Module VR & AR
AR:Magic Board (IMAG, Grenoble)
Images can bedrawn onto whiteboardProjected ontowhiteboard
Gestures can bedetected via processingof video images
26MSC IT Multimedia Module VR & AR
AR:Agumented Environments
Life-Sized Projector-Based Dioramas (2001) Kok-Lim Low, Greg Welch, Anselmo Lastra, Henry Fuchs. UNC Chapel Hill
27MSC IT Multimedia Module VR & AR
AR:Case Study: CASPER
Augmented surgeryTrajectory of needle is plannedin advanceDuring procedure, position ofneed is projected onto display
Version 1
Version 2
28MSC IT Multimedia Module VR & AR
AR:The Next Step – Mixed Reality
Mixed reality = VR + ARSystems that
combine physical and digital information and experienceCoordinate physical and digital experiences … for one or more people
29MSC IT Multimedia Module VR & AR
AR:Case Study: The City Project
30MSC IT Multimedia Module VR & AR
AR:Case Study: The City Project
EQUIPTupleSpace
locationsensors
Desktop VR
Hypertext (Web)The Real Gallery
31MSC IT Multimedia Module VR & AR
computationalcapabilities arebeginning tobecome availablefor incorporationin clothesMIThrilwearableplatform
AR:Wearable Computing
32MSC IT Multimedia Module VR & AR
For more informationCAVEs
Mel Slater website
VRMLhttp://vrmlworks.crispen.org/faq/
ARHiroshi Ishii, Tangible Media Group, MIT Media Lab
Pervasive ComputingGregory Abowd, Georgia Tech
Mixed RealityEquator IRC