8/6/2019 BITM 3223 Chapter 7

1/19

1

LECTURE 8:LECTURE 8:

DEVELOPMENT IN VRDEVELOPMENT IN VR

TECHNOLOGYTECHNOLOGY

8/6/2019 BITM 3223 Chapter 7

2/19

22

Development in VR DesignDevelopment in VR Design

Apart from the standard interaction /interfaceApart from the standard interaction /interfacefor VR (etc: keyboard ,mouse), thefor VR (etc: keyboard ,mouse), thedevelopment of technology such as speechdevelopment of technology such as speech

recognition had also influence the research inrecognition had also influence the research inVR.VR.

US Navy had been investigating theUS Navy had been investigating thepossibilities in using Natural Languagepossibilities in using Natural Language

Interface for VR system.Interface for VR system.http://www.aic.nrl.navy.mil/~severett/VSMM9http://www.aic.nrl.navy.mil/~severett/VSMM98/VSMM98.html8/VSMM98.html

8/6/2019 BITM 3223 Chapter 7

3/19

33

Speech is the most natural form of communicationSpeech is the most natural form of communication

for humans, so a speechfor humans, so a speech--based interface enablesbased interface enables

the user to interact with the VR system in a naturalthe user to interact with the VR system in a natural

and intuitive way without removing his or her eyesand intuitive way without removing his or her eyesfrom the display.from the display.

Useful for controlling things that do not have aUseful for controlling things that do not have a

physical presence in the virtual world, such as objectphysical presence in the virtual world, such as object

scale, display characteristics, and time.scale, display characteristics, and time.

8/6/2019 BITM 3223 Chapter 7

4/19

44

Using speech output in combination with speechUsing speech output in combination with speech

recognition helps to avoid the use of textual displays,recognition helps to avoid the use of textual displays,

which can be difficult to read on today's immersivewhich can be difficult to read on today's immersive

display equipment, and which might interfere with thedisplay equipment, and which might interfere with theuser's view and the "reality" of the virtual world.user's view and the "reality" of the virtual world.

Example of research:Example of research:

-- From the Real World to the Virtual World: SpeechFrom the Real World to the Virtual World: Speech

Recognition for Advanced User Interfaces,A. W.Recognition for Advanced User Interfaces,A. W.

Stedmon, Dr. S. C. Nichols & J. Wilson,VirtualStedmon, Dr. S. C. Nichols & J. Wilson,Virtual

Reality Applications Research Team (VIRART),Reality Applications Research Team (VIRART),

University of NottinghamUniversity of Nottingham

8/6/2019 BITM 3223 Chapter 7

5/19

55

Interfacing Commercial ApplicationsInterfacing Commercial Applications

to Virtual Realityto Virtual Reality

There are many types of peripherals( h/w) but no standardThere are many types of peripherals( h/w) but no standardinterface to connect it. So how to provide an application ininterface to connect it. So how to provide an application inexecutable form, while allowing user customizable softwareexecutable form, while allowing user customizable softwareinterfaces to the users VR devices?interfaces to the users VR devices?

http://www.siggraph.org/publications/newsletter/v32n4/columns/ehttp://www.siggraph.org/publications/newsletter/v32n4/columns/elvins.htmllvins.html --suggest on the use ofsuggest on the use ofdynamic shared libraries ( dll/dynamic shared libraries ( dll/udf / dso)udf / dso)..

Nearly all applications these days use dynamic shared librariesNearly all applications these days use dynamic shared librariesfor linking applications to system libraries.for linking applications to system libraries.

The USB port helps A LOT in detecting the peripheral. Can plugThe USB port helps A LOT in detecting the peripheral. Can plug

and play easily).and play easily).

8/6/2019 BITM 3223 Chapter 7

6/19

66

Advantages anddisadvantagesAdvantages anddisadvantages

of DLLof DLL

There are at least three advantages to usingThere are at least three advantages to using

DSOs in an application.DSOs in an application.

T

he application disk size for DSO linkedT

he application disk size for DSO linkedapplications can be significantly smaller thanapplications can be significantly smaller than

one linked with static libraries.one linked with static libraries.

The DSO can be optimized for a particularThe DSO can be optimized for a particular

hardware configuration transparent to thehardware configuration transparent to theapplication.application.

8/6/2019 BITM 3223 Chapter 7

7/19

77

Advantages anddisadvantagesAdvantages anddisadvantages

of DLLof DLL

The library can be supplied by the end user affectingThe library can be supplied by the end user affecting

the functionality of the application withoutthe functionality of the application without

necessitating a relink and/or recompile.necessitating a relink and/or recompile.

A minor disadvantage to DSO linked applicationsA minor disadvantage to DSO linked applicationswhen compared to statically linked applications is thatwhen compared to statically linked applications is that

they tend to start up slightly slower since the operatingthey tend to start up slightly slower since the operating

system must search the known libraries to resolve thesystem must search the known libraries to resolve the

unreferenced symbols. The good news is thatunreferenced symbols. The good news is that

following startfollowing start--up, a DSO linked application performsup, a DSO linked application performs

comparably to one that has been statically linked.comparably to one that has been statically linked.

8/6/2019 BITM 3223 Chapter 7

8/19

88

VR applicationVR application

characteristics for end usercharacteristics for end user

Provide the scientific or analysis capabilitiesProvide the scientific or analysis capabilitiesthat the user desires (e.g. isosurfaces, clipthat the user desires (e.g. isosurfaces, clipplanes, data calculation, statistics).planes, data calculation, statistics).

Needs to deliver sufficient renderingNeeds to deliver sufficient renderingperformance to preserve the illusion of realityperformance to preserve the illusion of realityas well as sufficient processor performanceas well as sufficient processor performancefor feature calculations (e.g. isosurfacefor feature calculations (e.g. isosurface

calculation).calculation).

8/6/2019 BITM 3223 Chapter 7

9/19

99

VR applicationVR application

characteristics for end usercharacteristics for end user

Support an interface mechanism to theSupport an interface mechanism to the

particular VR devices for which the user hasparticular VR devices for which the user has

access.access.

Easy to use and must not require significantEasy to use and must not require significant

learning time (both in terms of learning howlearning time (both in terms of learning how

to navigate within the VR environment andto navigate within the VR environment and

how to operate the application).how to operate the application).

8/6/2019 BITM 3223 Chapter 7

10/19

1010

Networked VRNetworked VR

very important part in modern computingvery important part in modern computingsystemssystems

allow the computing infrastructure to beallow the computing infrastructure to be

distributed across a local or global networkdistributed across a local or global network can share informationcan share information

A networked VR environment allowsA networked VR environment allows

participants in different locations to share theparticipants in different locations to share thesame virtual environmentsame virtual environment

8/6/2019 BITM 3223 Chapter 7

11/19

1111

Can be used for any kind of collaborativeCan be used for any kind of collaborative

project, scientific, industrial, design or art,project, scientific, industrial, design or art,

where the collaborators are located onwhere the collaborators are located on

different continents, different cities or justdifferent continents, different cities or just

across town. Typically high speed networksacross town. Typically high speed networks

are needed to carry the necessaryare needed to carry the necessary

information between the locations.information between the locations.

8/6/2019 BITM 3223 Chapter 7

12/19

1212

There are two different approaches to networkedThere are two different approaches to networked

VR:VR:

VR accessed over a networkVR accessed over a network -- eg VRMLeg VRML

There is a growing interest in extending the 2D webThere is a growing interest in extending the 2D webbrowsers to allow 3D interaction and visualisationbrowsers to allow 3D interaction and visualisation

Shared VR environmentsShared VR environments -- eg. dVISE/dVSeg. dVISE/dVS

the means of connecting several high performance VRthe means of connecting several high performance VR

systems together over either local or wide area networks,systems together over either local or wide area networks,multimulti--user architectureuser architecture

8/6/2019 BITM 3223 Chapter 7

13/19

1313

Article on networked vrArticle on networked vr

Teaching your system to shareTeaching your system to share

Pimentel, K.; Blau, B.;Pimentel, K.; Blau, B.;

Computer Graphics and Applications, IEEEComputer Graphics and Applications, IEEE

Volume 14, Issue 1, Jan. 1994 Page(s):60Volume 14, Issue 1, Jan. 1994 Page(s):60 -- 6565

Distributed virtual reality for everyoneDistributed virtual reality for everyone--aa

framework for networked VR on the Internetframework for networked VR on the Internet

Broll, W.;Broll, W.;

Virtual Reality Annual International Symposium, 1997.,Virtual Reality Annual International Symposium, 1997.,

IEEE 1997IEEE 1997

11--5 March 1997 Page(s):1215 March 1997 Page(s):121 -- 128, 217128, 217

8/6/2019 BITM 3223 Chapter 7

14/19

1414

Article on networked vrArticle on networked vr

Challenges in VRChallenges in VR--based robot teleoperationbased robot teleoperation

ChengCheng--Peng Kuan; KuuPeng Kuan; Kuu--Young Young;Young Young;

Robotics and Automation, 2003. Proceedings. ICRA '03. IEEERobotics and Automation, 2003. Proceedings. ICRA '03. IEEE

International Conference onInternational Conference on

Volume 3, 14Volume 3, 14--19 Sept. 2003 Page(s):439219 Sept. 2003 Page(s):4392 -- 4397 vol.34397 vol.3

8/6/2019 BITM 3223 Chapter 7

15/19

1515

HumanHuman--ComputerComputer

Interaction IssuesInteraction Issues

Key human factors issues include:Key human factors issues include:

VisualizationVisualization -- level of fidelitylevel of fidelity

InteractionInteraction -- style of interaction and technologystyle of interaction and technology

PerformancePerformance -- performance evaluationperformance evaluation

Which VR concept to useWhich VR concept to use

Use of multisensory modalityUse of multisensory modality

8/6/2019 BITM 3223 Chapter 7

16/19

1616

IssuesIssues

Cost of entryCost of entry

Technology obsolescenceTechnology obsolescence

Technology independence in terms of the softwareTechnology independence in terms of the software

toolstools

Interaction in a 3D environment is problematical withInteraction in a 3D environment is problematical with

2D devices such as a mouse2D devices such as a mouse

Quantifying the application benefitQuantifying the application benefit

TimingTiming

8/6/2019 BITM 3223 Chapter 7

17/19

1717

Future Developments in VRFuture Developments in VR

TechnologyTechnology

Faster/Better/CheaperFaster/Better/Cheaper

(evolutionary/revolutionary)(evolutionary/revolutionary) Improved resolutionImproved resolution

More precise, accurate, & wider range trackingMore precise, accurate, & wider range tracking

WirelessWireless

Graphics (more polygons, textures / new forms)Graphics (more polygons, textures / new forms)

PortablePortable

8/6/2019 BITM 3223 Chapter 7

18/19

1818

Future Developments in VR TechnologyFuture Developments in VR Technology

SoftwareSoftware

Better Development CapabilitiesBetter Development Capabilities

Off the Shelf ApplicationsOff the Shelf Applications

MultiMulti--presence will be commonpresence will be common

Refined Representational TechniquesRefined Representational Techniques

Refined Interaction TechniquesRefined Interaction Techniques

8/6/2019 BITM 3223 Chapter 7

19/19

1919

Future Developments in VRFuture Developments in VR

TechnologyTechnology

User InterfaceUser Interface

More UbiquitousMore Ubiquitous

VoiceVoice

Force Feedback (incl. smaller motion platforms)Force Feedback (incl. smaller motion platforms)

Eye TrackingEye Tracking

Additional SensesAdditional Senses