Tele-immersion

Presented by:Himanshu Sharma1207185

ContentsIntroductionHistoryTele-conferencing vs. Tele-

immersion WorkingApplicationsChallenges

IntroductionTele-immersion is an emerging

technology that will enable users at geographically distributed sites to collaborate in real time in a shared, simulated environment as if they are in the same physical room.

This is achieved through realistic

reconstruction of the scenes in virtual space.

HistoryThe idea of Tele-immersion was proposed by Jaron

Lanier , the head of Advanced Networks and Services in 1997. National Tele-Immersion Initiative (NTII) was formed to implement this.

In May 2000, researchers at University of North Carolina (UNC), the University of Pennsylvania and Advanced Networks and Services developed this technology.

A user sitting in office at UNC was able to see lifelike 3D images of his colleagues hundreds of mile away.

Artistic expression as proposed by Jaron in 1997

Tele-conference vs. Tele-immersion

Tele-immersion differs significantly from conventional video Tele-conferencing in that the user’s view of the remote environment changes dynamically as he moves his head.

Tele-conferencing Tele-immersion

WORKING

Immersive Virtual Environment

Audio Synthesizer

Audio Localizer

SpeechRecognizer

DisplayElectronics

Head/Eye/HandTrackingElectronics

Haptic/Tactilekinaestheticssystem

commands

graphics

eye position

head position

hand position

VirtualEnvironmentGenerator

UserEnvironment

head-mounteddisplay orprojectiondisplaysystem

2D to 3D…

Image Acquisition• Bank of digital cameras capture participants from a variety of angels.•There are about 7-15 cameras clusters each contain 4 cameras out of which 3 are black and white and one is color.•B&W cameras are for stereo construction .•The color camera is for extracting the appearance.

A camera cluster of 3 BW and 1 color cameras

Camera clusters

Each camera is synchronized to other camera.

Each camera is connected to workstation.

3D Construction

3D sceneInteractive 3D display

at remote location

Internet 2

computation

This reconstruction uses Trinocular Stereo Algorithm.

After constructing the disparity map, apply median filtering to remove a few outliers in the disparity map.

Then the median filtered disparity map is combined with a registered color texture to reconstruct a 3D point cloud.

3D Video Transmission 3D data is transmitted in compressed form

using Modern Driven compression algorithm.

System which generates 640x480 pixel depth color maps from 10 camera clusters in a rate of 15 frames per second (fps), requires 220 mbps bandwidth.

Around 1.2 gbps is necessary for high quality effect.

ApplicationsRemote medical training and diagnosis.

Automobile engineering.

Remote and distributed education.

Virtual travel and tourism.Art and Entertainment.

ChallengesQuality of transmitting multimedia and Tele-

immersion data streams over the internet is affected by high packets loss rates.

ExpensiveHigh bandwidth requirement.

Thank you

Queries??