+ All Categories
Home > Documents > 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with...

2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with...

Date post: 03-Jan-2016
Category:
Upload: brendan-potter
View: 212 times
Download: 0 times
Share this document with a friend
61
2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile --- April 4, 2001 Walter B. Panko, PhD – Professor, Health Informatics
Transcript
Page 1: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

The Intersection of Virtual Reality and Tele-immersion with

REUNA Networking ConferenceValparaiso, Chile --- April 4, 2001

Walter B. Panko, PhD – Professor, Health Informatics

Page 2: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Reality: The Future has Arrived

3-Dimensional Education

Simulations

Pre-Treatment planning

CAVE, Immersadesk, and NGI technologies currently applied

to surgery

School of Biomedical and Health Information Sciencesand Department of Surgery, College of Medicine

Page 3: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Reality in Medicine LaboratoryEstablished 1997

Medical artists

Physicians

Bioengineers

Engineers

Programmers

Graphics Experts

“Integrating virtual reality technologies

into the practice of medicine”

School of Biomedical and Health Information Sciencesand Department of Surgery, College of Medicine

Page 4: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Underlying Theme

Strength through Collaboration

Page 5: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Underlying Theme

Strength through Collaboration, thus

is our natural partner

Page 6: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Next Generation Internet

List of Major Partners

Electronic Visualization Lab - UIC

Page 7: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

VRMed Lab Mission

“The Killer App”

Page 8: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Key CollaborationElectronic Visualization Lab

- Virtual Reality systems, software and networking

-They develop, we apply

-Close collaboration

Electronic Visualization Lab

Page 9: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

ImmersaDeskTM

Image by Tycho Hoogland

Page 10: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

ImmersaDeskTM

Image by Tycho Hoogland

Page 11: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Tele-Immersive Virtual Reality

• Two or more ImmersaDeskTM systems– stereo vision– viewer centered perspective– large angles of view– interactivity

• Networked collaboration (using CAVERNsoft)– converse, see each other, and point in 3D!

Electronic Visualization Lab

Page 12: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543.

Page 13: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543.

Page 14: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Adding Value via Collaboration

Page 15: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Biomedical Tele-Immersion forthe Next Generation Internet

Electronic Visualization and Networking Tom DeFanti, PhDBiomedical Visualization and Tele-Immersive Environment Co-PI Mary Rasmussen, Ray Evenhouse, Sean Prokasy Greg Blew, Fred Dech, Zhuming Ai, PhD, J.J. KempinersDomain (Colorectal, Otolaryngology, and General Surgery) Russell K. Pearl, MD Theodore Mason, MD W. Scott Helton, MDEvaluation and Medical Education

Marcia Edison, PhDPrincipal and Co-Principal Investigator Jonathan C. Silverstein, MD, MS, Walter B. Panko, PhD

This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543.

Page 16: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Department of Otolaryngology - Head and Neck Surgery

Virtual Temporal Bone

Collaborators:

Dept. of Otolaryngology - Head and Neck Surgery

Dept. of Surgery, UICUniversiteit Utrecht, Nederland

Page 17: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Temporal Bone Anatomy

• Highly complex• Critical to understanding common problems• Surgeon’s conceptual visualization difficult to

achieve with 2D illustrations or photos• Cadaver dissection even difficult

– many repeated attempts to learn

• Few local experts in any region

Department of Otolaryngology - Head and Neck Surgery

Page 18: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

• Histologic sections digitized• Structures segmented by hand drawing around

structures by medical artists with domain experts• 3-Dimensional surface geometry files generated

– IsoView (Metro-Web), Cosmo Worlds (SGI)

– VRML 2.0 files displayed in Performer (SGI)

• Displayed in Networked ImmersaDesks using CAVERNsoft (Tele-Immersive Virtual Reality)

Temporal Bone Methods

This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543.

Page 19: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Dept. of Otolaryngology - Head and Neck Surgery,

Page 20: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Browser Demonstration Version of Virtual Temporal Bone

Department of Otolaryngology - Head and Neck Surgery

Page 21: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Dept. of Otolaryngology - Head and Neck Surgery,

Page 22: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Dept. of Otolaryngology - Head and Neck Surgery,

Page 23: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Pelvic Floor

Collaborators:

Division of Colon and Rectal Surgery,

Cook County Hospital, Chicago, IL

Dept. of Surgery, UIC

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Page 24: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Virtual Pelvic Floor

Page 25: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Pelvic Floor Video - Internet2 Members

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Page 26: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Virtual Pelvic Floor

Page 27: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Virtual Pelvic Floor

Page 28: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Virtual Pelvic Floor

Page 29: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Division of Colon and Rectal Surgery, Cook County Hospital, Chicago

Page 30: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Cranioplasty

Tele-Immersive environments for surgery

• Cranial defects due to disease or trauma

• Virtual Reality and virtual prototyping

Page 31: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 32: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 33: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 34: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 35: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 36: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 37: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 38: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 39: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 40: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Cranioplasty

Expected Results•Improved Appearance•Improved Protection•Surgery time cut to 1/3•Hospital stay from 7 to 2 days

Unexpected Results•Increased blood flow to brain•Increased cerebrospinal fluid (CSF) pressure•Increased cognitive function

Page 41: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Collaborators:

Dept. Of Ophthalmology and Visual Sciences, UIC

Electronic Visualization Lab, UIC

Page 42: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 43: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 44: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 45: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 46: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 47: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Page 48: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Eye Diseases in Virtual Reality

Content expert: Balaji K. Gupta MD1

Production/direction: Mary Rasmussen2

VR software/programming: Zhuming Ai2

Modeling: Ja Lu Lin3

1. Dept. of Ophthalmology and Visual Sciences, UIC

2. VRMedLab, UIC

3. Electronic Visualization Lab, UIC

Page 49: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Radiological Tele-Immersion for Next Generation Networks

Collaborators:

Dept. of Radiology, UIC

Electronic Visualization Lab, UIC

Distributed, collaborative,

stereoscopic visualization

and manipulation

of three-dimensional

radiological image data

This project has been funded in whole or in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543.

Page 50: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Radiological Tele-Immersion

VR software/programming: Zhuming Ai, PhD, Fred Dech

Content expert: Jonathan Silverstein M.D.

This project has been funded in part with Federal funds from the National Library of Medicine, National Institutes of Health, under Contract No. N01-LM-9-3543 and Grant R01-LM-06756-01.

Page 51: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Virtual Reality: The Future has Arrived

3-Dimensional Education

Simulations

Pre-Treatment planning

CAVE, Immersadesk, and NGI technologies

School of Biomedical and Health Information Sciencesand Department of Surgery, College of Medicine

Page 52: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Page 53: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Barriers yet to conquer

• BarrCost

Ubiquitous high-performance networking (1GB >=)

Cultural change

Page 54: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

Barriers yet to conquer

• BarrCost – trends are in right direction

Ubiquitous high-performance networking (1GB >=)

Cultural change – may be hardest part

Page 55: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

Fit In?

Quality of Service (QoS) Issues

Where Does

2000-1 University of Illinois at Chicago

Page 56: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

QoS

• Basic Types– Resource reservation– Prioritization

• Need?– More traffic– More demanding applications

• In healthcare, applications demand more frequent.

2000-1 University of Illinois at Chicago

Page 57: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

Tele-Immersion QoS Requirements

• Bandwidth needs: High

• Priority: High

• Multicast

• Guaranteed bandwidth

2000-1 University of Illinois at Chicago

Page 58: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

Remote Surgery or Simulation QoS Requirements

• Bandwidth needs: Moderate

• Priority: Highest

• Low Latency

• Guaranteed bandwidth

2000-1 University of Illinois at Chicago

Page 59: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

Distributed Anatomy Lab QoS Requirements

• Bandwidth needs: Low-moderate

• Priority: Low-medium

• Low Latency

• Guaranteed bandwidth: Not needed

2000-1 University of Illinois at Chicago

Page 60: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

Compared to other domains, the need for “big pipe” is not as

important.

Caveat

2000-1 University of Illinois at Chicago

Page 61: 2000-1 University of Illinois at Chicago The Intersection of Virtual Reality and Tele-immersion with REUNA Networking Conference Valparaiso, Chile ---

2000-1 University of Illinois at Chicago

www.internet2.edu

TM


Recommended