Virtual Simulations for Soldiers: Concepts and Applications
Dr. François Bernier
Defence Scientist
Defence R&D Canada
September 21-22, 2010
Château Cartier
Gatineau, Que.
Soldier Systems Technology Roadmap Human and Systems Integration Workshop
• Virtual simulation and immersion• Laboratories in DRDC Valcartier• Stressful virtual environment• Medics and IBTS training• Conclusion
OUTLINEOUTLINE
(Immersive) Virtual Simulations
Desktop
CAVELarge screen
• Definition: real people using simulated equipment in a (immersive) simulated world/virtual environment
• The technological landscape is diversified
Static HMDMobile HMD (FITE)
What does Immersive Mean ?
Level 1: inside
Level 2: inside + perspective
Level 0: outside
Level 3: inside + perspective + stereo
Video
• Flexible multi-screen visualization infrastructure for exploitation and integration of virtual reality and simulation technologies;
• Immersive, collaborative, interactive visualization approach in support of complexity-characterized applications;
• Realistic environment for training and experimentation.
Exploration of video games and emerging technologies (D&S)• Gaming genres & mechanics;• Visualization & interaction techniques;• Software development tools;• Emerging display & interaction technologies.
Stressful Virtual Environment (SVE)• SVEs are required in many applications• Stress management training is one example
Reduce negative reactions to stress Improve operational effectiveness Potentially protect against psychological injuries
• Stress coping techniques must be practiced SVE
Electrocardiogram
Electrodermal activity
Physiological ArousalStressors
Coping Strategies
Virtual Environment
Arousal
Valence
high
positive
low
negative
Fear-Panic Exaltation
BoredomMeditation-happiness
How to Create a SVE (1/2) ?
• Use stressors found in theatre
*Raw data from CF Land Personnel Concept and Policies Office
Combat-related stressors experienced in Afghanistan (CF)
How to Create a SVE (2/2) ?Tangible
Intangible
Approach 1: Graphic Quality
Virtual Battlespace 2 (2007)Virtual Battlespace 2 (2007)
Unreal Tournament 2004Unreal Tournament 2004
Far Cry 2 (2009)Far Cry 2 (2009)Far Cry 2 (2009)Far Cry 2 (2009)
Unreal Tournament 3 (2007)Unreal Tournament 3 (2007)
Arma 2 (2009)Arma 2 (2009)
Approach 2: Immersion and VG
22” 3D LCD 73” 3D TV CAVE
Immersion & Price
CAVE73" 3D-Ready TV
Handheld22" 3D Ready LCD
• What level of immersion is sufficient?• Does the type of video game matter?• We exposed 56 soldiers to various virtual environments
(2 video games x 3 immersive technologies)
• Result: All virtual environments are “equally” stressful
Approach 3: Suffering Avatar• Could we elicit stress with a virtual
character of a known person (avatar) experiencing pain ?
• 42 civilians has been exposed (in a 6-side CAVE-Like system) to familiar and unfamiliar avatars
• Suffering Yes• Known Not yet
6-side CAVE-Like (UQO)
Training: Medic in a Combat Context• An immersive virtual simulation (CAVE) could provide a
realistic operational context for combat medic training
Training: IBTS• Benefits of immersion for training IBTS
(in support of a Applied Military Science Project - Kingston)
• Detachment level training : 1 CAVE + 4 Desktops• Mission: IED identification & vehicle checkpoint
Training: IBTS• Fully immersive simulator tends to achieve training objectives
slightly better than the desktop immersive simulator• Minor technological deficiencies identified• Integration of cognitive, physical and affective aspects
(e.g.: crouching when shot)• Familiarization faster than with desktop• Less a game than a real training environment• Tiring but motivating• Able to cause information overload
Conclusion
Summary• Immersive virtual environments can provide a realistic,
interactive and engaging synthetic battlefield to the soldier
• There is not universal/common technology for all applications
• We now better understand how to create SVE
Challenges• Lack of integration with the current CF training environment
• Many benefits of immersive virtual environments remain to be identified
• The cost is still an issue
Questions?
Dr. François Bernier – Defence ScientistDefence R&D Canada - Valcartier
(418) 844-4000 (4346) [email protected]
