The TRAVERSE ProjectTranscending Reality - Activating Virtual Environment
Responses Through Sensory Enrichment
Mel SlaterICREA-Universitat de Barcelona
ERC Conference Budapest, 20 June, 2011
www.event-lab.org
!
!
Monday, June 27, 2011
Head-Mounted Display
Cave system
Immersive Virtual Reality (VR)
Monday, June 27, 2011
Head-Mounted Display
Cave system
Immersive Virtual Reality (VR)
Monday, June 27, 2011
An important goal of immersive VR research
Head-Mounted Display
Cave system
Immersive Virtual Reality (VR)
Monday, June 27, 2011
is to understand how to create environments
Monday, June 27, 2011
is to understand how to create environments
where people act as if what they’re experiencing is real
Monday, June 27, 2011
is to understand how to create environments
where people act as if what they’re experiencing is real
Rovira, Swapp, Spanlang, Slater (2009) Frontiers in Behavioral Neuroscience
Monday, June 27, 2011
Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.
Monday, June 27, 2011
Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.
while the ‘self’ remains invariant
Monday, June 27, 2011
Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.
while the ‘self’ remains invariant
The same ‘self’ goes into many different environments
and behaves according to the demands of those
environments
Monday, June 27, 2011
Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.
while the ‘self’ remains invariant
Here we put forward a new paradigm - that we usevirtual reality to (temporarily) transform the self.
The same ‘self’ goes into many different environments
and behaves according to the demands of those
environments
Monday, June 27, 2011
Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.
while the ‘self’ remains invariant
Here we put forward a new paradigm - that we usevirtual reality to (temporarily) transform the self.
The same ‘self’ goes into many different environments
and behaves according to the demands of those
environments
Different representations of ‘self’ go into the same
environent
Behave differently as the self varies?
Monday, June 27, 2011
Outline
• Conceptual aspects of IVR
• The virtual body
• Two experiments
• virtual reality can make you fat
• give you a very long arm
• Conclusions
Monday, June 27, 2011
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Visual perception through naturalsensorimotor contingencies
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Visual perception through naturalsensorimotor contingencies
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Visual perception through naturalsensorimotor contingencies
Place Illusion:Strong illusion of
being in the virtual place
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Visual perception through naturalsensorimotor contingencies
Place Illusion:Strong illusion of
being in the virtual place
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Visual perception through naturalsensorimotor contingencies
Place Illusion:Strong illusion of
being in the virtual place
Head-tracked Stereowide field-of-viewhead-mounted display
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Plausibility Illusion(Psi)
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Plausibility Illusion(Psi)
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Plausibility Illusion(Psi)
Illusion that events are real
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Plausibility Illusion(Psi)
Illusion that events are real
Monday, June 27, 2011
Events: that correlate with your actions that relate personally to you
Plausibility Illusion(Psi)
Illusion that events are real
Pan, Gillies and Slater (2011) submitted.Monday, June 27, 2011
Place Illusion Plausibility
Monday, June 27, 2011
Place Illusion Plausibility
PI and Psi are unified in the virtual body
Monday, June 27, 2011
Place Illusion Plausibility
PI and Psi are unified in the virtual body
Look down at yourself or in a mirror (SC)
Monday, June 27, 2011
Place Illusion Plausibility
PI and Psi are unified in the virtual body
Look down at yourself or in a mirror (SC)
Move and the body moves (correlated actions/events)
Monday, June 27, 2011
Place Illusion Plausibility
PI and Psi are unified in the virtual body
Look down at yourself or in a mirror (SC)
Move and the body moves (correlated actions/events)
Monday, June 27, 2011
Virtual body opens up a new tool for neuroscience to study body ownership
Monday, June 27, 2011
Virtual body opens up a new tool for neuroscience to study body ownership
and a new objective for virtual reality in understanding behavioural and attitudinal
implications of body transfer.
Monday, June 27, 2011
Virtual Reality Can Make You Fat
• Can VR generate the illusion of having a much fatter belly?
Normand, Giannopoulos, Spanlang, Slater (2010) PLoS ONE
Monday, June 27, 2011
Monday, June 27, 2011
Drift = After measure - Before measure
Monday, June 27, 2011
Results
• Average drift was positive - for the synchronous condition
• people overestimated their size after the experiment
• Questionnaire ratings of body ownership were high for the synchronous condition
• The questionnaire scores were correlated with drift
• Synchronous condition led to feeling of larger body.
Monday, June 27, 2011
Changing the Structure of the Body with VR:A Very Long Arm Illusion
Monday, June 27, 2011
Results
• The virtual arm can be incorporated up to about 3 times the real length
• strong subjective responses
• felt position of the hand changed after the elongation
• subjects responded to the falling knife
Monday, June 27, 2011
Conclusions• Virtual embodiment and transformation appears to
be possible.
• We are just starting to investigate the potential benefits of this:
• Put yourself in the shoes of the other
• Change in attitudes (if desired)
• Rehearsal and preparation for events from different standpoints
• Applications in health and psychotherapy
• Excellent tool for neuroscience to experiment with embodiment
• While keeping eyes on the ethical implications
Monday, June 27, 2011
ERC Benefits
Monday, June 27, 2011
ERC Benefits
Monday, June 27, 2011
ERC Benefits
• The application and negotiation process was straightforward
Monday, June 27, 2011
ERC Benefits
• The application and negotiation process was straightforward
• The long-term nature and freedom to choose any topic was liberating
Monday, June 27, 2011
ERC Benefits
• The application and negotiation process was straightforward
• The long-term nature and freedom to choose any topic was liberating
• Job security for long term researchers
Monday, June 27, 2011
ERC Benefits
• The application and negotiation process was straightforward
• The long-term nature and freedom to choose any topic was liberating
• Job security for long term researchers
• We were able to install significant and advanced equipment
Monday, June 27, 2011
ERC Benefits
• The application and negotiation process was straightforward
• The long-term nature and freedom to choose any topic was liberating
• Job security for long term researchers
• We were able to install significant and advanced equipment
• University of Barcelona built a new building.
Monday, June 27, 2011
AcknowledgementsBernhard Spanlang, Jean-Marie NormandElias GiannopoulosTabitha PeckKonstantina Kilteni
Daniel Perez-MarcosMaria V. Sanchez-Vives
David SwappAitor RoviraXueni Pan
Monday, June 27, 2011