+ All Categories
Home > Documents > The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives...

The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives...

Date post: 08-Aug-2020
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
49
The TRAVERSE Project Transcending Reality - Activating Virtual Environment Responses Through Sensory Enrichment Mel Slater ICREA-Universitat de Barcelona ERC Conference Budapest, 20 June, 2011 www.event-lab.org Monday, June 27, 2011
Transcript
Page 1: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

The TRAVERSE ProjectTranscending Reality - Activating Virtual Environment

Responses Through Sensory Enrichment

Mel SlaterICREA-Universitat de Barcelona

ERC Conference Budapest, 20 June, 2011

www.event-lab.org

!

!

Monday, June 27, 2011

Page 2: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Head-Mounted Display

Cave system

Immersive Virtual Reality (VR)

Monday, June 27, 2011

Page 3: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Head-Mounted Display

Cave system

Immersive Virtual Reality (VR)

Monday, June 27, 2011

Page 4: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

An important goal of immersive VR research

Head-Mounted Display

Cave system

Immersive Virtual Reality (VR)

Monday, June 27, 2011

Page 5: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

is to understand how to create environments

Monday, June 27, 2011

Page 6: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

is to understand how to create environments

where people act as if what they’re experiencing is real

Monday, June 27, 2011

Page 7: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

is to understand how to create environments

where people act as if what they’re experiencing is real

Rovira, Swapp, Spanlang, Slater (2009) Frontiers in Behavioral Neuroscience

Monday, June 27, 2011

Page 8: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.

Monday, June 27, 2011

Page 9: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.

while the ‘self’ remains invariant

Monday, June 27, 2011

Page 10: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.

while the ‘self’ remains invariant

The same ‘self’ goes into many different environments

and behaves according to the demands of those

environments

Monday, June 27, 2011

Page 11: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.

while the ‘self’ remains invariant

Here we put forward a new paradigm - that we usevirtual reality to (temporarily) transform the self.

The same ‘self’ goes into many different environments

and behaves according to the demands of those

environments

Monday, June 27, 2011

Page 12: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Hitherto attention has focussed on properties of the environment and the objects within it, the systems used to display it, and the interaction methods available within it.

while the ‘self’ remains invariant

Here we put forward a new paradigm - that we usevirtual reality to (temporarily) transform the self.

The same ‘self’ goes into many different environments

and behaves according to the demands of those

environments

Different representations of ‘self’ go into the same

environent

Behave differently as the self varies?

Monday, June 27, 2011

Page 13: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Outline

• Conceptual aspects of IVR

• The virtual body

• Two experiments

• virtual reality can make you fat

• give you a very long arm

• Conclusions

Monday, June 27, 2011

Page 14: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 15: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 16: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Visual perception through naturalsensorimotor contingencies

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 17: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Visual perception through naturalsensorimotor contingencies

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 18: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Visual perception through naturalsensorimotor contingencies

Place Illusion:Strong illusion of

being in the virtual place

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 19: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Visual perception through naturalsensorimotor contingencies

Place Illusion:Strong illusion of

being in the virtual place

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 20: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Visual perception through naturalsensorimotor contingencies

Place Illusion:Strong illusion of

being in the virtual place

Head-tracked Stereowide field-of-viewhead-mounted display

Monday, June 27, 2011

Page 21: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Monday, June 27, 2011

Page 22: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Monday, June 27, 2011

Page 23: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Plausibility Illusion(Psi)

Monday, June 27, 2011

Page 24: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Plausibility Illusion(Psi)

Monday, June 27, 2011

Page 25: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Plausibility Illusion(Psi)

Illusion that events are real

Monday, June 27, 2011

Page 26: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Plausibility Illusion(Psi)

Illusion that events are real

Monday, June 27, 2011

Page 27: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Events: that correlate with your actions that relate personally to you

Plausibility Illusion(Psi)

Illusion that events are real

Pan, Gillies and Slater (2011) submitted.Monday, June 27, 2011

Page 28: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Place Illusion Plausibility

Monday, June 27, 2011

Page 29: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Place Illusion Plausibility

PI and Psi are unified in the virtual body

Monday, June 27, 2011

Page 30: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Place Illusion Plausibility

PI and Psi are unified in the virtual body

Look down at yourself or in a mirror (SC)

Monday, June 27, 2011

Page 31: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Place Illusion Plausibility

PI and Psi are unified in the virtual body

Look down at yourself or in a mirror (SC)

Move and the body moves (correlated actions/events)

Monday, June 27, 2011

Page 32: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Place Illusion Plausibility

PI and Psi are unified in the virtual body

Look down at yourself or in a mirror (SC)

Move and the body moves (correlated actions/events)

Monday, June 27, 2011

Page 33: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Virtual body opens up a new tool for neuroscience to study body ownership

Monday, June 27, 2011

Page 34: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Virtual body opens up a new tool for neuroscience to study body ownership

and a new objective for virtual reality in understanding behavioural and attitudinal

implications of body transfer.

Monday, June 27, 2011

Page 35: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Virtual Reality Can Make You Fat

• Can VR generate the illusion of having a much fatter belly?

Normand, Giannopoulos, Spanlang, Slater (2010) PLoS ONE

Monday, June 27, 2011

Page 36: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Monday, June 27, 2011

Page 37: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Drift = After measure - Before measure

Monday, June 27, 2011

Page 38: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Results

• Average drift was positive - for the synchronous condition

• people overestimated their size after the experiment

• Questionnaire ratings of body ownership were high for the synchronous condition

• The questionnaire scores were correlated with drift

• Synchronous condition led to feeling of larger body.

Monday, June 27, 2011

Page 39: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Changing the Structure of the Body with VR:A Very Long Arm Illusion

Monday, June 27, 2011

Page 40: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Results

• The virtual arm can be incorporated up to about 3 times the real length

• strong subjective responses

• felt position of the hand changed after the elongation

• subjects responded to the falling knife

Monday, June 27, 2011

Page 41: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

Conclusions• Virtual embodiment and transformation appears to

be possible.

• We are just starting to investigate the potential benefits of this:

• Put yourself in the shoes of the other

• Change in attitudes (if desired)

• Rehearsal and preparation for events from different standpoints

• Applications in health and psychotherapy

• Excellent tool for neuroscience to experiment with embodiment

• While keeping eyes on the ethical implications

Monday, June 27, 2011

Page 42: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

Monday, June 27, 2011

Page 43: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

Monday, June 27, 2011

Page 44: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

• The application and negotiation process was straightforward

Monday, June 27, 2011

Page 45: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

• The application and negotiation process was straightforward

• The long-term nature and freedom to choose any topic was liberating

Monday, June 27, 2011

Page 46: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

• The application and negotiation process was straightforward

• The long-term nature and freedom to choose any topic was liberating

• Job security for long term researchers

Monday, June 27, 2011

Page 47: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

• The application and negotiation process was straightforward

• The long-term nature and freedom to choose any topic was liberating

• Job security for long term researchers

• We were able to install significant and advanced equipment

Monday, June 27, 2011

Page 48: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

ERC Benefits

• The application and negotiation process was straightforward

• The long-term nature and freedom to choose any topic was liberating

• Job security for long term researchers

• We were able to install significant and advanced equipment

• University of Barcelona built a new building.

Monday, June 27, 2011

Page 49: The TRAVERSE Project...Tabitha Peck Konstantina Kilteni Daniel Perez-Marcos Maria V. Sanchez-Vives David Swapp Aitor Rovira Xueni Pan Monday, June 27, 2011 Created Date 6/27/2011 9:47:33

AcknowledgementsBernhard Spanlang, Jean-Marie NormandElias GiannopoulosTabitha PeckKonstantina Kilteni

Daniel Perez-MarcosMaria V. Sanchez-Vives

David SwappAitor RoviraXueni Pan

Monday, June 27, 2011


Recommended