Date post: | 13-Apr-2017 |
Category: |
Education |
Upload: | fridolinwild |
View: | 1,233 times |
Download: | 0 times |
Reality as a Knowledge Medium
Fridolin Wild1,2)
1 )Oxford Brookes University2 )Open University, UK
A note on methodical order
Conversation is the root of all information exchange. Narratives convert tacit knowledge to explicit knowledge.
# 2
No, all embodied experience!
Just language?
Narrate| Experience
# 3
information sharing
sense making
The 4 Realms of Experience (Pine & Gilmore, 1998)
# 4
Performance Augmentationwith wearables
sensor-sensory loop:super-real experience
010000100001000010001010001111110
The guestenacts experiences
The stagerproduces narratives
Affordances:which cultures ofuse to support?
Viewpoints:from what
perspective?Abstraction:what matters? what to pay
attention to?
Editing:how to enrich or
reduce?
Social Scope:for individuals,
teams, or more?
Sensing:which senses and
what sensors?
Grand Challenges?
(Fominykh, Wild, Smith, Alvarez, & Morozov, 2014)
Capture | Re-Enact
Research questions (p.14) RQ01. How to enrich the capture of activities and experiences by means of wearable sensors?
RQ02. How to experience more of the captured activities and experiences via AR and WT or a remote simulation?
RQ03. To what extent can the knowledge of an expert be captured as wearable experience?
RQ04. To what extent can a trainee experience the phenomenology of the expert through applying wearable experience?
# 7
Wearable experienceExamples of narratives with the new new interface.
# 8
Scenario Phase 1: capturing
expert experience Phase 2: wearing
expert experience by trainees
Phase 3: analysis and post processing
Example 1: Live Guidance
Example 2 + 3: Re-enactment
Sensors & SensesGlasses, wristbands, BCIs, smart objects, …
# 12
Capturing (p.10, p18) Wearable ambient and biofeedback sensors Tracking human position and orientation of the person in space/environment Gaze direction Capture the narration and ambient sounds
videos of the vision area 360 video Audio
Gestures along with affect data and physiological data
# 13
Re-enactment All gathered sensor data will be stored and synchronized as a single
experience recording. This tangible artifact will be available for trainees.
Second, the re-enactment of the captured experience will be achieved by augmenting trainee experience with contextualized expert data in real time.
For example, by 3D scanning the environment the system will know the position of both the expert and the trainee in space. Therefore, the relative position of the expert can be displayed for the trainee as an AR element. Data from other sensors will make the trainee aware of where the expert is looking, what the expert is seeing, what the expert is saying, how the expert is handling the tools with hands, and more. In such a manner, the trainee will be able to experience the presence of the expert while working on a task.
# 14
Hardware + SDKs (p.19f)
# 15
Dream, record, narrate, repeat.WEKIT.
# 16
W E K I T p r o j e c t i s f u n d e d b y t h e E u r o p e a n C o m m i s s i o n = E U d i s c l a i m e r
h tt p : / / w e k i t . e u /
Ces’t [email protected]
skype: fridolin.wildwhatsapp: +447751239881
# 17