Exploring Diminished Reality (DR) Spaces to Augment the ... · (1) Literal perception (perceiving...

transcript

Asım Evren Yantaç / eyantac@ku.edu.trDoga Çorlu / dcorlu14@ku.edu.trMorten Fjeld / fjeld@chalmers.seAndreas Kunz / kunz@iwf.mavt.ethz.ch

Exploring Diminished Reality (DR) Spaces to Augment the Attention of Individuals with Autism

29.09.15 _ IWDR2015 _ Fukuoka, Japan

29.09.15 _ IWDR2015 _ Fukuoka, Japan / 472

Background

SURROUNDINGin 1910s

SURROUNDINGTODAY

We are now surrounded by data everywhere.

Accessibility is the degree to which a product, device, service, or environment is available to as many people as possible.

OTHERS

Accessibility is the degree to which a product, device, service, or environment is available to as many people as possible.

PEOPLE with DISABILITIES

The concept often focuses on people with disabilities or special needs and their right of access...

_ communication disorders;_ hearing impairments;_ visual impairments;_ mobility impairments;_ learning disability or impairment in mental functioning.

_ Agoraphobia_ Social anxiety disorder_ Panic disorder_ Alzheimer_ Bipolar disorder_ Autism_ Asperger_ Attention - deficit hyperactivity disorder_ Oppositional defiant disorder_ Anti-social personality disorder

Autism and Interaction Design...

Reasons for autism

Why Autism?_ communication_ socialisation_ imaginationdisorders.

Different sets of SAPTs:Senses / Perceptions / Abilities / Thinking Systems

Stimulus > Sensation > Interpretation (perception) > Comprehension (Concept)

There are 2 ways to look at things;- non-autistic- and autistic way. “our task should be to understand the second.”

Autistic perception has been learned from;- testimonies of high-funtioning autistics- close observation of autistic children.

Possible sensory autistic experience:(1) Literal perception (perceiving without interpretation)(2) Inability to distinguish fore/background(3) Hyper/Hypo sensitivity or white noise(4) Inconsistency of perception (flactuation)(5) Fragmented perception (6) Distorted perception(7) Sensory agnosia(8) Delayed perception(9) Vulnerability to sensory overload

Perceptual Styles:(1) mono processing(2) peripheral perception(3) system shutdown(4) compensating for unreliable sense(5) resonance

Cognitive Styles:(1) subconcious / un - pre concious cognition(2) preconscious VS. conscious style(3) attention(4) memory(5) concept formation(6) perceptual thinking(7) inertia (executive function def.)(8) imagination

Overload on visual and auditory sensory causes; - bending head down, - repetitive gestures, - cannot socialize, - cannot have eye contact. - throws into tantrum.

Unable to develop causality; - cannot sense the emotional states, - facial expressions, - actions within procedures.

Preoccupation to certain things.

Bad with time planning.

Some individuals are good with - structural information processing- focusing to specific things.

This makes them potentially - good users of machines and technology.

They have - better visual perception than auditory - different types of autistics have different visual representation tendecies (objects, realistic image, realistic illustrations, text).

INDIVIDUAL with AUTISM

SURROUNDING without TECH.

SURROUNDING with PEOPLE

SURROUNDING with PEOPLEand TECHNOLOGY

Our research focus: everyday life problems of individuals with autism.

We ran design workshops with interaction designers and autism experts

The insights gathered are presented next to designers of AUIs as targeted readership:

(R1) In most HCI uses, the environment “disables” the user. Human Factor research deals with the subject with an approach claiming that better interaction can be achieved by considering disabling environment factors.

(R2) Particular individuals with attention disorder are even more affected by distractors in their environment, even in their everyday life situations without using technology.

(R3) There are interactive assistive communication solutions for ASD individuals to help them with education. But not many of these studies try to find everyday life solu-tions.

(R4) These individuals are sometimes good with technology and mechanical abilities. Interactive technologies can make their life easier. This is also a valuable case study for interactive media design.

(R5) AUI is one paradigm that can help us build smart systems watching our needs and regulating the interaction in both disabled conditions and information bombard-ment situations.

(R6) DR is an emerging technique to optimize communication in HCI.

Evaluating these requirements, the workshops generated a set of seven criteria (C1-C7):

(C1) ASD individuals have problems in perception and attention that leads to impair-ment in social communication. Assistive technologies can be used to optimize commu-nication in their everyday life.

(C2) They confront many distractors in their everyday life. Sometimes they dislike spe-cific colors, objects, or people. Filtering out irrelevant information might help with aug-menting attention.

(C3) They spend most of their time in classrooms, living rooms or in room-like offices and prefer sameness in environments. Therefore, the solution should help with organiz-ing the information in their space.

(C4) Autistics do not like attachments to their bodies. The solution should not be a pros-thetic solution like a head-mounted AR device but can be a see-through or reflecting plane.

Evaluating these requirements, the workshops generated a set of seven criteria (C1-C7):

(C5) ASD individuals cannot understand mental states, facial expressions, abstract meanings of messages, or cause-effect relationships. Assistive technology can optimize these expressions and messages so that they can be perceived.

(C6) ASD individuals do not like eye contact with other people. The solution might help communication without the need for eye contact. It is preferable to stay away from gaze-contingent interaction techniques.

(C7) Different ASD individuals might have different perceptual abilities. For instance, some might be better than others with visual, auditory or verbal messages. Systems should support multi-modal communication abilities.

Design Ideas Based on the Criteria

Not only technology, but information overload generallydistracts Individuals with Autism.

Research question;

How can we change the world they sense

so that it doesn’t overload?

How about using a mirror like environment, which captures the room

and regulates the information to be presented.

CAMERA

AUTISTIC 1 AUTISTIC 2

DIFFERENT AUTISTICSSEE WITH THEIR

REPRESENTATION TYPES

PROJECTOR

VIEW POINT

BACK PROJECTED TANGIBLE MIRROR

Mediated Reality Diminished Reality /We can make use of;

But how?Here in this paper, we explore ideas on how to use diminished reality with a mirror concept for improvedattention of autistic individuals.

As a result of eight participatory design workshops,

we came up with some design solutions of

an interactive DR space with surfaces that filter out irrelevant visual data

present in the environment before it reaches the eye, or augmenting the

surroundings by projecting assistive information onto different types of sur-

faces.

We are now working on building the prototype of this system.

Thanks for your interest.Asım Evren Yantaç / eyantac@ku.edu.trDoga Çorlu / dcorlu14@ku.edu.trMorten Fjeld / fjeld@chalmers.seAndreas Kunz / kunz@iwf.mavt.ethz.ch

Exploring Diminished Reality (DR) Spaces to Augment the ... · (1) Literal perception (perceiving...

Documents