ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect

ColorBless: Augmenting Visual Information for Colorblind People

with Binocular Luster Effect

Soon Hau ChuaHaimo Zhang Muhammad Hammad Shengdong Zhao Sahil Goyal Karan Singh

National University of Singapore NUS-HCI Lab

1

] NUS-HCI Lab National University of Singapore- University of Toronto

ACM Transactions on Computer-Human Interaction (TOCHI), Jan 2015 Presented in ACM CHI 2015 Conference

ColorBless is a digital colorblind aid that applies binocular luster effect to differentiate

confusing colors for colorblind people


2

Binocular Luster Effect National University of Singapore NUS-HCI Lab

3

Brightness differences beyond what our brain can fuse

Binocular Luster Effect National University of Singapore NUS-HCI Lab

4

Simulation Video of Binocular Luster Effect (60fps)


5

Luster effect can only be seen with 3D glasses

6


Using Luster For Colorblind Aids

Original Image Simulated Colorblind Image

7


ColorBless

*Both images are for illustration purposes. For actual effect please refer to .JPS images in supplementary package.

Luster Effect

8



PatternBless

Lustered Patterns

The Problem for Colorblind People


9

• Significance: ~200 million people

• Type: Red-green (protanope, deuteranope) Blue-yellow (tritanope)


10

• Significance: ~200 million people

• Type: Red-green (protanope, deuteranope) Blue-yellow (tritanope)

The Problem for Colorblind People

Strategies of Colorblind Aids

• (i) Contextual Inferences


11

Contextual Inferences National University of Singapore NUS-HCI Lab

12

Normal color vision Red-green colourblind


• (ii) Substituting Colors


13


Substituting Colors National University of Singapore NUS-HCI Lab

14

Digital Recoloring Aids

• Recolor confusing colors

• Enhancing the contrast of confusing colors

• Daltonize recoloring algorithm

Substituting Colors National University of Singapore NUS-HCI Lab

15

Digital Recoloring Aids

Daltonized Colorblind Image

Original Image

Daltonize

Simulated Colorblind Image

Downside: Color perception for normal people is affected.

DaltonizedOriginal Image


• (ii) Substituting Colors

• (iii) Augmenting Visual Information


16


Augmenting Visual Information National University of Singapore NUS-HCI Lab

17Original Image

• Augment colors with other noncolor visual elements

• Sajadi et al’s pattern technique (2012)


Confusing colors Confusing

colors


Augmenting Visual Information

Simulated colorblind image after applyingSajadi’s Pattern technique

• Introduce visual artefacts

• Disrupt the purpose of images

• Higher cognitive effort needed

Augmenting Visual Information National University of Singapore NUS-HCI Lab

Downsides

19

Scenario

20


Meeting Scenario

On the screen

Contextual Inferences Substituting Colors

Existing Augmentation

Are these ideal?

Colorblind

Desirable Properties of a Colorblind Aid

• Confusing colors are easily distinguishable

• Does not affect the overall hues for people with normal color vision


21

22


ColorBless and PatternBless


Luster Effect Lustered

Patterns


23

Luster effect can only be seen with 3D glasses





24

Can ColorBless and PatternBless fulfil these properties?

ColorBless and PatternBless National University of Singapore NUS-HCI Lab

25

Original Image


26

Meyer & Greenberg ColorBlind Simulation Algorithm

(1998)



27

Find similar colors in colorblind view


28

Find colors similar in colorblind view, but different in original image


29

Apply luster effect to one of the color areas

Area to be “blessed” (Applied luster effect)by increasing its brightness (+dY) in one eye

and decrease (-dY) in another


30

Bless the whole area (ColorBless)

Bless with patterns (PatternBless)


31

Bless the whole area Bless with patterns

+dY +dY-dY -dY

User Studies






33

Techniques Compared

• Daltonize recoloring technique

• Sajadi’s pattern augmentation technique

• ColorBless

• PatternBless


34

Experimental Design

• Ten colorblind participants (mild to medium deutans)

• Simple color distinguishing task

• Indicate square with a different color

• Reaction time (s) and error rate were measured


35

Color Distinguishing Task


Experimental DesignColor Distinguishing Task

• Five confusing color pairs were prepared

• Determined 3 that were the most confusing in pre-study

• 3 color pairs x 6 positions x 5 conditions (control, Daltonize, Pattern, ColorBless, PatternBless) = 90 trials / participant

Results

*Error bars denote standard deviation


Color Distinguishing Task

37

ResultsSubjective Evaluation

*Average mean values are plotted, error bars denote standard deviation


38

ResultsPreferences in Common Working Use-cases

Users preference in different use-cases


39

Results

• Our participants place huge emphasis on reliability and speed when interpreting color-coded information

• Participants commented that while recoloring technique could resolve color confusion, they avoid relying on hues exclusively in everyday task

Post Interviews


40





41





42

Techniques Compared

• Daltonize recoloring technique

• Sajadi’s pattern augmentation technique

• Luster effect


43

Experimental Design• Ten normal color vision participants

• Evaluate the color shown in the stimulus image

• Five colors from the first user study were chosen

• Three color variants (Daltonize, Pattern, Luster)


44

A B C D E

Experimental Protocol

• Color evaluated using Color Dictionary (Heer & Stone 2012)

• Color name distance determined with Color Palette Analyser (Heer & Stone 2012)


A B C D E

45

Results National University of Singapore NUS-HCI Lab

Retaining Colors for Normal Color Vision People

46

Significant (p < .01)Daltonize performed poorly in distinguishing task





47

Additional Factor to Consider National University of Singapore NUS-HCI Lab

48

Subjective Evaluation in Study 1

Characteristics of Binocular Luster Effect National University of Singapore NUS-HCI Lab

49

Medium +dY Medium -dY Luster effect perceivable

Low +dY Low -dY No luster effect

High +dY High -dY Luster effecttoo strong &

uncomfortable

• Conducted an experiment with 20 participants

• Determined the range of brightness differences (10 < dY < 60) that is perceivable and comfortable at the same time

• Refer to the paper for more details on the experiment and results


Considering Additional Factor

Colorblind

Meeting Scenario 51


What the other three colleagues see on the screen

What the colorblind user sees

Scenario (with ColorBless)

ColorBless: Augmenting Visual Information for Colorblind People

with Binocular Luster Effect

Soon Hau ChuaHaimo Zhang Muhammad Hammad Shengdong Zhao Sahil Goyal Karan Singh


52

] NUS-HCI Lab National University of Singapore- University of Toronto

Soon Hau Chua [email protected]

mailto:[email protected]

Date post:	22-Jan-2018
Category:	Technology
Upload:	soon-hau-chua
View:	171 times
Download:	2 times

ColorBless: Augmenting Visual Information for Colorblind People with Binocular Luster Effect

Technology