+ All Categories
Home > Documents > Hot & Tight: Exploring Thermo and Squeeze Cues Recognition...

Hot & Tight: Exploring Thermo and Squeeze Cues Recognition...

Date post: 04-Nov-2019
Category:
Upload: others
View: 1 times
Download: 0 times
Share this document with a friend
27
"Hot & Tight: Exploring Thermo and Squeeze Cues Recognition on Wrist Wearables Human ICT convergence / Geeyoung Noh
Transcript
Page 1: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

"Hot & Tight: Exploring Thermo and Squeeze Cues Recognition on Wrist Wearables

Human ICT convergence / Geeyoung Noh

Page 2: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Notification apps:

easy to see and feel if it is on your wrist.

Watches, bracelets ...

What are wearables great for?

Today’s wearables device

Page 3: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Potential of haptic feedback through tactile patterns

On wearables haptic cues are readily and privately received.

Advantage: Direct contact with skin

Page 4: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Potential of haptic feedback through tactile patterns

Our hands are capable to detect a variety of haptic feedback

Page 5: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Past research has focused mostly on vibration and little work has explored other forms of haptic feedback

The issue

Potential of haptic feedback through tactile patterns

Our hands are capable to detect a variety of haptic feedback

Page 6: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Past research has focused mostly on vibration and little work has explored other forms of haptic feedback

The issue

Potential of haptic feedback through tactile patterns

Our hands are capable to detect a variety of haptic feedback

e.g., Tactons (Brewster et al.)

Page 7: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Our goal: to expand the research on notification modalities

In this paper, we explore the advantage of different haptic modalities for wearable computing

Temperature Squeeze

What we need do?

Watch

Page 8: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Related work : visual stimuli for wearables

Hansson and Ljungstrand (2012) Lyons et all (2012)

LED display Multiple displays

Page 9: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Mastscheko et al. (2010)

Spatial patterns

Related work : visual stimuli for wearables

Location and time-based patterns

Oakley and Park (2008)

Page 10: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Related work : Temperature / Squeezing for wearables

Baumann et all (2010)Wilson et all (2011)

Temperature : Palm of the hand & Wrist

Squeezing wearable Haptics

Page 11: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Servo

Arduino

Squeezing

Our prototypes used in the study

Housing

Wrist strap

VibrationMotor

Thermocouples

2 Peltiers

Thermo couples

Vibration and Temperature

Servo

Arduino

Squeezing

Servo

Arduino

Squeezing

Page 12: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Our prototypes used in the study

Housing

Wrist strap

VibrationMotor

Thermocouples

2 Peltiers

Thermo couples

·67 x 42 x 27 mm 3D printed boxes

·Watch style straps

·Arduino Pro Mini microprocessor

1. Vibration and Temperature

·2 Peltiers with temperature sensors

Page 13: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Our prototypes used in the study

·67 x 42 x 27 mm 3D printed boxes

·Watch style straps

·Arduino Pro Mini microprocessor

2. SqueezingServo

Arduino

·1 Servo motor

Page 14: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Tactile Stimuli

Five different time-varying cues for each of the three modalities

·4 seconds ·Right-aligned ·3 degree thermo(JND - just noticeable difference)s

Page 15: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Participants

‧12 participlants‧All right-handed‧Familiar with smart-devices

Experiment

‧45 minutes‧3 conditon modality (latin square design): vibation, thermo, squeeze‧25 randomly (5 trials x 5 stimuli)‧Error trials repeated

Evaluation Process

‧Used headphones with white noise

Page 16: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Preparing Experiment

Demographics

Checking Tempreature, wrist -size

Practices

Condition 1

Nasa TLXNasa TLXNasa TLX

Interviews

User study

Evaluation Process

Condition 2 Condition 3

Page 17: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

·ANOVA and post-hoc tests with Bonferroni CI adjustments

Results : Time

Significant p<0.01

5.4s (0.4)average rocognitions time :

Fastest

Page 18: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Results : Time

Not significant

4.4s (1) average rocognitions time :

Page 19: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Results : Time

Significant p<0.01

4.2s (0.5) average rocognitions time :

Slowest

Page 20: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Results : Errors

Error are very different from person to person (Some outliers)

Page 21: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

US

ER

INP

UT

Results : Errors confusion matrices

Two-short pulses

cue with 2 short-pulses and the one with a long followed by a short pulse: the difference of 300ms for the duration between short and long pulse was too small for accurate detection.

More than half of the errors 2 short-pulses

and the one with a long followed by a short pulse

: the difference of 300ms

US

ER

INP

UT

CORRECT

VIBRATION ‧Vibration Errors : 13 errors

Page 22: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

US

ER

INP

UT

CORRECT

SQUEEZE ‧Squeeze Errors : 38 errors

68% of errors

Same problem with the vibration condition

Results : Errors confusion matrices

Two-short pulses

Page 23: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Hot VS Cold

neutral (skin) temperature

with the slightly

cold or warm cues (± 3C )̊

+6C ̊with +3C ̊cues (24%)

-6C ̊with -3C ̊cues (24%)

Strong VS Mild

cold stimuli for hot ones (19%)

hot for cold ones (3%)

Skin VS stimuli

US

ER

INP

UT

CORRECT

THEREMO ‧Thermal Errors : 110 errors

Results : Errors confusion matrices

: 48% of errors : 16% of errors : 22% of errors

Page 24: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

0"

2"

4"

6"

8"

10"

12"

14"

16"

18"

20"

Workload" Mental" Physical" Temporal" Performance" Effort" FrustraAon"

Temperature" VibraAon" Squeeze"

TLX

Vibration perceived more easily

Results : Cognitive workload

Page 25: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

Temperature Squeeze

·similar to vibration

·pulse recognition works only if >300ms (or 13Hz)

·different from person to person

·different feeling (body part)

·Wrist, more conservative threshold than palm

Discussion

Vibaration

·easiest

·most accurate

Page 26: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

In conclusion, this paper suggests that diverse haptic notification cues on wearable devices are feasible

but more research, how to best design haptic cues specifically for wrist.

Conclusions

Page 27: Hot & Tight: Exploring Thermo and Squeeze Cues Recognition ...humanict.skku.edu/data/paper_present/노지영_졸업논문_발표자료.pdfT Results : Errors confusion matrices Two-short

rrors :

Vibration < Squeeze < Temperature

Vibration > Squeeze > Temperature

Squeeze has a lot of potential (similar to vibration)

Personal preferences are important

Thank you.

Summary

Errors

Easy of use

Potential

Preferences


Recommended