1

Ryoichi Komiya

Organizer/Chair

NICT

Design & Developers Forum D12

Ubiquitous Human to Human Telecommunications

Systems Design, Development & Standardization

at Globecom 2006

30 November 2006

2

Presentations at this forum NICT

Ryoichi Komiya (NICT, Multimedia University) The Super POTS

Hidenori Takahashi (KDDI 　 Labs) 　 Tactile communication system proposal using a mouse haptic device

Akiko Watanabe (Keio University) Intelligent space to pick up verbal/nonverbal messages

Stewart Fallis (BT Research Department) User Context within Ubiquitous Environments

Yoshitaka Shibata (Iwate Prefectural University) Feeling Communication System

Takashi Matsuyama (NICT, Kyoto University ) Dynamic structure of human verbal and nonverbal communication

Presenter Major presentation topics

3

Panel discussion

Session 1: Reviewing of current telecommunication systems from the view points of emotion transmission.Identifying most specific & effective emotions transmissionto substitute face to face conversation.Session 2: Sensor/actuator technologies to exchange nonverbalmessages over the networks.Wrap up for future R&D directions.

4

-Towards the Super POTS-

Ryoichi Komiya

National Institute of Information & Communications Technology

NICT

D&D Forum

“Ubiquitous Human to Human Telecommunications Systems Design,

Development & Standardization”

at Globecom 2006

30 November 2006

5

Table of Contents

1. Background of the Forum2. Lacking information to be sent by current telecommunication systems 3. The Super POTS4. Transmission of nonverbal messages by the Super POTS 5. Super POTS Design, Development & Standardization 6. Expected outcomes of the Super POTS

NICT

6

1. Background of the Forum

1. Today’s telecommunication systems including the POTS and the Internet are enough for business execution. Because business communications are composed of agreements and money movements.

2. However for the personal use, today’s telecommunication systems are not satisfactory. Because personal communications are composed of emotions.

　　　 Our intention is to build telecommunication systems which can　　　 transmit emotional/nonverbal messages.

NICT

7

Face to face conversation

Wide spectrum range of non-verbal communication

To understand people quickly

Smaller potential for misunderstanding

65-93 % of all meaning communicated is attribute to nonverbal messages

NICT

8

2. Lacking information to be sent by current telecommunication systems

A. Physical Appearance

B. Gesture and Movement

C. Face and Eye Behavior

D. Vocal Behavior

E. Space

F. Touch

G. Environment*: Virginia P. Richmond & James C. McCroskey, “Nonverbal

Behavior in Interpersonal Relations”, ALLYN AND BACON

NICT

Non verbal messages*

9

A. Physical AppearanceSheldon’s system

Body type & Psychological type

Endomorph

Oval-shaped body;

Heavy, large abdomen

Viscerotonic

Slow, sociable, emotional, forgiving, relaxed

NICT

10

Mesomorph

Triangular body shape;

Muscular, hard, firm, upright body quality

Somatotonic

Confident, energetic, dominant, enterprising, hot-tempered

NICT

11

Ectomorph

Fragile physique;

Flatness of chest, poorly muscled limbs

Cerebrotonic

Tense, awkward, meticulous, tactful, detached

NICT

12

BODY type self-descriptors

dependent dominant detached

calm cheerful tense

complacent energetic reticent

contented impetuous Self-conscious

sluggish efficient meticulous

placid enthusiastic reflective

leisurely competitive precise

cooperative determined thoughtful

NICT

13

Height, weight & skin color

Height: taller is preferred because it is often associated with power and dominance

Weight: slim and trim are associated with success, good self-concept, physical wellbeing and acceptability

Skin Color: “I have a dream that one day my little children will not be judged by the color of their skin, but by the content of their character” Martin Luther King

Unfortunately, that dream is yet to be fully realized.

NICT

14

Hair color

Hair color

Red: tempestuous

Brown: wholesome

Black: sultry

Blondes: having all the fun

NICT

15

Hair length

Hair length: has been associated with perceptions ofcredibility (male speaker)

Short: high credibility

Long: low credibility

Think of U.S. presidents who had long hair!

NICT

16

NICT

Ten decisions we might make about another person based solely on clothing choice.

Economic level Educational level

Trustworthiness Social position

Level of sophistication Economic background

Social background Educational background

Level of success Moral character

Clothing

17

B. Gesture & Movement

NICT

Dramatic: pictographs, drawings of forms and figures in space, moving dramatically from one place to another

Open: expansive, unreserved, extroverted, approach oriented

Dominant: expansive body posture & movement

Friendly: reduce distance, forward leaning,

Animate: repetitive head nods and frequent smiles

Contentious: assertive tone of voice with forward leaning, arm waving

Relaxed: posture, movement Impression leaving: combination of others

Attentive: active listening

Movement & communicator style

18

C. Face & Eye behavior

The SADFISH* are represented by face and eye behaviors.*S: surpriseA: angerD: disgustF: fearI: interestS: sadnessH: happiness

NICT

1

2

3

1 Eyebrows and forehead 2 Eyes and eyelids

3 Lower face: Cheeks, nose & mouth

19

C. Face & Eye behavior (cont.)

Emotions Three regions Ratio

Sadness & fear Eyes & eyelids 67% of the time

Anger Cheeks, mouth, brows & forehead

Disgust blends with surprise

Lower region

Happiness Lower region and eyes and eyelids 98-99% of the time

Surprise Brows/forehead

Eyes & eyelids

lower face

79% of the time

63% of the time

52% of the time

NICT

20

D. Vocal behavior

Information to be obtained from the human voice;

emotion, state of health, trustworthy vs. deceitful

characteristics, age and gender.

In one study, only 7 % of meaning in an interaction was

conveyed by the verbal content of spoken utterances and 38%

was conveyed through other vocal cues.*

*: tempo, resonance, pitch, silence & pause, accent, dialects

NICT

21

E. Space

The intimate: from touching to 18 inches

(lovers, relatives)

The personal: 18 inches-4 feet

(friends, close colleagues)

The social-consultative: 4 feet-8 feet

(work colleagues in a meeting)

The public: more than 8 feet

(people in public space)

NICT

22

F. Touch

NICT

Professional-functional touch

Impersonal, business like touch medical context, trying on shoes, hair stylist

Social-polite touch Limited form of interpersonal communication

Handshake, shoulder claps, kisses on each cheek

Friendship-warmth touch

Let another person know that we care for, value and have an interest in her/him

Love-intimacy touch Highly communicative, expressing caring, love and emotional and affective attachment

Sexual-arousal touch The most intense form of touch

23

G. Environment

NICT

Perceptional characteristics of environment

Other environmental factors

formality (churches, temples,.) attractiveness

warmth (family den, kitchen) colors

privacy (smaller dining rooms in a restaurant ) lighting

familiarity (restaurants, gas stations) temperature

constraint (crowded subway) Scent & smell

Distance (too near, too far)

24

3. The Super POTS NICT

SensorsActuators

Information processors

SensorsActuators

Information processors

NT NT

Calling party Called party

Parties regenerated by sensor/actuator technologies

Network

UNI

You can talk as if your called party were in front of you.

25

4. Transmission of nonverbal messages

by the Super POTS Non verbal messages Sensors & actuators

Physical Appearance S: video cameras to capture entire human body

A: wide display

Gesture and Movement S: video cameras to capture entire human body

A: wide display

Face and Eye Behavior S: video camera to capture eye contact

A: display with a height of average human face

Vocal Behavior S: microphones (bandwidth?)

A: receivers, speakers

Space S: Video cameras to capture entire living room

A: wide display

Touch S: Touch sensors

A: Touch actuators

Environment S: Video cameras to capture entire living room, smell sensor

A: wide display, smell palette

NICT

26

To develop telecommunication systems by which

you can fall in love with via network!!

Telecom Network

Network Termination (NT)

5. Super POTS Design, Development & Standardization

NICT

Sensors & Actuators

27

Sensors

Voice & sound

images

Heart beats

Touch

●

●

Wired/Wireless interfaces to NT (to be standardized)

NICT

28

Speakers, receivers

Displays, humanoid robotics

Heart beat regenerator

Tactile devices

ActuatorsWired/ Wireless Interfaces from NT (to be standardized)

NICT

29

Super POTS Standardization

User Network Interface: wired/wireless

NTUNI U

NetworksSensors

Actuators

U Interface (Subscriber transmission interface): wire/wireless

NICT

30

6. Expected Outcomes of the Super POTS

(1) Face to face communications with full eye contacts

(2) Reduction of business trips because of less misunderstanding

(3) Negotiation of international disputes by exchanging critical views

(4) Being a possible solution for war deterrent power

NICT

31

Thank you very much!!

NICT