Emotional Robots? Carlotta Pavese 12.03emotions.pdfDesigning Sociable Robots (2001); 100+ articles...

Post on 09-Oct-2020

1 views 0 download

transcript

Introduction Emotional Robots

Emotion and Artificial IntelligenceEmotional Robots?

Carlotta Pavese

12.03.13

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Outline

1 Introduction

2 Emotional Robots

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Outline

1 Introduction

2 Emotional Robots

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Cynthia BreazealCast of Characters

Sc.D. MIT, in EE and CS (2000)

Associate Professor, Media Arts &Sciences MIT; Founder & Directorof Personal Robotics Group at MITMedia Lab

Author of 2 books, includingDesigning Sociable Robots (2001);100+ articles

National Academy of Engineering’s Gilbreth Award

TIME magazine’s Best Inventions of 2008

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Rosalind PicardCast of Characters

Sc.D. MIT, in EE and CS

Professor of Media Arts & SciencesMIT; Founder & Director ofAffective Computing Group at MITMedia Lab

Author of Affective Computing(1997); nearly 200 articles

Largely responsible for starting field of AffectiveComputing

Fellow of the Institute of Electrical and ElectronicsEngineers (IEEE)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps

1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps

1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps

1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction

2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction2 Processing

3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioWhat is Emotion?

Biological, evolutionary perspective on emotion

Biologically shared mechanism of homeostasis

Emotions arise in three steps1 Induction2 Processing3 Bodily/Brain reaction

Emotional reactions are coordinated quick, non-consciouschanges to the whole organism

This allows the organism to reliably produce complexbehaviors in important circumstances

Emotion is thus a powerful mechanism for copingw/complex environment, scarce resources & high risks

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Summary of DamasioEmotions and Feeling

Emotions can happen w/o awareness of feeling

Recall the curious case of David

Emotions are felt when brain perceives reaction

Reflexivity: common idea about consciousness (Dennett,Lycan, Dretske)

According to Damasio, this also involves thecharacteristic feature of consciousness:

The perception is ‘bound to the self’

Damasio’s Slogan (From Interview)

We are not thinking machines. We are feeling machines thatthink. (http://youtu.be/Aw2yaozi0Gg)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Damasio and EmotionsImplications for Research on Emotional Machines

Emotional Machines

If Damasio is right, you can create an emotional machinew/o creating a conscious one

In building emotional machines, focus on replicatingemotional induction, processing & reaction

Suppose we really are feeling machines that think, andpart of feeling is perceiving emotional reactions

Then even to understand how cognition works, we mustsimulate the embodied emotional reactions that pervadeour interactions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Damasio and EmotionsImplications for Research on Emotional Machines

Emotional Machines

If Damasio is right, you can create an emotional machinew/o creating a conscious one

In building emotional machines, focus on replicatingemotional induction, processing & reaction

Suppose we really are feeling machines that think, andpart of feeling is perceiving emotional reactions

Then even to understand how cognition works, we mustsimulate the embodied emotional reactions that pervadeour interactions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Damasio and EmotionsImplications for Research on Emotional Machines

Emotional Machines

If Damasio is right, you can create an emotional machinew/o creating a conscious one

In building emotional machines, focus on replicatingemotional induction, processing & reaction

Suppose we really are feeling machines that think, andpart of feeling is perceiving emotional reactions

Then even to understand how cognition works, we mustsimulate the embodied emotional reactions that pervadeour interactions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Damasio and EmotionsImplications for Research on Emotional Machines

Emotional Machines

If Damasio is right, you can create an emotional machinew/o creating a conscious one

In building emotional machines, focus on replicatingemotional induction, processing & reaction

Suppose we really are feeling machines that think, andpart of feeling is perceiving emotional reactions

Then even to understand how cognition works, we mustsimulate the embodied emotional reactions that pervadeour interactions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Outline

1 Introduction

2 Emotional Robots

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Why Emotional Robots?Motivation

Okay, so emotion is relevant to this abstract questionabout whether machines could have minds

Why bother trying to build an emotional machine?

Other than that emotion is a powerful tool for adaptivebehavior (Damasio)

Cynthia Breazeal (bruh-zill) and Rosalind Picard haveprovided powerful answers to this question

http://www.ted.com/talks/cynthia_breazeal_

the_rise_of_personal_robots.html

http://youtu.be/ujxriwApPP4

Leonardo (the robot): http://youtu.be/ilmDN2e_Flc

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactions

And it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Emotional RobotsThe Road Map

Human interaction relies heavily on emotion

So it provides particularly powerful space ofman-machine interactionsAnd it is a particularly important part of making robotsthat interact w/people in a compelling way

Doing this does not require building a robot that can feelits emotions, just one that has them

Induction, processing, reaction

By producing a robot w/emotional and cognitive systems,test ideas about how the two interact

Let’s look at Breazeal’s robot Kismet

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Meet the Many Faces of KismetSix Basic Emotions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

The Many Faces of KismetStriking Resemblance: Disgust

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

The Many Faces of KismetStriking Resemblance: Sadness

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

The Many Faces of KismetStriking Resemblance: Fear

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

The Many Faces of KismetStriking Resemblance: Surprise

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

The Psychology Behind Kismet’s FacesThe Atoms of Facial Expressions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s Affective StateThree Dimensions

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureA Network of Specialists

Cognitive system (gray)

Perception, drive, behavior& motor systems

Affective system (white)

Speech detection,categorization, evaluation,elicitation

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureA Network of Specialists

Cognitive system (gray)

Perception, drive, behavior& motor systems

Affective system (white)

Speech detection,categorization, evaluation,elicitation

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureA Network of Specialists

Cognitive system (gray)

Perception, drive, behavior& motor systems

Affective system (white)

Speech detection,categorization, evaluation,elicitation

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureA Network of Specialists

Cognitive system (gray)

Perception, drive, behavior& motor systems

Affective system (white)

Speech detection,categorization, evaluation,elicitation

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input too

Input from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the affective architecture

Affective speech detection

Affective categorization

Visual input tooInput from drives & cognitivecategorization too

Affective appraisal

Emotion elicitation

Emotion arbitation

Output result to behavioral &motor systems

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, done

Input from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!

Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional system

This allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categories

Damasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s ArchitectureIn Focus: the cognitive architecture

Visual feature detection

Color, size, motion

Cognitive categorization

Toy, people, boring thing, doneInput from behavioral systemtoo!Behavioral system is undercontrol of emotional systemThis allows affective associationw/categoriesDamasio’s ‘somatic markers’ !

Drives satisfied/frustrated by somecategories

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s Emotional InputDetecting Emotionally Significant Tones

Characteristic contours in mothers’ speech (Fernald 1989)

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Kismet’s Emotional PerformanceDetecting Emotionally Significant Tones

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetWhy Facial Expressions

Kismet’s Expressions (Breazeal & Brooks, p.306)

“...It is certainly possible to use other information-baseddisplays to reveal the internal state of the robots: flashinglights, laser pointers, graphics, etc.

However, people wouldhave to learn how to decipher such displays to understandwhat they mean. Furthermore, information-based displays failto leverage from the socio-affective impact and intuitivemeaning that biological signals have for people.”

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetWhy Facial Expressions

Kismet’s Expressions (Breazeal & Brooks, p.306)

“...It is certainly possible to use other information-baseddisplays to reveal the internal state of the robots: flashinglights, laser pointers, graphics, etc. However, people wouldhave to learn how to decipher such displays to understandwhat they mean.

Furthermore, information-based displays failto leverage from the socio-affective impact and intuitivemeaning that biological signals have for people.”

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetWhy Facial Expressions

Kismet’s Expressions (Breazeal & Brooks, p.306)

“...It is certainly possible to use other information-baseddisplays to reveal the internal state of the robots: flashinglights, laser pointers, graphics, etc. However, people wouldhave to learn how to decipher such displays to understandwhat they mean. Furthermore, information-based displays failto leverage from the socio-affective impact and intuitivemeaning that biological signals have for people.”

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetThe Message

Reflecting on Kismet (Breazeal & Brooks, p.307)

“As robot builders, we shall continue to design integratedsystems for robots with internal mechanisms that complementand modulate its cognitive capabilities to improve the robot’soverall performance.

Several of these mechanisms may beclose analogs to those regulatory, signaling, biasing, and otheruseful attention, value-assessment, and prioritizationmechanisms associated with emotions in living creatures. As aconsequence, we will effectively be giving robots a system thatserves the same useful functions that emotions serve in us –no matter what we call it.”

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetThe Message

Reflecting on Kismet (Breazeal & Brooks, p.307)

“As robot builders, we shall continue to design integratedsystems for robots with internal mechanisms that complementand modulate its cognitive capabilities to improve the robot’soverall performance. Several of these mechanisms may beclose analogs to those regulatory, signaling, biasing, and otheruseful attention, value-assessment, and prioritizationmechanisms associated with emotions in living creatures.

As aconsequence, we will effectively be giving robots a system thatserves the same useful functions that emotions serve in us –no matter what we call it.”

Carlotta Pavese Emotion and Artificial Intelligence

Introduction Emotional Robots

Reflecting on KismetThe Message

Reflecting on Kismet (Breazeal & Brooks, p.307)

“As robot builders, we shall continue to design integratedsystems for robots with internal mechanisms that complementand modulate its cognitive capabilities to improve the robot’soverall performance. Several of these mechanisms may beclose analogs to those regulatory, signaling, biasing, and otheruseful attention, value-assessment, and prioritizationmechanisms associated with emotions in living creatures. As aconsequence, we will effectively be giving robots a system thatserves the same useful functions that emotions serve in us –no matter what we call it.”

Carlotta Pavese Emotion and Artificial Intelligence