Ag

ent

EnvironmentS

enso

rs

Effecto

rs

What the w

orldis like now

What action I

should do now

Ag

ent

EnvironmentS

enso

rs

Effecto

rs

What the w

orldis like now

What action I

should do now

State

How

the world evolves

What m

y actions do

Ag

ent

EnvironmentS

enso

rs

Effecto

rs

What it w

ill be like if I do action A

What the w

orldis like now

What action I

should do now

State

How

the world evolves

What m

y actions do

Goals

Ag

ent

EnvironmentS

enso

rs

Effecto

rs

What it w

ill be like if I do action A

What the w

orldis like now

How

happy I will be

in such a state

What action I

should do now

State

How

the world evolves

What m

y actions do

Utility