Myers’ EXPLORING PSYCHOLOGY
Learning
Learning relatively permanent change in an organism’s behavior due to experience
Types of Learning
1. Classical Conditioning2. Operant Conditioning3. Observational Learning
Association
We learn by association Our minds naturally connect events that
occur in sequence Aristotle 2000 years ago John Locke and David Hume 200 years
ago Associative Learning
learning that two events occur together two stimuli a response and its consequences
Association
Learning to associate two events
Event 1 Event 2
Sea snail associates splash with a tail shock
Seal learns to expect a snack for its showy antics
Classical or Pavlovian Conditioning
We learn to associate two stimuli
Operant Conditioning
We learn to associate a response and its consequence
Behaviorism
John B. Watson viewed psychology as
objective science generally agreed-upon
consensus today recommended study of
behavior without reference to unobservable mental processes not universally accepted
by all schools of thought today
Classical Conditioning
Ivan Pavlov 1849-1936 Russian
physician/ neurophysiologist
Nobel Prize in 1904
studied digestive secretions
Classical Conditioning
Pavlov’s device for recording salivation
Classical Conditioning
Classical Conditioning organism comes to associate two
stimuli Begins with a reflex a neutral stimulus that signals an
unconditioned stimulus begins to produce a response that anticipates and prepares for the unconditioned stimulus
Classical Conditioning
Unconditioned Stimulus (UCS) stimulus that unconditionally--
automatically and naturally--triggers a response
Unconditioned Response (UCR) unlearned, naturally occurring response
to the unconditioned stimulus salivation when food is in the mouth
Classical Conditioning
Conditioned Stimulus (CS) originally irrelevant stimulus that, after
association with an unconditioned stimulus, comes to trigger a conditioned response
Conditioned Response (CR) learned response to a previously neutral
conditioned stimulus
Pavlov’s Classic Experiment
Before Conditioning
During Conditioning After Conditioning
UCS (foodin mouth)
Neutralstimulus(tone)
Nosalivation
UCR (salivation)
Neutralstimulus(tone)
UCS (foodin mouth)
UCR(salivation)
CS(tone)
CR (salivation)
Classical Conditioning
Acquisition the initial stage in classical conditioning the phase associating a neutral stimulus
with an unconditioned stimulus so that the neutral stimulus comes to elicit a conditioned response
in operant conditioning, the strengthening of a reinforced response
Classical ConditioningUCS(passionate kiss) UCR
(sexualarousal)
CS(onionbreath)
CS(onion breath) CR
(sexualarousal)
UCS(passionate Kiss) UCR
(sexualarousal)
Classical Conditioning
Extinction diminishing of a CR in classical conditioning, when
a UCS does not follow a CS in operant conditioning, when
a response is no longer reinforced
Classical Conditioning
Strengthof CR
Pause
Acquisition(CS+UCS)
Extinction(CS alone)
Extinction(CS alone)
Spontaneousrecovery ofCR
Classical Conditioning
Spontaneous Recovery reappearance, after a rest
period, of an extinguished CR
Generalization tendency for stimuli similar
to CS to elicit similar responses
Classical Conditioning
Discrimination in classical conditioning, the
learned ability to distinguish between a CS and other stimuli that do not signal a UCS
Stimulus Discrimination
Discrimination is the learned ability to distinguish between a conditioned stimulus and other stimuli
that do not signal an unconditioned stimulus.
Stimulus Generalization
Tendency to respond to stimuli similar to the CS is called generalization. Pavlov conditioned the dog’s salivation (CR) by
using miniature vibrators (CS) on the thigh. When
he subsequently stimulated other parts of the dog’s body, salivation
dropped.
Nausea Conditioning in Cancer Patients
UCS(drug)
UCR(nausea)
CS(waiting room)
CS(waitingroom) CR
(nausea)
UCS(drug)
UCR(nausea)
Classical Conditioning
Extending Pavlov’s Understanding
Pavlov and Watson considered consciousness, or mind, unfit for the
scientific study of psychology. However, they underestimated the importance of
cognitive processes and biological constraints.
Pavlov’s greatest contribution to psychology
is isolating elementary behaviors from more
complex ones through objective scientific
procedures.
Pavlov’s Legacy
Ivan Pavlov(1849-1936)
1. Former crack cocaine users should avoid cues (people, places) associated with previous drug use.
2. Through classical conditioning, a drug (plus its taste) that affects the immune response may cause the taste of the drug to invoke the immune response.
Applications of Classical Conditioning
Watson used classical conditioning procedures to develop advertising
campaigns for a number of organizations,
including Maxwell House, making the “coffee break”
an American custom.
Applications of Classical Conditioning
John B. Watson
Brow
n Brothers
Operant Conditioning
Operant Conditioning type of learning in which behavior is
strengthened if followed by reinforcement or diminished if followed by punishment
Law of Effect Thorndike’s principle that behaviors
followed by favorable consequences become more likely, and behaviors followed by unfavorable consequences become less likely
Operant Conditioning
Operant Behavior operates (acts) on environment produces consequences
Respondent Behavior (Classical) occurs as an automatic response
to stimulus behavior learned through
classical conditioning
Operant Conditioning
B.F. Skinner (1904-1990) elaborated
Thorndike’s Law of Effect
developed behavioral technology
Operant Chamber
Skinner Box chamber with a
bar or key that an animal manipulates to obtain a food or water reinforcer
contains devices to record responses
Shaping
Shaping is the operant conditioning procedure in which reinforcers guide
behavior towards the desired target behavior through successive approximations.
A rat shaped to sniff mines. A manatee shaped to discriminateobjects of different shapes, colors and sizes.
Kham
is Ram
adhan/ Panapress/ Getty Im
ages
Fred Bavendam
/ Peter Arnold, Inc.
Types of Reinforcers
Reinforcement: Any event that strengthens the behavior it follows. A heat lamp positively reinforces a meerkat’s behavior in the cold.
Reuters/ C
orbis
Principles of Reinforcement
Primary Reinforcer innately reinforcing stimulus i.e., satisfies a biological need
Conditioned Reinforcer A learned reinforcer (stimulus)
that gains its reinforcing power through its association with primary reinforcer
secondary reinforcer
1. Immediate Reinforcer: A reinforcer that occurs instantly after a behavior. A rat gets a food pellet for a bar press.
2. Delayed Reinforcer: A reinforcer that is delayed in time for a certain behavior. A paycheck that comes at the end of a week.
Immediate & Delayed Reinforcers
We may be inclined to engage in small immediate reinforcers (watching TV) rather than large
delayed reinforcers (getting an A in a course) which require consistent study.
Schedules of Reinforcement
Continuous Reinforcement reinforcing the desired response each
time it occurs Partial (Intermittent) Reinforcement
reinforcing a response only part of the time
results in slower acquisition greater resistance to extinction
Schedules of Reinforcement
Fixed Ratio (FR) reinforces a response only after a
specified number of responses faster you respond the more
rewards you get different ratios very high rate of responding like piecework pay
Schedules of Reinforcement
Variable Ratio (VR) reinforces a response after an
unpredictable number of responses
average ratios like gambling, fishing very hard to extinguish because of
unpredictability
Schedules of Reinforcement
Fixed Interval (FI) reinforces a response only after
a specified time has elapsed response occurs more
frequently as the anticipated time for reward draws near
Mail delivery, waiting for cake to bake
Schedules of Reinforcement
Variable Interval (VI) reinforces a response at
unpredictable time intervals produces slow steady responding like pop quiz, waiting for a busy
phone line to clear.
Schedules of Reinforcement
Variable Interval
Number of responses
1000
750
500
250
010 20 30 40 50 60 70
Time (minutes)
Fixed Ratio
Variable Ratio
Fixed Interval
Steady responding
Rapid respondingnear time forreinforcement
80
Discriminative Stimulus
Sd Discriminative stimulus = in operant conditioning, a stimulus (cue) signaling that a response will be reinforced Logos such as golden arches – turn in
here and you will find food Word “Sale” - Others?
Punishment
Punishment aversive event that
decreases the behavior that it follows
powerful controller of unwanted behavior
Punishment
Punishment
1. Results in unwanted fears.2. Conveys no information to the organism.3. Justifies pain to others.4. Causes unwanted behaviors to reappear
in its absence.5. Causes aggression towards the agent.6. Causes one unwanted behavior to appear
in place of another.
Although there may be some justification for occasional punishment (Larzelaere &
Baumrind, 2002), it usually leads to negative effects.
Extending Skinner’s Understanding
Skinner believed in inner thought processes and biological underpinnings, but many psychologists criticize him for
discounting them.
Skinner’s LegacySkinner argued that behaviors were
shaped by external influences instead of inner thoughts and feelings. Critics argued
that Skinner dehumanized people by neglecting their free will.
Falk/ Photo Researchers, Inc.
Cognition and Operant Conditioning
Cognitive Map mental representation of the layout of
one’s environment Example: after exploring a maze, rats
act as if they have learned a cognitive map of it
Latent Learning learning that occurs, but is not
apparent until there is an incentive to demonstrate it
Intrinsic MotivationIntrinsic Motivation: The desire to perform a behavior for its own sake.
Extrinsic Motivation: The desire to perform a behavior due to promised rewards or threats of punishments.
Applications of Operant Conditioning
Skinner introduced the concept of teaching machines that shape learning in small steps
and provide reinforcements for correct rewards.
In School
LW
A-JD
L/ C
orbis
Applications of Operant Conditioning
Reinforcers affect productivity. Many companies now allow employees to share
profits and participate in company ownership.
At work
Applications of Operant Conditioning
At Home
In children, reinforcing good behavior increases the occurrence of these behaviors. Ignoring
unwanted behavior decreases their occurrence.
Operant vs. Classical Conditioning
Learning by Observation
Higher animals, especially humans,
learn through observing and
imitating others.
The monkey on the right imitates the
monkey on the left in touching the pictures in a certain order to
obtain a reward.
© H
erb Terrace
©H
erb Terrace
Mirror Neurons
Neuroscientists discovered mirror neurons in the brains of animals and humans that are active during observational learning.
Rep
rint
ed w
ith p
erm
issi
on f
rom
the
Am
eric
an
Ass
ocia
tion
for
the
Adv
ance
men
t of
Scie
nce,
Sub
iaul
et a
l., S
cien
ce 3
05: 4
07-4
10 (
2004
) ©
200
4 A
AA
S.
Observational Learning
Mirror Neurons frontal lobe neurons that fire
when performing certain actions or when observing another doing so
may enable imitation, language learning, and empathy
(born on December 4, 1925 in Mundare, a small town in Alberta, Canada)
He is the leading researcher and theorist in the area of observational learning.
is a type of learning that occurs as a function of observing, retaining and replicating novel behavior executed by others
occurs when an observers behavior changes after viewing the behavior of a model
also known as vicarious learning, social learning or modeling
According to Bandura, observational learning may or may not involve imitation.
Social learning theory holds that children in particular, learn by observing and imitating models
Children take an active part in their own learning
The child’s own characteristics influence the choice of models.
It focuses on the learning that occurs within a social context.
Observational learning does not require that the behavior exhibited by the model is duplicated.
1.The observer will imitate the model’s behavior if the model possesses characteristics.
2.The observer will react to the way the model is treated and mimic the models behavior.
3.A distinction between an observer’s “acquiring” a behavior and “performing “ a behavior.
(Presence of reinforcement or (Presence of reinforcement or punishment)punishment)
Reinforcement theory of motivation was proposed by
BF Skinner and his associates.
It states that individual’s behavior is a function of its
consequences. (based on law of effect)
Positive and Negative Reinforcement
Positive Reinforcement
Observer is likely to repeat behavior a model demonstrates
Behavior doesn’t matter, reinforcement received matters.
Negative Reinforcement
Observer is less likely to repeat a beahavior a model demonstarets.
Behavior doenst matter, reinforcement received matters.
- Anything that increase the behavior
- is a consequence of behavior that decreases
the likelihood of repetition.
1.The observer is reinforced by the model
2. The observer is reinforced by a third person
3. The imitated behavior itself leads to reinforcing consequences
4. Consequences of the model’s behavior affect the observers behavior vicariously (vicarious reinforcement)
Television and Observational Learning