Operant Conditioning

Objective(s)What is operant conditioning and how does it differ

from classical conditioning?

Conditioning BehaviorsClassical (Respondent) – occurs as an automatic response to some stimulus

Operant – operates on the environment, producing consequences

4

Operant vs. Classical Conditioning

Classical conditioning forms associations between stimuli (CS and US). Operant conditioning, on the other hand, forms an association between behaviors and the resulting events.

Operant ConditioningA type of learning in

which behavior is strengthened if

followed by a reinforcer or diminished if

followed by a punisher.

Operant Conditioning Involves operant behavior, a behavior that operates on the environment, producing rewarding or punishing stimuli.

Operant Conditioning

Response-Consequence

Operant Conditioning

Response-Consequence

Conditioning BehaviorsThorndike’s Law of Effect

Operant chamber (Skinner Box)

Shaping behaviors with reinforcers

Thorndike’s Law of Effect• Responses to a

situation that are followed by satisfaction are strengthened

• Responses that are followed by discomfort are weakened.

Thorndike’s Law of Effect

B.F. Skinner• 1904-1990• Behaviorist who

believed psychs should focus on observable behavior that could be objectively measured and verified.

14

Skinner’s ExperimentsSkinner’s experiments extend

Thorndike’s thinking, especially his law of effect. This law states that rewarded

behavior is likely to occur again.

15

Operant ChamberUsing Thorndike's law of effect as a

starting point, Skinner developed the Operant chamber, or the Skinner

box, to study operant conditioning.

16

Operant ChamberThe operant chamber, or Skinner box, comes with a bar or key that

an animal manipulates to obtain a reinforcer

like food or water. The bar or key is

connected to devices that record the

animal’s response.

17

Skinner’s LegacySkinner argued that behaviors were shaped

by external influences instead of inner thoughts and feelings. Critics argued that

Skinner dehumanized people by neglecting their free will.

19

ShapingShaping is the

operant conditioning procedure in

which reinforcers

guide behavior towards the

desired target behavior.

ReinforcementAny consequence that

strengthens behavior Positive (presents a

pleasurable stimulus such as praise, hug, food)

Negative (removes aversive stimuli – NOT punishment)

Positive Reinforcement

Negative Reinforcement

Ways to Increase BehaviorOperant

Conditioning Term

Description Possible Examples

Positive Reinforcement

Add a desirable stimulus

Getting a hug, a raise,

praise, etc.

Negative Reinforcement

Remove an aversive stimulus

Fastening a seatbelt to

turn off beeping

ReinforcersPrimarySecondaryToken economy

Primary ReinforcersA reinforcer that is naturally reinforcing for a given species.

Ex. food, water, and shelter

Secondary ReinforcersA reinforcer that gains its effectiveness by a learned association w/primary reinforcers.

Ex. Money!!!!

Token Economy A theraputic method, based

on operant condtioning, by which individuals are rewarded w/tokens that act as 2ndary reinforcers. The tokens can be redeemed for rewards & privileges.

Ex. Elementary teachers

28

1.Immediate Reinforcer: A reinforcer that occurs instantly after a behavior.

2.Delayed Reinforcer: A reinforcer that is delayed in time for a certain behavior.

Immediate & Delayed Reinforcers

Schedules of Reinforcement

ContinuousPartial (intermittent)1. Fixed-ratio (FR)2. Variable-ratio (VR)3. Fixed-interval (FI)4. Variable-interval (VI)

Ratio SchedulesRatio schedules are based

upon the # of responses:Fixed: reinforcement occurs

after a predetermined set of responses

Variable: reinforcement is unpredictable b/c the ratio varies

Interval SchedulesInterval schedules are based on

responses made w/in a certain time period:

Fixed: reinforcement occurs after a predetermined time has elapsed

Variable: reinforcement occurs unpredicatbly since the time interval varies

PunishmentAn event that decreases the behavior it follows.

Opposite of reinforcement

Punishment vs. Reinforcement

Punishment decreases the chance of a behavior being repeated, reinforcement increases the chance.

PunishmentPositive: adding an aversive

stimulus after the response Negative: taking away a

reinforcer after the response ***Makes a behavior less likely to

happen, negative enforcement make a behavior more likely to happen.***

Types of PunishersType Description Examples

Positive Punishment

Administer an aversive stimulus

Spanking; a parking ticket

Negative Punishment

Withdraw a desirable stimulus

Time-out from privileges; revoked driver’s license

37

Drawbacks of Punishment1. Results in unwanted fear, hostility, and

aggression.

2. Justifies pain to others.

3. Causes unwanted behaviors to reappear in its absence.

4. Causes aggression towards the agent.

5. Can produce learned helplessness.

6. Often produces a temporary change in behavior.

7. Conveys no information to the organism.

38

Effective Uses of Punishment

1. Punishment should be delivered immediately after the offensive behavior.

2. Punishment should be certain.

3. Punishment should be limited and sufficient so that it “fits the crime”.

4. Punishment should focus on the behavior, not the character, of the offender.

39

Learned Helplessness

• Martin Seligman• The condition of a

human or animal that has learned to behave helplessly, failing to respond even though there are opportunities for it to help itself by avoiding unpleasant circumstances or by gaining positive rewards.

40

Applications of Operant Conditioning

Skinner introduced the concept of teaching machines that shape

learning in small steps and provide reinforcements for correct rewards.

In School

41

Applications of Operant Conditioning

Reinforcement principles can enhance athletic performance.

42

Applications of Operant Conditioning

Reinforcers affect productivity. Many companies now allow employees to

share profits and participate in company ownership.

43

Applications of Operant Conditioning

In children, reinforcing good

behavior increases the occurrence of these behaviors.

Ignoring unwanted behavior decreases

their occurrence.

Diana BaumrindAuthoritarianAuthoritativePermissiveNeglectful

Parenting Styles

Cognition & Op Cond.The limitations of Behaviorist

theories of learning:

1. Believe that classical & operant conditioning explain almost all learning.

2.Believe that the behaviorists underestimate the importance of cognitive processes.

Cognition & Op. CondLatent learningCognitive mapInsight Intrinsic/Extrinsic Motivation

Latent LearningLearning that is not

outwardly used until the situation calls for it.

Edward TolmanExperiment: Rats running a

maze for food & making a cognitive map

InsightWolfgang KohlerSultan the chimp getting a banana through trial and error

Overjustification EffectThe effect of promising a reward for doing what one already likes to do and losing interest in it.

IntrinsicExtrinsic