• LEARNING: a relatively enduring change in
behavior, resulting from experience
BEHAVIORISM: defines psychology as
the science of behavior
S R
Stimulus is
detected by
an organism
Organism
emits a
response
What are the responses?
S R
Nonassociative Learning
• LEARNING: a relatively enduring change in
behavior, resulting from experience
Associative Learning
Ivan Pavlov: The Discovery of Classical Conditioning
CLASSICAL CONDITIONING two stimuli are
paired and become associated ….
– One predicts the occurrence of the other
– One can trigger a response that was
originally triggered by the other
1. NEUTRAL STIMULUS (NS): does not cause an
automatic response
2. UNCONDITIONED STIMULUS (US): unlearned
signal; causes an automatic response
3. UNCONDITIONED RESPONSE (UR): behavior
automatically caused by a stimulus
Classical Conditioning: Necessary Elements
4. CONDITIONED STIMULUS (CS): learned signal that
predicts another onset of another stimulus
5. CONDITIONED RESPONSE (CR): behavior associated
with a learned signal
Classical Conditioning: Necessary Elements
Classical Conditioning
S R
UCR
UCR
CR
UCS
NS
CS
UCS +
A new
SR unit
An
existing
SR unit
Classical Conditioning
S R
Food Salivation
Salivation
Salivation
Food Bell
Bell
UCR
UCR
CR
UCS
UCS NS
CS
+
EXAMPLE #1:
– UCS:
– UCR:
– CS:
– CR:
EXAMPLE #2:
– UCS:
– UCR:
– CS:
– CR:
• ACQUISITION: forming a learned response
• EXTINCTION: weakening of a conditioned
response
• SPONTANEOUS RECOVERY: reappearance of an
extinguished response
• GENERALIZATION: responses given to stimuli that
resemble the conditioned stimulus
• DISCRIMINATION: learned ability to distinguish
between a conditioned stimulus and other stimuli
Classical Conditioning
Classical Conditioning
• BIOLOGICAL PREPAREDNESS: animals are
genetically programmed to fear specific objects.
Classical Conditioning
• RESCORLA-WAGNER MODEL:
the strength of the CS-US
association is determined by
the extent to which the
unconditioned stimulus is
unexpected
• PREDICTION ERROR: the
difference between the
expected and actual outcomes
– Positive = ↑CS-US bond
– Negative = ↓CS-US bond
Classical Conditioning
“Little Albert”
Experiment
John B. Watson & Rosalie Rayner
‘Little Albert’
Noise Fear UCR
UCR
CR
UCS
UCS NS
CS
+Rat
Noise Fear
Rat Fear
S R
Associative Learning
Operant Conditioning
• Edward Thorndike’s LAW OF EFFECT
• OPERANT CONDITIONING:
– Participant makes a response to produce a
consequence
– The probability of a response is changed by a change
in consequences
• OPERANT: A behavior freely initiated or
displayed
Classical Conditioning
Operant Conditioning
PASSIVE
ACTIVE
Positive
Negative
ADD SOMETHING
TAKE SOMETHING AWAY
Operant Chamber / Skinner Box
REINFORCEMENT: a consequence that
– INCREASES behaviors
– Strengthens the response
• POSITIVE REINFORCEMENT: ADDING something to
INCREASE the likelihood of the behavior
REINFORCEMENT: a consequence that
– INCREASES behaviors
– Strengthens the response
• NEGATIVE REINFORCEMENT: SUBTRACTING
something to INCREASE the likelihood of the
behavior
PUNISHMENT: a consequence that
– DECREASES the behavior
– Weakens the response
• POSITIVE PUNISHMENT: ADDING something to
DECREASE the likelihood of the behavior
PUNISHMENT: a consequence that
– DECREASES the behavior
– Weakens the response
• NEGATIVE PUNISHMENT: SUBTRACTING something
to DECREASE the likelihood of the behavior
Practice!
• When John breaks curfew, his Dad makes him wash the car. The
next week, John breaks curfew three more times.
• Carrie has a terrible headache, so she tries a new type of
headache medication. It works so well that every time she has
a headache, she now only buys that type of headache
medication.
• Workers lose 10 minutes of lunch time for every report they
turn in late. Eventually, they stop turning in late work.
• When Aaron turns in a perfect essay, his teacher praises him
and asks him to read it out loud. From that point on, Aaron
turns in very poorly written essays.
Operant Conditioning:
Review of Terms
Positive Negative
Reinforcement Give food
pellet
Take away
shock
Punishment Give shock Take away
food pellet
Operant Conditioning
PRIMARY
REINFORCERS
SECONDARY
REINFORCERS
Operant Conditioning
• PREMACK PRINCIPLE: a more valued activity
can reinforce the performance of a less valued
activity
Operant Conditioning
• SHAPING:
reinforcing
behaviors that are
increasingly similar
to the desired
behavior
• ACQUISITION: the strengthening of a reinforced
operant response
• EXTINCTION: the diminishing of the operant
response when it is no longer reinforced
• SPONTANEOUS RECOVERY: the return of the
operant response following a break in extinction
training
SCHEDULES OF REINFORCEMENT:
a preset pattern for delivering reinforcement
• CONTINUOUS REINFORCEMENT SCHEDULE: every
single instance is reinforced
• PARTIAL REINFORCEMENT SCHEDULE: only some
instances are reinforced
Partial Reinforcement Schedules
• FIXED RATIO: reinforces a response only after a
specified number of responses
Partial Reinforcement Schedules
• VARIABLE RATIO: reinforces a response after an
unpredictable number of responses have occurred
Partial Reinforcement Schedules
• FIXED INTERVAL: reinforces a response only
after a specified time has passed
• VARIABLE INTERVAL: reinforces a response at
unpredictable time intervals
Partial Reinforcement Schedules
Partial Reinforcement Schedules
PARTIAL REINFORCEMENT EFFECT: it takes longer to
extinguish an operant response following partial
reinforcement
Schedules of Reinforcement
• Interval: time
• Ratio: # of responses
Ask Yourself:
Is reinforcement provided based
on the passage of time or based
on the number of responses?
Ask yourself:
Is the criteria the same every
single time or does it vary from
trial to trial?
•Fixed: set amount
•Variable: varying
amounts
Practice!
1. Pete gets a $1000 bonus for every 10 cars he sells.
2. Checking to see if the dishwasher is done.
3. Each time a dog retrieves the newspaper, his owner
gives him a Schnausage.
4. A surfer waits to catch a wave.
5. A rat gets a pellet of food for every ten lever presses, on
average.
Operant Conditioning
• Breland & Breland
Operant Conditioning
• COGNITIVE MAP:
a mental
representation of
an environment
• LATENT
LEARNING: takes
place in the
absence of
reinforcement
• LEARNING: a relatively enduring change in
behavior, resulting from experience
Observational Learning
Observational Learning
• MODELING: imitation of observed behavior
Observational Learning
• VICARIOUS
LEARNING:
learning the
consequences of
an action by
watching others
being rewarded
or punished
Observational Learning
Observational Learning
• MIRROR
NEURONS: fire
when you
observe
someone engage
in an action and
when you engage
in a similar action

Ch06 Learning