Chapter 4
Cumulative Record
A record of the total number of operant responses over time that visually depicts the rate of responding.
Punisher
A stimulus that decreases the probability of a prior response.
Secondary Reinforcer
A stimulus that gains its reinforcing property through learning.
Reinforcer
A stimulus that increases the probability of a prior response.
Primary Reinforcer
A stimulus that is innately reinforcing (since birth)
Reflex
A stimulus-response pair in which the stimulus (the unconditioned stimulus) automatically elicits the response (the unconditioned response)
A stimulus that is unpleasant.
Aversive Stimulus
Trace Conditioning
conditioned stimulus precedes the unconditioned stimulus but is removed before the unconditioned stimulus is presented so that the two stimuli do NOT occur together.
Which of the following is an example of a secondary reinforcer? a) money b) a money order c) a check d) all of the above
d) all of the above
Negative Reinforcement occurs when an ______ stimulus is ______. a) appetitive; presented b) appetitive; removed c) aversive; presented d) aversive; removed
d) aversive; removed
Stimulus Discrimination (Classical)
elicitation of the conditioned response only by a small set of highly similar stimuli that includes the conditioned stimulus.
Continuing to take advil because it alleviates headaches is an example of _______, and no longer parking in "No Parking" zones because you lost money in fines for doing so is an example of ______. a) positive punishment; positive reinforcement b) positive reinforcement; positive punishment c) negative punishment; negative reinforcement d) negative reinforcement; negative punishment
negative reinforcement; negative punishment
Fixed-Variable Schedule
A partial schedule of reinforcement in which a reinforcer is delivered after the first response is given once a set interval of time has elapsed.
Fixed-Ratio Schedule
A partial schedule of reinforcement in which a reinforcer is delivered each time a fixed number of responses is made. The fixed number can be any number greater than one.
Variable-Ratio Schedule
A partial schedule of reinforcement in which the number of responses it takes to obtain a reinforcer varies on each trial but averages to a set number across trials.
Law of Effect
A principle developed by Edward Thorndike says that any behavior that results in satisfying consequences tends to be repeated and that any behavior that results in unsatisfying consequences tends not to be repeated.
Classical Conditioning
Acquiring a new response (the conditioned response) to a previously neutral stimulus (the conditioned stimulus) that reliably signals the arrival of an unconditioned
What is the learning process of Classical Conditioning?
Acquisition, Extinction, Spontaneous Recovery, Stimulus Generalization, Stimulus Discrimination
The application of classical and operant conditioning principles to eliminate undesirable behavior and to teach more desirable behavior.
Behavior Modification
The stimulus that comes to elicit a new response in classical conditioning.
Conditioned Stimulus
The diminishing of the operant responses when it is no longer reinforced.
Extinction (operant)
Stimulus Generalization (Operant)
Giving the operant response in the presence of stimuli similar to the discriminative stimulus (the more similar, the higher the response rate).
A principle developed by Edward Thorndike that says that any behavior that results in satisfying consequences tends to be repeated and that any behavior that results in unsatisfying consequences tends not to be repeated.
Law of Effect
Observational Learning (modeling)
Learning by observing others and imitating their behavior.
Latent Learning
Learning that occurs but is not demonstrated until there is an incentive to do so.
Operant Conditioning
Learning to associate behaviors with their consequences. Behaviors that are reinforced (lead to satisfying consequences) will be strengthened, and behaviors that are punished (lead to unsatisfying consequences) will be weakened.
Stimulus Discrimination (Operant)
Learning to give the operant response only in the presence of the discriminative stimulus.
Mirror Neurons
Neurons that fire both when performing an action and when observing another person perform the same action.
Training an animal or human to make an operant response by reinforcing successive approximations to the desired response.
Shaping
The finding that operant responses reinforced on partial schedules are more resistant to extinction than those reinforced on a continuous schedule.
Partial-Reinforcement Effect
Positive Punishment
Pleasant Stimulus is taken away
Positive Reinforcement
Pleasant stimulus is given
Punishment in which an aversive stimulus is presented.
Positive Punishment
Continuous Schedule of Reinforcement
Reinforcing the desired operant response each time it is made.
Partial Schedule of Reinforcement
Reinforcing the desired operant response only part of the time.
A stimulus that gains its reinforcing property through learning.
Secondary reinforcer
A partial recovert in strength of the conditioned response following a break during extinction training.
Spontaneous Recovery (classical)
In operant conditioning, given the operant response in the presence of stimuli similar to the discriminative stimulus.
Stimulus Generalization
Behavior Modification
The application of classical and operant conditioning principles to eliminate undesirable behavior and to teach more desirable behavior.
Extinction (Operant)
The diminishing of the operant response when it is no longer reinforced.
Partial-Reinforcement Effect
The finding that operant responses that are reinforced on partial schedules are more resistant to extinction than those reinforced on a continuous schedule.
A partial schedule of reinforcement in which the number of responses it takes to obtain a reinforcer varies on each trial but averages to a set number across trials.
Variable-Ratio Schedule
Premack Principle
The principle that the opportunity to perform a highly frequent behavior can reinforce a less frequent behavior.
Punishment
The process by which the probability of a response is decreased by the presentation of a punisher.
Reinforcement
The process by which the probability of a response is increased by the presentation of a reinforcer.
Unconditioned Response (UCR)
The response in a reflex that is automatically elicited by the unconditioned stimulus
Conditioned Response (CR)
The response that is elicited by the conditioned stimulus in classical conditioning.
Unconditioned Stimulus (UCS)
The stimulus in a reflex that automatically elicits an unconditioned response
Conditioned Stimulus (CS)
The stimulus that comes to elicit a new response (the conditioned response) in classical conditioning
Discriminative Stimulus (Operant)
The stimulus that has to be present for the operant response to be reinforced.
Acquisition (Operant)
The strengthening of a reinforced operant response.
Spontaneous Recovery (Operant)
The temporary recovery of the operant response following a break during extinction training.
Instinctual Drift
The tendency for an animal to drift back from a learned operant response to an innate, instinctual response to an object.
A classical conditioning procedure in which the conditioned stimulus precedes the unconditioned stimulus but the two stimuli do not occur together.
Trace Conditioning
Shaping
Training a human or animal to make an operant response by reinforcing successive approximations of the desired response.
Positive Punishment
Unpleasant stimulus is given
Negative Reinforcement
Unpleasant stimulus is taken away
A partial schedule of reinforcement in which the time that must elapse on each trial before a response will lead to the delivery of a reinforcer varies from trial to trial but averages to a set time across trials.
Variable-Interval Schedule
Spontaneous Recovery (Classical)
a partial recovery in strength of the conditioned response following a break during extinction training.
Appetitive Stimulus
a stimulus that is PLEASANT
Aversive Stimulus
a stimulus that is UNPLEASANT
Which of the following is the best example of a primary reinforcer? a) a cheeseburger b) a grade of "A" on an exam c) praise from your teacher d) winning the lottery
a) a cheeseburger
In stimulus generalization in classical conditioning, the strength of the CR _____, as the similarity of the generalization stimulus to the ______ increases. a) increases; CS b) decreases; CS c) increases; UCS d) decreases; UCS
a) increases; CS
The _____ effect is a decrease in an intrinsically motivated behavior after the behavior is extrinsically reinforced and the reinforcement discontinued. a) overjustification b) partial reinforcement c) shaping d) instinctual drift
a) overjustification
Acquisition (Classical)
acquiring a new response (the conditioned response) to the conditioned stimulus.
In Pavlov's classical conditioning research, a tone was used at the _____ and the food inserted in the mouth served as the ____. a) UCS; CS b) CS; UCS c) UCR; CR d) CR; UCR
b) CS;UCS
The stimulus in whose presence a response will be reinforced is called the stimulus _____ in operant conditioning. a) a generalization b) discriminative c) acquisition d) extinction
b) discriminative
In reinforcement, the probability of a behavior _______; in punishment the probability of a behavior ______. a) increases; increases b) increases; decreases c) decreases; increases d) decreases; decreases
b) increases; decreases
The Bredlands' difficulties in training animals were the result of _____. a) the partial-reinforcement effect b) instinctual drift c) a token economy d) latent learning
b) instinctual drift
Tolman's research with rats in mazes indicated the occurrence of _____. a) observational learning b) latent learning c) the partial-reinforcement effect d) instinctual drift
b) latent learning
The results of Bandura's Bobo doll studies illustrate _____, and Tolman and Honzik's studies of latent learning indicate the importance of ______ in maze learning by rats. a) observational learning; the overjustification effect b) observational learning; cognitive maps c) the partial-reinforcement effect; the overjustification effect d) the partial-reinforcement effect; cognitive maps
b) observational learning; cognitive maps
In classical conditioning, the diminishing of the CR following removal of the UCS is called ____. a) acquisition b) discrimination c) extinction d) generlization
c) extinction
A steep cumulative record in operant conditioning indicates _____, and a flat cumulative record indicates _____. a) a slow rate of responding; no responding b) a slow rate of responding; a fast rate of responding c) a fast rate of responding; no responding d) a fastrate of responding; a slow rate of responding
c) fast rate of responding; no responding
Piecework in a factory is an example of a ______ schedule of reinforcement; a slot machine is an example of a ____ schedule of reinforcement. a) variable-ratio; fixed-interval b) fixed-interval; variable-ratio c) fixed-ratio; variable-ratio d) variable-ratio; fixed-ratio
c) fixed-ratio; variable-ratio
Delayed Conditioning
the conditioned stimulus precedes the unconditioned stimulus and remains present until after the unconditioned stimulus is presented so that the two stimuli occur together.
Extinction (Classical)
the diminishing of the conditioned response when the unconditioned stimulus no longer follows the conditioned stimulus.
Stimulus Generalization (Classical)
the elicitation of the conditioned response to stimuli that are similar to the conditioned stimulus. The more similar the stimulus is to the conditioned stimulus, the stronger the response.