Chapter 4

Cumulative Record

A record of the total number of operant responses over time that visually depicts the rate of responding.

Punisher

A stimulus that decreases the probability of a prior response.

Secondary Reinforcer

A stimulus that gains its reinforcing property through learning.

Reinforcer

A stimulus that increases the probability of a prior response.

Primary Reinforcer

A stimulus that is innately reinforcing (since birth)

Reflex

A stimulus-response pair in which the stimulus (the unconditioned stimulus) automatically elicits the response (the unconditioned response)

A stimulus that is unpleasant.

Aversive Stimulus

Trace Conditioning

conditioned stimulus precedes the unconditioned stimulus but is removed before the unconditioned stimulus is presented so that the two stimuli do NOT occur together.

Which of the following is an example of a secondary reinforcer? a) money b) a money order c) a check d) all of the above

d) all of the above

Negative Reinforcement occurs when an ______ stimulus is ______. a) appetitive; presented b) appetitive; removed c) aversive; presented d) aversive; removed

d) aversive; removed

Stimulus Discrimination (Classical)

elicitation of the conditioned response only by a small set of highly similar stimuli that includes the conditioned stimulus.

Continuing to take advil because it alleviates headaches is an example of _______, and no longer parking in "No Parking" zones because you lost money in fines for doing so is an example of ______. a) positive punishment; positive reinforcement b) positive reinforcement; positive punishment c) negative punishment; negative reinforcement d) negative reinforcement; negative punishment

negative reinforcement; negative punishment

Fixed-Variable Schedule

A partial schedule of reinforcement in which a reinforcer is delivered after the first response is given once a set interval of time has elapsed.

Fixed-Ratio Schedule

A partial schedule of reinforcement in which a reinforcer is delivered each time a fixed number of responses is made. The fixed number can be any number greater than one.

Variable-Ratio Schedule

A partial schedule of reinforcement in which the number of responses it takes to obtain a reinforcer varies on each trial but averages to a set number across trials.

Law of Effect

A principle developed by Edward Thorndike says that any behavior that results in satisfying consequences tends to be repeated and that any behavior that results in unsatisfying consequences tends not to be repeated.

Classical Conditioning

Acquiring a new response (the conditioned response) to a previously neutral stimulus (the conditioned stimulus) that reliably signals the arrival of an unconditioned

What is the learning process of Classical Conditioning?

Acquisition, Extinction, Spontaneous Recovery, Stimulus Generalization, Stimulus Discrimination

The application of classical and operant conditioning principles to eliminate undesirable behavior and to teach more desirable behavior.

Behavior Modification

The stimulus that comes to elicit a new response in classical conditioning.

Conditioned Stimulus

The diminishing of the operant responses when it is no longer reinforced.

Extinction (operant)

Stimulus Generalization (Operant)

Giving the operant response in the presence of stimuli similar to the discriminative stimulus (the more similar, the higher the response rate).

A principle developed by Edward Thorndike that says that any behavior that results in satisfying consequences tends to be repeated and that any behavior that results in unsatisfying consequences tends not to be repeated.

Law of Effect

Observational Learning (modeling)

Learning by observing others and imitating their behavior.

Latent Learning

Learning that occurs but is not demonstrated until there is an incentive to do so.

Operant Conditioning

Learning to associate behaviors with their consequences. Behaviors that are reinforced (lead to satisfying consequences) will be strengthened, and behaviors that are punished (lead to unsatisfying consequences) will be weakened.

Stimulus Discrimination (Operant)

Learning to give the operant response only in the presence of the discriminative stimulus.

Mirror Neurons

Neurons that fire both when performing an action and when observing another person perform the same action.

Training an animal or human to make an operant response by reinforcing successive approximations to the desired response.

Shaping

The finding that operant responses reinforced on partial schedules are more resistant to extinction than those reinforced on a continuous schedule.

Partial-Reinforcement Effect

Positive Punishment

Pleasant Stimulus is taken away

Positive Reinforcement

Pleasant stimulus is given

Punishment in which an aversive stimulus is presented.

Positive Punishment

Continuous Schedule of Reinforcement

Reinforcing the desired operant response each time it is made.

Partial Schedule of Reinforcement

Reinforcing the desired operant response only part of the time.

A stimulus that gains its reinforcing property through learning.

Secondary reinforcer

A partial recovert in strength of the conditioned response following a break during extinction training.

Spontaneous Recovery (classical)

In operant conditioning, given the operant response in the presence of stimuli similar to the discriminative stimulus.

Stimulus Generalization

Behavior Modification

The application of classical and operant conditioning principles to eliminate undesirable behavior and to teach more desirable behavior.

Extinction (Operant)

The diminishing of the operant response when it is no longer reinforced.

Partial-Reinforcement Effect

The finding that operant responses that are reinforced on partial schedules are more resistant to extinction than those reinforced on a continuous schedule.

A partial schedule of reinforcement in which the number of responses it takes to obtain a reinforcer varies on each trial but averages to a set number across trials.

Variable-Ratio Schedule

Premack Principle

The principle that the opportunity to perform a highly frequent behavior can reinforce a less frequent behavior.

Punishment

The process by which the probability of a response is decreased by the presentation of a punisher.

Reinforcement

The process by which the probability of a response is increased by the presentation of a reinforcer.

Unconditioned Response (UCR)

The response in a reflex that is automatically elicited by the unconditioned stimulus

Conditioned Response (CR)

The response that is elicited by the conditioned stimulus in classical conditioning.

Unconditioned Stimulus (UCS)

The stimulus in a reflex that automatically elicits an unconditioned response

Conditioned Stimulus (CS)

The stimulus that comes to elicit a new response (the conditioned response) in classical conditioning

Discriminative Stimulus (Operant)

The stimulus that has to be present for the operant response to be reinforced.

Acquisition (Operant)

The strengthening of a reinforced operant response.

Spontaneous Recovery (Operant)

The temporary recovery of the operant response following a break during extinction training.

Instinctual Drift

The tendency for an animal to drift back from a learned operant response to an innate, instinctual response to an object.

A classical conditioning procedure in which the conditioned stimulus precedes the unconditioned stimulus but the two stimuli do not occur together.

Trace Conditioning

Shaping

Training a human or animal to make an operant response by reinforcing successive approximations of the desired response.

Positive Punishment

Unpleasant stimulus is given

Negative Reinforcement

Unpleasant stimulus is taken away

A partial schedule of reinforcement in which the time that must elapse on each trial before a response will lead to the delivery of a reinforcer varies from trial to trial but averages to a set time across trials.

Variable-Interval Schedule

Spontaneous Recovery (Classical)

a partial recovery in strength of the conditioned response following a break during extinction training.

Appetitive Stimulus

a stimulus that is PLEASANT

Aversive Stimulus

a stimulus that is UNPLEASANT

Which of the following is the best example of a primary reinforcer? a) a cheeseburger b) a grade of "A" on an exam c) praise from your teacher d) winning the lottery

a) a cheeseburger

In stimulus generalization in classical conditioning, the strength of the CR _____, as the similarity of the generalization stimulus to the ______ increases. a) increases; CS b) decreases; CS c) increases; UCS d) decreases; UCS

a) increases; CS

The _____ effect is a decrease in an intrinsically motivated behavior after the behavior is extrinsically reinforced and the reinforcement discontinued. a) overjustification b) partial reinforcement c) shaping d) instinctual drift

a) overjustification

Acquisition (Classical)

acquiring a new response (the conditioned response) to the conditioned stimulus.

In Pavlov's classical conditioning research, a tone was used at the _____ and the food inserted in the mouth served as the ____. a) UCS; CS b) CS; UCS c) UCR; CR d) CR; UCR

b) CS;UCS

The stimulus in whose presence a response will be reinforced is called the stimulus _____ in operant conditioning. a) a generalization b) discriminative c) acquisition d) extinction

b) discriminative

In reinforcement, the probability of a behavior _______; in punishment the probability of a behavior ______. a) increases; increases b) increases; decreases c) decreases; increases d) decreases; decreases

b) increases; decreases

The Bredlands' difficulties in training animals were the result of _____. a) the partial-reinforcement effect b) instinctual drift c) a token economy d) latent learning

b) instinctual drift

Tolman's research with rats in mazes indicated the occurrence of _____. a) observational learning b) latent learning c) the partial-reinforcement effect d) instinctual drift

b) latent learning

The results of Bandura's Bobo doll studies illustrate _____, and Tolman and Honzik's studies of latent learning indicate the importance of ______ in maze learning by rats. a) observational learning; the overjustification effect b) observational learning; cognitive maps c) the partial-reinforcement effect; the overjustification effect d) the partial-reinforcement effect; cognitive maps

b) observational learning; cognitive maps

In classical conditioning, the diminishing of the CR following removal of the UCS is called ____. a) acquisition b) discrimination c) extinction d) generlization

c) extinction

A steep cumulative record in operant conditioning indicates _____, and a flat cumulative record indicates _____. a) a slow rate of responding; no responding b) a slow rate of responding; a fast rate of responding c) a fast rate of responding; no responding d) a fastrate of responding; a slow rate of responding

c) fast rate of responding; no responding

Piecework in a factory is an example of a ______ schedule of reinforcement; a slot machine is an example of a ____ schedule of reinforcement. a) variable-ratio; fixed-interval b) fixed-interval; variable-ratio c) fixed-ratio; variable-ratio d) variable-ratio; fixed-ratio

c) fixed-ratio; variable-ratio

Delayed Conditioning

the conditioned stimulus precedes the unconditioned stimulus and remains present until after the unconditioned stimulus is presented so that the two stimuli occur together.

Extinction (Classical)

the diminishing of the conditioned response when the unconditioned stimulus no longer follows the conditioned stimulus.

Stimulus Generalization (Classical)

the elicitation of the conditioned response to stimuli that are similar to the conditioned stimulus. The more similar the stimulus is to the conditioned stimulus, the stronger the response.