Unit 4
Robert Rescorla
1988 found that the CS has to provide some kind of information about the coming of the UCS
Operant
A Skinner box is most likely to be used in research on __________ conditioning.
Secondary, Primary
A __________ reinforcer, such as money or praise, gets its value through an association with a __________ reinforcer.
Positive
A stimulus presented (ADDED) to a person or animal that decreases the probability of a particular response is known as __________.
Fish Food
Alan always turns the aquarium light on before putting fish food into the tank. After a while he notices that the fish swim to the top to look for food as soon as he turns on the light. In this example, the __________ is the unconditioned stimulus.
spontaneous recovery
An animal is conditioned to salivate to a bell using Pavlovian procedures. After the conditioning is established, the animal is then put through an extinction procedure and the conditioned salivation disappears. Then the animal is removed from the test situation for several days. When returned to the test situation, the conditioned response is seen again. The effect is known as __________.
John B. Watson
Founder of behaviorism// all behavior could be explained in terms of learning--- Performed Little Albert Experiment
Negative Reinforcement
Fred is afraid of spiders. He won't even watch a nature show on TV about them. When he sees a picture of a spider, he has a panic attack, but when he avoids looking at the image, his panic goes away. Fred's avoidance of spiders is being __________.
Shaping-successive approximation
In the process of shaping, behaviors are ordered in terms of increasing similarity to the desired response. These behaviors are called __________.
Vicarious Conditioning
It is even possible to become classically conditioned by simply watching someone else respond to a stimulus in a process called __________.
Conditioned Stimulus (CS)
John Watson offered a live, white rat to Little Albert and then made a loud noise behind his head by striking a steel bar with a hammer. The white rat served as the __________ in his study.
Conditioned Taste Aversion
Last month, Walter became sick after eating two chili dogs, so he no longer likes chili dogs. Walter has experienced __________.
Classical Conditioning.
Learning to make a reflex response to a stimulus other than to the original, natural stimulus is called ______________
Conditioned Stimulus
Miranda notices that her cat salivates as soon as it hears the sound of the electric can opener. In this example, the sound of the can opener is the ______________
Ivan Pavlov
Physiologist that stumbled upon unconditioned stimulus
Insight learning
The "aha!" experience is known as __________.
Latent learning
The idea that learning occurs and is stored up, even when behaviors are not reinforced, is called _______.
Operant Conditioning
The kind of learning that applies to voluntary behavior is called __________.
Thorndike
The person MOST closely associated with the Law of Effect is __________.
Martin Seligman
The person most closely associated with research on learned helplessness is __________.
Positive reinforcement
The reinforcement of a response by the addition or experiencing of a pleasurable stimulus
Acquisition
The repeated pairing of the neutral stimulus with the UCS.
Pavlov
The researcher responsible for discovering classical conditioning was
Generalization
The tendency to respond to a stimulus that is similar to the original conditioned stimulus is called __________.
Cats and Puzzle Box
Thorndike was known for his work with __________.
Punishment
What has occurred when there is a decrease in the likelihood or rate of a target response?
Reinforcement
What is more effective, Reinforcement or Punishment?
Negative
When a stimulus is removed from a person or animal resulting in a decrease in the probability of response, it is known as __________.
Ratio
When the number of responses is important to a schedule of reinforcement, that schedule is called a __________ schedule.
Rescorla
Which theorist proposed the cognitive perspective that explains that classical conditioning occurs because of expectancy/contingency?
Observational Learning
Which type of learning occurs when we observe how other people act?
Wolfgang Kohler
Who is best known for studying the phenomenon of insight in animals?
Thorndike
Who was one of the first researchers to explore and outline the laws of voluntary responses?
Bell before biscuit
You decide that you are going to condition your dog to salivate to the sound of a bell. You give the dog a biscuit, and then a second later you ring the bell. You do this several times, but no conditioning seems to occur. This is probably because __________.
Learning.
___________________ is any relatively permanent change in behavior brought about by experience or behavior
Unconditioned (or "unlearned") stimulus (UCS):
a naturally occurring stimulus that leads to an involuntary response
Unconditioned response (UCR)
an involuntary response to a naturally occurring or unconditioned stimulus
Punishment
any event or object that when following a response makes that response less likely to happen again
Reinforcement
any event or stimulus that increases the probability
Secondary reinforcers
any reinforcer that becomes reinforcing after being paired with a primary reinforcer such as praise, tokens, or gold stars
Primary reinforcers
any reinforcer that is naturally reinforcing by meeting a basic biological need, such as hunger, thirst, or touch
Learning
any relatively permanent change in behavior brought about by experience or practice
Discriminative stimulus
any stimulus such as a stop sign or doorknob that provides the organism with a cue for making a certain response in order to obtain reinforcement
Vicarious conditioning
classical conditioning of a reflex response or emotion by watching the reaction or another person
Stimulus discrimination
determining the difference between fake sounds and the real ones
Conditioned taste aversions
development of a nausea or aversive response to a particular taste because that taste was followed by a nausea reaction, occurring after only one association
Conditional emotional response (CER)
emotional response that has become classically conditioned to occur to learned stimuli, such as the fear of dogs or the emotional reaction that occurs when seeing an attractive person
secondary reinforcers
everything else (stickers, high-fives)
Neurofeedback
form of biofeedback using brain-scanning devices to provide feedback about brain activity in an effort to modify behavior
primary reinforcers
innately satisfying (food and water)
Law of Effect
law stating if an action is followed by a pleasurable consequences that tends to be repeated
Conditioned, or learned, response (CR)
learned reflex response to conditioned stimulus
Observational Learning
learning new behavior by watching a model perform that behavior
Latent learning
learning that remains hidden until its application becomes useful
Classical Conditioning
learning to make an involuntary response to a stimulus other than the original natural stimulus that normally produces the reflex
Applied behavior analysis or ABA
modern term for a form of behavior modification that uses shaping techniques to mold a desired behavior or response
Higher-order conditioning
occurs when a strong conditioned stimulus is paired with a neutral stimulus causing the neutral stimulus to become a second conditioned stimulus
Stimulus substitution
original theory in which Pavlov stated that classical conditioning occurred because conditioned stimulus became a substitute for an unconditioned stimulus
Biological preparedness
referring to the tendency of animals to learn certain associations, such as taste and nausea with only one or few pairings due to the survival value of learning
overjustification effect
reinforcing behaviors that are intrinsically motivating causes you to stop doing them (give child $5 for reading when they already like tor read--- they stop reading)
Fixed interval
schedule of reinforcement in which interval of time that must pass before reinforcement becomes possible is always the same
Variable interval
schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible os different for each trial or event
Fixed ratio
schedule of reinforcement in which the number of responses required for reinforcement is always the same
Variable ratio
schedule of reinforcement in which the number of responses required for reinforcement is different for each trial or event
Successive approximations
small steps in behavior one after the other that lead to a particular goal behavior
Neutral stimulus (NS)
stimulus that has no effect on the desired response
Extinction
the disappearance or weakening of a learned response following the removal or absence of the unconditional stimulus or removal or reinforcer
Punishment by application(positive)
the punishment of a response by the addition or experiencing of an unpleasant stimulus
Punishment by removal(negative)
the punishment of a response by the removal of a pleasurable stimulus
Spontaneous recovery
the reappearance of a learned response after extinction has occurred
Negative reinforcement
the reinforcement of a response by the removal, escape from, or avoidance of an unpleasant stimulus
Continuous reinforcement
the reinforcement of each and every correct response
Shaping
the reinforcement of simple steps in behavior that lead to a desired more complex behavior
Partial reinforcement
the tendency for a response that is reinforced after some but not all correct responses to be very resistant to extinction
Learned helplessness
the tendency to fail to act to escape from a situation because of repeated failures in the past
Stimulus generalization
the tendency to respond to a stimulus that is only similar to the original conditioned stimulus
Behavior modification
the use of operant conditioning techniques to bring about desired changes in behavior
Token economy
type of behavior modification in which desired behavior is awarded with tokens
token reinforcer
type of secondary--- can be exchanged for other things
Biofeedback
using feedback about biological conditions to bring involuntary responses such as blood pressure and relaxation under voluntary control