Unit 4

Robert Rescorla

1988 found that the CS has to provide some kind of information about the coming of the UCS

Operant

A Skinner box is most likely to be used in research on __________ conditioning.

Secondary, Primary

A __________ reinforcer, such as money or praise, gets its value through an association with a __________ reinforcer.

Positive

A stimulus presented (ADDED) to a person or animal that decreases the probability of a particular response is known as __________.

Fish Food

Alan always turns the aquarium light on before putting fish food into the tank. After a while he notices that the fish swim to the top to look for food as soon as he turns on the light. In this example, the __________ is the unconditioned stimulus.

spontaneous recovery

An animal is conditioned to salivate to a bell using Pavlovian procedures. After the conditioning is established, the animal is then put through an extinction procedure and the conditioned salivation disappears. Then the animal is removed from the test situation for several days. When returned to the test situation, the conditioned response is seen again. The effect is known as __________.

John B. Watson

Founder of behaviorism// all behavior could be explained in terms of learning--- Performed Little Albert Experiment

Negative Reinforcement

Fred is afraid of spiders. He won't even watch a nature show on TV about them. When he sees a picture of a spider, he has a panic attack, but when he avoids looking at the image, his panic goes away. Fred's avoidance of spiders is being __________.

Shaping-successive approximation

In the process of shaping, behaviors are ordered in terms of increasing similarity to the desired response. These behaviors are called __________.

Vicarious Conditioning

It is even possible to become classically conditioned by simply watching someone else respond to a stimulus in a process called __________.

Conditioned Stimulus (CS)

John Watson offered a live, white rat to Little Albert and then made a loud noise behind his head by striking a steel bar with a hammer. The white rat served as the __________ in his study.

Conditioned Taste Aversion

Last month, Walter became sick after eating two chili dogs, so he no longer likes chili dogs. Walter has experienced __________.

Classical Conditioning.

Learning to make a reflex response to a stimulus other than to the original, natural stimulus is called ______________

Conditioned Stimulus

Miranda notices that her cat salivates as soon as it hears the sound of the electric can opener. In this example, the sound of the can opener is the ______________

Ivan Pavlov

Physiologist that stumbled upon unconditioned stimulus

Insight learning

The "aha!" experience is known as __________.

Latent learning

The idea that learning occurs and is stored up, even when behaviors are not reinforced, is called _______.

Operant Conditioning

The kind of learning that applies to voluntary behavior is called __________.

Thorndike

The person MOST closely associated with the Law of Effect is __________.

Martin Seligman

The person most closely associated with research on learned helplessness is __________.

Positive reinforcement

The reinforcement of a response by the addition or experiencing of a pleasurable stimulus

Acquisition

The repeated pairing of the neutral stimulus with the UCS.

Pavlov

The researcher responsible for discovering classical conditioning was

Generalization

The tendency to respond to a stimulus that is similar to the original conditioned stimulus is called __________.

Cats and Puzzle Box

Thorndike was known for his work with __________.

Punishment

What has occurred when there is a decrease in the likelihood or rate of a target response?

Reinforcement

What is more effective, Reinforcement or Punishment?

Negative

When a stimulus is removed from a person or animal resulting in a decrease in the probability of response, it is known as __________.

Ratio

When the number of responses is important to a schedule of reinforcement, that schedule is called a __________ schedule.

Rescorla

Which theorist proposed the cognitive perspective that explains that classical conditioning occurs because of expectancy/contingency?

Observational Learning

Which type of learning occurs when we observe how other people act?

Wolfgang Kohler

Who is best known for studying the phenomenon of insight in animals?

Thorndike

Who was one of the first researchers to explore and outline the laws of voluntary responses?

Bell before biscuit

You decide that you are going to condition your dog to salivate to the sound of a bell. You give the dog a biscuit, and then a second later you ring the bell. You do this several times, but no conditioning seems to occur. This is probably because __________.

Learning.

___________________ is any relatively permanent change in behavior brought about by experience or behavior

Unconditioned (or "unlearned") stimulus (UCS):

a naturally occurring stimulus that leads to an involuntary response

Unconditioned response (UCR)

an involuntary response to a naturally occurring or unconditioned stimulus

Punishment

any event or object that when following a response makes that response less likely to happen again

Reinforcement

any event or stimulus that increases the probability

Secondary reinforcers

any reinforcer that becomes reinforcing after being paired with a primary reinforcer such as praise, tokens, or gold stars

Primary reinforcers

any reinforcer that is naturally reinforcing by meeting a basic biological need, such as hunger, thirst, or touch

Learning

any relatively permanent change in behavior brought about by experience or practice

Discriminative stimulus

any stimulus such as a stop sign or doorknob that provides the organism with a cue for making a certain response in order to obtain reinforcement

Vicarious conditioning

classical conditioning of a reflex response or emotion by watching the reaction or another person

Stimulus discrimination

determining the difference between fake sounds and the real ones

Conditioned taste aversions

development of a nausea or aversive response to a particular taste because that taste was followed by a nausea reaction, occurring after only one association

Conditional emotional response (CER)

emotional response that has become classically conditioned to occur to learned stimuli, such as the fear of dogs or the emotional reaction that occurs when seeing an attractive person

secondary reinforcers

everything else (stickers, high-fives)

Neurofeedback

form of biofeedback using brain-scanning devices to provide feedback about brain activity in an effort to modify behavior

primary reinforcers

innately satisfying (food and water)

Law of Effect

law stating if an action is followed by a pleasurable consequences that tends to be repeated

Conditioned, or learned, response (CR)

learned reflex response to conditioned stimulus

Observational Learning

learning new behavior by watching a model perform that behavior

Latent learning

learning that remains hidden until its application becomes useful

Classical Conditioning

learning to make an involuntary response to a stimulus other than the original natural stimulus that normally produces the reflex

Applied behavior analysis or ABA

modern term for a form of behavior modification that uses shaping techniques to mold a desired behavior or response

Higher-order conditioning

occurs when a strong conditioned stimulus is paired with a neutral stimulus causing the neutral stimulus to become a second conditioned stimulus

Stimulus substitution

original theory in which Pavlov stated that classical conditioning occurred because conditioned stimulus became a substitute for an unconditioned stimulus

Biological preparedness

referring to the tendency of animals to learn certain associations, such as taste and nausea with only one or few pairings due to the survival value of learning

overjustification effect

reinforcing behaviors that are intrinsically motivating causes you to stop doing them (give child $5 for reading when they already like tor read--- they stop reading)

Fixed interval

schedule of reinforcement in which interval of time that must pass before reinforcement becomes possible is always the same

Variable interval

schedule of reinforcement in which the interval of time that must pass before reinforcement becomes possible os different for each trial or event

Fixed ratio

schedule of reinforcement in which the number of responses required for reinforcement is always the same

Variable ratio

schedule of reinforcement in which the number of responses required for reinforcement is different for each trial or event

Successive approximations

small steps in behavior one after the other that lead to a particular goal behavior

Neutral stimulus (NS)

stimulus that has no effect on the desired response

Extinction

the disappearance or weakening of a learned response following the removal or absence of the unconditional stimulus or removal or reinforcer

Punishment by application(positive)

the punishment of a response by the addition or experiencing of an unpleasant stimulus

Punishment by removal(negative)

the punishment of a response by the removal of a pleasurable stimulus

Spontaneous recovery

the reappearance of a learned response after extinction has occurred

Negative reinforcement

the reinforcement of a response by the removal, escape from, or avoidance of an unpleasant stimulus

Continuous reinforcement

the reinforcement of each and every correct response

Shaping

the reinforcement of simple steps in behavior that lead to a desired more complex behavior

Partial reinforcement

the tendency for a response that is reinforced after some but not all correct responses to be very resistant to extinction

Learned helplessness

the tendency to fail to act to escape from a situation because of repeated failures in the past

Stimulus generalization

the tendency to respond to a stimulus that is only similar to the original conditioned stimulus

Behavior modification

the use of operant conditioning techniques to bring about desired changes in behavior

Token economy

type of behavior modification in which desired behavior is awarded with tokens

token reinforcer

type of secondary--- can be exchanged for other things

Biofeedback

using feedback about biological conditions to bring involuntary responses such as blood pressure and relaxation under voluntary control