Psych Chapter 6
ratio
# of responses
interval
amount of time
applications of operant conditioning
animal training, overcoming procrastination, superstitions, token economies, analysis of autism
all behavior can be studied as a simple stimulus response reaction with no regard for internal processes, psychology must focus on outward observable behavior that can be measured
behaviorism
when behavior is rewarded after a set amount of time
fixed interval reinforcement schedule
learning that occurs but is not observable in behavior until there is no reason to demonstrate it
latent learning
using a conditioned stimulus to condition a neutral stimulus
higher order conditioning (second order conditioning)
Tendency for animals to return to innate behaviors following repeated reinforcement
instinctive drift
innate behaviors that are triggered by a broader range of events, such as aging or change of season, more complex, higher brain centers
instincts
innate behaviors that occur naturally
instincts and reflexes
behaviors that are followed by consequences that are satisfying to the organism are more likely to be repeated, and behaviors that are followed by unpleasant consequences are less likely to be repeated
law of effect
relatively permanent change in behavior or knowledge that results from experience
learning
Bandura identifies 3 kinds of models:
live, verbal, symbolic
neuron involved in observational learning and empathy, activated when animal performs or observes action
mirror neuron
individuals performing the imitated behavior
models
remove an adverse stimulus to decrease behavior
negative punishment
undesirable stimulus is removed to increase behavior
negative reinforcement
no inherent value and only has reinforcing qualities when linked with a primary reinforcer
secondary reinforcer
responding more strongly over time to repeated exposure to stimulus
sensation
reward successive approximations of a target behavior
shaping
the return of a previously extinguished conditioned response following a rest period
spontaneous recovery
when an organism learns to respond differently to to various stimuli that are similar
stimulus discrimination
natural (unlearned) reaction to given stimulus (dog's salivation)
unconditioned response (UCR)
a stimulus that elicits a reflective response in an organism (meat powder)
unconditioned stimulus (UCS)
gets reinforcement based on varying amounts of time, which are unpredictable
variable interval reinforcement
add an undesirable stimulus to decrease a behavior
positive punishment
desirable stimulus is added to increase behavior
positive reinforcement
reinforcers that have innate reinforcing qualities, not learned, like water, food, shelter, sleep, sex
primary reinforcer
any outcome that weakens the probability of a response
punishment
motor or neural reaction to a specific stimulus in the environment, simpler, involve specific body parts, primitive centers of CNS
reflexes
outcomes that strengthen the probability of a response
reinforcements
steps of shaping
1. reinforce any response that resembles the desired behavior 2. reinforce response most closely resembles desired behavior, no longer reinforce previously reinforced response 3. reinforce response that even more closely resembles desired behavior 4. continue 5. only reinforce desired behavior
drawbacks of punishment on children
1. teaches fear 2. children become more aggressive
through his experiments, Pavlov realized that an organism has 2 types of responses to its environment
1. unconditioned (unlearned) responses 2. conditioned (learned) responses
several ways observational learning can occur
1. you learn a new response 2.you choose whether or not to imitate the model depending on what you saw happen to the model 3. you learn a general rule you can apply yo other situations
who proposed the law of effect?
E L Thorndike
Russian scientist known for dog experiments on classical conditioning
Ivan Pavlov
founder of behaviorism
John B Watson
we are evolutionarily predisposed to be more afraid of certain things
Preparedness
demonstrated that organisms can learn even if they do not receive immediate reinforcement (latent learning)
Tolman
initial period of learning, phase during which a CR is established
acquisition
organism makes connections between stimuli or events that occur together in the environment
associative learning
specific steps in process of modeling that must be followed if learning is to be successful
attention, retention, reproduction, motivation
process by which we learn to associate stimuli and to anticipate events
classical conditioning
mental picture of the layout of the maze
cognitive map
response previously associated with a non neutral stimulus that comes to be elicited by a neutral stimulus(salivation with tone only)
conditioned response (CR)
stimulus that elicits a response after repeatedly being paired with an unconditioned stimulus (tone and meat powder)
conditioned stimulus (CS)
when an organism receives a reinforcer each time it displays a behavior
continuous reinforcement
applications of classical conditioning
explains acquisition of fears and phobias (little albert), treat phobias (little peter)
decrease in the conditioned response when the unconditioned stimulus is no longer presented with the conditioned stimulus
extinction
set number of responses that must occur before the behavior is rewarded
fixed ratio reinforcement schedule
process by which we respond less strongly over time to repeated stimuli, simplest and earliest form of learning to develop
habituation
when we learn not to respond to a stimulus that is presented repeatedly without change
habituation
extinguish a response in a different setting in which it was acquired; when in original setting, extinguished response reappears
renewal effect
stimulus that does not naturally elicit a response (tone)
neutral stimulus (NS)
we learn by watching others and then imitating or modeling what they do or say
observational learning
form of learning in which the stimulus /experience happens after the behavior is demonstrated
operant conditioning
occurs when we reinforce responses only some of the time, more resistant to extinction
partial reinforcement
when an organism demonstrates the conditioned response to stimuli that are similar to the condition stimulus
stimulus generalization
number of responses needed for a reward varies, most powerful partial reinforcement schedule
variable ratio reinforcement schedule
if you see a model being punished for their behavior, you will be less motivated to copy them
vicarious punishment
if you see a model reinforced for their behavior, you will be more motivated to copy them
vicarious reinforcement