Psych 101 IUP Final Exam
Fixed Ratio Variable Ratio Fixed Interval Variable Interval
Schedules of Partial Reinforcement
There are rules for determining which responses will be reinforced
Schedules of reinforcement
Learned reinforcers, usually by association with primary reinforce (money)
Secondary Reinforcers
NO!!
Is negative reinforcement punishment?
Reinforcement follows every correct response (bubble gum machine)
Continuous Reinforcement
Not immediate, depends on schedule of reinforcement
Is operant extinction immediate?
Not repeated
Acts followed by negative consequences tend to be
Repeated
Acts followed by positive consequences tend to be
Dog jumps on kitchen table and sees food He starts jumping on all tables to find food He learns which tables have no food
An example of stimulus generalization and discrimination is operant conditioning is...
Aversion therapy with Antabuse (disulfiram) to treat alcoholism
Applications of Classical Conditioning can include...
No
Are things through operant conditioning permanent?
No
Are we born with phobias?
Small percentage of heroin users die each year from an overdose , usually when in a new environment due to loss of his/her conditioned tolerance
Behavioral Tolerance and Heroin Overdose
Depends on a rapid reinforcement
Changing human behavior also
Fixed Interval 15 minutes- only the first response made after 15 minutes passed will be reinforced
Common Fixed Interval
Fixed Ratio 10, every 10 correct responses is reinforced
Common Fixed Ratio
Variable Interval 15 seconds, reinforcement is available after an interval that average 15 seconds
Common Variable Interval
Variable Ratio 4, on average the fourth response is reinforced Yields high response rates Greater resistance to extinction than Fixed Ratio
Common Variable Ratio
More similar, more response
Conditioned responses occur along a gradient meaning...
No, often they do not immediately extinguish
Do classical conditioned responses automatically go away?
Yes
Does operant conditioning have stimulus generalization and discrimination?
Piecework: a worker receives $5 for e very 100 envelopes they stuff or every 100 flyers they stick on a windshield
Example of Fixed Ratio
Slot machines (casino)
Example of Variable Ratio
Person gets DUI and loses license and doesn't drink and drive again Child gets put in time out to decrease behavior Girl is out past curfew gets grounded and doesn't do it again
Example of negative punishment
A dolphin jumping through a hoop, pigeon pressing button
Example of something to shape?
Fishing Pop Quiz
Examples of Variable Interval
Applying sunblock before beach, not getting burned so likely to do it again Use umbrella to stay dry, use it more often Person uses a drug to stop withdrawal, more likely to use again Stops headaches with medicine, takes meds again
Examples of negative reinforcement
Speeding ticket, less likely to speed again Burning hand when touching hot stove, doesn't do it again
Examples of positive punishment
Worker gets paid for over time, child gets dessert for eating veggies, or high after cocaine
Examples of positive reinforcement
Drug self-administration Intracranial self stimulation (ICSS)
Extensions of the skinner box?
Weaken or Remove
Extinguish
Responses are reinforced only after a fixed amount of time passed Yields moderate response rate (depends on amount of time passed)
Fixed Interval (FI)
A specific number of responses must be made prior to obtaining a reinforcer Yields a high response rate (depends on # of responses)
Fixed Ratio (FR)
Form of classical conditioning in which the conditioned stimulus is used to promote learning
Higher-order Classical Conditioning
In nature if someone is bitten by a snake they become fearful of all snakes (survival technique)
How are conditioned responses adaptive?
Through changing drug habits/rehab
How are tangible reinforcers applied to Behavioral Analysis (behavioral modification)
Can happen while watching TV or hearing other people's experiences etc.
How can vicarious or second hand conditioning occur?
Repeatedly present conditioned stimulus without unconditioned stimulus
How can we extinguish classical conditioning?
By Shaping
How can you change a behavior that is rare or does not happen naturally?
In Pavlov's case repeatedly present bell without food
How could Pavlov extinguish classical conditioning?
Rewarded as it faced button, rewarded as walked towards button etc.
How did Jim Holland shape the pigeon?
He studied how cats escaped a puzzle box
How did Thorndike do this?
Systematic Desensitization
How do you extinguish a phobia?
Through successive approximations of an initially improbable behavior
How is shaping done?
By gradually walking people through fear hierarchy in a relaxed state
How is systematic desensitization approached?
Electrode in animals that administers rewarding electrical stimulation helping study what areas of the brain are involved in pleasure
Intracranial self stimulation (ICSS)
As if it were an unconditioned stimulus
In higher-order classical conditioning the conditioned stimulus is used
No
Is classical conditioning permanent?
Scalloped response rates- post reinforcement pause Implications for education (student's studying habits when class has a test every 2 weeks)
Issue with Fixed Interval
The probability of a response by the effect it has
Law of Effect
Conditioned emotional responses
Many phobias are thought to originate as...
Something removed to change behavior (removing stimuli)
Negative
Removal of reinforcer (a desirable stimulus or opportunity) in response to an unwanted behavior in order to decrease the probability of that behavior occurring again
Negative Punishment (Response Cost)
Increases probability of behavior by removing something unpleasant
Negative Reinforcement
Removal to decrease probability of behavior
Negative punishment is
Removal to increase probability of behavior
Negative reinforcement is
A type of learning in which the strength of a behavior is modified by the behavior's consequences, such as reward and punishment
Operant Conditioning
Instrumental Learning
Operant Conditioning is also called
Accidentally reinforced behavior
Origin of Superstitions?
Not all responses are reinforced (ex.slot machine/casino)
Partial Reinforcement
An extreme or irrational fear or aversion to something
Phobia
Bad experiences during childhood
Phobias are linked to
Enhanced via stimulus generalization and higher-order-conditioning
Phobias often...
Something added to change behavior (adding stimuli)
Positive
Any event that follows a response and decreases the likelihood of it happening again
Positive Punishment
Varies among individuals, anything added to increase behavior
Positive Reinforcement
Non-learned reinforcers, usually meet physiological needs (food, water, affection, psychoactive drugs, intracranial self-stimulation)
Primary Reinforcers
Decreases the frequency of a desired behavior
Punishment
Fast and fast
Rate of acquisition and extinction for continuous reinforcement?
Slow and slow
Rate of acquisition and extinction for partial reinforcement?
Increases the frequency of a desired behavior
Reinforcement
Anything that increase the probability of the frequency of a response
Reinforcer
Gradually molding responses through positive reinforcement to final desired pattern
Shaping is...
Praise, attention
Social Reinforcers
Performing operant conditioned behavior to test/see if the rules have changed
Spontaneous Recovery
Reappearance of learned response after it was presumably extinguished
Spontaneous Recovery
The learned ability to respond differently to similar stimuli
Stimulus Discrimination
Tendency to respond to stimuli similar but not identical to a conditioned stimulus
Stimulus Generalization
The learned ability to respond differently to similar stimuli
Stimulus discrimination is...
Tendency to respond to stimuli similar but not identical to conditioned stimulus
Stimulus generalization is...
Reducing fear and anxiety by repeatedly exposing a person to emotional stimuli while the person is relaxed
Systematic Desensitization
Money, casino chips, etc....
Tangible Secondary Reinforcers
A variety of situations Young children, developmentally disabled, drug addiction treatment
Tangible reinforcers are used in
Primary Secondary Social
Types of reinforcers
Reinforcement is given for the first correct response given after a variable amount of time Yields slow steady response rates, highly resistant to extinction
Variable Interval (VI)
Varied number of correct responses required to obtain a reinforce (depends on # of responses)
Variable Ratio (VR)
Learned to respond emotionally to a stimulus by watching others emotional reactions
Vicarious/Second Hand Conditioning
Nature/nurture is very important
Watson's Statement about...
Extinction
What is it called when you get rid of an operant conditioned behavior?
A behavior repeated because it seems to produce reinforcement even though its unnecessary
What is superstition?
Maybe primary, maybe secondary, etc. (look up)
What kind of reinforcer are grades?
Basis for many studies of operant conditioning (reinforcement)
What was the operant conditioning chamber?
When it rapidly follows a behavior
When is reinforcement (and punishment) most effective?
When the interval between the lever pull and receiving food is less than 50 seconds
When is reinforcement most effective in skinners box?
Developed by B.F. Skinner (1904-1990) [Skinner box]
Who made the operant conditioning chamber
Edward Thorndike (1874-1949)
Who studied the Law of Effect?
It makes evolutionary sense!
Why does it make sense they the responses do not just extinguish over night?
It is harder to distinguish periods of occasional reinforcement and extinction
Why is partial reinforcement hard to extinguish?
Because it does not happen right after the crime
Why might prison not be an effective deterrent?
They don't lose their value as rapidly as primary reinforcers Typically have more power over time (not always hungry, loose interest)
Why might tangible reinforcers be more effective than primary?
