Week 5-Cooper CH 13
alt
*Alt*ernative schedule: two schedules operating at the same time on the same behavior with the same SD but different requirements for reinforcement where reinforcement is delivered for the satisfaction of EITHER schedule.
chain
*Chain*ed Schedule
conj
*Conj*unctive Schedule: two schedules operating at the same time on the same behavior with the same SD with different requirements for reinforcement where reinforcement is delivered for the satisfaction of BOTH schedule.
mult
*Mult*iple schedule
2 subsets of Progressive Schedules of Reinforcement
1) PR: Progressive Ratio 2) PI: Progressive Interval
Ratio Strain
A behavioral effect associated with abrupt increases in ratio requirements when moving from denser to thinner reinforcement schedules; common effects include avoidance, aggression, and unpredictable pauses or cessation in responding.
Multiple schedule (mult)
A combined schedule of reinforcement that presents two or more schedules of reinforcement for the same behavior with a different SD associated with each schedule. Example: One schedule after another. Each schedule is an sd for the next schedule.
Mixed schedule (mix)
A combined schedule of reinforcement that presents two or more schedules of reinforcement for the same behavior without an SD associated with any of the schedules. Example: With a mix FR 10 FI 1 schedule, reinforcement sometimes occurs after the completion of 10 responses and sometimes occurs with the first correct response and a 1 minute interval from the preceding.
Multiple Schedule (mult)
A compound schedule of reinforcement consisting of two or more basic schedules of reinforcement (elements) that occur in an alternating, usually random, sequence; a discriminative stimulus is correlated with the presence or absence of each element of the schedule, and reinforcement is delivered for meeting the response requirements of the element in effect at any time.
Mixed Schedule (Mix)
A compound schedule of reinforcement consisting of two or more basic schedules of reinforcement that occur in an alternating, usually random, sequence; no discriminative stimuli are correlated with the presence or absence of each element of the schedule, and reinforcement is delivered for meeting the response requirements of the element in effect at any time.
Chained schedule of reinforcement (chain)
A compound schedule of reinforcement in which an SD is associated with a series of responses that occur in a particular order. Example: Each step must be done in order, must be chained together (behavior chain of putting gas in a car)
Tandem schedule (tand)
A compound schedule of reinforcement in which an SD is not associated with a series of responses that occur in a particular order. example: Shopping list, does not have to be in order.
Intermittent Schedule of Reinforcement (INT)
A contingency of reinforcement in which some, but not all, occurrences of the behavior produce reinforcement.
Extinction (Ext)
A procedure that occurs when reinforcement of a previously reinforced behavior is discontinued; as a result, the frequency of that behavior decreases in the future.
Schedule of Reinforcement
A rule specifying the environmental arrangements and response requirements for reinforcement; a description of a contingency of reinforcement.
Schedule of reinforcement
A rule that describes a contingency of reinforcement.
Continuous reinforcement (CRF)
A schedule in which every instance of a behavior produces reinforcement. Example: an FR1 schedule.
Compound Schedule of Reinforcement
A schedule of reinforcement consisting of two or more elements of continuous reinforcement (CRF), the four intermittent schedules of reinforcement (FR, VR, FI, VI), differential reinforcement of various rates of responding (DRH, DRL), and extinction. The elements from these basic schedules can occur successively or simultaneously and with or without discriminative stimuli; reinforcement may be contingent on meeting the requirements of each element of the schedule independently or in combination with all elements.
Tandem Schedule (Tand)
A schedule of reinforcement identical to the chained schedule except it does not use discriminative stimuli with the elements in the chain.
Fixed interval (FI)
A schedule of reinforcement in which only the first response that occurs after a certain amount of time has passed obtains reinforcement. Example: FI5 student will be reinforced after the first correct response after the 5 minutes. Scallop Effect.
Variable interval (VI)
A schedule of reinforcement in which only the first response that occurs after a variable amount of time obtains reinforcement.
Differential Reinforcement of Low Rates (DRL)
A schedule of reinforcement in which reinforcement a) follows each occurrence of the target behavior that is separated from the previous response by a minimum interresponse time or b) is contingent on the number of responses within a period of time not exceeding a predetermined criterion.
Differential Reinforcement of Diminishing Rates (DRD)
A schedule of reinforcement in which reinforcement is provided at the end of a predetermined interval contingent on the number of responses emitted during the interval being fewer than a gradually decreasing criterion based on the individual's performance during previous intervals.
Conjunctive schedule (conj)
A schedule of reinforcement in which reinforcement occurs when the requirements of both a ratio schedule and an interval schedule are met. Example: Work for 5 minutes AND answer 20 questions.
Alternative schedule (alt)
A schedule of reinforcement in which reinforcement occurs when the requirements of either a ratio schedule or an interval schedule is met, regardless of which schedule is met first. Example: Work for 5 minutes OR answer 20 questions.
Intermittent schedule of reinforcement (INT)
A schedule of reinforcement in which some, but not all, occurrences of a behavior are reinforced.
Variable ratio (VR)
A schedule of reinforcement in which the number of responses required to obtain reinforcement varies around a particular number. example: slot machine, don't know when reinforcement will be given.
Fixed Interval (FI)
A schedule of reinforcement in which the reinforcement is delivered for the first response emitted following the passage of a fixed duration of time since the last response was reinforced.
Differential Reinforcement of High Rates (DRH)
A schedule of reinforcement in which the reinforcement is provided at the end of a predetermined interval contingent on the number of responses emitted during the interval being greater than a gradually increasing criterion based on the individual's performance in previous intervals.
Concurrent Schedule (Conc.)
A schedule of reinforcement in which two or more contingencies of reinforcement operate independently and simultaneously for two or more behaviors.
Fixed Ratio (FR)
A schedule of reinforcement requiring a fixed number of responses for reinforcement.
Variable Ratio (VR)
A schedule of reinforcement requiring a varying number of responses for reinforcement.
Concurrent schedule (conc)
A schedule of reinforcement that occurs when two or more contingencies of reinforcement operate independently and simultaneously for two or more behaviors. Example: Choice making. Give the student the option to either play on the computer or watch a you tube video.
Continuous Reinforcement (CRF)
A schedule of reinforcement that provides reinforcement for each occurrence of the target behavior.
Variable Interval (VI)
A schedule of reinforcement that provides reinforcement for the first correct response following the elapse of variable duration of time occurring in a random or unpredictable order
Fixed ratio (FR)
A schedule of reinforcement that requires the completion of a certain number of responses before obtaining reinforcement. example: Every 10 correct responses, reinforcement FR10
Chained Schedule of Reinforcement (a.k.a., Chain)
A schedule of reinforcement which the response requirements of two or more basic schedules must be met in a specific sequence before reinforcement is delivered; a discriminative stimulus is correlated with each component of the schedule.
Progressive Schedule of Reinforcement
A schedule that systematically thins each successive reinforcement opportunity independent of the individual's behavior.
Limited Hold
A situation in which reinforcement is available only for a finite time following the lapse of an FI or VI interval--if the target response does not occur within the time limit, reinforcement is withheld and new interval begins.
Postreinforcement pause
After reinforcement is delivered in an FR or FI schedule of reinforcement, a pause in responding occurs. Example: FR is steps and the FI is scallop. This helps with satiation in reinforcement.
alt vs conj: what's the difference?
Alt: if EITHER contingency is met, consequence is delivered. Conj: only if BOTH contingencies are met with the consequence be delivered.
Compound schedule of reinforcement
Any schedule of reinforcement that combines two or more schedules of reinforcement (e.g. CRF, FR, FI, VR, VI, DRL, DRH, EXT).
Maximum ratio is determined by (4 factors)
Baseline rate of responding and reinforcement, MO, reinforcer quality, ratio change procedures.
Adjunctive Behaviors
Behavior that occurs as a collateral effect of a schedule of periodic reinforcement for other behavior; time-filling or interim activities (e.g., doodling, idle talking, smoking, drinking) that are induced by schedules of reinforcement during times when reinforcement is unlikely to be delivered. Also called schedule-induced behavior.
Adjunctive behaviors
Behaviors other than the target behavior that are produced as a side effect of schedules of reinforcement. example: professional puts someone on a reinforcement schedule, when that reinforcement schedule stops, that person has side effects such as smoking more, drinking more etc.
Compound Schedules of Reinforcement: 4 elements
CRF, intermittent schedules of reinforcement (FR, VR, FI, VI) differential reinforcement of various rates of responding (DRL, DRH, DRD) and Extinction
Schedule Thinning
Changing a contingency of reinforcement by gradually increasing the response ratio or the extent of the time interval; it results in a lower rate of reinforcement per responses, time, or both.
conc
Concurrent schedule of reinforcement
The 2 boundaries of schedules of reinforcement
Extinction and continuous reinforcement - all schedules of reinforcement fall somewhere between these two.
FI vs FR rate of responding: which is more consistant?
FR (there is a pause, then a consistant rate of responding, with FI you get the scallop effect - increased rate of responding that peaks at the end of the interval when reinforcement is delivered)
If the postreinforcement pause is a problem, should you use an FI or FR schedule?
FR- you may still get a pause but it will be less.
Schedule thinning
Gradually increasing the number of responses before reinforcement occurs or gradually increasing the duration of the interval before the first response is followed by reinforcement. Example: VR4 to VR6
A larger FI produces a greater or lesser rate of responding?
Lesser
Longer FI schedules lead to longer or shorter postreinforcement pauses?
Longer
A larger VI leads to higher or lower rates of responding?
Lower (the larger the Variable interval, the lower the rate of responding)
mix
Mixed schedule: similar to mult but with the same sd
Ratio strain
Occurs when a schedule of reinforcement is thinned too quickly and produces the same effect as extinction. Example: Too many demands.
Limited Hold
On an interval schedule of reinforcement, Fixed or Variable, the target response must occur within a specified time following the end of the interval where responding was not reinforced.
Alternative Schedule (alt)
Provides reinforcement whenever the requirement of either a ratio schedule or an interval schedule is met, regardless of which of the component schedule's requirements is met first.
Which conc leads to a difference in the rate of responding between the concurrent schedules, Interval or Ratio?
Ratio: the learner tends to meet the requirement of the more richly reinforced contingency. With concurrent Interval schedules, learners tend to meet the contingency requirements at an equal rate.
Conjunctive Schedule
Reinforcement follows the completion of response requirements for both a ratio and an interval schedule of reinforcement.
Differential reinforcement of diminishing rates (DRD)
Reinforcement occurs only at the end of a pre-determined time interval when the number of responses is less than a criterion that is gradually decreased. example: want to decrease behavior
Differential reinforcement of high rates (DRH)
Reinforcement occurs only when the rate of responding is higher than a predetermined criterion. example: want to increase behavior
Differential reinforcement of low rates (DRL)
Reinforcement occurs only when the rate of responding is lower than a predetermined criterion.
tand
Tandem schedule: Identical to a chain schedule with another schedule that is connected to the chain. 5 step chain Ex: tand FR 5 FI 30 sec. ex: 5 steps to wash hands then leave bathroom within 30 seconds for reinforcement.
Post-Reinforcement Pause
The absence of responding for a period of time following reinforcement; an effect commonly produced by fixed interval (FI) and fixed ratio (FR) schedules of reinforcement.
Matching Law
The allocation of responses to choices available on concurrent schedules of reinforcement; rates of responding across choices are distributed in proportions that match the rates of reinforcement received from each choice alternative.
Chained Schedule
The completion of one contingency is immediately followed by the next in a predetermined chain. Conditioned reinforcement for the first behavior in the chain is the SD for the next behavior in the chain and so on until the last response produces the terminal reinforcement. (Cooper Ex is tuning a bike, pg 319)
Matching law
The rate of responding in concurrent schedules is typically proportional to the rate of reinforcement received from each choice alternative. Example: Will choose to behave in the high probability behavior to gain reinforcement.
Progressive schedule of reinforcement
To attempt to take out reinforcement. It has to be done gradually. Start with every minute give reinforcement then go up to two minutes, then 3, then so on.
"Conc" Concurrent Schedules
Two or more contingencies of reinforcement operating independently and at the same time for two or more behaviors. Can be used in interventions and preference assessments
Multiple schedule of reinforcement
Two or more schedules of reinforcement for one class of responses that occur at different times with different Discriminated Stimuli and Reinforcement Schedules. EX: one schedule is reciting math facts in DTT with 1:1 tutor for Tokens on a FR-5 schedule and the other schedule is reciting math facts chorally in the classroom with the teacher reinforced with a Full Session group contingency of FR-20 for early recess.
Mixed schedule of reinforcement
Two or more schedules of reinforcment occur in alternating random sequnece but no SD is corrolated with the presence or absence of each element
Which typically produces a higher rate of responding: VR or FR schedules?
VR
Limited hold
When added to a FI or VI schedule of reinforcement, limits the amount of time given for the first response at the end of the interval to occur in order to obtain reinforcement. Example: student has a waiting program, they must wait for reinforcement for a certain amount of time before they can receive it. If they try to gain access to reinforcement before time is up, the time starts over and they have to wait again. Example: when dialing a phone number, the duration between each number dialed has a limited time. If the person is too slow to dial, the number will not work.
Mixed schedules of reinforcement
Which schedule of reinforcement presents two or more basic schedules of reinforcement in an alternating (usually random) sequence usually occurring successively and independently with no correlated discriminative stimuli?
Fixed Ratio
Which schedule of reinforcement produces a post-reinforcement pause?
Does the size of the ratio in a VR schedule have the same effect as the size of the ratio in an FR schedule?
Yes. With both schedules and increased ratio increases the rate of responding (caveat: as long as the initial ratio and subsequent increases are appropriate)
Schedule of reinforcement
a rule describing how when and why reinforcement will be delivered (a rule describing a contingency of reinforcement)
mult vs conc
mult is at different times, conc is at the same time
INT Uses/Advantages
strengthens behavior, (in Cooper: "primarily during the initial stages of learning new behaviors" p305), used to maintain established behaviors