psych book
as a stimulus or event that increases the liklihood that behavior will be repeated.
reinforcement
one that has been paired with a primary reinforcer and through classical conditioning has acquired value and reinforcement
secondary reinforcer
as i said in the first question. the sound of a tuning fork does not cause salivation. The dog had to be taught or ________ to associate this sound with found
conditioned
the salivation which the ordinarily neutral event caused is the
conditioned response. (a conditioned response is learned) the dog learned to salivate after he was trained to think that food will come when he hears the bell
an ordinarily neutral event that, after training, leads to a response such as salivation is a
conditioned stimulus
behavior that is reinforced every time it occurs is said to be on a
continuous schedule
the ability to respond differently to different stimuli example: Pavlov taught the dog to respond only to the circle by always pairing meat powder with the circle but never pairing it with the oval.
discrimination
occurs when an animal responds to a second stimulus similar to the original conditioned stimulus without prior training with the second stimuli. example: when pavlov conditioned a dog to salivate at the sight of a circle (the CS), he found that the dog would salivate when it saw ano oval as well. The dog had responded to the oval similarly to the way it responded to the circle.
generalization
give an example of a great secondary reinforcers
money. you have learned that getting money is associated with buying food or material things
some examples of events that may serve as conditioned stimuli for salivation are
the sight of the food, an experimenter entering the room, the sound of a tone, or a flash of light
an experimenter wolfe demonstrated primary and secondary reinforcers with chimpanzees he made poker chips become valuable to the chimps. he provided with the animals with a chimp O mats that dispensed peanuts or banans which are primary reinforcers. to obtain food, the chimps had to pull down on a heavily weighted bar to obtain poker chips, then insert the chips in a slot in the machine. with repetition, the poker chips became conditioned reinforcers. (in notes. also on pg. 252)
(not a question)
example of partial schedule a rat learns to press a bar most rapidly when it receives food each time it does so. when the rat stops receiving food each time it presses the bar, however, it quickly stops its bar pressing. behaviors that are acquired on partial schedules of reinforcement are established more slowly but are more persistent. for example, a rat that is only sometimes rewarded with food for pressing a bar will continue to press even though no food appears. when reinforced on partial schedules one cannont always predict when the next reinforcement will occur, so they learn to be persistent in the skinner box experiment, skinner found that the rats kept responding even though they were reinforced randomly. in fact, the rats responded with even greater endurance
(not a question)
if a rest period is given following extinction, the CR may reappear when the CS is presented again but notfollowed by a UCS. this is called spontaneous recovery. spontaneous recovery does not bring the CR back to its orignal strength. example: Pavlov's dogs produced much less saliva during spontaneous recovery than they did at the end of their original conditioning. Alternating lengthy rest periods and the tone without food caused more rapid loss of salivation each time and less recovery the next time the CS was presented.
(not a question)
know about classical conditioning in the case with Little albert. the bed wetting experiment the taste aversion: eating something and getting sick later and blaming it on what you ate. the example with the rats drinking the water that made them sick (these were in our notes. It's also on pg. 246-247 in book)
(not a question)
the ordinarily neutral event was the ring of the fork and the presentation of the food (and after training) the training caused the dog to associate the bell with food causing to salivate when it hears the bell even before the food was pesented
(not a question)
the responses are generally more stable and last longer once they are learned. a person or animal that is continuously reinforced for a behavior tends to maintain that behavior only when the reinforcement is given. if the reinforcement stops, the behavior quickly undergoes extinction
(not a question)
scientists who is mostly associated with operant conditioning. he believed that most behavior is influenced by a person's history of rewards and punishments. he trained rats to respond to lights and sounds in a special enclosure called a skinner box
B.F Skinner
how does operant conditioning differ from classical conditioning
In classical conditioning, the experimenter presents the CS and UCS independent of the participant's behavior. The UCR is elicited. Reactions to the CS are then observed. in operant conditioning the participant must engage in a behavior in order for the programmed outcome to occur. in other words, operant conditioning is the study of how voluntary behavior is affected by its consequences.
pavlov began his experiments by ringing a tuning fork and them immediately placing some meat powder on the dog's tongue. he chose the tuning fork because it was a neutral stimulus. define a neutral stimulus
a stimulus that had nothing to do with the response to meat prior conditioning. the sound of the tuning fork did not cause the dog to salivate.
classical conditioning is an example of a _______
behaviorist theory
what are some examples of unconditioned responses
blushing, shivering, being startled, or salivating
when the conditioned response gradually dies out example: Pavlov discovered that if he stopped presenting food after the sound of the tuning fork, the sound gradually lost its effect on the dog. After he repeatedly struck the tuning fork without giving food, the dog no longer caused the salivation response
extinction
...
fixed interval schedule
a pattern of reinforcement in which a specific number of correct responses is required before reinforcement can be obtained. example: the student who receives a good grade after completing a specified amount of work a typist who is paid by the number of pages completed dentists who gets paid $75 for each cavity repaired or filled (people tend to work hard on fixed ratio schedules)
fixed-ratio schedule
in the experiment food was the unconditioned stimulus because
food was the stimulus that caused the salivation. (food normally causes salivation)
in the experiment salivation was the unconditioned response because
it happens automatically (a dog does not have to be taught to salivate when it smells meat)
positive reinforcer
learning something by getting a reward for it
4 basic methods of intermittent reinforcement/partial schedule
number :of correct responses that the animal makes between reinforcement ratio schedule: amount of time that elapses before reinforcement is given interval schedule: ? fixed: or predictable schedule variable: unpredictable schedule
negative reinforcer
occurs when something unpleasant is taken away
learning in which a certain action is reinforced or punished, resulting in corresponding increases or decreases in occurrence. example: your dog is wandering around the neighborhood, sniffing around. A neighbor sees the dog and tosses a bone out the kitchen door to it. the next day the dog is likely to stop at the same door on its rounds. if your neighbor continues to give a bone every time the dog will become a regular visitor to that neighbor
operant conditioning
positive reinforcement occurs only intermittently is said to be on a
partial schedule
other examples of secondary reinforcers
praise, status, and prestige all these items are associated with a primary reinforcer and have acquired value, so they reinforce certain types of behavior when used
one that satisfies a biological need such as hunger, thirst or sleep
primary reinforcer
is a process in which reinforcement is used to sculpt new responses out of old ones. an experimenter can use this method to teach a rat to do something it has never done before and would never do by itself example: the video showed in class about the bird learning to turn in a full circle. each time it turned in the right direction (to make the circle) it was rewarded with food.
shaping
what are some examples of reinforcers that people usually
social approval, money and extra priveleges
after only a few times, the dog started salivating as soon as it heard the sound, even if the food was not placed in its mouth. what did pavlov conclude about this
that a neutral stimulus (the tuning fork or it's ring) can cause a formerly unrelated response. this occurs if it is presented regularly just before the stimulus (food) that normally brings about that response (salivation) IN OTHER WORDS if the neutral stimulus is often presented before the stimulus, it causes a response.
whether or not a particular stimulus is a reinforcement depends on
the effect the stimulus has on the learner
what is an important factor in operant conditioning
timing and frequency of reinforcement
pavlov used the term _________ to refer to stimuli and to the automatic involuntary responses they caused
unconditioned
a reaction that occurs naturally and automatically when the unconditioned stimulus is presented. sort of like a reflex
unconditioned response
an event that leads to a certain, predictable response usually without any previous training.
unconditioned stimulus
...
variable interval schedule
the number of responses needed for a reinforcement changes from one time to the next. since reinforcement is unpredictable, there is typically no pause after a reward because it is possible that a reward will occur on the very next response example: slot machines are a goood example. they are set to pay off after a varying number of attempts at pulling the handle. door to door salespeople and individuals who do telephone surveys are operating on this system since they don't know how many doorbellls they will have to ring or call to make before they make a sale or find someone who will answer the survey
variable ratio schedule
what is spontaneous recovery
when the conditioned response occurs again after a rest period