psych book

as a stimulus or event that increases the liklihood that behavior will be repeated.

reinforcement

one that has been paired with a primary reinforcer and through classical conditioning has acquired value and reinforcement

secondary reinforcer

as i said in the first question. the sound of a tuning fork does not cause salivation. The dog had to be taught or ________ to associate this sound with found

conditioned

the salivation which the ordinarily neutral event caused is the

conditioned response. (a conditioned response is learned) the dog learned to salivate after he was trained to think that food will come when he hears the bell

an ordinarily neutral event that, after training, leads to a response such as salivation is a

conditioned stimulus

behavior that is reinforced every time it occurs is said to be on a

continuous schedule

the ability to respond differently to different stimuli example: Pavlov taught the dog to respond only to the circle by always pairing meat powder with the circle but never pairing it with the oval.

discrimination

occurs when an animal responds to a second stimulus similar to the original conditioned stimulus without prior training with the second stimuli. example: when pavlov conditioned a dog to salivate at the sight of a circle (the CS), he found that the dog would salivate when it saw ano oval as well. The dog had responded to the oval similarly to the way it responded to the circle.

generalization

give an example of a great secondary reinforcers

money. you have learned that getting money is associated with buying food or material things

some examples of events that may serve as conditioned stimuli for salivation are

the sight of the food, an experimenter entering the room, the sound of a tone, or a flash of light

an experimenter wolfe demonstrated primary and secondary reinforcers with chimpanzees he made poker chips become valuable to the chimps. he provided with the animals with a chimp O mats that dispensed peanuts or banans which are primary reinforcers. to obtain food, the chimps had to pull down on a heavily weighted bar to obtain poker chips, then insert the chips in a slot in the machine. with repetition, the poker chips became conditioned reinforcers. (in notes. also on pg. 252)

(not a question)

example of partial schedule a rat learns to press a bar most rapidly when it receives food each time it does so. when the rat stops receiving food each time it presses the bar, however, it quickly stops its bar pressing. behaviors that are acquired on partial schedules of reinforcement are established more slowly but are more persistent. for example, a rat that is only sometimes rewarded with food for pressing a bar will continue to press even though no food appears. when reinforced on partial schedules one cannont always predict when the next reinforcement will occur, so they learn to be persistent in the skinner box experiment, skinner found that the rats kept responding even though they were reinforced randomly. in fact, the rats responded with even greater endurance

(not a question)

if a rest period is given following extinction, the CR may reappear when the CS is presented again but notfollowed by a UCS. this is called spontaneous recovery. spontaneous recovery does not bring the CR back to its orignal strength. example: Pavlov's dogs produced much less saliva during spontaneous recovery than they did at the end of their original conditioning. Alternating lengthy rest periods and the tone without food caused more rapid loss of salivation each time and less recovery the next time the CS was presented.

(not a question)

know about classical conditioning in the case with Little albert. the bed wetting experiment the taste aversion: eating something and getting sick later and blaming it on what you ate. the example with the rats drinking the water that made them sick (these were in our notes. It's also on pg. 246-247 in book)

(not a question)

the ordinarily neutral event was the ring of the fork and the presentation of the food (and after training) the training caused the dog to associate the bell with food causing to salivate when it hears the bell even before the food was pesented

(not a question)

the responses are generally more stable and last longer once they are learned. a person or animal that is continuously reinforced for a behavior tends to maintain that behavior only when the reinforcement is given. if the reinforcement stops, the behavior quickly undergoes extinction

(not a question)

scientists who is mostly associated with operant conditioning. he believed that most behavior is influenced by a person's history of rewards and punishments. he trained rats to respond to lights and sounds in a special enclosure called a skinner box

B.F Skinner

how does operant conditioning differ from classical conditioning

In classical conditioning, the experimenter presents the CS and UCS independent of the participant's behavior. The UCR is elicited. Reactions to the CS are then observed. in operant conditioning the participant must engage in a behavior in order for the programmed outcome to occur. in other words, operant conditioning is the study of how voluntary behavior is affected by its consequences.

pavlov began his experiments by ringing a tuning fork and them immediately placing some meat powder on the dog's tongue. he chose the tuning fork because it was a neutral stimulus. define a neutral stimulus

a stimulus that had nothing to do with the response to meat prior conditioning. the sound of the tuning fork did not cause the dog to salivate.

classical conditioning is an example of a _______

behaviorist theory

what are some examples of unconditioned responses

blushing, shivering, being startled, or salivating

when the conditioned response gradually dies out example: Pavlov discovered that if he stopped presenting food after the sound of the tuning fork, the sound gradually lost its effect on the dog. After he repeatedly struck the tuning fork without giving food, the dog no longer caused the salivation response

extinction

...

fixed interval schedule

a pattern of reinforcement in which a specific number of correct responses is required before reinforcement can be obtained. example: the student who receives a good grade after completing a specified amount of work a typist who is paid by the number of pages completed dentists who gets paid $75 for each cavity repaired or filled (people tend to work hard on fixed ratio schedules)

fixed-ratio schedule

in the experiment food was the unconditioned stimulus because

food was the stimulus that caused the salivation. (food normally causes salivation)

in the experiment salivation was the unconditioned response because

it happens automatically (a dog does not have to be taught to salivate when it smells meat)

positive reinforcer

learning something by getting a reward for it

4 basic methods of intermittent reinforcement/partial schedule

number :of correct responses that the animal makes between reinforcement ratio schedule: amount of time that elapses before reinforcement is given interval schedule: ? fixed: or predictable schedule variable: unpredictable schedule

negative reinforcer

occurs when something unpleasant is taken away

learning in which a certain action is reinforced or punished, resulting in corresponding increases or decreases in occurrence. example: your dog is wandering around the neighborhood, sniffing around. A neighbor sees the dog and tosses a bone out the kitchen door to it. the next day the dog is likely to stop at the same door on its rounds. if your neighbor continues to give a bone every time the dog will become a regular visitor to that neighbor

operant conditioning

positive reinforcement occurs only intermittently is said to be on a

partial schedule

other examples of secondary reinforcers

praise, status, and prestige all these items are associated with a primary reinforcer and have acquired value, so they reinforce certain types of behavior when used

one that satisfies a biological need such as hunger, thirst or sleep

primary reinforcer

is a process in which reinforcement is used to sculpt new responses out of old ones. an experimenter can use this method to teach a rat to do something it has never done before and would never do by itself example: the video showed in class about the bird learning to turn in a full circle. each time it turned in the right direction (to make the circle) it was rewarded with food.

shaping

what are some examples of reinforcers that people usually

social approval, money and extra priveleges

after only a few times, the dog started salivating as soon as it heard the sound, even if the food was not placed in its mouth. what did pavlov conclude about this

that a neutral stimulus (the tuning fork or it's ring) can cause a formerly unrelated response. this occurs if it is presented regularly just before the stimulus (food) that normally brings about that response (salivation) IN OTHER WORDS if the neutral stimulus is often presented before the stimulus, it causes a response.

whether or not a particular stimulus is a reinforcement depends on

the effect the stimulus has on the learner

what is an important factor in operant conditioning

timing and frequency of reinforcement

pavlov used the term _________ to refer to stimuli and to the automatic involuntary responses they caused

unconditioned

a reaction that occurs naturally and automatically when the unconditioned stimulus is presented. sort of like a reflex

unconditioned response

an event that leads to a certain, predictable response usually without any previous training.

unconditioned stimulus

...

variable interval schedule

the number of responses needed for a reinforcement changes from one time to the next. since reinforcement is unpredictable, there is typically no pause after a reward because it is possible that a reward will occur on the very next response example: slot machines are a goood example. they are set to pay off after a varying number of attempts at pulling the handle. door to door salespeople and individuals who do telephone surveys are operating on this system since they don't know how many doorbellls they will have to ring or call to make before they make a sale or find someone who will answer the survey

variable ratio schedule

what is spontaneous recovery

when the conditioned response occurs again after a rest period