Psychology Chapter 4
- A tabula rasa (blank slate) - Inborn
- Some philosophers including Aristotle have speculated that we come into life as a ______?_______. Our lives are the process of acquiring (learning) all knowledge. - Other philosophers have proposed that we come into life with all knowledge basically ______?______ (hard-wired by biology to learn certain things over others)
Applied Behavioral Analysis
Newer term for behavior modification; use of operant conditioning principles to help clients in a clinical setting
Contiguity
Objects occur closely together thus causing an association in the mind
Learning (major focus in the 1970s, still exerts tremendous influence)
A relatively permanent change in behavior based on experience - Area most associated with America
Operant Conditioning
A type of learning in which consequences (i.e., reinforcements or punishments) determine whether a behavior will increase or decrease in its frequency or intensity is called
Shaping
ALL animal training/behavior is done through this method:
Spontaneous Recovery
After extinction trials, allow the organism rest, then re-pair CS with UCS; leads to fast learning curve
VARIABLE interval (VI 2) schedule of reinforcement.
An animal may get rewarded on the average of every two minutes, but the time could vary
FIXED interval schedule of reinforcement Ex. Many workers get paid weekly or monthly that could be translated as an FI 7 or FI 30 (days) schedule of reinforcement
Animals are rewarded after a particular period
Interval schedule of reinforcement
Animals were reinforced after a certain period of time
Puzzle Box
Apparatus built by Thorndike in which cats would be placed and try to escape.
Unconditioned Response (UCR) -- Unconditioned: not learned
Automatic response to the unconditioned stimulus
Partial reinforcement extinction effect Ex. slot machines, lottery tickets, and scratch off cards
Behavior is more persistent (continue to exist longer) under conditions of partial reinforcement than under conditions of continuous reinforcement
Law of Effect (Thorndike) - The cat would explore the puzzle box eventually find the lever that released the door and led to its escape. the time it took to find the lever the second time was greatly reduced. Eventually, the cat would escape immediately upon being placed in the box
Behavior that produces a desired outcome will be repeated - occurs because the stimulus-response bond is strengthened
Edward L. "Ted" Thorndike
In 1898, a poor American student did research on animal learning at Harvard University
Pavlov's Pouch
Cannula (thin tube) that allowed the precise measurement of gastric juices collected from research dogs
Albert Ellis and Aaron Beck (cognitive limitation)
Cognitive-behavioral theorists who made the bold statement that it is not the events in our lives that cause our distress, rather it is our thoughts and perceptions about these events that cause us misery.
Edward C. Tolman (observational learning)
Demonstrated in the 1930s that reinforcement often had more of an impact on performance than on learning.
Teaching Machine
F. B. Skinner believed that students should read the chapter, take a test on it, and proceed when they could pass a certain criterion. It was a programmed system of instruction (PSI) --> no lectures
Walden Two
In his book, F. B. Skinner described an experimental community whose happiness was the result of a lack of social strife (anger/conflict) and the use of operant conditioning principles in the raising of children and community government.
1. used to help severely autistic children to talk 2. allowed schizophrenic individuals to leave the hospital and live in the community 3. shape the college professor to stand in a certain position. If he stands on the left side of the room, students are bored. However, when he moves to the right, students become attentive 4. Elementary School Teachers
Examples of shaping:
- He had three groups of rats running the same maze under differing conditions. - First group received no reinforcement --> found no food (the "goal box") at the end of the laboratory maze. - Second group received reinforcement for correct performance on every single trial, and they soon learned to find the "goal box" very quickly. - Third group received no reinforcement on the first 10 days, they simply were allowed to run the maze. Then on Day 11, they were reinforced with a goal box. They showed a spectacularly fast learning curve and caught up with the continuously reinforced group almost immediately. Apparently, they had already learned the maze by forming cognitive maps.
Explain Edward C. Tolman's experiment:
White rat (CS) then banged two iron bars together to make a loud noise. The loud noise (UCS) automatically led to the response of fear and crying (UCR). After only six conditioning trials, merely the sight of the white rat (CS) evoked the response of fear, an attempt to escape the situation, and crying (CR) --> classically conditioned and stimulus generalization USC (noise) ---- UCR (cry) -----> CR CS (white rat) ---- oriented response
Explain Little Albert situation in terms of unconditional and conditional:
- 99% of the population knows that very soft and subtle music was a cue for the arrival of a killer shark BUT BEFORE THAT were screams of fear 1. UCS (killer shark) --- UCR (scream) - discovered, the UCS is usually paired with the CS (music) and the CR is the screaming 2. CS (music) ---- orientating response (grabbing attention by hearing it)
Explain the 1975 movie Jaws based on the book by Peter Benchle (shark, cry, music):
Positive Reinforcement Ex. A teacher tells a joke and the students laugh (reward). Because of positive reinforcement the teacher is much more likely to tell a joke. Ex. A baby cries and the parents rush to sooth them. Their caring attention (reward) has become a positive reinforcement for crying in the child
Follow a behavior with a reward to increase the probability of the behavior
- Positive Reinforcement - Negative Reinforcement - Positive Punishment - Negative Punishment
Four possible contingencies:
Dave Letterman
Has been showing "Stupid Pet Tricks" for 30 years on his late night talk show. He has been the recipient of a lot of shaping. - Ex. dog that was trained to buy beer from a grocery store for its owner
B. F. Skinner
He taught his pigeons to play ping pong and invented the cumulative recording device for animals
Albert Bandura
His investigation of children's interaction with an inflatable knockdown Bobo Doll; those children who witnessed aggressive behavior in others were more likely to demonstrate it themselves (observational learning)
- Usually a dramatic shot down a long hall and the music gets louder/longer. The audience expects a major event, but the music stops and nothing happens. However, without warning, something happens. - By the time you have heard, "These jeans . . ." you have already stopped listening realizing it is a commercial. Many modern commercials will show people talking about something interesting before they pan down to the Dockers logos on their pants.
How do horror/thriller directors go about with classical conditioning? What about commercials using classical conditioning?
The best way to learn a foreign language is when one is IMMERSED IN A CULTURE. Everything about the environment is a cue for what the word means. When these cues are gone and you are not practicing the language every day, it is easy to forget. However, spontaneous recovery occurs when you relearn the language in a short time, with or without the cues.
How does spontaneous recovery apply to learning a foreign language?
The animal will eventually stop responding altogether. From a superficial standpoint it looks as if learning has never occurred
If you continue with extinction, what will happen to the animal?
Reinforcement
Increases the probability of the original behavior
Black Box (cognitive Limitation)
Influence of the organism; unnecessary in S—R psychology
Biological limitations - it is easier to get pigeons to peck for food or flap their wings (natural responses) than it is to get them to sing (unnatural response). Most of the animal responses that are easy to train are those that serve an evolutionary purpose or are adaptive for the animal.
It is easier to train animals to do certain behaviors in their innate behavioral repertoire (born/natural) than it is to train unnatural behaviors AND most human phobias are adaptive in small amounts
- Model: behaviorism - Therapeutic approach: applied behavior analysis
Learning is a highly research-oriented version of psychological science that often employs animal models discovered in the laboratory. It led to the model of psychology known as ______?_____ and the therapeutic approach of ___________?___________.
- Cognitive limitations - Biological limitations - Observational learning limitations
Learning theory has 3 experienced limitations:
Negative Reinforcement
Listed as one of the most misunderstood concepts in psychology (right next to the differences between a psychologist and a psychiatrist)
Punishment
Long and controversial history; a consequence that DECREASES the probability of the original behavior
Behaviorism
Model of psychology employing learning principles and classical/operant conditioning
Positive Punishment Ex. If a student asks a question in the class and the professor belittles her, question-asking behavior usually decreases.
One follows the behavior with an aversive stimulus to DECREASE the probability of that behavior
Continuous Reinforcement Ex. vending machine is very effective when it gives you your chips every time you put in your money. However, you would stop paying very quickly if it did nothing after you put in your money.
One gets a reward every time the desired behavior is performed - more effective at establishing a NEW behavior - downside: the behavior drops out very quickly once it is not reinforced.
Scratch off lottery tickets
One of the real unknown addictions of many college students
Modeling
One performs behaviors by watching others perform them
1. Animal must act (not wait till paired like CC) 2. Reinforcement or punishment is contingent (depending) on behavior 3. Voluntary behavior (emitted not elicited)
Operant Conditioning is different from classical conditioning because it (3)....
- When fed - When a person first entered a room - In response to various sounds (footsteps towards bowl)
Pavlov changed his life at age 50 because he discovered "psychic secretions" in dogs. When did they salivate?
Classical Conditioning - What leads to what?
Pavlov's elaboration on the Locke model of association. At its core, its places great importance on the idea of contiguity.
Learning
Pavlov's work became the foundation of the subspecialty of psychological science known as....
Negative Punishment Ex. a young graduate was having difficulty getting his dissection (degree) completed. His friends said anytime he submitted an assignment late, they would burn his first edition books. He missed his first assignment and his friends burned a book. He never missed another assignment after that
Penalty, one follows the behavior with the removal of something good to DECREASE the probability of that behavior
Variable Ratio
People are very persistent with slot machines, lottery tickets, and scratch off cards. These are examples of which of the following types of reinforcement?
Acquisition phase of learning - the conditioned response (CR) is virtually the same as the unconditioned response (UCR), it is simply exhibited in response to the conditioned stimulus (CS)
Process of classical conditioning from original UCS to CR
John Locke
Proposed the Law of Association in the 17th century
Zeitgeist of American academia
Psychological science's insistence on precise measurement of observable stimuli fit the __________?__________ and resulted in thousands of publications on observable behavior. - successful both in the laboratory and in the clinic.
Ivan Pavlov ("Absent Minded Professor")
Russian physiologists who developed the idea of classical conditioning using "Pavlov' Pouch". He received the Noble Prize in digestion in 1904 at about 50 years of age (20th century)
B. F. Skinner
Second most recognizable psychologist in the world
Conditioned Response (learned)
Similar to the unconditioned response but it is a learned response to the conditioned stimulus
Baby Tender (F. B. Skinner)
Skinner's larger version of an operant chamber for infants; designed to be sold to the general public (sales did not increase)
Unconditioned Stimulus (UCS) --Unconditioned: not learned
Starts with a stimulus that automatically leads to the unconditioned response
B. F. "Fred" Skinner
Stated that in Thorndike's examples of the cats, behavior "operates" on the environment and the animal learns from its contingencies
1. USC (food) ---- UCR (salivate) 2. Neutral Stimulus (bell) -- USC (food) -- UCR (salivate) (Neutral stimulus becomes conditioned) 3. CS (bell) --- CR (salivation) conditioned: learned
Steps of Classical Conditioning (salivate, food, bell)
Stimulus Discrimination Ex. dog responds to wife (for food) but not to the husband
The animal exhibits a response to one stimulus but not to another similar stimulus
Ratio schedule of reinforcement
The animal is rewarded after a certain number of times the behavior occurs
FIXED ratio schedule of reinforcement Ex. a factory worker may be paid after he has constructed 50 wagons --> FR 50 schedule
The animal is rewarded after a particular number of times the behavior occurs.
VARIABLE ratio schedule of reinforcement Ex. a factory worker could be on an IR 50 schedule of reinforcement in which he gets paid after an average of 50 wagons; however, he may get paid after 25 or 75 Ex. slot machines and lottery tickets
The animal is rewarded on the average of a certain number of times the behavior occurs
Behavior Modification - helps overcome maladaptive behaviors, fears, and anxieties
The application of operant conditioning principles
Adaptive: fear of hot stove --> fear of all stoves because you learn that they are all hot and dangerous
The more similar the stimulus, the stronger the response. Give an example...
orienting response
The neutral stimulus only gets your attention or, in Pavlov's terms, it produces an _______?______.
Skinner Chamber (F. B. Skinner)
The operant chamber for rats in which the researcher could easily record the animal's behavior
Cognitive Maps
Tolman's idea of what rats were developing while running the maze
Latent Learning
Tolman's term for learning without reinforcement
1. Classical Conditioning 2. Operant Conditioning.
Two forms of learning:
Extinction Ex. Imagine if you presented the bell without the food or if you repeatedly played the Jaws music without the shark
Undo conditioning/acquisition (learned skill) --> When one presents the CS without the UCS; leads to a decrease in responding
Mary Cover Jones - demonstrated that you could use the same classical conditioning principles to undo the fear of a rabbit in a three-year-old boy by the name of Little Peter. (decondition/uncondition)
Watson had intended to undo the phobic learning in Little Albert B. by using the same classical conditioning principles; however, the boy's mother moved away from the hospital before this could take place. What psychologist experimented his idea?
Conditioned Stimulus (learned)
With repeated trials, it is learned to predict the unconditioned stimulus and leads to the conditioned response
Law of Association (John Locke) - 17th century Ex. toilet flushing, water pressure change, and hot/cold water. You learned that the events went together and in that order.
We acquire knowledge about the world through associating ideas that occur closely together.
Psychologists went on a quest to locate the boy, but sadly he passed away at age five from a serious illness
What ever happened to Little Albert B?
- He was unable to obtain lab space for his work on chickens so he hid the chickens in his (no pets allowed) apartment - His landlord found the fowl and kicked him out - He told his story to WILLIAM JAMES who took pity and allowed him into his home - Thorndike changed from chickens (cost $) to free stray away cats - William James children liked him because he always had animals to play with
What happened to E.L Thorndike?
He was robbed of his suitcase in the train station
What happened to Pavlov when he arrived in New York City.
We gain knowledge through divine means (God) and rational means (reason/logic)
What have some philosophers hypothesized how we acquire information:
Direct conditioning - two stimuli presented simultaneously Rabit :( + Food :) = (bringing together) happy child
What was Mary Cover Jones method and what does it mean?
Fish, friends, and freedom (3 F's)
What was the puzzle box motivated by?
Stimulus Generalization Ex. my fear of dogs
When you learn a response to one stimulus but you also perform it to other, similar stimuli.
Partial Reinforcement Ex. bamo-bina pizza study, casino
You do not get rewarded (or punished) every time the behavior occurs - resistant to extinction (dropping out) - most of nature works this way (life)
Observational Learning
You do not have to experience the reinforcement or punishment directly, you can learn the consequences of certain actions by watching their contingencies on others.
Negative reinforcement Ex. Ibuprofen removes the aversive stimulus (headache), so our likelihood to use the medication as well as to use it in greater strength has increased
You follow the behavior with the removal of an aversive stimulus to INCREASE the probability of that behavior - NOT a punishment
Continuous Reinforcement
You get a reward every time you perform a desired behavior - get fast acquisition
The water temperature will either get really hot or really cold. - How do we know this IN ADVANCE (when we all come from different backgrounds and experience different things)
You move into a new apartment and the first thing you do is take a shower. Your roommate decides to flush the toilet three times. At that exact moment you feel a change in the water pressure and you move out of the path of oncoming water. Why?
Shaping - Must be patient, it takes TIME
You reward (positively reinforce) closer and closer approximations to the desired behavior.