Ch 13 & 14 EXAM 5
What are the 3 types of external validity?
1. Ecological 2. Historical 3. Population
quasi-experiment
A study that is similar to an experiment except that the researchers do not have full experimental control (e.g., they may not be able to randomly assign participants to the independent variable conditions).
cultural psychology
A subdiscipline of psychology concerned with how cultural settings shape a person's thoughts, feelings, and behavior, and how these in turn shape cultural settings
Meta-Analysis
A way of mathematically averaging the effect sizes of all the studies that have tested the same variables to see what conclusion that whole body of evidence supports.
matched groups
An experimental design technique in which participants who are similar on some measured variable are grouped into sets; the members of each matched set are then randomly assigned to different experimental conditions. Also called matching.
nonequivalent control group design
An independent-groups quasi-experiment that has at least one treatment group and one comparison group, but participants have not been randomly assigned to the two groups.
nonequivalent control group pretest/posttest design
An independent-groups quasi-experiment that has at least one treatment group and one comparison group, in which participants have not been randomly assigned to the two groups, and in which at least one pretest and one posttest are administered.
In _________, external validity matters much less than internal validity.
Ans: Theory-Testing Mode
In a quasi-experiment (Minke, 2011), the effectiveness of Skejby, a Danish half-way house which mixes offenders with non-offenders, was compared to that of the control condition of half-way houses housing only offenders. Measurement of the effectiveness was based on rate of recidivism of former inmates. What threat to internal validity would occur if the inmates who were sent to prision from the half-way house for violation were no included in the recidivism measurement?
Attrition
How is external validity improved?
Larger sample, Real - life settings
Replicable
Pertaining to a study whose results have been obtained again when the study was repeated.
Which of the following does not characterize a small-N design?
Researchers determine that a result is replicable by a test of statistical significance.
In a quasi-experiment (Minke, 2011), the effectiveness of Skejby, a Danish half-way house which mixes offenders with non-offenders, was compared to that of the control condition of half-way houses housing only offenders. Measurement of the effectiveness was based on rate of recidivism of former inmates. What threat to internal validity would occur if inmates were allowed to choose their own half-way house?
Selection ("choose")
How is internal validity improved?
Single and double blind technique, counterbalancing and random allocation, standardisation
Experimental Realism
The extent to which a laboratory experiment is designed so that participants experience authentic emotions, motivations, and behaviors.
Ecological Validity
The extent to which the tasks and manipulations of a study are similar to real-world contexts. Also called mundane realism.
File Drawer Problem
The idea that reviews and meta-analyses of published literature might overestimate the support for a theory, because studies finding null effects are less likely to be published than studies finding significant results, and are thus less likely to be included in such reviews.
Generalization Mode
The intent of researchers to generalize the findings from the same samples and procedures in their study to other populations or contexts. See also theory-testing mode.
What is ecological validity?
Whether the findings can be generalized to other settings
In quasi-experiments, researchers lack full experimental control. Therefore, which type of validity must they assess to make sure they can draw firm conclusions from their results? Select one: a. external b. statistical c. internal d. construct
c. internal (Internal validity in quasi-experiments cannot be assured in the same way as in a true experiment, so researchers need to closely examine the design and results of the study to ensure that internal validity is maintained.)
Gathercole and Baddeley (1990) examined phonological memory skills in children with disordered language development using two control groups, one made up of much younger children who were matched on verbal abilities. If they had done a follow-up study a year later, which type of threat to internal validity would this age difference most likely have caused? Select one: a. history b. regression c. selection d. maturation
d. maturation (In this case, because of the age differences, the younger children may have matured at a very different rate than the treatment group.)
If you repeat a study and the results are the same as the first time, what term can be used to describe the finding? Select one: a. repetitive b. obvious c. redundant d. replicable
d. replicable
Dr. Reynolds developed a treatment for social anxiety disorder. In his initial test of the treatment he found that it was effective in decreasing social anxiety symptoms in adults who only had social anxiety. Since Dr. Reynolds knows that people who have social anxiety disorder also often are depressed, he designs a second study to test whether his treatment decreases social anxiety symptoms in two different groups of people — those who have social anxiety disorder only and those who have both social anxiety disorder and depression. This second study would be a _________. Select one: a. meta-analysis replication b. direct replication c. conceptual replication d. replication-plus-extension
d. replication-plus-extension
In a quasi-experiment by Minke (2011), the effectiveness of Skejby, a Danish half-way house which mixes offenders with non-offenders, was compared to that of the control condition of half-way houses housing only offenders. Measurement of effectiveness was based on rate of recidivism of former inmates. If inmates are allowed to choose their own half-way house, which threat to internal validity would this potentially pose? Select one: a. testing b. regression c. history d. selection
d. selection (Inmates that would choose a half-way house with non-offenders may differ systematically in some way from other inmates.)
Dr. Reynolds develops a treatment for social anxiety disorder. In his first studies of his new treatment, his goal is to see if the treatment works under very controlled conditions. He only accepts patients who do not have any other disorders and randomizes the patients to his treatment and a wait-list control group. He also supervises each case very closely to ensure that the therapists are sticking to his treatment manual. This study is in ________. Select one: a. data-generating mode b. analysis mode c. generalization mode d. theory-testing mode
d. theory-testing mode
In _________, external validity matters much less than internal validity. Select one: a. experimental realism mode b. generalization mode c. analysis mode d. theory-testing mode
d. theory-testing mode
Horselenberg et al (2003) reported an experiment based on Kassin and Kieche (1996) in which the participant was falsely accused of striking a computer key that caused the data to be deleted. The earlier study showed that 69 percent of the participants were willing to sign a confession that they had struck the key. Horselenberg's study included the signed confession, which included giving up part of the participation fee. Horselenberg's study, conducted in the Netherlands, found similar results to Kassin's, conducted in the United States. What validity does this affect?
external
A study of the effects of nutrition labels on menu choices was conducted by a restaurant chain following the implementation of a city law requiring that information. The 15 main courses were chosen for study. The data for sales of the main courses for the month preceding the start of use of the new menus and the month following that start were compared. Sales figures showed that the average energy content of the purchased main courses dropped, while overall sales remained steady. What type of design is this?
interrupted time-series design
In most studies there is a trade off between experimental control and ecological validity
more control = less ecological validity, more ecological validity = less control
A psychologist is working with the parents of four children who exhibits violent behaviors toward each other. The parents have been instructed to record the number of these behaviors each child exhibits in the pre-dinner hour for one week. The parents then begin a using positive reinforcement technique to shape the behavior of the youngest child, while continuing to record. The recording continues and the technique is used on one additional child each week. By the end of six weeks, there is a significant decrease in violent decrease in violent behavior for each of the child. What type of design is this?
stable/multiple
Associated with generalisability
the extent to which findings can be generalised to the real world is dependent on ecological validity
wait-list design
A quasi-experiment in which all participants plan to receive treatment, but are assigned to do so at different times.
interrupted time-series design
A quasi-experiment in which participants are measured repeatedly on a dependent variable before, during, and after the "interruption" caused by some event
nonequivalent control group interrupted time-series design
A quasi-experiment with two or more groups in which participants have not been randomly assigned to groups; participants are measured repeatedly on a dependent variable before, during, and after the "interruption" caused by some event; and the presence or timing of the interrupting event differs among the groups.
Field Setting
A real-world setting for a research study.
conceptual replication
A replication study in which researchers examine the same research question (the same conceptual variables) but use different procedures for operationalizing the variables. See also direct replication, replication-plus-extension.
direct replication
A replication study in which researchers repeat the original study as closely as possible to see whether the original effect shows up in the newly collected data. Also called exact replication. See also conceptual replication, replication-plus-extension
Replication-Plus-Extension
A replication study in which researchers replicate their original study but add variables or conditions that test additional questions. See also conceptual replication, direct replication.
Theory-Testing-Mode
A researcher's intent for a study, testing association claims or causal claims to investigate support for a theory. See also generalization mode.
Scientific Literature
A series of related studies, conducted by various researchers, that have tested similar variables. Also called literature.
reversal design
A small-N design in which a researcher observes a problem behavior both before and during treatment, and then discontinues the treatment for a while to see if the problem behavior returns.
stable-baseline design
A small-N design in which a researcher observes behavior for an extended baseline period before beginning a treatment or other intervention; if behavior during the baseline is stable, the researcher is more certain of the treatment's effectiveness.
multiple-baseline design
A small-N design in which researchers stagger their introduction of an intervention across a variety of contexts, times, or situations
small-N design
A study in which researchers gather information from just a few cases.
single-N design
A study in which researchers gather information from only one animal or one person.
Dr. Joseph thinks that most people are generally trusting of strangers. He did a study at his university in the United States to test this idea, and the results confirmed his hypothesis. Dr. Joseph is discussing the results of this study with a friend who is a psychology researcher in China, Dr. Ming. Dr. Ming thinks that people in Eastern cultures, such as China, are less trusting of strangers than people in Western cultures, such as the United States. Dr. Joseph and Dr. Ming decide to run a second study where they have a group of participants in China and a group of participants in the United States both complete the task used in Dr. Joseph's study. This second study is an example of ______________. Select one: a. Cultural Psychology b. Cognitive Psychology c. Developmental Psychology d. Clinical Psychology
a. Cultural Psychology
_________ is a subdiscipline of psychology that is primarily in generalization mode. It examines how cultural contexts shape the way a person thinks, feels, and behaves. Select one: a. Cultural psychology b. Clinical psychology c. Cognitive psychology d. Replicable psychology
a. Cultural psychology
Mark conducts a study for his research methods class to determine if consuming caffeine causes people to perform better on cognitive tasks. In his study, he gives half of his participants a glass of water and half of his participants a glass of cola, and then has them attempt to solve 15 math problems. He finds that people who drink caffeine beforehand solve more math problems than those who drink water beforehand. Mark decides to conduct a conceptual replication. Which of the following could be in the study to make it this type of replication? Select one: a. Having participants drink a caffeinated energy drink rather than a caffeinated cola b. Measuring the same participants one week later c. Measuring a different group of participants d. Having participants complete 10 math problems instead of 15
a. Having participants drink a caffeinated energy drink
Cindy decides to conduct a meta-analysis examining the relationship between daily stress and cardiovascular health for her senior psychology research project. Which of the following is NOT a step Cindy will do in conducting her meta-analysis? Select one: a. Measure daily stress and cardiovascular health in several new samples of participants b. Collect all the studies that have been conducted on daily stress and cardiovascular health c. Contact other researchers for unpublished studies d. Calculate an effect size
a. Measure daily stress and cardiovascular health in several new samples of participants.
Which of the following does NOT characterize a small-N design? Select one: a. Results are analyzed in terms of statistical significance. b. Researchers collect a lot of information on relatively few cases c. Individuals' data are presented, as opposed to comparing group averages. d. Each participant is treated as a separate experiment.
a. Results are analyzed in terms of statistical significance. (Small-N does not allow tests of statistical significance; instead the replicability is found by repeating the experiment with a new participant.)
Julie works at a large gym. She wants to do a study of the effect of having a personal trainer on self-esteem and mood. She collects a list of members at her gym who would like to have a personal trainer. She assigns half of them to have a trainer right away and half of them to wait several months before being assigned a trainer. She measures self-esteem and mood in all of the participants over the next several months when only one of the groups would have a trainer. What advantages does Julie's design have over selecting a group of people at the gym who were already using personal trainers and a group who were not using trainers? Select one: a. She is preventing a selection effect. b. She is preventing a maturation threat. c. She is preventing a regression to the mean. d. She is preventing a history threat.
a. She is preventing a selection effect. (By using a wait-list design, Julie is preventing a selection effect because there may be preexisting differences between people who are already using personal trainers and those who are not.)
Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). In addition to measuring the body concern of the participants who joined a fraternity/sorority both immediately before and immediately after they join, Dr. Fletcher measures them for the three weeks before and the three weeks after. This type of design would be able to better address which of the following threats to internal validity? Select one: a. Testing b. History c. Selection-history d. Experimenter bias
a. Testing
Which of the following is an example of a field setting? Select one: a. a preschool playground with video cameras b. a biology lab with galvanic skin response detectors c. a psychology lab with EEG apparatus d. a neuropsychological lab with an MRI machine
a. a preschool playground with video cameras
A school district is comparing two reading programs for high school students reading below grade level. Two very similar schools are used to test the programs, a different one at each school. Students participating in the programs are pretested for their reading abilities and the mean scores are similar at both schools. The reading program implemented at High School A is known to be much more rigorous than the program implemented at High School B. The posttest shows more improvement at High School A, but more of the students dropped out of the program. What threat to internal validity does this pose? Select one: a. attrition b. history c. maturation d. selection
a. attrition (Students dropped out of the more rigorous program at a higher rate. This may have caused the improvement in the posttest mean score for High School A.)
Roediger and McDermott (1995) conducted a study involving a paradigm initially developed by Deese (1959) which produces false recall of a word when a participant is given a list of words to recall which centers on a particular word but does not include it. For example, if participants were given a list that included sandal, towel, sunscreen, and waves, then they would falsely remember the word beach even though it was not on the list. They did two studies based on Deese's original study. In the first study, they used the same word lists that Deese used and in the second experiment they used new sets of stimulus words. What is the term for the first study they ran? Select one: a. direct replication b. meta-analysis replication c. conceptual replication d. replication-plus-extension
a. direct replication
A company that owned several hospitals in rural areas of the south went bankrupt and closed the hospitals it operated over a period of a couple of months. Researchers became aware of this situation and used public health records to document average age at death of residents in those communities where the hospitals closed and in communities that were matched on several variables but did not lose their hospitals. The researchers collected death records for several years before and after the closure of these hospitals to look at the effect the closure had on life expectancy. What kind of research design are the researchers using? Select one: a. nonequivalent control group interrupted time-series design b. nonequivalent control group pretest/posttest design c. nonequivalent control group design d. interrupted time-series design
a. nonequivalent control group interrupted time-series design (Television Access and Crime Rates - In nonequivalent control group interrupted time-series design the independent variable is studied both as a repeated-measures variable and as an independent-groups variable.)
If you repeat a study and the results are the same as the first time, what term can be used to describe the finding? Select one: a. replicable b. obvious c. repetitive d. redundant
a. replicable
Dr. Joseph thinks that most people are generally trusting of strangers. He did a study at his university in the United States to test this idea, and the results confirmed his hypothesis. Dr. Joseph is discussing the results of this study with a friend who is a psychology researcher in China, Dr. Ming. Dr. Ming thinks that people in Eastern cultures, such as China, are less trusting of strangers than people in Western cultures, such as the United States. Dr. Joseph and Dr. Ming decide to run a second study where they have a group of participants in China and a group of participants in the United States both complete the task used in Dr. Joseph's study. This second study is a ____________. Select one: a. replication-plus-extension b. meta-analysis replication c. direct replication d. conceptual replication
a. replication-plus-extension
Following implementation of a new city law, a restaurant chain began displaying the nutrition labels for their menu items. The restaurant owner recorded sales of the 15 highest-calorie menu items on three occasions—once the month before the change in menu display, once the week of the change in menu display, and once the month after the change in menu display. The owner observed that the sale of the high-calorie menu items dropped, while overall sales remained steady. What is the dependent variable in this study? Select one: a. sales for high-calorie menu items b. the nutritional value of the menu items c. menu labeling d. restaurant sales overall
a. sales for high-calorie menu items (Food Breaks and Parole Decisions — What is being measured is sales of high-calorie menu items.)
A study by Grimstvedt et al. (2010) of the effects of signage on stair use in university buildings examined the effect of placing signs encouraging stair use near elevators. Based on their design, Blake is designing a study for her campus. The initial part of the study will be a month-long measuring of elevator and stair use in four different buildings on the campus. This will be followed by the treatment: the simultaneous posting of signs at each of the four locations. Elevator and stair use will then be measured for another month. What type of design is this? Select one: a. stable-baseline b. interrupted time-series c. multiple-baseline d. matched-groups
a. stable-baseline (The researchers plan to first establish a baseline of elevator and stair use before administering the treatment.)
Mark conducts a study for his research methods class to determine if consuming caffeine causes people to perform better on cognitive tasks. In his study, he gives half of his participants a glass of water and half of his participants a glass of cola, and then has them attempt to solve 15 math problems. He finds that people who drink caffeine beforehand solve more math problems than those who drink water beforehand. Refer to Research Study 14.1 to answer the following question. Mark decides to conduct the exact same study again to ensure that he can find the same difference between the groups a second time. This study is known as a: Select one: a. Replication-plus-extension b. Direct replication c. Conceptual replication d. Secondary replication
b. Direct replication
When generalizing the results of a sample to a population, which of the following is the most important question to ask? Select one: a. How many participants were in the sample? b. How were the participants sampled? c. Do the participants come from the "real world"? d. Where were the participants tested?
b. How were the participants sampled?
Which of the following is NOT a method for addressing concerns about external validity in a Small-N study? Select one: a. Specify that the result only applies to the participant studied. b. Nothing — it is not possible to achieve external validity in Small-N design. c. Specify a limited population to which to generalize. d. Triangulate by comparing results with other research.
b. Nothing — it is not possible to achieve external validity in Small-N design. (The Small-N external validity question typically centers on generalizability to other people or groups, not to other settings.)
Which of the following is NOT a major type of replication? Select one: a. Direct replication b. Statistical replication c. Conceptual replication d. Replication-plus-extension
b. Statistical replication
Cindy decides to conduct a meta-analysis examining the relationship between daily stress and cardiovascular health for her senior psychology research project. Refer to Research Study 14.2 to answer the following question. Cindy's advisor recommends that she contact several researchers in the field for articles that were not published and/or that found null effects. Doing this will address which of the following? Select one: a. The need for overestimation b. The file drawer problem c. Ecological validity d. The lack of significant findings reported
b. The file drawer problem
Horselenberg et al. (2003) conducted an experiment based on Kassin and Kieche (1996) in which the participant was falsely accused of striking a computer key that caused the data to be deleted. The earlier study showed that 69 percent of the participants were willing to sign a confession that they had struck the key. Horselenberg's study included a change in procedure where the signed confession included giving up part of the participation fee. In Horselenberg's study the researcher made the accusation rather than a peer, so that the situation more closely paralleled false confessions of a crime. In doing so, what did the researchers most clearly increase? Select one: a. larger effect size b. experimental realism c. internal validity d. situational variation
b. experimental realism
Ecological validity is considered to be an aspect of which of the four validities? Select one: a. construct b. external c. internal d. statistical
b. external
A drought in California created the opportunity for a quasi-experiment on the effectiveness of fines on water conservation (Agras et al., 1980). Three comparable cities were considered: two that instituted fines at different times and a third that did not. Water consumption data for the three years before the onset of the fines was used as baseline and subsequent consumption data was gathered through the end of the drought. Effectiveness of fines was assessed by examining consumption the following month. In this study, researchers capitalized on real-life opportunities to study phenomena. Therefore, they maximized which type of validity? Select one: a. statistical b. external c. construct d. internal
b. external (External validity is the applicability to other places, people, or times.)
Which type of claim is always done in generalization mode? Select one: a. relational b. frequency c. causal d. association
b. frequency
Dr. Reynolds develops a treatment for social anxiety disorder. After he has shown his treatment to be effective in very controlled laboratory studies, he decides to test it in other settings. He collaborates with clinicians who work in a variety of clinical settings across the country. Dr. Reynolds trains the clinicians on his treatment, but doesn't supervise them closely. He also allows patients with some common co-morbidities, such as depression, to participate in the study. This study is in _________. Select one: a. analysis mode b. generalization mode c. data-generating mode d. theory-testing mode
b. generalization mode
What is it called when a researcher mathematically averages the results of many studies that have been completed with the same variables? Select one: a. effect size measurement b. meta-analysis c. replication-plus-extension d. analysis of variance
b. meta-analysis
Which of the following is NOT a way that researchers in a quasi-experimental study attempt to achieve internal validity? Select one: a. seeking out naturally occurring comparison groups b. randomly assigning participants to conditions c. implementing a wait-list policy d. matching participants
b. randomly assigning participants to conditions. (Are Quasi-Experiments the Same as Correlational Studies? — If the participants were randomly assigned to the conditions, the study would be experimental, not quasi-experimental.)
Ellen is an elementary school teacher who has a very disruptive child in her classroom. She wants to see whether using a good behavior point system will be effective for managing this child's behavior. She begins by noting the child's behavioral outbursts for a week before she begins the point system, then she tries using the point system for two weeks and notices a drop in the child's outbursts. For the next two weeks she discontinues using the point system and she notes an increase in the child's outburst. What kind of design is Ellen using to test this intervention? Select one: a. interrupted time-series design b. reversal c. multiple baseline d. stable baseline
b. reversal (In a reversal design, the problem behavior is observed both with and without treatment, and then the treatment is removed for a while (the reversal period) to see whether the problem behavior returns.)
Dr. Grayson, a health psychologist, conducts a study examining whether people eat more when they are exposed to pictures of food than when they are not exposed to pictures of food. She goes to a fast-food restaurant in downtown Chicago that has pictures of menu items on its menu board and measures the amount of food ordered during the lunch rush (11:30 a.m.-1:30 p.m.) on Tuesday. On Thursday, she does the same thing but at a fast-food restaurant that does not have pictures on their menu board (about two blocks away from the first restaurant). She finds that the restaurant with pictures of food sells more food than the restaurant that does not have pictures. Dr. Grayson decides to conduct her study again, but in the new study, she studies people at a sit-down restaurant, and she manipulates whether the menu they use at the table has pictures or not. This is known as which of the following? Select one: a. Direct replication b. Replication-plus-extension c. Conceptual replication d. Statistical replication
c. Conceptual replication
Dr. Grayson, a health psychologist, conducts a study examining whether people eat more when they are exposed to pictures of food than when they are not exposed to pictures of food. She goes to a fast-food restaurant in downtown Chicago that has pictures of menu items on its menu board and measures the amount of food ordered during the lunch rush (11:30 a.m.-1:30 p.m.) on Tuesday. On Thursday, she does the same thing but at a fast-food restaurant that does not have pictures on their menu board (about two blocks away from the first restaurant). She finds that the restaurant with pictures of food sells more food than the restaurant that does not have pictures. Dr. Grayson wants to conduct her study again, but this time she wants to conduct it in her laboratory. She wants people to feel and act the same way in her laboratory that they would when facing ordering choices in an actual fast food restaurant. To this end, she must try to enhance which of the following? Select one: a. Generalizability b. Cultural relativity c. Experimental realism d. Construct validity
c. Experimental realism
Dr. Grayson, a health psychologist, conducts a study examining whether people eat more when they are exposed to pictures of food than when they are not exposed to pictures of food. She goes to a fast-food restaurant in downtown Chicago that has pictures of menu items on its menu board and measures the amount of food ordered during the lunch rush (11:30 a.m.-1:30 p.m.) on Tuesday. On Thursday, she does the same thing but at a fast-food restaurant that does not have pictures on their menu board (about two blocks away from the first restaurant). She finds that the restaurant with pictures of food sells more food than the restaurant that does not have pictures. Because Dr. Grayson conducted her study in a field setting, which of the following is an advantage of her study? Select one: a. It removes all threats to internal validity. b. It automatically generalizes to other situations (e.g., fancy restaurants, cafeterias). c. It has a high degree of ecological validity. d. It automatically generalizes to other people.
c. It has a high degree of ecological validity.
Which of these statements is TRUE of external validity? Select one: a. The larger the sample the better. b. Studies must take place outside the laboratory to have external validity. c. It is based on how the sample is obtained rather than sample size. d. A population always refers to the population of the earth.
c. It is based on how the sample is obtained rather than sample size.
Dr. Anderson is a nutritionist who helps clients lose weight prior to surgery. She is working with W. J., a male client who is planning on undergoing a heart transplant. He currently eats more than 3,500 calories a day and has been asked by his doctor to cut the number of calories to about 1,800 (400 for breakfast, 600 for lunch, and 800 for dinner). She is curious as to whether a food journal will help W. J. reduce the number of calories he eats. A food journal is used to record everything a person eats. Dr. Anderson decides to phase in the food journal gradually, initially only recording what is eaten at breakfast during the first three days after baseline (days 4-6). During days 7-9, the journal is used at lunch, too, and during days 10-12, it also is used during dinner. Each day, Dr. Anderson's client sends her entries from the food journal and the number of calories he ate at each meal (as calculated by his wife, whose help she enlisted). What type of small-N design has Dr. Anderson used with W. J.? Select one: a. Interrupted time-series design b. Reversal design c. Multiple-baseline design d. Stable-baseline design
c. Multiple-baseline design
What is the file drawer problem in psychology? Select one: a. Results of research in areas of public interest are more likely to be published. b. Studies done by friends of the editors of journals are more likely to be published. c. Significant relationships are more likely to be published than null effects. d. Famous psychologists are more likely to be published than unknowns.
c. Significant relationships are more likely to be published than null effects.
Roediger and McDermott (1995) conducted a study involving a paradigm initially developed by Deese (1959) which produces false recall of a word when a participant is given a list of words to recall which centers on a particular word but does not include it. For example, if participants were given a list that included sandal, towel, sunscreen, and waves, then they would falsely remember the word beach even though it was not on the list. They did two studies based on Deese's original study. In the first study, they used the same word lists that Deese used and in the second experiment they used new sets of stimulus words. What is the term for the second study they ran? Select one: a. replication-plus-extension b. direct replication c. conceptual replication d. meta-analysis replication
c. conceptual replication
What is the term for a replication study in which a researcher evaluates the same research question but uses different procedures? Select one: a. meta-analysis replication b. replication-plus-extension c. conceptual replication d. direct replication
c. conceptual replication
Horselenberg et al. (2003) conducted an experiment based on Kassin and Kieche (1996) in which the participant was falsely accused of striking a computer key that caused the data to be deleted. The earlier study showed that 69 percent of the participants were willing to sign a confession that they had struck the key. Horselenberg's study included a change in procedure where the signed confession included giving up part of the participation fee. Horselenberg et al. conducted their study in the Netherlands and found similar results to Kassin's. That this finding was observed in multiple contexts supports which validity? Select one: a. construct b. statistical c. external d. internal
c. external
Following implementation of a new city law, a restaurant chain began displaying the nutrition labels for their menu items. The restaurant owner recorded sales of the 15 highest-calorie menu items on three occasions—once the month before the change in menu display, once the week of the change in menu display, and once the month after the change in menu display. The owner observed that the sale of the high-calorie menu items dropped, while overall sales remained steady. What type of design is this? Select one: a. reversal design b. nonequivalent control group design c. interrupted time-series design d. nonequivalent groups time-series design
c. interrupted time-series design (Food Breaks and Parole Decisions — This study is a repeated-measure design with an interruption: the introduction of the nutrition information on the menus.)
What is it called when a researcher mathematically averages the results of many studies that have been completed with the same variables? Select one: a. effect size measurement b. analysis of variance c. meta-analysis d. replication-plus-extension
c. meta-analysis
Which of the following is NOT a form of replication in psychological research? Select one: a. conceptual replication b. direct replication c. meta-analysis replication d. replication-plus-extension
c. meta-analysis replication
A drought in California created the opportunity for a quasi-experiment on the effectiveness of fines on water conservation (Agras et al., 1980). Three comparable California cities were considered: two that instituted fines at different times and a third that did not institute fines. Water consumption data for the three years before the onset of the fines was used as baseline and subsequent consumption data was gathered through the end of the drought. Effectiveness of fines was assessed by examining consumption the following month. With regard to the monitoring of water consumption, what type of design was this? Select one: a. small-N design b. reversal c. multiple baseline d. stable baseline
c. multiple baseline (Each of the cities has a baseline, and the institution of fines occurred at different times in the two treatment cities.)
What does it mean to say that most theory testing is done on WEIRD people? Select one: a. that most people who participate in studies are white, empathetic, individualistic, reliable, and dedicated b. that most psychologists go into the field because they have personal problems they hope to solve c. that most participants are Western, educated, industrialized, rich, and democratic d. that people who volunteer for psychology studies are unusual in some way
c. that most participants are Western, educated, industrialized, rich, and democratic
Dr. Joseph thinks that most people are generally trusting of strangers. He did a study at his university in the United States to test this idea, and the results confirmed his hypothesis. This study is in _________. Select one: a. experimental realism mode b. generalization mode c. theory-testing mode d. analysis mode
c. theory-testing mode
Roediger and McDermott (1995) conducted a study involving a paradigm initially developed by Deese (1959) which produces false recall of a word when a participant is given a list of words to recall which centers on a particular word but does not include it. For example, if participants were given a list that included sandal, towel, sunscreen, and waves, then they would falsely remember the word beach even though it was not on the list. They did two studies based on Deese's original study. In the first study, they used the same word lists that Deese used and in the second experiment they used new sets of stimulus words. This study is in _________. Select one: a. analysis mode b. data-generating mode c. theory-testing mode d. generalization mode
c. theory-testing mode
Cherry et al (2010) examined the knowledge of normal and pathological memory aging in college students, social workers, and health care professionals. Participants completed a questionnaire and mean scores were computed for both normal and pathological memory aging. Scores differed among the groups of participants. A second experiment was similar, but used a more diverse set of participants. What type of study was this?
conceptual replication
Mark conducts a study for his research methods class to determine if consuming caffeine causes people to perform better on cognitive tasks. In his study, he gives half of his participants a glass of water and half of his participants a glass of cola, and then has them attempt to solve 15 math problems. He finds that people who drink caffeine beforehand solve more math problems than those who drink water beforehand. Refer to Research Study 14.1 to answer the following question. Mark decides to conduct a variation of the original study in which he measures participants' ability to solve verbal analogies as the cognitive task instead of measuring their ability to solve math problems. He finds that people who drink caffeine beforehand solve more verbal analogies than those who drink water beforehand, suggesting caffeine consumption causes improved cognitive performance. This study is known as a: Select one: a. Replication-plus-extension b. Secondary replication c. Statistical replication d. Conceptual replication
d. Conceptual replication
Dr. LaGuardia is a cognitive neuroscientist who is interested in the effect of brain concussions on the ability to recognize faces. He conducts a quasi-experimental study in which he examines football players before and after the regular season, using the Benton Facial Recognition Test (a published, widely used measure of one's ability to recognize faces) to compare those who received concussions to those who did not. He finds that players who had concussions during the regular season performed worse on the Benton Facial Recognition Test than did players who did not experience concussions. -Which of the following makes Dr. LaGuardia's quasi-experimental study different from a correlational study? Select one: a. He used members of a real sports team rather than members of the general population. b. He used a validated measure of the dependent variable. c. He was able to confirm the occurrence of a concussion rather than relying on self-report. d. He used a naturally occurring comparison group (i.e., players who did not suffer a concussion).
d. He used a naturally occurring comparison group (i.e., players who did not suffer a concussion).
Which of the following designs has elements of both a within-group design and an independent-groups design? Select one: a. Multiple regression design b. Nonequivalent control group design c. Matched group factorial design d. Nonequivalent groups interrupted time-series design
d. Nonequivalent groups interrupted time-series design
_________ is composed of several studies on a particular topic, often conducted by many different researchers. Select one: a. A field setting b. A meta-analysis c. The file-drawer problem d. The scientific literature
d. The scientific literature
Horselenberg et al. (2003) conducted an experiment based on Kassin and Kieche (1996) in which the participant was falsely accused of striking a computer key that caused the data to be deleted. The earlier study showed that 69 percent of the participants were willing to sign a confession that they had struck the key. Horselenberg's study included a change in procedure where the signed confession included giving up part of the participation fee. What type of study was Horselenberg's? Select one: a. replication b. meta-analysis c. confirmation d. conceptual replication
d. conceptual replication
What is the term for a replication study in which a researcher evaluates the same research question but uses different procedures? Select one: a. direct replication b. meta-analysis replication c. replication-plus-extension d. conceptual replication
d. conceptual replication
Julie works at a large gym. She wants to do a study of the effect of having a personal trainer on self-esteem and mood. She collects a list of members at her gym who would like to have a personal trainer. She assigns half of them to have a trainer right away and half of them to wait several months before being assigned a trainer. She measures self-esteem and mood in all of the participants over the next several months when only one of the groups would have a trainer. What kind of design is Julie using? Select one: a. reversal design b. stable-baseline design c. multiple-baseline design d. wait-list design
d. wait-list design (By having half of the participants wait before being assigned to a trainer she is using a wait-list design.)
A drought in California created the opportunity for a quasi-experiment on the effectiveness of fines on water conservation (Agras et al. 1980). Three comparable cities were considered: Twothat instituted fines at different times and a third that did not. Water consumption data for the three years before the onset of the fines was used as baseline and subsequent consumption data was gathered through the end of the drought. Effectiveness of fines was assessed by examining consumption the following month. With regard to the monitoring of water consumption, What type of design is this?
multiple base-line
What is the term for a quasi-experimental design with at least one treatment group and one comparison group, but in which the participants have not been randomly assigned to the groups?
nonequivalent control group design
In a quasi-experiment (Minke, 2011), the effectiveness of Skejby, a Danish half-way house which mixes offenders with non-offenders, was compared to that of the control condition of half-way houses housing only offenders. Measurement of the effectiveness was based on rate of recidivism of former inmates. In abstract, the author describe Skejby as "an outstanding social experiment". What threat to internal validity occurs when researchers are not objective in their assessments?
observer bias
