Research Methods Test #4

ESEARCH STUDY 13.1: Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). Suppose Dr. Fletcher was concerned that students who choose to join fraternities/sororities are more concerned with their appearance overall. How could he test whether this type of selection threat exists? a. Collect appearance concerns at more time points throughout the year from his subjects. b. Examine whether any events occurred on campus that year that may influence appearance concerns for all students. c. Compare baseline levels of appearance concerns in fraternity/sorority students versus the average college student. d. Check that none of his participants had exceptionally high levels of appearance concerns at the beginning of his study.

c. Compare baseline levels of appearance concerns in fraternity/sorority students versus the average college student.

In a previous correlational study, Dr. Layayette has found that owning dogs is associated with lower levels of daily stress in sample of returning war veterans. Which of the following would constitute a shift from theory-testing mode to generalization mode? a. Conducting an experimental study in which he assigns people to own a dog or not b. Conducting a study examining the stress reduction mechanism c. Conducting a study on dog ownership using a sample of elderly participants from a local retirement home d. Conducting a study on the same sample of war veterans, this time using a different measure of daily stress

c. Conducting a study on dog ownership using a sample of elderly participants from a local retirement home

Replicability helps interrogate which of the four big validities? a. Statistical validity b. Construct validity c. External validity d. Internal validity

c. External validity

A participant's score on a dependent variable is a combination of which of the following? a. Systematic variance and error variance b. Manipulation effect and observer bias c. Measurement error and their true score d. Their mean score and their standard deviation

c. Measurement error and their true score

Which of the following is a reason that psychologists especially value meta-analyses? a. Meta-analyses eliminate the need for replications. b. Meta-analyses always take less time to conduct. c. Meta-analyses allow researchers to examine the strength of a relationship. d. Meta-analyses are immune to threats to internal validity.

c. Meta-analyses allow researchers to examine the strength of a relationship.

Which of the following is a difference between true experiments and quasi-experiments? a. Quasi-experiments do not involve manipulated variables. b. Quasi-experiments cannot have comparison groups. c. Quasi-experiments do not use random assignment. d. Quasi-experiments cannot have pretest measures.

c. Quasi-experiments do not use random assignment.

What does the author of the textbook mean when she writes "We don't live in a main effect world"? a. She means that psychologists do not like main effects b. She means that main effects are not important c. She means that interactions are common in everyday life d. She means that studies that produce interactions are the only studies worth conducting

c. She means that interactions are common in everyday life

Which of the following is true of instrumentation threats? a. They occur only when using mechanical instruments b. They are only problematic in observational research c. They can be avoided with counterbalancing d. They are the same as testing threats

c. They can be avoided with counterbalancing

Which of the following is true of ceiling and floor effects? a. They don't affect the results of a study. b. They are only problematic in pretest/posttest designs. c. They can be caused by poorly designed dependent variables. d. They cannot be detected by manipulation checks.

c. They can be caused by poorly designed dependent variables.

Dr. Deveraux has conducted a study that has resulted in a null effect. Nonetheless, she suspects that there truly is a causal relationships between her independent and dependent variables. Which of the following is UNLIKELY to be to blame? a. A reverse confound b. A weak manipulation c. Too many participants d. An insensitive measure

c. Too many participants

Which of the following can help prevent testing effects? a. Employing a pretest-only design b. Using a clear coding manual c. Using a comparison group d. Establishing reliability of the measure

c. Using a comparison group

Using the same setting and consistent protocols for each participant in a study will reduce the effect of: a. individual differences b. measurement error c. situation noise d. floor effects

c. situation noise

To be a history threat, the external event must occur: a. constantly during the experiment b. intentional, induced by the experimenters c. systematically, affecting most members of the group d. at the beginning of the experiment

c. systematically, affecting most members of the group

The mathematical way to describe an interaction is: a.A patterned pattern b.A caveat c.A difference in differences d.A qualified main effect

c.A difference in differences

What does the author of the textbook mean when she writes, "We don't live in a main effect world"? a.She means that main effects are not important. b.She means that studies that produce interactions are the only studies worth conducting. c.She means that interactions are common in everyday life. d.She means that psychologists do not like to examine main effects.

c.She means that interactions are common in everyday life.

Which of the following studies would NOT have a possible threat of observer bias? a. A study looking at whether increasing the number of hours listening to music increases singing ability b. A study looking at he effect of eating fruits and vegetables and general physical fitness c. A study looking at the effect of tutoring on SAT scores d. A study looking at the effect of increasing the rate of text messaging in a day on writing/English composition skill

d. A study looking at the effect of increasing the rate of text messaging in a day on writing/English composition skill

Dr. Morimoto is curious as to whether exposing people to violent video games causes them to be more aggressive. He assigns half his participants to play a video game for 5 minutes and the other half to play for 7 minutes. He finds that there is no relationship between playing the game longer and being more aggressive. What might be to blame for this null effect? a. A reverse confound b. Ceiling effect c. An insensitive measure d. A weak manipulation

d. A weak manipulation

In quasi-experimental designs, the researcher does not have experimental control over the independent variable and does not randomly assign participants to conditions. This results in which of the following? a. The researcher being unable to rule out any threats to internal validity b. An unethical study c. A study that is no different than a correlational design d. A weaker causal claim than a true experiment

d. A weaker causal claim than a true experiment

Which of the following MUST be done before meta-analyses can occur? a. Only direct replications b. Cultural psychology replications done on the topic c. Publication of the topic in the popular media d. Collection of the scientific literature on a topic

d. Collection of the scientific literature on a topic

Which of the following types of replications investigate the same research question but use different procedures? a. Replication-plus-extension b. Statistical replication c. Direct replication d. Conceptual replication

d. Conceptual replication

RESEARCH STUDY 11.1: In previous studies, Dr. Schulenberg has established that finding meaning in one's everyday work activities can lead to greater success in the workplace (e.g., productivity, creativity). He is curious as to whether this can happen in the college classroom. Specifically, he is curious whether finding meaning in one's classroom experience can lead to greater academic performance. In the spring semester, he has his teaching assistant randomly assign half the class to write a paragraph each class period about how the material has meaning for their lives (meaning group). The other half writes a paragraph about what they did to prepare for class (preparation group). He does not know which of his students are writing which paragraph, and the students are not aware they are responding to different writing assignments. To measure academic performance, he gives the students a midterm essay exam and a final exam. Which of the following aspects of Dr. Schulenberg's study allows him to prevent observer bias? A. Ensuring the person grading the exams is unaware of each student's writing group B. Keeping his students unaware of which type of essay they are writing C. Having his teaching assistant assign students randomly to the two groups D. Grading the exams himself (a Ph.D.) instead of having his teaching assistant (a college senior) do it

A. Ensuring the person grading the exams is unaware of each student's writing group

RESEARCH STUDY 11.1: In previous studies, Dr. Schulenberg has established that finding meaning in one's everyday work activities can lead to greater success in the workplace (e.g., productivity, creativity). He is curious as to whether this can happen in the college classroom. Specifically, he is curious whether finding meaning in one's classroom experience can lead to greater academic performance. In the spring semester, he has his teaching assistant randomly assign half the class to write a paragraph each class period about how the material has meaning for their lives (meaning group). The other half writes a paragraph about what they did to prepare for class (preparation group). He does not know which of his students are writing which paragraph, and the students are not aware they are responding to different writing assignments. To measure academic performance, he gives the students a midterm essay exam and a final exam. Imagine that in Dr. Schulenberg's study, he notes that all of the students do extremely well on the midterm exam. When he looks at the results of the final exam, he notices that all the students' exam scores went down. Which of the following pattern of results would suggest that there is a threat to internal validity? A. The final exam scores were lower in the preparation group than the meaning group B. The final exam scores were equally low in both groups C. The final exam scores were lower than the national average D. The final exam scores were lower than the final exam scores of students of his colleague Dr. Fao.

B. The final exam scores were equally low in both groups

RESEARCH STUDY 11.1: In previous studies, Dr. Schulenberg has established that finding meaning in one's everyday work activities can lead to greater success in the workplace (e.g., productivity, creativity). He is curious as to whether this can happen in the college classroom. Specifically, he is curious whether finding meaning in one's classroom experience can lead to greater academic performance. In the spring semester, he has his teaching assistant randomly assign half the class to write a paragraph each class period about how the material has meaning for their lives (meaning group). The other half writes a paragraph about what they did to prepare for class (preparation group). He does not know which of his students are writing which paragraph, and the students are not aware they are responding to different writing assignments. To measure academic performance, he gives the students a midterm essay exam and a final exam. The study described above is an example of which of the following? A. a one-group, pretest/posttest design B. a double-blind study C. a null effect D. observer bias

B. a double-blind study

Dr. Whetstone is curious about self-esteem changes as a result of a new counseling program. She is concerned about testing threats in her study. Which of following would you recommend to her as a way to address this type of threat? a. Omitting a comparison group b. Conducting a pretest-only study c. Refusing to let participants drop out of the study d. Using a different measure of self-esteem at pretest than at posttest

NOT A

Which of the following is true of the scientific literature? a. It compromises studies conducted all in the same year b. It compromises studies that have tested the exact same variable c. It compromises studies conducted with different methods d. It compromises studies conducted by a single researcher

NOT B

A cultural psychologist would be most interested in which of the following sets of participants? a. A sample of Taiwanese grandparents b. A sample of community college students c. A sample of 12-year old children d. A sample of homeless veterans

a. A sample of Taiwanese grandparents

RESEARCH STUDY 13.2: Dr. LaGuardia is a cognitive neuroscientist who is interested in the effect of brain concussions on the ability to recognize faces. He conducts a quasi-experimental study in which he examines football players before and after the regular season using the Benton Facial Recognition Test (a published, widely used measure of one's ability to recognize faces) to compare those who received concussions to those who did not. He finds that players who had concussions during the regular season performed worse on the Benton Facial Recognition Test than did players who did not experience concussions. Which of the following is true regarding external validity in Dr. LaGuardia's study? a. Because Dr. LaGuardia selected participants who actually experienced concussions, the study has strong external validity. b. Because Dr. LaGuardia's study is a quasi-experiment, it is impossible to obtain external validity. c. Because Dr. LaGuardia selected a widely used measure, his study generalizes to other applications of this measure. d. Because Dr. LaGuardia's dependent variable was assessed in the laboratory, the study has limited external validity.

a. Because Dr. LaGuardia selected participants who actually experienced concussions, the study has strong external validity.

RESEARCH STUDY 13.2: Dr. LaGuardia is a cognitive neuroscientist who is interested in the effect of brain concussions on the ability to recognize faces. He conducts a quasi-experimental study in which he examines football players before and after the regular season using the Benton Facial Recognition Test (a published, widely used measure of one's ability to recognize faces) to compare those who received concussions to those who did not. He finds that players who had concussions during the regular season performed worse on the Benton Facial Recognition Test than did players who did not experience concussions. In interrogating the construct validity of Dr. LaGuardia's study, which of the following statements is accurate? a. Because Dr. LaGuardia's participants actually experienced concussions, his independent variable appears to have construct validity. b. Because Dr. LaGuardia did not use a true experiment, it is impossible to determine if his independent variable has construct validity. c. Because Dr. LaGuardia studied real football players, his dependent variable appears to have construct validity. d. Because Dr. LaGuardia did not use a true experiment, it is impossible to determine if his dependent variable has construct validity.

a. Because Dr. LaGuardia's participants actually experienced concussions, his independent variable appears to have construct validity.

RESEARCH STUDY 13.3: Dr. Anderson is a nutritionist who helps clients lose weight prior to surgery. She is working with W. J., a male client who is planning on undergoing a heart transplant. He currently eats more than 3,500 calories a day and has been asked by his doctor to cut the number of calories to about 1,800 (400 for breakfast, 600 for lunch, and 800 for dinner). She is curious as to whether a food journal will help W. J. reduce the number of calories he eats. A food journal is used to record everything a person eats to help patients be more aware of what they're eating. W. J.'s wife also recorded the food he consumed at each meal to have complete data before introducing the journal. Dr. Anderson decides to phase in the food journal gradually, initially only having W. J. record what he ate at breakfast during the first three days after baseline (days 4-6). During days 7-9, the journal is used at lunch, too, and during days 10-12, it also is used during dinner. The data for Dr. Anderson's study are below. In interrogating the statistical validity of Dr. Anderson's study, which of the following might be asked? a. By what margin did W. J.'s calorie intake improve? b. Was Dr. Anderson qualified to analyze the data? c. Was the number of calories consumed by W. J. going to decrease before surgery anyway? d. How accurate was W. J.'s wife in her calculation of the calories consumed at each meal?

a. By what margin did W. J.'s calorie intake improve?

Which of the following types of replications investigate the same research question but use different procedures? a. Conceptual replication b. Replication plus extension c. Direct Replication d. Statistical Replication

a. Conceptual replication

RESEARCH STUDY 13.2: Dr. LaGuardia is a cognitive neuroscientist who is interested in the effect of brain concussions on the ability to recognize faces. He conducts a quasi-experimental study in which he examines football players before and after the regular season using the Benton Facial Recognition Test (a published, widely used measure of one's ability to recognize faces) to compare those who received concussions to those who did not. He finds that players who had concussions during the regular season performed worse on the Benton Facial Recognition Test than did players who did not experience concussions. In analyzing the data, Dr. LaGuardia finds that there was no pretest difference in Benton Facial Recognition scores. However, he does find that the football players who received concussions had worse visuo-spatial awareness before the study. Which of the following threats to internal validity should he be concerned with? a. Design confounds b. Regression to the mean c. Maturation threat d. History threat

a. Design confounds

RESEARCH STUDY 13.3: Dr. Anderson is a nutritionist who helps clients lose weight prior to surgery. She is working with W. J., a male client who is planning on undergoing a heart transplant. He currently eats more than 3,500 calories a day and has been asked by his doctor to cut the number of calories to about 1,800 (400 for breakfast, 600 for lunch, and 800 for dinner). She is curious as to whether a food journal will help W. J. reduce the number of calories he eats. A food journal is used to record everything a person eats to help patients be more aware of what they're eating. W. J.'s wife also recorded the food he consumed at each meal to have complete data before introducing the journal. Dr. Anderson decides to phase in the food journal gradually, initially only having W. J. record what he ate at breakfast during the first three days after baseline (days 4-6). During days 7-9, the journal is used at lunch, too, and during days 10-12, it also is used during dinner. The data for Dr. Anderson's study are below. Which of the following is evidence that would allow Dr. Anderson to conclude that keeping a food journal caused weight loss in W. J.? a. Dinner calories decreased on Day 10. b. Calorie intakes for the three meals differed on Day 1. c. Breakfast calories decreased on Day 2. d. Lunch calories decreased on Day 3.

a. Dinner calories decreased on Day 10.

RESEARCH STUDY 11.1: In previous studies, Dr. Schulenberg has established that finding meaning in one's everyday work activities can lead to greater success in the workplace (e.g., productivity, creativity). He is curious as to whether this can happen in the college classroom. Specifically, he is curious whether finding meaning in one's classroom experience can lead to greater academic performance. In the spring semester, he has his teaching assistant randomly assign half the class to write a paragraph each class period about how the material has meaning for their lives (meaning group). The other half writes a paragraph about what they did to prepare for class (preparation group). He does not know which of his students are writing which paragraph, and the students are not aware they are responding to different writing assignments. To measure academic performance, he gives the students a midterm essay exam and a final exam. Which of the following aspects of Dr. Schulenberg's study allows him to prevent observer bias? a. Ensuring the person grading the exams is unaware of each student's writing group b. Having his teaching assistant assign students randomly to the two groups c. Keeping his students unaware of which type of essay they are writing d. Grading the exams himself (a Ph.D.) instead of having his teaching assistant (a college senior) do it

a. Ensuring the person grading the exams is unaware of each student's writing group

The degree to which a quasi-experiment supports a causal claim depends on which of the following? a. Its design and its results b. Its importance and its external validity c. Its statistical significance and its practical significance d. Its duration and its sample size

a. Its design and its results.

A wait-list design is helpful in dealing with which of the following threats to internal validity? a. Maturation b. Selection c. History d. Attrition

a. Maturation

The addition of a comparison group can address which of the following threats to internal validity? a. Maturation b. Selection-history c. Instrumentation d. Attrition

a. Maturation

Which of the following is a benefit of a meta analysis compared to other types of publications? a. Meta-analyses allow for calculation of effect size across multiple studies b. Only meta-analyses allow for examination of moderators c. Meta-analysis always avid the file drawer problem d. Meta-analysis is the only type of publication that synthesizes an entire scientific literature

a. Meta-analyses allow for calculation of effect size across multiple studies

Why do quasi-experiments tend to have very good construct validity for the independent variable? a. They use real-world manipulations/experiences. b. They tend to use more participants. c. They also have good construct validity for the dependent variable. d. The manipulations have been previously validated in the lab.

a. They use real-world manipulations/experiences.

RESEARCH STUDY 13.1: Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). In addition to measuring the Body Concern of the participants who joined a fraternity/sorority both immediately before and immediately after they join, Dr. Fletcher measures them for the 3 weeks before and the 3 weeks after. This type of design is known as a(n): a. interrupted time-series design. b. multiple-baseline design. c. nonequivalent control group design. d. nonequivalent groups interrupted time-series design.

a. interrupted time-series design.

Spontaneous remission in clinical studies is an example of which of the following threats to internal validity? a. maturation b. attrition c. placebo effects d. regression

a. maturation

To be a history threat, the external event must occur: a. systematically, affecting most members of the group. b. intentionally, induced by the experimenters. c. at the beginning of the experiment. d. constantly during the experiment.

a. systematically, affecting most members of the group.

Dr. Gavin is conducting a 2 x 4 independent-groups factorial design. Assuming he wants 25 people in each cell, how many participants does Dr. Gavin need to recruit? a.200 b.100 c.250 d.150

a.200

Which of the following claims is most likely to be made in generalization mode? a. "Men are more likely than women to report considering infidelity." b. "A majority of women report considering infidelity at least once during their marriages." c. "Being exposed to attractive individuals increases thoughts of infidelity." d. "Parental divorce is associated with greater likelihood of infidelity."

b. "A majority of women report considering infidelity at least once during their marriages."

Which of the following phrases might a person encounter in a popular media article that indicates an interaction? a. "mediator variables" b. "it depends" c. "mixed factorial design" d. "statistically significant"

b. "it depends"

Which of the following people would be of most for a small N design? a. A college student b. A person diagnosed with schizophrenia c. A person suffering from a cold d. A psychology student

b. A person diagnosed with schizophrenia

In quasi-experimental designs, the researcher does not have experimental control over the independent variable and does not randomly assign participants to conditions. This results in which of the following? a. The researcher being unable to rule out any threats to internal validity b. A weaker causal claim than a true experiment c. An unethical study d. A study that is no different than a correlational design

b. A weaker causal claim than a true experiment

Dr. Merrick designs a study comparing the effects of mindfulness training to cognitive training on flexible thinking. In designing this study, what would be an appropriate manipulation check? a. Ensuring that no participants had prior experience with mindfulness training b. Adding a third group that receives flexibility training c. Testing that the flexible thinking task is hard enough to show group differences d. Measuring heart rate to ensure that mindfulness has a calming effect

b. Adding a third group that receives flexibility training

Ceiling effects can affect: a. Independent variables only b. Both independent and dependent variables c. Dependent variables only d. Certain groups more than others

b. Both independent and dependent variables

Unsystematic variability in a study is also known as: a. Null effect b. Error variance c. Situational variability d. Group inconsistency

b. Error variance

RESEARCH STUDY 14.3: Dr. Grayson, a health psychologist, conducts a study examining whether people eat more when they are exposed to pictures of food than when they are not exposed to pictures of food. She goes to a fast-food restaurant in downtown Chicago that has pictures of menu items on its menu board and measures the amount of food ordered during the lunch rush (11:30 a.m.-1:30 p.m.) on Tuesday. On Thursday, she does the same thing but at a fast-food restaurant that does not have pictures on its menu board (about two blocks away from the first restaurant). She finds that the restaurant with pictures of food sells more food than the restaurant that does not have pictures. Dr. Grayson wants to conduct her study again, but this time she wants to conduct it in her laboratory. She wants people to feel and act the same way in her laboratory that they would when facing ordering choices in an actual fast-food restaurant. To this end, she must try to enhance which of the following? a. Statistical validity b. Experimental realism c. Cultural relativity d. Generalizability

b. Experimental realism

RESEARCH STUDY 13.1: Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). If Dr. Fletcher is interested in a causal relationship between joining a fraternity/sorority and attractiveness/appearance concern, why doesn't he conduct a true experiment? a. It is not possible to study private organizations, like fraternities/sororities. b. He was unable to randomly assign participants to join a fraternity/sorority. c. He was unable to recruit an equal number of males and females. d. It is not possible to measure body concern.

b. He was unable to randomly assign participants to join a fraternity/sorority

Which of the following is true of experimental realism? a. It is only important in generalization mode. b. It supports external validity. c. It exists only in field settings. d. It is a synonymous term for mundane realism.

b. It supports external validity.

Which of the following is a difference between small- N and large- N designs? a. Large-N designs have the power to detect large effect sizes, while small-N designs can only detect small effects. b. Large-N studies typically gather less information about participants than small-N designs. c. It is not possible to maintain experimental control in small-N studies, whereas it is in large-N studies. d. Statistical validity is stronger in large-N designs, while generalizability is more important in small-N designs.

b. Large-N studies typically gather less information about participants than small-N designs.

Which of the following is an independent-groups quasi-experimental design? a. Stable-baseline b. Nonequivalent control group design c. Interrupted time-series design d. Nonequivalent groups interrupted time-series design

b. Nonequivalent control group design

RESEARCH STUDY 11.2: Dr. Bloedorn is a health psychologist who researches nutrition. She is curious as to whether a new drink additive will help people consume fewer calories during a meal. The drink additive is a white, odorless, tasteless powder that a person can add to any drink. She collects a random sample of 63 overweight students on campus and measures the calories they eat during lunch using a bomb calorimeter. She then gives this additive to the same 63 participants to use at dinner and measures how many calories they eat (again using the bomb calorimeter). The addition of a control group that does not use the drink additive would help Dr. Bloedorn address which of the following threats to internal validity? a. Demand characteristics b. Placebo effects c. History d. Instrumentation

b. Placebo effects

A wait-list design is helpful in dealing with which of the following threats to internal validity? a. Maturation b. Selection c. Attrition d. History

b. Selection

Which of the following threats to internal validity would result in group differences prior to the start of the study? a. Design confound b. Selection effect c. Maturation effect d. Order effect

b. Selection effect

RESEARCH STUDY 13.1: Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). In addition to measuring the Body Concern of the participants who joined a fraternity/sorority both immediately before and immediately after they join, Dr. Fletcher measures them for the 3 weeks before and the 3 weeks after. This type of design would be able to better address which of the following threats to internal validity? a. Experimenter bias b. Testing c. Selection-history d. History

b. Testing

RESEARCH STUDY 13.1: Dr. Fletcher is interested in whether joining a fraternity/sorority causes people to become more concerned about their attractiveness and appearance. He recruits a group of 55 freshmen (25 males, 30 females) who are planning to go through fraternity/sorority recruitment on his campus. After they join, he gives them a measure of attractiveness concern/appearance concern (the Body Concern Scale). In addition to measuring the Body Concern of the participants who joined a fraternity/sorority both immediately before and immediately after they join, Dr. Fletcher measures them for the 3 weeks before and the 3 weeks after. This type of design would be able to better address which of the following threats to internal validity? a. History b. Testing c. Experimenter bias d. Selection-history

b. Testing

According to the textbook, what is the problem with WEIRD samples? a. They are not used frequently enough. b. They are not very representative of the world's population. c. They are not good for theory-testing mode. d. They are not very easy to measure.

b. They are not very representative of the world's population.

In which of the following ways are correlational designs similar to quasi-experimental designs? a. They both use nonrandom samples b. They both suffer from possible threats to internal validity c. They both use random assignment d. They both use small numbers of participants

b. They both suffer from possible threats to internal validity

Which of the following can help prevent testing effects? a. Using a clear coding manual b. Using a comparison group c. Establishing reliability of the measure d. Employing a pretest-only design

b. Using a comparison group

Which of the following things can be done to reduce the effect of individual differences? a. Collecting measurements from diverse groups of people b. Using a matched-groups design c. Using a between-groups design d. Decrease power

b. Using a matched-groups design

When a double-blind study is not possible, an acceptable alternative may be: a. the use of a control group b. a masked design c. a matched groups design d. a within-groups design

b. a masked design

In a conceptual replication, the _________ are the same, but the _________ is/are different from the original study. a. independent variables; dependent variables b. variables; operationalization c. methods; participants d. researchers; outcomes

b. variables; operationalization

Dr. Gong conducts a study where she randomly assigns participants to different experimental conditions. The testing for each condition occurs in a different room of the psychology building. After collecting her data, she learns that the air conditioning in one of the rooms had been turned off during data collection. Which of the following threats to internal validity should Dr. Gong be concerned with? a.Order effect b.Design confound c.Maturation effect d.Selection effect

b.Design confound

Neely is examining the graph of an interaction and sees that one line is flat and one line rises sharply to the right. Which of the following should Neely conclude? a.There is a crossover interaction. b.There is a spreading interaction. c.There is a main-effect interaction. d.There is no interaction.

b.There is a spreading interaction.

Studies with one independent variable can show: a.a factorial effect. b.a simple difference. c.an interaction effect. d.a difference in differences.

b.a simple difference.

The number of main effects that need to be examined is _________ the number of independent variables. a.unrelated to b.equal to c.independent of d.more important than

b.equal to

Which of the following types of study support external validity? a. A study that is a direct replication b. A failed replication study c. A study that adds a new independent variable d. A study using non-randomly selected participants

c. A study that adds a new independent variable

RESEARCH STUDY 13.3: Dr. Anderson is a nutritionist who helps clients lose weight prior to surgery. She is working with W. J., a male client who is planning on undergoing a heart transplant. He currently eats more than 3,500 calories a day and has been asked by his doctor to cut the number of calories to about 1,800 (400 for breakfast, 600 for lunch, and 800 for dinner). She is curious as to whether a food journal will help W. J. reduce the number of calories he eats. A food journal is used to record everything a person eats to help patients be more aware of what they're eating. W. J.'s wife also recorded the food he consumed at each meal to have complete data before introducing the journal. Dr. Anderson decides to phase in the food journal gradually, initially only having W. J. record what he ate at breakfast during the first three days after baseline (days 4-6). During days 7-9, the journal is used at lunch, too, and during days 10-12, it also is used during dinner. The data for Dr. Anderson's study are below. In interrogating the construct validity of Dr. Anderson's study, which of the following might be asked? a. By what margin did W. J.'s calorie intake improve? b. Was Dr. Anderson qualified to analyze the data? c. Was the number of calories consumed by W. J. going to decrease before surgery anyway? d. How accurate was W. J.'s wife in her calculation of the calories consumed at each meal?

d. How accurate was W. J.'s wife in her calculation of the calories consumed at each meal?

Which of the following is NOT a small-N design? a. Reversal design b. Stable-baseline design c. Multiple-Baseline design d. Interrupted time-series design

d. Interrupted time-series design

In what way does high within-groups variance obscure between-groups variance? a. It leads to larger effect sizes b. It leads to null results c. It limits the type of statistical analyses that can be conducted d. It causes more overlap between experimental/comparison groups

d. It causes more overlap between experimental/comparison groups

In what way does high within-groups variance obscure between-groups variance? a. It leads to larger effect sizes. b. It limits the type of statistical analyses that can be conducted. c. It leads to null results. d. It causes more overlap between experimental/comparison groups.

d. It causes more overlap between experimental/comparison groups.

RESEARCH STUDY 13.3: Dr. Anderson is a nutritionist who helps clients lose weight prior to surgery. She is working with W. J., a male client who is planning on undergoing a heart transplant. He currently eats more than 3,500 calories a day and has been asked by his doctor to cut the number of calories to about 1,800 (400 for breakfast, 600 for lunch, and 800 for dinner). She is curious as to whether a food journal will help W. J. reduce the number of calories he eats. A food journal is used to record everything a person eats to help patients be more aware of what they're eating. W. J.'s wife also recorded the food he consumed at each meal to have complete data before introducing the journal. Dr. Anderson decides to phase in the food journal gradually, initially only having W. J. record what he ate at breakfast during the first three days after baseline (days 4-6). During days 7-9, the journal is used at lunch, too, and during days 10-12, it also is used during dinner. The data for Dr. Anderson's study are below. Which of the following is NOT a trade-off of Dr. Anderson's use of a small- N design? a. Inferential statistical tests probably cannot be used to examine whether food journals is an effective way to reduce weight. b. She will have to use graphs to represent quantitative changes. c. She will have limited ability to generalize to other patients. d. It will be harder to interpret the size of the effect.

d. It will be harder to interpret the size of the effect.

Which of the following is a difference between participants in small- N designs compared to large- N designs? a. Large-N designs prioritize having a large sample over sampling procedures, while small-N designs focus on sampling procedures. b. Large-N designs benefit from having diverse populations, while small-N designs typically use normative samples. c. Large-N designs only generalize to the population from which participants are drawn, whereas small-N designs generalize to the larger population. d. Large-N designs are more concerned with selecting representative participants, while small-N designs focus on unique cases

d. Large-N designs are more concerned with selecting representative participants, while small-N designs focus on unique cases.

Which of following is NOT a method researchers used to identify or correct for attrition? a. Determine whether those who dropped out of the study had a different pattern of scores than those who stayed in the study b. Drop the original/pretest scores of the participants who left the study c. Use a control group d. Not allow participants to leave a study once it has started

d. Not allow participants to leave a study once it has started

Testing threats involve ________ whereas instrumentation threats involve ________. a. within-groups; between groups b. independent variables' dependent variables c. researchers; participants d. participants; measurements

d. Participants and measurements

Dr. Gavin decides that instead of conducting a 2X4 independent-groups factorial design, he is going to conduct a 2X4 within-groups factorial design. Which of the following things will change? a. The number of main effects that need to be examined b. The number of cells c. the number of interactions that need to be examined d. The number of participants needed

d. The number of participants needed

Which of the following can direct replication studies change? a. The independent variable b. The study procedures c. The dependent variable d. The participants

d. The participants

How does a researcher who conducts a small N design address external validity concerns about his study? a. Runs a large N study before running a small N study b. Runs more small N studies with the same participants c. Runs more small N studies with similar participants d. Triangulates his findings with other findings

d. Triangulates his findings with other findings

Which of the following claims is always researched in generalization mode? a. experimental claims b. causal claims c. association claims d. frequency claims

d. frequency claims

In conducting quasi-experimental designs, researchers tend to give up some _________ in exchange for _________. a. construct validity; statistical validity b. internal validity; statistical validity c. statistical validity; external validity d. internal validity; external validity

d. internal validity; external validity

A small N design that involves providing treatment and removing treatment is known as a(n): a. multiple-baseline design b. interrupted time-series design c. stable-baseline design d. reversal design

d. reversal design

Neely is examining the graph of an interaction and sees one line is flat and one line rises sharply to the right. Which of the following should Neely conclude? a. There is no interaction b. there is a crossover interaction c. there is a main-effect interaction d. there is a spreading interaction

d. there is a spreading interaction

Which of the following is true of p-hacking? a. It is always done intentionally b. it can involve running a different analysis than originally proposed c. It is considered a common and acceptable practice d. It is the same as HARKing

not D

RESEARCH STUDY 12.1: Dr. Elder was interested in the way people recognize objects as members of categories. For example, what makes us recognize a dog as being a dog and not a cat? More specifically, he was curious as to whether people think about categories in a more complex way if they contemplate an "opposite" category first. For example, does a person think differently about the category of "southern" if they first think about the category of "northern"? He is also curious as to whether people categorize differently if they are exposed to category members compared with generating category members. Dr. Elder has four groups of participants (with 30 people in each group). In Group A, participants were told to cut out pictures of dogs and cats from magazines. In Group B, participants were told to cut out pictures of just dogs from magazines. In Group C, participants were told to draw pictures of cats and dogs. In Group D, participants were told to draw pictures of just dogs. After doing this for 30 minutes, participants in all groups were asked to list the attributes that define the "dog" category. Having a higher number of attributes listed was considered to be an indication of thinking about the category in a more complex way. The results of his study are below.Type of Activity-Cutting out Pictures-Drawing PicturesFocus of the Activity-Dogs and cats15 (Cutting Out Pictures)9 (Drawing Pictures)-Dogs only7 (Cutting Out Pictures)6 (Drawing Pictures)Which of the following could be said of the focus of activity variable in Dr. Elder's study? a.There appears to be no main effect for the focus of activity variable. b.The focus of activity variable is a participant variable. c.A proper statistical test would be necessary to determine the effect of the focus of activity variable. d.The focus of activity finding is not as important as the type of activity finding.

Not D

Which of the following topics would be especially well suited to a quasi-experimental design? a. Does watching violent movies cause increases in acceptability of aggression? b. Do people diagnosed with a mental illness have poorer social abilities? c. Does parent-training therapy lead to better parenting skills? d. Does therapy improve coping skills following exposure to a natural disaster?

Not D

RESEARCH STUDY 12.1: Dr. Elder was interested in the way people recognize objects as members of categories. For example, what makes us recognize a dog as being a dog and not a cat? More specifically, he was curious as to whether people think about categories in a more complex way if they contemplate an "opposite" category first. For example, does a person think differently about the category of "southern" if they first think about the category of "northern"? He is also curious as to whether people categorize differently if they are exposed to category members compared with generating category members. Dr. Elder has four groups of participants (with 30 people in each group). In Group A, participants were told to cut out pictures of dogs and cats from magazines. In Group B, participants were told to cut out pictures of just dogs from magazines. In Group C, participants were told to draw pictures of cats and dogs. In Group D, participants were told to draw pictures of just dogs. After doing this for 30 minutes, participants in all groups were asked to list the attributes that define the "dog" category. Having a higher number of attributes listed was considered to be an indication of thinking about the category in a more complex way. The results of his study are below.Type of Activity-Cutting out Pictures-Drawing PicturesFocus of the Activity-Dogs and cats15 (Cutting Out Pictures)9 (Drawing Pictures)-Dogs only7 (Cutting Out Pictures)6 (Drawing Pictures)Which of the following best describes Dr. Elder's study? a.A 4 x 2 nested factorial design b.A 2 x 1 mixed factorial design c.A 2 x 4 within-groups factorial design d.A 2 x 2 crossed factorial design

d.A 2 x 2 crossed factorial design

What is the difference between a main effect and an overall effect? a.Main effects are more complicated to determine than overall effects. b.Main effects look at one variable at a time; overall effects look at all variables simultaneously. c.Main effects are less important than overall effects. d.There is no difference between main effects and overall effects.

d.There is no difference between main effects and overall effects.

If a study has a difference in the differences, you know the study definitely has a: a.significant main effect. b.spreading interaction. c.crossover interaction. d.significant interaction.

d.significant interaction.