Exam 2/16/2016

Differential carryover

a treatment condition affects participants' performance in a later condition in one way and in another way when followed by a different condition

One-group posttest-only design

administration of a posttest to a single group of participants after they have been given an experimental treatment condition rarely useful because no pretest or control group almost all threats to internal validity apply is useful only when specific background information exists on the dependent variable

randomized counterbalancing

sequence of conditions is randomly determined for each participant

10 Psychology participant pools provide a ________ sample. Select one: a. cluster b. convenient c. simple random d. stratified

10 Psychology participant pools provide a ________ sample. Select one: x a. cluster ***b. convenient* x c. simple random x d. stratified

10 Random assignment of participants to the various groups in an experiment Select one: a. guarantees that the independent variable will affect the dependent variable. b. maximized the probability that extraneous variables will NOT have a differential effect on the various treatment groups. c. is essential if you want to generalize your results to the population. d. is very difficult to do and is therefore not commonly done.

10 Random assignment of participants to the various groups in an experiment Select one: x a. guarantees that the independent variable will affect the dependent variable. ***b. maximized the probability that extraneous variables will NOT have a differential effect on the various treatment groups.* c. is essential if you want to generalize your results to the population. d. is very difficult to do and is therefore not commonly done.

intrasubject counterbalancing

participants take treatments in more than one order may not be feasible with long treatment sequences

automation

the technique of totally automating the experimental procedures, so that no experimenter-participant interaction is required

Counterbalancing

Used only with repeated measures (within participants) designs All participants receive all treatment conditions

complete counterbalancing

all possible sequences of treatment conditions are used participants randomly assigned to sequence

2 x 2 design

number of numerals = number of IVs = 2 each number indicates the number of levels for each IV IV1 = 2 levels IV2 = 2 levels

Posttest-only control-group design

random assignment to groups creates equivalence use of control group eliminates most threats to internal validity

Main effect

the influence of one independent variable on the dependent variable ignoring the second IV one main effect for each IV in a study

1 The nonequivalent posttest-only design differs from the one-group posttest-only design and the one-group pretest-posttest design in that Select one: a. it has a comparison group. b. it has high external validity. c. it includes randomization procedures. d. the results can be generalized to the population.

1 The nonequivalent posttest-only design differs from the one-group posttest-only design and the one-group pretest-posttest design in that Select one: ***a. it has a comparison group.* x b. it has high external validity. x c. it includes randomization procedures. d. the results can be generalized to the population.

1 Which of the following is not a typical source of order effects? a. practice b. familiarity with being in experiment c. aging d. learning

1 Which of the following is not a typical source of order effects? x a. practice x b. familiarity with being in experiment ***c. aging* x d. learning

1 Which of the functions of debriefing is probably least likely to be accomplished? Select one: a. the ability to determine if our independent variable manipulation was effective b. the ethical function of explaining the purpose of any deception employed c. none of the above; that is, all have been shown to be adequately addressed with debriefing. d. the educational value function

1 Which of the functions of debriefing is probably least likely to be accomplished? Select one: x a. the ability to determine if our independent variable manipulation was effective x b. the ethical function of explaining the purpose of any deception employed x c. none of the above; that is, all have been shown to be adequately addressed with debriefing. ***d. the educational value function*

10 The defining characteristic of a factorial experimental design is Select one: a. the measurement of more than one dependent variable. b. the manipulation of one independent variable. c. the manipulation of more than one independent variable. d. inclusion of more than two cells.

10 The defining characteristic of a factorial experimental design is Select one: x a. the measurement of more than one dependent variable. x b. the manipulation of one independent variable. ***c. the manipulation of more than one independent variable.* x d. inclusion of more than two cells.

11 Factorial designs are very frequently used because they have many advantages. Which of the following is NOT among them? Select one: a. the results are easy to interpret b. more than one hypothesis can be tested c. potentially confounding extraneous variables can be incorporated into the experiment d. possible interactions among independent variables can be explored

11 Factorial designs are very frequently used because they have many advantages. Which of the following is NOT among them? Select one: ***a. the results are easy to interpret* x b. more than one hypothesis can be tested x c. potentially confounding extraneous variables can be incorporated into the experiment x d. possible interactions among independent variables can be explored

11 What is the advantage of a double-blind experimental design? Select one: a. The effects of extraneous variables are not eliminated but they are spread evenly across groups. b. It makes it impossible for the participant to discover the hypothesis and assures that the data are interpreted in terms of what actually happened, not in terms of what "should" have happened. c. It increases confidence that the data are being interpreted in an unbiased manner. d. It makes the demand characteristics the same for participants in all conditions and eliminates the possibility that the experimenter unintentionally signals the expected outcome to the participants.

11 What is the advantage of a double-blind experimental design? Select one: x a. The effects of extraneous variables are not eliminated but they are spread evenly across groups. x b. It makes it impossible for the participant to discover the hypothesis and assures that the data are interpreted in terms of what actually happened, not in terms of what "should" have happened. x c. It increases confidence that the data are being interpreted in an unbiased manner. ***d. It makes the demand characteristics the same for participants in all conditions and eliminates the possibility that the experimenter unintentionally signals the expected outcome to the participants.*

11 Which of the following is NOT an advantage that comes from automating one's experimental apparatus? Select one: a. facilitation of presentation of the independent variable. b. increased power of statistical tests c. decreased probability of recording errors d. increased uniformity of stimulus presentation

11 Which of the following is NOT an advantage that comes from automating one's experimental apparatus? Select one: x a. facilitation of presentation of the independent variable. ***b. increased power of statistical tests* x c. decreased probability of recording errors x d. increased uniformity of stimulus presentation

28 Participants in human experiments are generally selected Select one: a. based on convenience and availability. b. at random from the population. c. from phone books or class rosters. d. through lotteries and newspaper ads.

28 Participants in human experiments are generally selected Select one: ***a. based on convenience and availability.* x b. at random from the population. c. from phone books or class rosters. d. through lotteries and newspaper ads.

12 A group of physicians tests a new analgesic on their patients with chronic pain problems. They obtain patient ratings of pain, administer the new drug for a week, and then obtain pain ratings again. They find that pain ratings are down 10 points at their second observation. This is an example of which experimental design. Select one: a. one-group pretest-posttest design b. non-equivalent posttest-only design c. one-group posttest-only design d. non-equivalent before-after (pretest-posttest) design

12 A group of physicians tests a new analgesic on their patients with chronic pain problems. They obtain patient ratings of pain, administer the new drug for a week, and then obtain pain ratings again. They find that pain ratings are down 10 points at their second observation. This is an example of which experimental design. Select one: ***a. one-group pretest-posttest design* x b. non-equivalent posttest-only design x c. one-group posttest-only design x d. non-equivalent before-after (pretest-posttest) design

12 Dr. Bassuk is conducting a pilot study for his newest research project. During this pilot study, he repeatedly stops the participants and interviews them. He asks them to report what they were thinking during each portion of the study. This group of participants in the pilot study can also be called a Select one: a. sacrifice group b. introspective group c. concurrent group d. carry-over group

12 Dr. Bassuk is conducting a pilot study for his newest research project. During this pilot study, he repeatedly stops the participants and interviews them. He asks them to report what they were thinking during each portion of the study. This group of participants in the pilot study can also be called a Select one: ***a. sacrifice group* x b. introspective group x c. concurrent group x d. carry-over group

12 The most common criticism regarding the use of college student participant pools is that Select one: a. it may compromise internal validity. b. it may compromise external validity. c. it may introduce a confounding variable. d. students are coerced into participating in research.

12 The most common criticism regarding the use of college student participant pools is that Select one: x a. it may compromise internal validity. ***b. it may compromise external validity.* c. it may introduce a confounding variable. d. students are coerced into participating in research.

13 If an IRB refuses to approve a study the researcher Select one: a. must abide by their ruling and either redesign the study or not conduct it. b. must appear before the board to answer questions about his or her research design. c. has the option to appeal to the national IRB committee. d. can still conduct the study but has greater liability if something goes wrong.

13 If an IRB refuses to approve a study the researcher Select one: ***a. must abide by their ruling and either redesign the study or not conduct it.* x b. must appear before the board to answer questions about his or her research design. x c. has the option to appeal to the national IRB committee. d. can still conduct the study but has greater liability if something goes wrong.

13 What is the major advantage of a within-participants design? Select one: a. the data are easier to interpret than are data from between-participants designs b. it does not carry the risk of carryover or sequencing effects c. the experimenter doesn't have to worry about whether the groups of participants are equivalent to each other d. it is not subject to the influence of expectancy effects

13 What is the major advantage of a within-participants design? Select one: x a. the data are easier to interpret than are data from between-participants designs x b. it does not carry the risk of carryover or sequencing effects ***c. the experimenter doesn't have to worry about whether the groups of participants are equivalent to each other* x d. it is not subject to the influence of expectancy effects

13 _____________ must be used with repeated measures designs. Select one: a. matching b. carryover c. counterbalancing d. intrasubject balancing

13 _____________ must be used with repeated measures designs. Select one: x a. matching x b. carryover ***c. counterbalancing* x d. intrasubject balancing

14 By using intragroup incomplete counterbalancing, you can control for all of the following EXCEPT Select one: a. linear order effects. b. linear carryover effects. c. nonlinear order effects. d. differential carryover effects

14 By using intragroup incomplete counterbalancing, you can control for all of the following EXCEPT Select one: x a. linear order effects. x b. linear carryover effects. x c. nonlinear order effects. ***d. differential carryover effects*

14 Reporting of details regarding participant characteristics, selection, and assignment procedures Select one: a. is not important. b. is considered superfluous and unnecessary given space limitations in most journals. c. is important to enable other researchers to replicate your findings. d. violates conditions of anonymity and is therefore considered unethical.

14 Reporting of details regarding participant characteristics, selection, and assignment procedures Select one: a. is not important. x b. is considered superfluous and unnecessary given space limitations in most journals. ***c. is important to enable other researchers to replicate your findings.* d. violates conditions of anonymity and is therefore considered unethical.

14 Which of the following is an advantage of within-participant designs over between participant designs? Select one: a. a reduction in the potential for differential carryover effects b. reduced potential for guessing the hypothesis c. a reduction in the number of research participants needed d. reduced potential for practice and fatigue effects

14 Which of the following is an advantage of within-participant designs over between participant designs? Select one: a. a reduction in the potential for differential carryover effects b. reduced potential for guessing the hypothesis ***c. a reduction in the number of research participants needed* xxxd. reduced potential for practice and fatigue effects

15 A researcher predicts that tennis professionals will play better in front of an audience. Less capable tennis players, however, are expected to do better without an audience. The researcher Select one: a. expects an interaction effect to occur. b. is predicting a main effect for the audience variable. c. is using a mixed design. d. is predicting a main effect for ability of the tennis player.

15 A researcher predicts that tennis professionals will play better in front of an audience. Less capable tennis players, however, are expected to do better without an audience. The researcher Select one: ***a. expects an interaction effect to occur.* x b. is predicting a main effect for the audience variable. x c. is using a mixed design. x d. is predicting a main effect for ability of the tennis player.

15 In a study designed to examine the effects of caffeine on reaction time, four caffeine conditions (100, 200, 300, and 400 mg of caffeine) are used. If the experimenter decides to use complete counterbalancing and assuming that one subject will be tested in each of the sequences used, how many people will be needed to complete the study? Select one: a. 48 b. 4 c. 24 d. 12

15 In a study designed to examine the effects of caffeine on reaction time, four caffeine conditions (100, 200, 300, and 400 mg of caffeine) are used. If the experimenter decides to use complete counterbalancing and assuming that one subject will be tested in each of the sequences used, how many people will be needed to complete the study? Select one: a. 48 x b. 4 ***c. 24* x d. 12

15 Postexperimental interviews are particularly important when, experimental procedures involves the use of Select one: a. minors. b. deception. c. all of the above. d. random assignment.

15 Postexperimental interviews are particularly important when, experimental procedures involves the use of Select one: a. minors. ***b. deception.* x c. all of the above. d. random assignment.

16 "Pilot" research allows the investigator to Select one: a. simplify his or her research design. b. determine if the randomizing techniques really work. c. select the right participants for his or her study. d. check out the procedures before collecting the real data.

16 "Pilot" research allows the investigator to Select one: x a. simplify his or her research design. x b. determine if the randomizing techniques really work. x c. select the right participants for his or her study. ***d. check out the procedures before collecting the real data.*

16 There are many good reasons for pretesting participants before introducing the independent variable. Perhaps the most common of these is that pretesting Select one: a. is a prerequisite for posttesting. b. gives the experimenter direct evidence of change in performance. c. eliminates the need for random assignment of participants to groups. d. increases the sensitivity of the experiment.

16 There are many good reasons for pretesting participants before introducing the independent variable. Perhaps the most common of these is that pretesting Select one: x a. is a prerequisite for posttesting. ***b. gives the experimenter direct evidence of change in performance.* x c. eliminates the need for random assignment of participants to groups. x d. increases the sensitivity of the experiment.

16 Which of the following extraneous variables can NOT be corrected using random assignment? Select one: a. experimenter but not participant effects b. participant but not experimenter effects c. none of the above d. participant and experimenter effects

16 Which of the following extraneous variables can NOT be corrected using random assignment? Select one: x a. experimenter but not participant effects x b. participant but not experimenter effects x c. none of the above ***d. participant and experimenter effects*

17 The posttest-only control group design requires Select one: a. all of the above. b. a control condition. c. matching on at least one extraneous variable. d. random selection of participants.

17 The posttest-only control group design requires Select one: x a. all of the above. ***b. a control condition.* x c. matching on at least one extraneous variable. x d. random selection of participants.

17 Participants in a memory experiment are asked to learn a list of high-imagery words and then to learn a list of low-imagery words. Using the same participants in each condition could cause it to be confounded by Select one: a. demand characteristic. b. the use of different words types. c. carryover and/or order effects. d. experimenter bias.

17 Participants in a memory experiment are asked to learn a list of high-imagery words and then to learn a list of low-imagery words. Using the same participants in each condition could cause it to be confounded by Select one: x a. demand characteristic. x b. the use of different words types. ***c. carryover and/or order effects.* x d. experimenter bias.

18 If it is not feasible to use a blind technique throughout the whole experiment, the alternative is the Select one: a. double-blind technique. b. selective information technique. c. partial blind technique. d. partial revelation technique.

18 If it is not feasible to use a blind technique throughout the whole experiment, the alternative is the Select one: x a. double-blind technique. x b. selective information technique. ***c. partial blind technique.* x d. partial revelation technique.

18 In a 4X2 factorial design there are _________ cells. Select one: a. 2 b. 8 c. 6 d. 4

18 In a 4X2 factorial design there are _________ cells. Select one: x a. 2 ***b. 8* x c. 6 x d. 4

19 In some experiments, demand characteristics are controlled by making sure neither the participant nor the experimenter knows what condition(s) the participant experienced until the data are collected and analyzed. This is called a----- procedure. Select one: a. matched ignorance b. counterbalancing c. treatment-placebo d. double-blind

19 In some experiments, demand characteristics are controlled by making sure neither the participant nor the experimenter knows what condition(s) the participant experienced until the data are collected and analyzed. This is called a----- procedure. Select one: x a. matched ignorance x b. counterbalancing x c. treatment-placebo ***d. double-blind*

19 What is the important difference between the between-participants posttest-only design and the flawed non-equivalent posttest-only design? Select one: a. the former uses random assignment of participants to groups b. the latter involves testing participants twice c. the latter does not manipulate an independent variables d. the former uses two groups of participants

19 What is the important difference between the between-participants posttest-only design and the flawed non-equivalent posttest-only design? Select one: ***a. the former uses random assignment of participants to groups* x b. the latter involves testing participants twice x c. the latter does not manipulate an independent variables x d. the former uses two groups of participants

19 Which of the following should be done first during debriefing? Select one: a. tell participants that deception was involved in the research b. explain the purpose of the research c. ask participants questions about their experience d. let participants ask questions about their experience

19 Which of the following should be done first during debriefing? Select one: x a. tell participants that deception was involved in the research x b. explain the purpose of the research c. ask participants questions about their experience ***d. let participants ask questions about their experience*

2 The consent to participate statement must include all of the following, except which one? Select one: a. funding sources and any governmental agencies affiliated with the study. b. list of procedures, discomforts or risks associated with participation. c. information about earning extra credit. d. detailed information about the study: where, when and how long will the subject participate.

2 The consent to participate statement must include all of the following, except which one? Select one: ***a. funding sources and any governmental agencies affiliated with the study.* x b. list of procedures, discomforts or risks associated with participation. x c. information about earning extra credit. x d. detailed information about the study: where, when and how long will the subject participate.

2 Suppose you do find an extraneous variable that could have great influence on your results, beyond the influence of the independent variable. You could increase the experiment's sensitivity by a. exposing half of your participants to the independent variable, and half to the extraneous variable, and comparing the performance of the two groups. b. studying that variable first. c. randomly assigning participants to experience either the independent variable or the extraneous variable. d. incorporating that extraneous variable as a second independent variable.

2 Suppose you do find an extraneous variable that could have great influence on your results, beyond the influence of the independent variable. You could increase the experiment's sensitivity by x a. exposing half of your participants to the independent variable, and half to the extraneous variable, and comparing the performance of the two groups. x b. studying that variable first. x c. randomly assigning participants to experience either the independent variable or the extraneous variable. ***d. incorporating that extraneous variable as a second independent variable.*

2 The major disadvantage of a within-participants design is that Select one: a. it is very susceptible to order and carryover effects. b. it is difficult to interpret the data it produces. c. it does not guarantee equivalence across groups of participants. d. it is unusually vulnerable to influence of expectancy effects.

2 The major disadvantage of a within-participants design is that Select one: ***a. it is very susceptible to order and carryover effects.* x b. it is difficult to interpret the data it produces. x c. it does not guarantee equivalence across groups of participants. x d. it is unusually vulnerable to influence of expectancy effects.

20 Frequently, experimenters try out new procedures and/or apparatuses by running the experiment using just a few participants. This experiment is called a Select one: a. test run. b. pilot study. c. dry run. d. mini-study.

20 Frequently, experimenters try out new procedures and/or apparatuses by running the experiment using just a few participants. This experiment is called a Select one: x a. test run. ***b. pilot study.* c. dry run. d. mini-study.

20 The major fault in the non-equivalent posttest only design is that Select one: a. there is no way to tell the direction of effect that the independent variable may have. b. the two groups are may not be equivalent at the beginning. c. the two groups do not experience the same level of the independent variable. d. it involves random assignment to groups, therefore the groups are not equivalent at the start of the study

20 The major fault in the non-equivalent posttest only design is that Select one: x a. there is no way to tell the direction of effect that the independent variable may have. ***b. the two groups are may not be equivalent at the beginning.* x c. the two groups do not experience the same level of the independent variable. x d. it involves random assignment to groups, therefore the groups are not equivalent at the start of the study

20 When one of the matching techniques is used, Select one: a. the possibility of confounding of the experiment is eliminated. b. randomizing techniques are no longer needed. c. randomizing should still be used where possible. d. generalization to the population is assured.

20 When one of the matching techniques is used, Select one: x a. the possibility of confounding of the experiment is eliminated. x b. randomizing techniques are no longer needed. ***c. randomizing should still be used where possible.* x d. generalization to the population is assured.

21 A power analysis allows you to determine the number of participants needed if you also know Select one: a. alpha. b. effect size. c. alpha and power. d. alpha, power, and effect size.

21 A power analysis allows you to determine the number of participants needed if you also know Select one: a. alpha. x b. effect size. c. alpha and power. ***d. alpha, power, and effect size.*

21 Dr. James is conducting a repeated measures study in which the IV has three levels. Dr. James randomly assigns one of the six possible sequences of levels to each participant. This type of counterbalancing is called Select one: a. complete counterbalancing b. incomplete counterbalancing c. intrasubject counterbalancing d. randomized counterbalancing

21 Dr. James is conducting a repeated measures study in which the IV has three levels. Dr. James randomly assigns one of the six possible sequences of levels to each participant. This type of counterbalancing is called Select one: x a. complete counterbalancing x b. incomplete counterbalancing x c. intrasubject counterbalancing ***d. randomized counterbalancing*

23 A research design that contains both between participants and within participants variables is called a Select one: a. double variable design b. mixed design c. factorial design d. combination design

23 A research design that contains both between participants and within participants variables is called a Select one: x a. double variable design ***b. mixed design* x c. factorial design x d. combination design

24 Any experimental design that incorporates more than one independent variable is called a _______ design. Select one: a. factorial b. complex c. interaction d. simple randomized

24 Any experimental design that incorporates more than one independent variable is called a _______ design. Select one: ***a. factorial* x b. complex x c. interaction x d. simple randomized

24 The main disadvantage of intrasubject counterbalancing is Select one: a. it requires a large number of participants in order to be valid. b. it does not control for linear order effects. c. it requires many test conditions for each participant and thus can take a long time. d. it does not work when carryover effects are linear.

24 The main disadvantage of intrasubject counterbalancing is Select one: x a. it requires a large number of participants in order to be valid. x b. it does not control for linear order effects. ***c. it requires many test conditions for each participant and thus can take a long time.* x d. it does not work when carryover effects are linear.

24 Which of the following is NOT true with regard to procedures? Select one: a. it is far more important to treat human participants in exactly the same manner than it is for non-human participants b. as long as the instructions are uniformly presented, it is not very important how an experimenter greets and otherwise interacts with the participants c. the handling of rats between the home cages and the test apparatus can influence the outcome of the experiment d. all participants should experience the same events even though they are totally unrelated to the experiment

24 Which of the following is NOT true with regard to procedures? Select one: a. it is far more important to treat human participants in exactly the same manner than it is for non-human participants ***b. as long as the instructions are uniformly presented, it is not very important how an experimenter greets and otherwise interacts with the participants* c. the handling of rats between the home cages and the test apparatus can influence the outcome of the experiment x d. all participants should experience the same events even though they are totally unrelated to the experiment

26 A good way to work out the kinks of an experiment is to Select one: a. engage in step-by-step visualization of the research procedure. b. conduct a pilot study. c. write an IRB proposal. d. have someone else read the procedure section of your paper.

26 A good way to work out the kinks of an experiment is to Select one: x a. engage in step-by-step visualization of the research procedure. ***b. conduct a pilot study.* x c. write an IRB proposal. d. have someone else read the procedure section of your paper.

26 Even though the one-group pretest-posttest design is inadequate, it has one methodological advantage over the one-group posttest-only design, and that is Select one: a. statistical tests are available to use with that design. b. external validity. c. the use of randomization. d. pretest scores can be compared to posttest scores.

26 Even though the one-group pretest-posttest design is inadequate, it has one methodological advantage over the one-group posttest-only design, and that is Select one: x a. statistical tests are available to use with that design. x b. external validity. x c. the use of randomization. ***d. pretest scores can be compared to posttest scores.*

27 Which of the following is NOT the purpose of creating the research design for a research problem? Select one: a. to analyze the data collected b. to suggest how the data will be collected c. to control for unwanted variation d. to create an outline or plan for data collection

27 Which of the following is NOT the purpose of creating the research design for a research problem? Select one: ***a. to analyze the data collected* x b. to suggest how the data will be collected x c. to control for unwanted variation x d. to create an outline or plan for data collection

28 Suppose a researcher were reporting on a factorial experiment in which she simultaneously manipulated two independent variables. One of the independent variables was presented between participants and the other was presented within participants. This is an example of a design. Select one: a. simple randomized participants b. mixed model c. interactive d. complex

28 Suppose a researcher were reporting on a factorial experiment in which she simultaneously manipulated two independent variables. One of the independent variables was presented between participants and the other was presented within participants. This is an example of a design. Select one: x a. simple randomized participants ***b. mixed model* x c. interactive x d. complex

29 In a 4x2 factorial design, there are Select one: a. two independent variables with 4 levels on one and 2 levels on the other. b. four independent variables with 2 levels each. c. eight independent variables. d. two independent variables with 4 levels each.

29 In a 4x2 factorial design, there are Select one: ***a. two independent variables with 4 levels on one and 2 levels on the other.* x b. four independent variables with 2 levels each. x c. eight independent variables. x d. two independent variables with 4 levels each.

3 Suppose you have gone to great lengths to determine which participants will perform the experiment at what time and in what group, but some participants just fail to show up for their appointments. What should you do? Select one: a. estimate what their performance would have been based on how other members of their group performed and add it in to your results b. randomly select and assign new participants to take their place c. to fill in the gaps in your groups, take the nearest willing volunteers d. nothing; conduct the experiment as planned, without their data

3 Suppose you have gone to great lengths to determine which participants will perform the experiment at what time and in what group, but some participants just fail to show up for their appointments. What should you do? Select one: a. estimate what their performance would have been based on how other members of their group performed and add it in to your results ***b. randomly select and assign new participants to take their place* c. to fill in the gaps in your groups, take the nearest willing volunteers d. nothing; conduct the experiment as planned, without their data

3 Which of the following describes intrasubject counterbalancing in an experiment with two experimental conditions, A and B? a. half the participants experience condition one first followed by condition two (AB), while the other half gets the conditions in the reverse order (BA) b. each participant experiences condition A first, then condition B (AB) c. half the participants experience one condition (A), and the other half experience the other condition(B) d. each participant experiences the following: condition A, condition B, condition B again, and condition A again (ABBA)

3 Which of the following describes intrasubject counterbalancing in an experiment with two experimental conditions, A and B? x a. half the participants experience condition one first followed by condition two (AB), while the other half gets the conditions in the reverse order (BA) x b. each participant experiences condition A first, then condition B (AB) x c. half the participants experience one condition (A), and the other half experience the other condition(B) ***d. each participant experiences the following: condition A, condition B, condition B again, and condition A again (ABBA)*

30 According to research by Kimmel (1991), IRB decisions seem to be partially dependent on Select one: a. age (younger reviewers tend to be more lenient). b. time of day (more studies are approved in the morning). c. gender (male reviewers are more likely to approve studies). d. the size of the university (larger universities tend to have lower approval rates).

30 According to research by Kimmel (1991), IRB decisions seem to be partially dependent on Select one: a. age (younger reviewers tend to be more lenient). x b. time of day (more studies are approved in the morning). ***c. gender (male reviewers are more likely to approve studies).* x d. the size of the university (larger universities tend to have lower approval rates).

30 Often, we do not know at the start of an experiment what extraneous variables could affect our results. The best means of controlling unknown sources of extraneous variables is Select one: a. matching. b. counterbalancing. c. analysis of covariance. d. randomization.

30 Often, we do not know at the start of an experiment what extraneous variables could affect our results. The best means of controlling unknown sources of extraneous variables is Select one: x a. matching. x b. counterbalancing. x c. analysis of covariance. ***d. randomization.*

30 The two most important techniques for eliminating potential rival hypotheses are Select one: a. use of pretests and control groups. b. random assignment of participants and use of control groups. c. random assignment of participants and use of pretests. d. random selection of participants and random assignment of participants.

30 The two most important techniques for eliminating potential rival hypotheses are Select one: x a. use of pretests and control groups. ***b. random assignment of participants and use of control groups.* x c. random assignment of participants and use of pretests. x d. random selection of participants and random assignment of participants.

31 Order effects and carryover effects differ in that Select one: a. carryover effects only occur when there are two independent variables. b. for carryover effects it is only the ordinal position of the treatment that matters. c. for order effects it is only the ordinal position of the treatment that matters.

31 Order effects and carryover effects differ in that Select one: x a. carryover effects only occur when there are two independent variables. x b. for carryover effects it is only the ordinal position of the treatment that matters. ***c. for order effects it is only the ordinal position of the treatment that matters.*

33 The most basic and simplest matching technique is to Select one: a. hold the extraneous variable constant b. frequency distribution matching c. make the extraneous variable an IV d. individual matching

33 The most basic and simplest matching technique is to Select one: ***a. hold the extraneous variable constant* x b. frequency distribution matching x c. make the extraneous variable an IV x d. individual matching

33 The pretest-posttest control group design is also considered a _________ design. Select one: a. mixed b. within participants c. weak d. between participants

33 The pretest-posttest control group design is also considered a _________ design. Select one: ***a. mixed* x b. within participants x c. weak x d. between participants

34 Perhaps the greatest technological advance in experimental apparatus has been Select one: a. the development of the Skinner box. b. the ability to tape record experimental instructions. c. the development of EEG. d. the arrival of affordable, easily programmed microcomputers.

34 Perhaps the greatest technological advance in experimental apparatus has been Select one: x a. the development of the Skinner box. x b. the ability to tape record experimental instructions. x c. the development of EEG. ***d. the arrival of affordable, easily programmed microcomputers.*

36 Which of the following is NOT typically considered to be a function of debriefing? Select one: a. to return participants to their preexperimental state b. to obtain demographic information from the participants c. to assess the effects of the independent variable manipulation d. to teach the participants something about the research

36 Which of the following is NOT typically considered to be a function of debriefing? Select one: x a. to return participants to their preexperimental state ***b. to obtain demographic information from the participants* x c. to assess the effects of the independent variable manipulation d. to teach the participants something about the research

37 It is usually impossible to eliminate the effects of extraneous variables. However, it may be possible to eliminate Select one: a. differential effects of intrinsic variables. b. differential effects of extraneous variables. c. the effects of the independent variable. d. the effects of the dependent variable.

37 It is usually impossible to eliminate the effects of extraneous variables. However, it may be possible to eliminate Select one: x a. differential effects of intrinsic variables. ***b. differential effects of extraneous variables.* x c. the effects of the independent variable. d. the effects of the dependent variable.

37 Which of the following factors should you consider when deciding on what research design to use? Select one: a. use of a pretest b. use of a control group c. number of groups d. all of the above

37 Which of the following factors should you consider when deciding on what research design to use? Select one: *a. use of a pretest* *b. use of a control group* *c. number of groups* ***d. all of the above*

38 One way in which experimenter expectancy effects can be manifested is in errors in recording data. What is the best way to control this? Select one: a. do not use a dependent variable that has to be measured b. automate the data collection as much as possible c. do not use a dependent variable that has to be measured numerically d. use a panel of students to make the observations of the dependent variable

38 One way in which experimenter expectancy effects can be manifested is in errors in recording data. What is the best way to control this? Select one: x a. do not use a dependent variable that has to be measured ***b. automate the data collection as much as possible* x c. do not use a dependent variable that has to be measured numerically x d. use a panel of students to make the observations of the dependent variable

38 Power of a statistical test refers to Select one: a. the probability of rejecting a false null hypothesis. b. the probability of not rejecting a true null hypothesis. c. the probability of rejecting a true null hypothesis. d. the probability of not rejecting a false null hypothesis.

38 Power of a statistical test refers to Select one: ***a. the probability of rejecting a false null hypothesis.* b. the probability of not rejecting a true null hypothesis. x c. the probability of rejecting a true null hypothesis. d. the probability of not rejecting a false null hypothesis.

39 According to your text what is the primary disadvantage of posting debriefing information on a website? Select one: a. an inability to assess the psychological state of the participant b. difficulty in determining the effectiveness of our deception c. an inability to accurately explain the nature of the research d. the inability to fulfill the educational component of the debriefing session.

39 According to your text what is the primary disadvantage of posting debriefing information on a website? Select one: ***a. an inability to assess the psychological state of the participant* b. difficulty in determining the effectiveness of our deception x c. an inability to accurately explain the nature of the research d. the inability to fulfill the educational component of the debriefing session.

39 The only control technique that can account for both known and unknown sources of extraneous variation is Select one: a. random selection. b. precision control. c. random assignment. d. matching by yoked control.

39 The only control technique that can account for both known and unknown sources of extraneous variation is Select one: x a. random selection. x b. precision control. ***c. random assignment.* x d. matching by yoked control.

39Why does a good experiment include a control group? Select one: a. it gives us information about how participants would perform without experiencing the experimental treatment b. it increases the number of people in the study, and hence, the generalizability of the results c. control groups have been an established part of scientific tradition for many decades d. it eliminates the effects of external validity

39Why does a good experiment include a control group? Select one: ***a. it gives us information about how participants would perform without experiencing the experimental treatment* x b. it increases the number of people in the study, and hence, the generalizability of the results x c. control groups have been an established part of scientific tradition for many decades x d. it eliminates the effects of external validity

4 As sample size increases, Select one: a. average scores on the dependent variable increase b. the ability to detect statistically significant differences among groups. c. scores on the independent variable decrease d. research becomes less valid.

4 As sample size increases, Select one: x a. average scores on the dependent variable increase ***b. the ability to detect statistically significant differences among groups.* c. scores on the independent variable decrease d. research becomes less valid.

4 Dr. Sheffield wants to investigate the causal relationship between frustration and memory. She divides participants into two groups using random assignment. One group is given a problem to solve that has no solution, inducing frustration, while the other group is given a problem to solve that has a solution. Then both groups have their memory tested. The group that is in the frustration condition can also be called the Select one: a. experimental group b. posttest group c. control group d. comparison group

4 Dr. Sheffield wants to investigate the causal relationship between frustration and memory. She divides participants into two groups using random assignment. One group is given a problem to solve that has no solution, inducing frustration, while the other group is given a problem to solve that has a solution. Then both groups have their memory tested. The group that is in the frustration condition can also be called the Select one: ***a. experimental group* x b. posttest group x c. control group x d. comparison group

4 Sometimes, the treatment received in one condition of an experiment can influence behavior under the next condition. This is known as a ___ effect. a. interference b. order c. confusion d. carryover

4 Sometimes, the treatment received in one condition of an experiment can influence behavior under the next condition. This is known as a ___ effect. x a. interference x b. order x c. confusion ***d. carryover*

40 When would an experimenter want to use "yoked" matching of participants? Select one: a. when the required performance or response is too difficult for one person to do alone b. when the temporal sequence of experimental events could be confounded with the independent variable and influence the results c. when random selection of participants from the population is not possible or is impractical d. when participants are randomly selected from the population but not randomly assigned to groups

40 When would an experimenter want to use "yoked" matching of participants? Select one: a. when the required performance or response is too difficult for one person to do alone ***b. when the temporal sequence of experimental events could be confounded with the independent variable and influence the results* x c. when random selection of participants from the population is not possible or is impractical x d. when participants are randomly selected from the population but not randomly assigned to groups

43 Evelyn has a new speed reading program she wants to test. She trains 6 people on her program, then measures their reading speed. This is an example of which experimental design? Select one: a. one-group pretest-posttest design b. one-group posttest-only design c. non-equivalent posttest-only design d. non-equivalent before-after (pretest-posttest) design

43 Evelyn has a new speed reading program she wants to test. She trains 6 people on her program, then measures their reading speed. This is an example of which experimental design? Select one: x a. one-group pretest-posttest design ***b. one-group posttest-only design* x c. non-equivalent posttest-only design x d. non-equivalent before-after (pretest-posttest) design

48 Which of the following is NOT a benefit of incorporating a pretest into your experimental design? Select one: a. it can determine if there is a potential ceiling effect in the dependent measure b. it allows for assessment of each group's initial position on the dependent measure c. it allows the experimenter to match participants on critical variables d. it can sensitize the participants to the experimental treatment

48 Which of the following is NOT a benefit of incorporating a pretest into your experimental design? Select one: x a. it can determine if there is a potential ceiling effect in the dependent measure x b. it allows for assessment of each group's initial position on the dependent measure x c. it allows the experimenter to match participants on critical variables ***d. it can sensitize the participants to the experimental treatment*

49 One problem, noted in your text, with recruiting research participants through the Internet is that Select one: a. contacting potential participants is difficult. b. it is difficult to find diverse samples. c. the participants may not be representative of non-Internet users

49 One problem, noted in your text, with recruiting research participants through the Internet is that Select one: x a. contacting potential participants is difficult. b. it is difficult to find diverse samples. ***c. the participants may not be representative of non-Internet users*

49 The major fault in the one-group pretest-posttest design is that a. there is no way to test whether participants' performance changed over time. b. there are no statistics available to test the data this design yields. c. there is no way to control for demand characteristics. d. there is no way to examine the effects of history and maturation on the results.

49 The major fault in the one-group pretest-posttest design is that x a. there is no way to test whether participants' performance changed over time. x b. there are no statistics available to test the data this design yields. x c. there is no way to control for demand characteristics. ***d. there is no way to examine the effects of history and maturation on the results.*

5 If human participants cannot be selected randomly, Select one: a. then select with a conscious bias and keep that in mind when interpreting data. b. it is imperative to match participants to each other (individual matching). c. then use non-human participants so you can get them at your convenience. d. it becomes more important to report exactly how participants were selected and assigned.

5 If human participants cannot be selected randomly, Select one: x a. then select with a conscious bias and keep that in mind when interpreting data. x b. it is imperative to match participants to each other (individual matching). x c. then use non-human participants so you can get them at your convenience. ***d. it becomes more important to report exactly how participants were selected and assigned.*

5 Suppose you are conducting a factorial study with variables A and B. Your results reveal an interaction effect. This means that Select one: a. the effects of variable A and of variable B cancel each other out. b. one of the variables, A or B, can have an effect on performance only if the other does not. c. the effect of independent variable A depends on what level of independent variable B they experience. d. variable A is effective in changing performance only if variable B is also effective.

5 Suppose you are conducting a factorial study with variables A and B. Your results reveal an interaction effect. This means that Select one: x a. the effects of variable A and of variable B cancel each other out. x b. one of the variables, A or B, can have an effect on performance only if the other does not. ***c. the effect of independent variable A depends on what level of independent variable B they experience.* x d. variable A is effective in changing performance only if variable B is also effective.

5 Which of the control techniques has the most power to insure that unidentified, extraneous variables do not have differential effects on the different groups in the experiment? a. counterbalancing b. randomization c. matching d. precision matching

5 Which of the control techniques has the most power to insure that unidentified, extraneous variables do not have differential effects on the different groups in the experiment? x a. counterbalancing ***b. randomization* x c. matching x d. precision matching

50 Suppose you are interested in studying how prior exposure can affect color preference, but you know that color preferences are also a function of ethnic background. You could increase your study's sensitivity by studying only one ethnic group. There is a problem inherent in this approach, which is that Select one: a. you don't know which ethnic group prefers which colors. b. you would have to use a larger sample to be sure your results were valid. c. your results would not be generalizable beyond the ethnic group you studied. d. you would have to use several levels of prior exposure to be sure you were getting an accurate picture of the relationship between exposure and preference.

50 Suppose you are interested in studying how prior exposure can affect color preference, but you know that color preferences are also a function of ethnic background. You could increase your study's sensitivity by studying only one ethnic group. There is a problem inherent in this approach, which is that Select one: x a. you don't know which ethnic group prefers which colors. x b. you would have to use a larger sample to be sure your results were valid. ***c. your results would not be generalizable beyond the ethnic group you studied.* x d. you would have to use several levels of prior exposure to be sure you were getting an accurate picture of the relationship between exposure and preference.

51 Dr. Bassuk is conducting a pilot study for his newest research project. During this pilot study, he has the participants verbalize their thoughts as they perform the experiment. This technique is called the Select one: a. carry-over technique b. sacrifice technique c. concurrent technique d. think-aloud technique

51 Dr. Bassuk is conducting a pilot study for his newest research project. During this pilot study, he has the participants verbalize their thoughts as they perform the experiment. This technique is called the Select one: x a. carry-over technique b. sacrifice technique c. concurrent technique ***d. think-aloud technique*

6 In all repeated-measures designs Select one: a. participants will be tested more than once per condition. b. every participant will be tested in each of the conditions of the study. c. participants will be matched on at least one variable. d. there is less control than between participants designs.

6 In all repeated-measures designs Select one: x a. participants will be tested more than once per condition. ***b. every participant will be tested in each of the conditions of the study.* x c. participants will be matched on at least one variable. x d. there is less control than between participants designs.

6 What is the primary benefit of matching? a. it eliminates the influence of virtually all known extraneous variables b. the influence of the variables on which participants are matched is spread evenly across groups c. it eliminates experimenter expectancy and participant effects d. it overrides the need for random assignment

6 What is the primary benefit of matching? x a. it eliminates the influence of virtually all known extraneous variables ***b. the influence of the variables on which participants are matched is spread evenly across groups* x c. it eliminates experimenter expectancy and participant effects x d. it overrides the need for random assignment

7 Because researchers are generally more concerned with establishing internal validity rather than external validity, they are typically more concerned with _________ and less concerned with ____________. Select one: a. populations; samples b. samples; populations c. random selection; random assignment d. random assignment; random selection

7 Because researchers are generally more concerned with establishing internal validity rather than external validity, they are typically more concerned with _________ and less concerned with ____________. Select one: x a. populations; samples x b. samples; populations x c. random selection; random assignment ***d. random assignment; random selection*

8 In a 2 (age) x 2 (type of therapy) factorial design, which of the following outcomes would be an example of an interaction? Select one: a. young adults do better in therapy A; older adults also do better with this therapy b. therapy A works better for young adults, while therapy B works better for older adults c. therapy B works better overall, and this is true for both young and old adults d. older adults improve more than younger adults, regardless of type of therapy

8 In a 2 (age) x 2 (type of therapy) factorial design, which of the following outcomes would be an example of an interaction? Select one: x a. young adults do better in therapy A; older adults also do better with this therapy ***b. therapy A works better for young adults, while therapy B works better for older adults* x c. therapy B works better overall, and this is true for both young and old adults x d. older adults improve more than younger adults, regardless of type of therapy

9 The most important difference between weak and strong research designs is that strong designs Select one: a. include both a pre-test and a post-test. b. include more than one independent variable. c. have greater internal validity. d. have greater external validity.

9 The most important difference between weak and strong research designs is that strong designs Select one: x a. include both a pre-test and a post-test. x b. include more than one independent variable. ***c. have greater internal validity.* x d. have greater external validity.

Debriefing

Functions ethical undo any deception involved in study decrease stress or risk if possible attempt to return participants to pre-experimental state particularly important if deception is used educational this mostly applies to students participating in research for class credit methodological to establish effectiveness of independent variable or deception to judge accuracy of participations' suspicions and perceptions sense of satisfaction participant feeling as if they contributed to science and society

Posttest-only design with nonequivalent groups

design in which the performance of an experimental group is compared with that of a nonequivalent control group at the posttest internal threats addressed include history, maturation, regression, and attrition no assurance of equality of groups because they were not randomly assigned may confound selection with treatment effect selection additive and interactive effects also may be present

sacrifice groups

groups of participants who are stopped and interviewed at different stages of the experiment

Pretest-posttest control-group design

+advantages of including a pretest can assess the effects of randomization insure that groups are equivalent on dependent variable prior to introduction of experimental conditions determine if ceiling or floor effect has occurred allows use of analysis of covariance to statistically control for pretest differences allows researcher to assess the change in dependent variable from pretest to posttest -Disadvantage of including a pretest may not generalize to situations with no pretest

2 x 3 design

2 IVs IV1 = 2 levels IV2 = 3 levels

21 Which of the following is a clear example of an interaction? Select one: a. larger print is read faster in bright light than smaller print and smaller print is read slower in dim light than larger print. b. rats given a drug in the morning are more active than rats given placebo and rats given placebo in the evening are more active than rats given drug. c. performance on a proofreading task is impaired when others are present rather than alone. The effect is the same whether the others are men or women. d. compared to drinking non-alcoholic beverages, drinking alcohol makes men more aggressive in a hot room and drinking alcohol also makes men more aggressive in a cool room.

21 Which of the following is a clear example of an interaction? Select one: x a. larger print is read faster in bright light than smaller print and smaller print is read slower in dim light than larger print. ***b. rats given a drug in the morning are more active than rats given placebo and rats given placebo in the evening are more active than rats given drug.* x c. performance on a proofreading task is impaired when others are present rather than alone. The effect is the same whether the others are men or women. x d. compared to drinking non-alcoholic beverages, drinking alcohol makes men more aggressive in a hot room and drinking alcohol also makes men more aggressive in a cool room.

22 Generally speaking, as the number of the participants in the study increases, Select one: a. power also increases. b. the likelihood of correctly rejecting the null hypothesis decreases. c. the likelihood of making a Type II error also increases. d. power decreases.

22 Generally speaking, as the number of the participants in the study increases, Select one: x a. power also increases. x b. the likelihood of correctly rejecting the null hypothesis decreases. ***c. the likelihood of making a Type II error also increases.* x d. power decreases.

22 Hannah wants to see if her new technique of ping-pong playing can increase one's ping-pong performance. She asks the U.S. Olympic ping-pong team to work with her. Half of the U.S Olympic team is randomly assigned to be taught by the new style, the experimental group, and the other randomly assigned half are not, the control group. Her technique does not significantly increase the performance of the experimental group compared to the control group, perhaps because they are already so good at the sport. This could be an example of Select one: a. an internally valid study. b. the need for matching groups. c. the need for determining initial comparability. d. a ceiling effect./floor effect

22 Hannah wants to see if her new technique of ping-pong playing can increase one's ping-pong performance. She asks the U.S. Olympic ping-pong team to work with her. Half of the U.S Olympic team is randomly assigned to be taught by the new style, the experimental group, and the other randomly assigned half are not, the control group. Her technique does not significantly increase the performance of the experimental group compared to the control group, perhaps because they are already so good at the sport. This could be an example of Select one: x a. an internally valid study. x b. the need for matching groups. x c. the need for determining initial comparability. ***d. a ceiling effect./floor effect*

22 Two middle school teachers want to find which of three new violence prevention programs would be most effective in their school. From September through November, program #1 is in effect. It is then replaced by program #2 from December through February, and then program #3 runs from March through May. In June the teachers examined fight reports for the school year and find that there were 14 fights in the fall, 10 fights in the winter, and 6 fights in the spring. They conclude that program #3 is most effective is stopping violence. Which of the following is a plausible rival hypothesis to their interpretation? Select one: a. fighting decreases in spring, anyway b. the effects of programs #1 and #2 could have carried over into the spring c. whatever program came third might have been associated with the fewest fights d. all of the above are plausible alternative explanations

22 Two middle school teachers want to find which of three new violence prevention programs would be most effective in their school. From September through November, program #1 is in effect. It is then replaced by program #2 from December through February, and then program #3 runs from March through May. In June the teachers examined fight reports for the school year and find that there were 14 fights in the fall, 10 fights in the winter, and 6 fights in the spring. They conclude that program #3 is most effective is stopping violence. Which of the following is a plausible rival hypothesis to their interpretation? Select one: x a. fighting decreases in spring, anyway x b. the effects of programs #1 and #2 could have carried over into the spring x c. whatever program came third might have been associated with the fewest fights ***d. all of the above are plausible alternative explanations*

23 In what counterbalancing technique would you present experimental treatments to participants in one order, and then in the reverse order? Select one: a. randomizedcounterbalancing b. extrasubject counterbalancing c. intrasubject counterbalancing d. intersubject counterbalancing

23 In what counterbalancing technique would you present experimental treatments to participants in one order, and then in the reverse order? Select one: x a. randomizedcounterbalancing x b. extrasubject counterbalancing ***c. intrasubject counterbalancing* x d. intersubject counterbalancing

25 A mixed factorial design has Select one: a. a yoked control. b. one independent variable and two dependent variables. c. at least one between-subjects factor and at least one within-subjects factor. d. one main effect and one interaction.

25 A mixed factorial design has Select one: x a. a yoked control. x b. one independent variable and two dependent variables. ***c. at least one between-subjects factor and at least one within-subjects factor.* x d. one main effect and one interaction.

25 If an experiment had four conditions (A, B, C, and D) and each participant is to be measured under each condition, intragroup incomplete counterbalancing might be the best method to use. Which of the following describes this method? Select one: a. Group I: ABCD; Group II: BCDA ;Group III: CDAB; Group IV: DABC b. ABCDDCBA c. Group I: ABDC; Group II: BCAD; Group III: CDBA; Group IV: DACB d. ABCD

25 If an experiment had four conditions (A, B, C, and D) and each participant is to be measured under each condition, intragroup incomplete counterbalancing might be the best method to use. Which of the following describes this method? Select one: x a. Group I: ABCD; Group II: BCDA ;Group III: CDAB; Group IV: DABC x b. ABCDDCBA ***c. Group I: ABDC; Group II: BCAD; Group III: CDBA; Group IV: DACB* x d. ABCD

26 Participants volunteered to be in a study of the effects of vitamin supplements. The experimenter was given an unlabeled syringe containing saline or a vitamin supplement to inject into the participant. The participants were not told if the injection they received is the vitamin supplement or a placebo. This experiment is using a_________ technique. Select one: a. independent measure of the dependent variable b. deception c. blind d. double-blind

26 Participants volunteered to be in a study of the effects of vitamin supplements. The experimenter was given an unlabeled syringe containing saline or a vitamin supplement to inject into the participant. The participants were not told if the injection they received is the vitamin supplement or a placebo. This experiment is using a_________ technique. Select one: x a. independent measure of the dependent variable x b. deception x c. blind ***d. double-blind*

27 In individual matching, Select one: a. each participant is randomly paired with another participant. b. each participant in one group is equated with another participant in another group on selected extraneous variables (e.g., education level). c. groups are formed such that they have the same overall distribution of a given extraneous variable (e.g., age). d. each participant is paired with another participant such that both experience the same temporal sequence of events.

27 In individual matching, Select one: x a. each participant is randomly paired with another participant. ***b. each participant in one group is equated with another participant in another group on selected extraneous variables (e.g., education level).* x c. groups are formed such that they have the same overall distribution of a given extraneous variable (e.g., age). x d. each participant is paired with another participant such that both experience the same temporal sequence of events.

28 If you are interested in any possible interaction effects between an extraneous variable and the independent variable, which of the following techniques you should use? Select one: a. counterbalancing b. matching by equating participants c. matching by making the extraneous variable into another independent variable d. matching by holding the extraneous variable constant

28 If you are interested in any possible interaction effects between an extraneous variable and the independent variable, which of the following techniques you should use? Select one: x a. counterbalancing x b. matching by equating participants ***c. matching by making the extraneous variable into another independent variable* x d. matching by holding the extraneous variable constant

29 Carryover effects occur when Select one: a. participants drop out of the study at differential rates. b. the independent variable affects the dependent variable c. the effects of one condition are still present when the next condition is administered. d. something internal to the participants changes over time that is unrelated to the independent variable.

29 Carryover effects occur when Select one: x a. participants drop out of the study at differential rates. x b. the independent variable affects the dependent variable x c. the effects of one condition are still present when the next condition is administered. ***d. something internal to the participants changes over time that is unrelated to the independent variable.*

29 The session that the researcher holds with participants at the conclusion of the experiment is called Select one: a. informed consent. b. post hoc information gathering. c. a postexperimental interview. d. deception.

29 The session that the researcher holds with participants at the conclusion of the experiment is called Select one: a. informed consent. b. post hoc information gathering. ***c. a postexperimental interview.* x d. deception.

31 Rhonda designs an experiment in which half of her participants are randomly assigned to view a sad movie and half view a comedy, but all participants fill out three mood surveys at one, two, and three weeks after the movie. This is an example of Select one: a. a between-participants design. b. a non-equivalent posttest-only design. c. a within-participants design. d. a mixed-model, factorial design.

31 Rhonda designs an experiment in which half of her participants are randomly assigned to view a sad movie and half view a comedy, but all participants fill out three mood surveys at one, two, and three weeks after the movie. This is an example of Select one: x a. a between-participants design. x b. a non-equivalent posttest-only design. x c. a within-participants design. ***d. a mixed-model, factorial design.*

31 The power of a statistical test is determined by Select one: a. all of the above. b. the sample size. c. the effect size. d. the probability level.

31 The power of a statistical test is determined by Select one: ***a. all of the above.* b. the sample size. c. the effect size. d. the probability level.

32 A ________ occurs in a factorial design when there are differences on the dependent variable in the different levels of one condition, that are consistent across the levels of the other independent variable . Select one: a. confound b. main effect c. interaction d. marginal mean

32 A ________ occurs in a factorial design when there are differences on the dependent variable in the different levels of one condition, that are consistent across the levels of the other independent variable . Select one: x a. confound ***b. main effect* x c. interaction x d. marginal mean

32 Dr. French makes sure that she has multiple video cameras recording her observation room during data collection. She also has multiple research assistants review the video recordings after the data are collected. This is to control for Select one: a. recording errors b. participant effects c. attribute errors d. experimenter expectancy

32 Dr. French makes sure that she has multiple video cameras recording her observation room during data collection. She also has multiple research assistants review the video recordings after the data are collected. This is to control for Select one: ***a. recording errors* x b. participant effects x c. attribute errors x d. experimenter expectancy

33 When conducting an Internet based study it is a good idea to not only conduct a pilot study using several participants but to also complete the study yourself because Select one: a. this will allow you to determine if the data collected will be returned to you is an manner that is understandable and arranged in a way that can be statistically analyzed. b. completing the study yourself allows you to understand how it feels to complete an online study c. All of the above are correct d. having participants complete the study allows you to get feedback regarding whether the study works properly in your browser

33 When conducting an Internet based study it is a good idea to not only conduct a pilot study using several participants but to also complete the study yourself because Select one: ***a. this will allow you to determine if the data collected will be returned to you is an manner that is understandable and arranged in a way that can be statistically analyzed.* b. completing the study yourself allows you to understand how it feels to complete an online study c. All of the above are correct d. having participants complete the study allows you to get feedback regarding whether the study works properly in your browser

34 Which of the following is NOT a disadvantage of the individual matching? Select one: a. the more variables on which one wishes to match participants, the more difficult it is to find matched participants. b. it is often difficult to arrange for two participants to arrive at the experimental site at the same time. c. it is often difficult to decide which of the many possible extraneous variables one should control through matching. d. this type of matching limits the generality of your results to a unique group of participants

34 Which of the following is NOT a disadvantage of the individual matching? Select one: x a. the more variables on which one wishes to match participants, the more difficult it is to find matched participants. ***b. it is often difficult to arrange for two participants to arrive at the experimental site at the same time.* c. it is often difficult to decide which of the many possible extraneous variables one should control through matching. x d. this type of matching limits the generality of your results to a unique group of participants

34 Which of the following is the LEAST important characteristic of a good control group? Select one: a. its members experience everything the experimental group experiences except the treatment b. it is equivalent to the experimental group in all important characteristics c. it is measured on the same dependent variable as the experimental group d. it has the same number of participants as the experimental group

34 Which of the following is the LEAST important characteristic of a good control group? Select one: x a. its members experience everything the experimental group experiences except the treatment x b. it is equivalent to the experimental group in all important characteristics x c. it is measured on the same dependent variable as the experimental group ***d. it has the same number of participants as the experimental group*

35 Although the extent to which experimenter effects influence study outcomes is controversial, techniques have been developed to at least partially counteract these effects. Which of the following is the LEAST likely to be used? Select one: a. keeping the experimenter unaware of the experimental condition a given participant is in for a long as possible b. keeping the experimenter unaware of the experimental condition a given participant is tested in c. automating as many aspects of the experiment as possible d. using a random sample of experimenters to control for experimenter attribute effects

35 Although the extent to which experimenter effects influence study outcomes is controversial, techniques have been developed to at least partially counteract these effects. Which of the following is the LEAST likely to be used? Select one: x a. keeping the experimenter unaware of the experimental condition a given participant is in for a long as possible x b. keeping the experimenter unaware of the experimental condition a given participant is tested in x c. automating as many aspects of the experiment as possible ***d. using a random sample of experimenters to control for experimenter attribute effects*

35 The difference between a factorial experimental design and a one-way design is that Select one: a. a stronger case for causality can be made with a factorial design. b. factorial designs always incorporate both within and between participants. c. there is more than one independent variable in a factorial design. d. greater external validity is gained in a factorial design.

35 The difference between a factorial experimental design and a one-way design is that Select one: ***a. a stronger case for causality can be made with a factorial design.* x b. factorial designs always incorporate both within and between participants. x c. there is more than one independent variable in a factorial design. x d. greater external validity is gained in a factorial design.

36 A research study examined the effects of playing violent or non-violent video games on the aggressive behavior of children of two different ages (10 year olds and 13 year olds). The researchers found that, regardless of age, children who played violent video games were more aggressive than those who played non-violent video games. This finding represents a Select one: a. mixed interaction. b. two-way interaction. c. interaction. d. main effect.

36 A research study examined the effects of playing violent or non-violent video games on the aggressive behavior of children of two different ages (10 year olds and 13 year olds). The researchers found that, regardless of age, children who played violent video games were more aggressive than those who played non-violent video games. This finding represents a Select one: x a. mixed interaction. x b. two-way interaction. x c. interaction. ***d. main effect.*

36 The major advantage of individual matching is that Select one: a. it does not require the experimenter to know each participant's status on important extraneous variables such as age or IQ b. one can be sure that the two groups of participants are equal on the matched extraneous variables. c. statistical comparison of group performance is made easier. d. it is very easy to match on numerous variables at the same time.

36 The major advantage of individual matching is that Select one: x a. it does not require the experimenter to know each participant's status on important extraneous variables such as age or IQ ***b. one can be sure that the two groups of participants are equal on the matched extraneous variables.* x c. statistical comparison of group performance is made easier. x d. it is very easy to match on numerous variables at the same time.

38 What is the difference between a within-participants design and a between-participants design? Select one: a. the latter exposes all participants to all levels of the independent variable b. the former exposes the participants to more than one level of the independent variable c. the latter involves research participants testing each other, rather than the experimenter testing them d. the former involves all participants experiencing all levels of the independent variable

38 What is the difference between a within-participants design and a between-participants design? Select one: x a. the latter exposes all participants to all levels of the independent variable x b. the former exposes the participants to more than one level of the independent variable x c. the latter involves research participants testing each other, rather than the experimenter testing them ***d. the former involves all participants experiencing all levels of the independent variable*

4 Sometimes, the treatment received in one condition of an experiment can influence behavior under the next condition. This is known as a ___ effect. a. interference b. order c. confusion d. carryover

4 Sometimes, the treatment received in one condition of an experiment can influence behavior under the next condition. This is known as a ___ effect. x a. interference x b. order x c. confusion ***d. carryover*

40 Factorial designs present many problems. Which of the following is NOT among them? Select one: a. simultaneous manipulation of all the factors can be difficult b. if the design incorporates more than two factors, the higher-order interactions may be difficult to interpret c. they often require a large number of participants d. they can be used with one or more factors or independent variables

40 Factorial designs present many problems. Which of the following is NOT among them? Select one: x a. simultaneous manipulation of all the factors can be difficult x b. if the design incorporates more than two factors, the higher-order interactions may be difficult to interpret x c. they often require a large number of participants ***d. they can be used with one or more factors or independent variables*

41 Power refers to Select one: a. the chances of rejecting the false null hypothesis. b. the chances of generalizing your results beyond the sample tested. c. the chances of rejecting a true null hypothesis. d. the chances of rejecting any null hypothesis.

41 Power refers to Select one: ***a. the chances of rejecting the false null hypothesis.* b. the chances of generalizing your results beyond the sample tested. c. the chances of rejecting a true null hypothesis. x d. the chances of rejecting any null hypothesis.

41 What is the common purpose of using the double blinding and deception techniques? Select one: a. they eliminate experimenter bias b. they keep participants' perceptions of the experiment constant across different conditions of the experiment c. they are more economical and easier to use than randomization or matching d. they eliminate the effects of most known extraneous variables

41 What is the common purpose of using the double blinding and deception techniques? Select one: x a. they eliminate experimenter bias ***b. they keep participants' perceptions of the experiment constant across different conditions of the experiment* x c. they are more economical and easier to use than randomization or matching d. they eliminate the effects of most known extraneous variables

41 Which of the following is NOT an advantage of a within-participants design? Select one: a. it allows for many assessments of the dependent measure over time b. it usually yields a more sensitive assessment of the effects of the independent variable(s) c. it is relatively immune to carryover effects d. it tends to require fewer participants that a between-participants design

41 Which of the following is NOT an advantage of a within-participants design? Select one: x a. it allows for many assessments of the dependent measure over time b. it usually yields a more sensitive assessment of the effects of the independent variable(s) ***c. it is relatively immune to carryover effects* d. it tends to require fewer participants that a between-participants design

42 In the context of experimental design, "double blind" refers to the situation in which Select one: a. neither the data analyst nor the participant knows what hypothesis is being tested. b. the experimenter randomly chooses which group and treatment sequence each participant is assigned to. c. two investigators analyze the data independently, and both are kept unaware of the identity of all participants. d. neither the experimenter nor the participant knows which experimental treatment the participant is receiving.

42 In the context of experimental design, "double blind" refers to the situation in which Select one: x a. neither the data analyst nor the participant knows what hypothesis is being tested. x b. the experimenter randomly chooses which group and treatment sequence each participant is assigned to. x c. two investigators analyze the data independently, and both are kept unaware of the identity of all participants. ***d. neither the experimenter nor the participant knows which experimental treatment the participant is receiving.*

42 The Institutional Animal Care and Use Committee (IACUC) judges which of the following? Select one: a. whether methods of euthanasia are in accordance with accepted procedures b. the number of animals that should be used to maintain a reasonable amount of power c. whether the researcher has chosen the appropriate species of animal to answer his or her question d. insures that no animals are used in research

42 The Institutional Animal Care and Use Committee (IACUC) judges which of the following? Select one: ***a. whether methods of euthanasia are in accordance with accepted procedures* x b. the number of animals that should be used to maintain a reasonable amount of power x c. whether the researcher has chosen the appropriate species of animal to answer his or her question x d. insures that no animals are used in research

42 Two teachers who are friends teach math at different high schools. At a conference, they learn about a new program for teaching trigonometry. They decide to test it by having one teacher use it in her class and the other use the traditional program, then compare their students' scores on the AP trigonometry test. This is an example of which experimental design? Select one: a. non-equivalent before-after (pretest-posttest) design b. one-group posttest-only design c. non-equivalent posttest-only design d. one-group pretest-posttest design

42 Two teachers who are friends teach math at different high schools. At a conference, they learn about a new program for teaching trigonometry. They decide to test it by having one teacher use it in her class and the other use the traditional program, then compare their students' scores on the AP trigonometry test. This is an example of which experimental design? Select one: x a. non-equivalent before-after (pretest-posttest) design x b. one-group posttest-only design ***c. non-equivalent posttest-only design* x d. one-group pretest-posttest design

43 If a researcher is worried about experimenter bias during the interaction between experimenter and participant, _________ could totally control for this bias by removing the experimenter from interaction with the participant completely. Select one: a. think-aloud technique b. double blind c. automation d. partial blind

43 If a researcher is worried about experimenter bias during the interaction between experimenter and participant, _________ could totally control for this bias by removing the experimenter from interaction with the participant completely. Select one: x a. think-aloud technique x b. double blind ***c. automation* x d. partial blind

43 Postexperimental interviews fulfill many obligations the experimenter has toward his or her participants. Which of the following is NOT among them? Select one: a. educating participants about the nature and role of psychological research b. assessing whether the participant would like to be trained as a researcher, too c. offering the participant satisfaction with his or her role in the experiment d. ethical obligations to inform participants about the experiment

43 Postexperimental interviews fulfill many obligations the experimenter has toward his or her participants. Which of the following is NOT among them? Select one: x a. educating participants about the nature and role of psychological research ***b. assessing whether the participant would like to be trained as a researcher, too* x c. offering the participant satisfaction with his or her role in the experiment x d. ethical obligations to inform participants about the experiment

44 How might you solicit individuals for a study via the Internet? Select one: a. post a study or survey on a Web site that specializes in advertising such opportunities b. contact an organization or association and ask for their members email address c. all of the above are potential ways of soliciting participants d. purchase email address from a commercial organization such as a white pages services

44 How might you solicit individuals for a study via the Internet? Select one: x a. post a study or survey on a Web site that specializes in advertising such opportunities b. contact an organization or association and ask for their members email address ***c. all of the above are potential ways of soliciting participants* d. purchase email address from a commercial organization such as a white pages services

44 In a between-participants posttest-only design Select one: a. each participant experiences all treatment conditions. b. all of the above. c. pairs of matched participants experience the same treatment conditions. d. each participant is tested in only one treatment condition

44 In a between-participants posttest-only design Select one: x a. each participant experiences all treatment conditions. x b. all of the above. xxxc. pairs of matched participants experience the same treatment conditions. ***d. each participant is tested in only one treatment condition*

44 What is the best technique to use to control for sequencing effects? Select one: a. precision control matching b. yoked matching c. random assignment to groups d. counterbalancing

44 What is the best technique to use to control for sequencing effects? Select one: x a. precision control matching x b. yoked matching x c. random assignment to groups ***d. counterbalancing*

45 In the one-group pretest-posttest design which of the following threats to internal validity is NOT controlled? Select one: a. testing b. none are controlled c. maturation d. history

45 In the one-group pretest-posttest design which of the following threats to internal validity is NOT controlled? Select one: ***a. testing* x b. none are controlled x c. maturation x d. history

45 The "sensitivity" of an experiment refers to its ability to detect any differences in performance, however small, between the two groups. In one technique to improve sensitivity the experimenter uses matching of participants across groups, assuring that Select one: a. groups are equated on all possible variables. b. the performance of a participant in one group is statistically equated with the performance of that participant's partner in another group. c. groups of participants are equated on those selected extraneous matching variables. d. generalization to the population can be made.

45 The "sensitivity" of an experiment refers to its ability to detect any differences in performance, however small, between the two groups. In one technique to improve sensitivity the experimenter uses matching of participants across groups, assuring that Select one: x a. groups are equated on all possible variables. x b. the performance of a participant in one group is statistically equated with the performance of that participant's partner in another group. ***c. groups of participants are equated on those selected extraneous matching variables.* x d. generalization to the population can be made.

45 When selecting participants from a population, experimenters need Select one: a. not worry about representativeness if a large sample size is used. b. to be concerned about differences between volunteers and nonvolunteers. c. not worry about random selection with children d. all of the above.

45 When selecting participants from a population, experimenters need Select one: a. not worry about representativeness if a large sample size is used. ***b. to be concerned about differences between volunteers and nonvolunteers.* c. not worry about random selection with children x d. all of the above.

46 The omission of or alteration of the truth of information give to participants in a research study can be done to Select one: a. a and b b. control for participant effects c. control for experimenter effects d. control for experimenter attributes

46 The omission of or alteration of the truth of information give to participants in a research study can be done to Select one: x a. a and b ***b. control for participant effects* x c. control for experimenter effects x d. control for experimenter attributes

46 When choosing between a within-participants design and a between-participants design, one is often considering a tradeoff between Select one: a. controlling for more extraneous variables with the former and having results that are more applicable to the "real world" with the latter. b. a more sensitive design with the former and a more economical design with the latter. c. internal validity with the former and an ability to generalize results to a larger population with the latter. d. a more sensitive design with the former and a more controlled design with the latter.

46 When choosing between a within-participants design and a between-participants design, one is often considering a tradeoff between Select one: x a. controlling for more extraneous variables with the former and having results that are more applicable to the "real world" with the latter. x b. a more sensitive design with the former and a more economical design with the latter. x c. internal validity with the former and an ability to generalize results to a larger population with the latter. ***d. a more sensitive design with the former and a more controlled design with the latter.*

47 Jennifer wants to study motor-pursuit performance (tracking a moving light with a hand-held wand) under each of three conditions of distraction, high, medium, and low. Instead of using three separate groups of participants, she makes sure her groups are equivalent by testing the same 12 participants under all three conditions of distraction. She finds that performance is poorest in the first (high distraction) condition, better in the second (medium distraction), but best in the third (low distraction) condition. She concludes that performance is hindered by distraction. What is the problem with this interpretation? Select one: a. you can't measure and compare a variable like motor pursuit performance over time b. comparisons like that should only be made across separate groups of people c. her participants could have improved simply with practice over the three conditions d. twelve participants are not enough to allow for such conclusions

47 Jennifer wants to study motor-pursuit performance (tracking a moving light with a hand-held wand) under each of three conditions of distraction, high, medium, and low. Instead of using three separate groups of participants, she makes sure her groups are equivalent by testing the same 12 participants under all three conditions of distraction. She finds that performance is poorest in the first (high distraction) condition, better in the second (medium distraction), but best in the third (low distraction) condition. She concludes that performance is hindered by distraction. What is the problem with this interpretation? Select one: x a. you can't measure and compare a variable like motor pursuit performance over time x b. comparisons like that should only be made across separate groups of people ***c. her participants could have improved simply with practice over the three conditions* x d. twelve participants are not enough to allow for such conclusions

47 Two classes of students at different schools are closely matched on IQ scores. One class is being taught with the standard method and the other class is being taught with a new technique. The two classes are then to be compared on scores from a standardized test at the end of the year. Select one: a. because there was no pretest, no valid comparisons can be made b. maturation is a major confounding variable in this study c. even though matched on IQ scores, the classes may not be equivalent on many other variables

47 Two classes of students at different schools are closely matched on IQ scores. One class is being taught with the standard method and the other class is being taught with a new technique. The two classes are then to be compared on scores from a standardized test at the end of the year. Select one: x a. because there was no pretest, no valid comparisons can be made x b. maturation is a major confounding variable in this study ***c. even though matched on IQ scores, the classes may not be equivalent on many other variables*

47 What should be the main determinant of what kind of organism is used in a given experiment? Select one: a. cost b. the type of research problem c. availability d. precedent; what others in the field use

47 What should be the main determinant of what kind of organism is used in a given experiment? Select one: x a. cost b. the type of research problem x c. availability ***d. precedent; what others in the field use*

48 The primary concern of the Institutional Review Board (IRB) is to Select one: a. insure the ethical treatment of nonhuman animals in research. b. improve the internal validity of the research design. c. protect the welfare of human participants. d. insure that research proposals contain no risk to the participants.

48 The primary concern of the Institutional Review Board (IRB) is to Select one: x a. insure the ethical treatment of nonhuman animals in research. x b. improve the internal validity of the research design. ***c. protect the welfare of human participants.* d. insure that research proposals contain no risk to the participants.

48 Which of the following is the proper sequence of steps in conducting an experiment with individual matching? Select one: a. select a sample of research participants, match each participant with a partner who has same the value of matching variable(s), administer the same treatment to both partners, measure the dependent variable(s) b. select a sample of research participants, match each participant with another person one the selected matching variable(s), randomly assign each member of the matched partners to each group, administer the treatments to the groups, measure the dependent variable(s) c. select a sample of research participants, randomly match each participant with a partner, administer the treatments to the partners, measure the dependent variable(s) d. match each participant with a partner who has the same value of matching variable(s), select a random sample of research participants from the pairs, administer the treatments to the sample, measure the dependent variable(s)

48 Which of the following is the proper sequence of steps in conducting an experiment with individual matching? Select one: x a. select a sample of research participants, match each participant with a partner who has same the value of matching variable(s), administer the same treatment to both partners, measure the dependent variable(s) ***b. select a sample of research participants, match each participant with another person one the selected matching variable(s), randomly assign each member of the matched partners to each group, administer the treatments to the groups, measure the dependent variable(s)* x c. select a sample of research participants, randomly match each participant with a partner, administer the treatments to the partners, measure the dependent variable(s) x d. match each participant with a partner who has the same value of matching variable(s), select a random sample of research participants from the pairs, administer the treatments to the sample, measure the dependent variable(s)

49 What is the purpose of "blinding" the experimenter to the condition(s) his or her participants are experiencing? Select one: a. it makes the IV stronger b. if the experimenter knows this information, it will affect the way he or she interprets the data once they are analyzed c. knowing this information may cause the experimenter to behave differently toward participants in the different conditions d. knowledge of these conditions invalidates the experiment

49 What is the purpose of "blinding" the experimenter to the condition(s) his or her participants are experiencing? Select one: x a. it makes the IV stronger x b. if the experimenter knows this information, it will affect the way he or she interprets the data once they are analyzed ***c. knowing this information may cause the experimenter to behave differently toward participants in the different conditions* x d. knowledge of these conditions invalidates the experiment

50 In a 4x2 factorial design, there are independent variables. Select one: a. 6 b. 2 c. 8 d. 4

50 In a 4x2 factorial design, there are independent variables. Select one: x a. 6 ***b. 2* x c. 8 x d. 4

7 Effect size is the Select one: a. scale on the vertical axis required to plot all of the data. b. magnitude of the relationship between the independent variable and the dependent variable. c. magnitude of alpha and power combined. d. magnitude of the manipulation of the independent variable.

7 Effect size is the Select one: a. scale on the vertical axis required to plot all of the data. ***b. magnitude of the relationship between the independent variable and the dependent variable.* x c. magnitude of alpha and power combined. x d. magnitude of the manipulation of the independent variable.

7 What is the factor that makes the between-participants posttest-only design a "strong" experimental design and the nonequivalent posttest-only design a weak design? Select one: a. the between-participants posttest-only design involves manipulating variables and the nonequivalent posttest-only design does not b. random assignment helps insure that the two experimental groups are essentially Equivalent at the outset c. testing participants twice changes their performance in the nonequivalent posttest-only design d. the between participants posttest-only design uses two groups of different participants and the nonequivalent posttest-only design used the same participants

7 What is the factor that makes the between-participants posttest-only design a "strong" experimental design and the nonequivalent posttest-only design a weak design? Select one: x a. the between-participants posttest-only design involves manipulating variables and the nonequivalent posttest-only design does not ***b. random assignment helps insure that the two experimental groups are essentially Equivalent at the outset* x c. testing participants twice changes their performance in the nonequivalent posttest-only design x d. the between participants posttest-only design uses two groups of different participants and the nonequivalent posttest-only design used the same participants

8 In within participants experimental designs, participants are tested under more than one condition. A carryover effect may confound the results if Select one: a. some of the participants only receive the first condition. b. the participants have been in other psychology experiments. c. more than one independent variable is investigated. d. performance under the later conditions is altered by participating in the prior conditions.

8 In within participants experimental designs, participants are tested under more than one condition. A carryover effect may confound the results if Select one: x a. some of the participants only receive the first condition. x b. the participants have been in other psychology experiments. x c. more than one independent variable is investigated. ***d. performance under the later conditions is altered by participating in the prior conditions.*

9 How many possible sequences would be needed for complete counterbalancing with three treatment conditions? Select one: a. 12 b. 9 c. 3 d. 6

9 How many possible sequences would be needed for complete counterbalancing with three treatment conditions? Select one: a. 12 x b. 9 x c. 3 ***d. 6*

One-group pretest-posttest design

design in which a treatment condition is interjected between a pretest and posttest of the dependent variable most threats to internal validity exist to infer causality must identify and demonstrate that internal validity threats do not exist

incomplete counterbalancing

most commonly used technique not all possible sequences are used criteria - for sequences enumerated each treatment condition must appear an equal number of times in each ordinal position and each treatment condition must precede and be followed by every other condition an equal number of times sequences determined by formula

Deception

omission of or altering the truth of information given to the participant during a research study used when there is no other way to gain the knowledge and risk does not outweigh the benefit of the information must keep the false information constant for all participants

Interaction effect

the joint, combined, or "interactive" effect of two or more independent variables on the dependent variable i.e., when the effect of one independent variable depends on another when displayed graphically, an interaction yields non-parallel lines