PSY290- Research Methods Final Review
When using inferential statistics, researchers calculate a/an ______ to determine the statistical significance. a) effect size b) coefficient of importance c) curve value d) probability estimate e) replication value
D- probability estimate
A small-N design that involves providing treatment and then removing treatment is known as a/an? a) interrupted time-series design b) stable-baseline design c) multiple-baseline design d) reversal design
D- reversal design
informed consent
research participants' right to learn about a research project, know its risks and benefits, and decide whether to participate.
Theory testing mode and external validity
-association and causal claims -goal: to test a theory rigorously, isolate variables -prioritize internal validity -artificial situations may be required -real world comes later -external validity is not the priority
Generalization mode and external validity
-frequency claims -goal: to make a claim about a population -real world matters -external validity is essential
5 APA Ethical Principles
1) Beneficence and Nonmaleficence 2) Fidelity and Responsibility 3) Integrity 4) Justice 5) Respect for people's rights and dignity
Which of the following is NOT a major type of replication? a) statistical replication b) direct replication c) replication-plus-extension d) conceptual replication e) all of the above are major types of replications
A- statistical replication
Which of the following are true of IRBs in the US: a) they can be found in settings other than colleges and universities b) they are mandated by federal law c) they must have a psychologist as a member d) they must have at least 5 members e) they tend to have detailed applications for researchers to compelte
A, B, D, E (NOT C) they can be found in settings other than colleges and universities. they are mandated by federal law. they must have at least 5 members. they tend to have detailed applications for researchers to complete
Which of the following ethical violations proposed by the Belmont Report was committed in the Tuskegee Study? a) participants were harmed b) participants were not treated respectfully c) participants were not treated by actual physicians d) participants were from a disadvantaged social group e) all of the above
A, B, D- participants were harmed, not treated respectfully, and were from a disadvantaged social group
The Belmont Report includes which of the following: a) the principle of respect for persons b) the principle of integrity c) the principle of beneficence d) the principle of justice
A, C, and D- the principle of respect for persons, the principle of beneficence, and the principle of justice
Which claim is most likely to be tested in generalization mode? a) frequency claim b) association claim c) causal claim
A- frequency claim
In conducting quasi-experimental designs, researchers tend to give up some ___ in exchange for ______. a) internal validity; external validity b) internal validity; statistical validity c) construct validity; external validity d) external validity; internal validity
A- internal validity; external validity
Which of the following is NOT a small-N design? a) interrupted time-series design b) stable-baseline design c) multiple-baseline design d) reversal design
A- interrupted time-series design
Which for the following is another term for ecological validity? a) mundane realism b) ordinary application c) everyday extrapolation d) experimental realism e) cultural application
A- mundane realism
Which of the following is a difference between true experiments and quasi-experiments? a) quasi-experiments do not use random assignment b) quasi-experiments do not involve any manipulated variables c) quasi-experiments cannot have comparison groups d) quasi-experiments cannot have pretest measures e) all of the above are differences between true experiments and quasi-experiments
A- quasi-experiments do not use random assignment
According to the textbook, what's the problem with WEIRD samples? a) they're not very representative of the world's population b) they're not good for theory-testing mode c) they're not used frequently enough d) both A and B e) both B and C
A- they're not very representative of the world's population
If a researcher is concerned about external validity, which of the following would you recommend with regard to conducting small-N designs? a) do not conduct small-N designs if you're concerned about external validity b) compare the results of small-N designs with other studies c) conduct only reversal designs d) use inferential statistics e) use only one's own clients/patients/students
B- compare the results of small-N designs with other studies
When an experiment is run in an artificial lab setting it: a) must be replicated in a field setting to be generalizable b) may have high experimental realism despite its setting c) is said to have ecological validity
B- may have high experimental realism despite its setting
Federally funded animal experimentation a) sadly does not have to worry about ethical violations b) must comply with IACUC guidelines c) must be approved by an IRB d) both b and c
B- must comply with IACUC guidelines
In which of the following ways are correlational designs similar to quasi-experimental designs? a) they both use nonrandom samples b) they both suffer from possible threats to internal validity c) they both use random assignment d) they both use small numbers of participants e) none of the above
B- they both suffer from possible threats to internal validity
In addition to being an ethical violation, why are data falsification and fabrication problematic? a) they are impossible to discover b) they impede scientific progress c) they are federal crimes d) both A and B are problematic e) all of the above
B- they impede scientific progress
The need to balance the potential costs and benefits to participants taking part in a research study is to address which principle of the Belmont report? a) the principle of respect for persons b) the principle of justice c) the principle of beneficence d) the principle of fidelity e) the principle of integrity
C- The Principle of Beneficence
A replication study will NOT help to support external validity when it is a: a) conceptual replication b) replication-plus-extension study c) direct replication d) none of the above
C- direct replication
According to those that find the Milgram study unethical, this study did harm to the participants: a) because they did not inform participants of a cure b) through physical harm, from the shocks c) from mental stress, that outweighed the research's benefits
C- from mental stress, that outweighed the research's benefits
How would a researcher quantitatively summarize a scientific literature? a) review article b) literature review c) meta-analysis d) both a and b
C- meta analysis
Deception in psychology studies a) should never be done b) is unethical c) must be followed with a debriefing
C- must be followed with a debriefing
Which of the following is an independent groups quasi-experimental design? a) interrupted time-series design b) nonequivalent control group design c) nonequivalent groups interrupted time-series design d) stable-baseline design e) all of the above
C- nonequivalent groups interrupted time-series design
Responsible journalists do which of the following as it pertains to discussing replicability? a) they report only on studies that have been directly replicated b) they report findings only from meta-analyses c) they provide readers with a sense of the entire literature as well as recent studies d) they do both A and B e) they do all of the above
C- they provide readers with a sense of the entire literature as well as recent studies
The notation p< 0.05 indicates which of the following? a) the study was conducted correctly b) the findings are statistically significant c) they can conclude that it's unlikely the results were obtained by chance d) both B and C e) all of the above
D- both B and C- the findings are statistically significant AND they can conclude that it's unlikely that the results were obtained by chance
The American Psychological Association's ethical guidelines have ___ principles and ___ standards. a) 3, 10 b) 3, 8 c) 3, 5 d) 5, 10 e) 5, 8
D- 5 principles and 10 standards
Which of the following is a reason that psychologists especially value meta-analysis? a) meta-analysis can examine conceptual and direct replications b) meta-analysis allows researchers to examine the strength of a relationship c) in meta-analyses, moderators of relationships can be examined d) all of these are reasons psychologists especially value meta-analyses
D- all of these are reasons psychologists especially value meta-analyses
In small-N designs, each participant is treated: a) with multiple interventions b) by a clinical psychologist c) as a data point d) as a separate experiment e) all of the above
D- as a separate experiment
Which of the following is a primary goal of debriefing? a) to prevent researchers from being sued b) to give participants insight into the nature of psychological science c) to inform participants about the presence and purpose of deception d) both B and C e) all of the above
D- both B and C
_______ psychology is a subdiscipline of psychology that works primarily in the generalization mode. a) clinical b) experimental c) evolutionary d) social e) cultural
E- Cultural psychology
In which of the following situations would written informed consent be required? a) an observational study that measures walking speed of people entering and exiting buildings b) an anonymous study that measures the relationship between time spent in grocery stores and money spent on groceries c) a confidential study examining income level and voting behavior d) none
Only C (A and B do NOT need written informed consent)
Three types of small-N designs?
Stable baseline design, Reversal design, Multiple-baseline design
institutional review board (IRB)
a committee responsible for ensuring that research on humans is conducted ethically.
external validity
a measure of how well the results of a study generalize to, or represent, individuals or contexts besides those in the study itself.
interrupted time-series design
a quasi-experiment in which people are measured repeatedly on a dependent variable before, during, and after the interruption caused by some event.
nonequivalent control group design
a quasi-experiment that has at least one treatment group and one comparison group, but participants have not been randomly assigned to the two groups.
nonequivalent groups interrupted time-series design
a quasi-experiment that has at least one treatment group and one comparison group, but participants have not been randomly assigned to the two groups.
field setting
a real-world setting for a research study.
conceptual replication
a replication study in which researchers examine the same research question (the same concepts) but use different procedures for operationalizing the variables.
direct replication
a replication study in which researchers repeat the original study as closely as possible to see whether the original effect shows up in the newly collected data.
replication-plus-extension
a replication study in which researchers replicate their original study but add variables to test additional questions.
scientific literature
a series of related studies, conducted by various researchers, that have tested similar variables.
inferential statistics
a set of techniques that use chance and probability to help researchers make decisions about what their data mean and what inferences they can make from them.
multiple-baseline design
a small-N design in which researchers stagger their introduction of an intervention across a variety of contexts, times, or situations.
reversal design
a study in which a researcher observes a problem behavior both before and during treatment and then discontinues the treatment for a while to see if the problem behavior returns.
stable-baseline design
a study in which a researcher observes behavior for an extended baseline period before beginning a treatment or other intervention. If behavior during the baseline is stable, the researcher is more certain of the treatment's effectiveness.
single-N design
a study in which researchers gather information form only one animal or one person.
small-N design
a study in which researchers gather information from just a few cases.
quasi-experiments
a study that is similar to an experiment except that the researchers do not have full experimental control. (they may not be able to randomly assign participants to the independent variable conditions.
cultural psychology
a subdiscipline of psychology concerned with how cultural settings shape a person's thoughts, feelings, and behavior and how these in turn shape cultural settings.
meta-analysis
a way of mathematically averaging the results of all the studies that have tested the same variables to see what conclusion that whole body of evidence supports.
justice
an ethical principle from the Belmont Report calling for a fair balance between the kinds of people who participate in research and the kinds of people who benefit from it.
respect for persons
an ethical principle from the Belmont Report stating that research participants should be treated as autonomous agents and that certain groups deserve special protections.
beneficence
an ethical principle from the Belmont Report stating that researchers must take precaution to protect participants from harm and to promote participants' well-being.
data falisification
an ethical problem that occurs when researchers influence a study's results, perhaps by deleting observations from a data set or by influencing their research subjects to act in the hypothesized way.
data fabrication
an ethical problem that occurs when researchers invent data that fit their hypotheses.
Which of the following is NOT one of the reasons why someone would conduct a quasi experiment? a) to take advantage of an opportunity b) ethical standards c) to prevent selection effects d) to maximize external validity
c) to prevent selection effects
The degree to which a quasi experiment supports a causal statement depends on: a) random assignment b) design c) number of participants d) results e) b and d
e) b and d- design and results
replicable
pertaining to a study whose results are obtained again when the study is repeated.
experimental realism
the extent to which a laboratory experiment is designed so that participants experience authentic emotions, motivations, and behaviors.
ecological validity
the extent to which the tasks and manipulations of a study are similar to real-world contexts.
file drawer problem
the idea that studies finding null effects are less likely to be published than studies finding significant results.
generalization mode
the intent of researchers to generalize the findings from the samples and procedures in their study to other populations or contexts.
plagarism
the representation of the ideas or words of others as one's own.
theory-testing mode
the testing of association claims or causal claims to investigate support for a theory.
deception
the withholding of some details of a study from participants (deception through omission) or the act of actively lying to them (deception through commission).
debriefed
to inform participants afterward about a study's true nature, details, and hypotheses.
