Research and Program Evaluation

______ concerns the consistency of a measure based on content, for instance, when two forms of the measure are administered to a sample and reliability coefficients are obtained between them. a) scorer reliability b) alternate-form reliability c) alternate-form validity d) test-retest reliability

b) alternate-form reliability

In the discussion section, researchers may need to propose ______. a) concrete links to the data b) alternative explanations when the results do not meet expected outcomes or are not consistent with the theories addressed c) the type of statistics the reader should use d) to what extent the instruments were standardized

b) alternative explanations when the results do not meet expected outcomes or are not consistent with the theories addressed

Threats to construct validity impact the _______ that can be drawn from the findings. a) concepts b) conclusions c) controls d) cues

b) conclusions

______ scores are based on a predetermined level of performance to a comparison study. a) norm-referenced b) criterion-referenced c) reliant-referenced d) analytically referenced

b) criterion-referenced

Random assignment to groups _________ the effects of some threats to validity. a) increases b) decreases c) escalates d) doesn't change

b) decreases

Researchers use ______ to summarize the data collected based on the sample in a particular research study, which includes calculating the measures of central tendency. a) inferential statistics b) descriptive statistics c) nonparametric statistics d) regression statistics

b) descriptive statistics

___________ type threat to internal validity occurs when the experimental and control groups are selected based on different criteria or when participants are assigned to groups differentially and not by random assignment. a) attrition b) differential selection c) maturation d) history

b) differential selection

____________ validity refers to the extent to which the researchers can replicate the actual events occurring in the natural environment and thus can generalize the results back to the population. a) internal b) external c) replication d) extraneous

b) external

Annotations should be an exact copy of the abstract. a) true b) false

b) false

The purpose statement is typically found in the abstract review section of an article, toward the end of the review. a) true b) false

b) false

The purpose statement should not be based on the argument developed in the literature review. a) true b) false

b) false

Two different types of populations include ______. a) accessible population and intended population b) target population and accessible population c) target population and observable population d) observable population and accessible population

b) target population and accessible population

One of the early uses of virtual reality in counseling has been with the treatment of individuals who have been diagnosed with ______. a) borderline personality disorder b) schizophrenia c) PTSD d) insomnia

c) PTSD

The researchers' acknowledgement of possible limitations demonstrates ______. a) honesty b) integrity c) an understanding of the cautions that should be taken when interpreting results d) weakness

c) an understanding of the cautions that should be taken when interpreting results

Events occurring during the time of the study that are unrelated to the treatment or independent variables are known as ______. a) instrumentation b) statistical regression c) history d) maturation

c) history

In the discussion section, it is important that the researchers address ______. a) how the independent variable was chosen b) how the dependent variable was chosen c) how the research questions or hypotheses relate to the findings d) what themes were used in the study

c) how the research questions or hypotheses relate to the findings

Which threat to external ecological validity refers to how events occurring at the time of the intervention or treatment affect the outcome? a) measurement of the dependent variable b) interaction between time of measurement and treatment effects c) interaction between history and treatment effects d) novelty or disruption effects

c) interaction between history and treatment effects

Statistics is commonly defined as the science of conducting studies to organize, summarize, and ______ information. a) set up b) infer c) interpret d) understand

c) interpret

The strength of this approach to measuring dependent variables is ease and time of administration and does not require extensive training is _____. a) ratings b) interviews c) self-report inventories d) physiological measures

c) self-report inventories

When the experimenter communicates to the participants, most often subtly, what outcomes he or she would like to achieve, this is known as ________. a) the Hawthorne effect b) the disruption effect c) the experimenter effect d) the description effect

c) the experimenter effect

Theoretically, the more control the researchers have over the experimental condition, ______. a) the lower the internal validity b) the higher the internal reliability c) the lower the internal reliability d) the higher the internal validity

d) the higher the internal validity

Theoretically, the more control the researchers have over the experimental conditions, __________________. a) the lower the internal validity b) the lower the internal reliability c) the higher the internal reliability d) the higher the internal validity

d) the higher the internal validity

Which of the following statement(s) is/are NOT true when evaluating articles in the professional literature? a) any error or limitation of a study should cause you to totally reject the findings b) a general purpose of the literature section is to provide an argument for conducting the study c) it is important to note any biases in the literature review d) there is need for the researcher to define new concepts in the literature review

a) any error or limitation of a study should cause you to totally reject the findings

When the purpose statement denotes an attempt to identify phenomena, events, or exercises, he or she is using ______. a) clarifying methods b) quantitative methods c) ethnographic methods d) unreliable method

a) clarifying methods

A common sampling approach used by researchers because many of the methods are more difficult to implement is known as ______. a) convenience sampling b) simple random sampling c) cluster sampling d) equal size sampling

a) convenience sampling

Random assignment to groups ______ the validity of a study. a) increases b) eliminates c) decreases d) doesn't change

a) increases

Which type of validity do researchers generally agree is of higher priority when considering the trade-offs between the different types of validity? a) internal b) external c) construct d) statistical conclusion

a) internal

The extent to which the results of an experiment can be generalized from the sample that participated in it to a larger group of individuals, or population is known as ______. a) population validity b) sample reliability c) population reliability and validity d) population reliability

a) population validity

The general purpose of a literature review section is ______. a) provide an argument for conducting the research b) selecting variable c) rule out particular sample population d) rule out characteristics of population

a) provide an argument for conducting the research

__________ is about how we invite potential participants from the population of interest to participate in a study, while __________ is about how we assign participants to groups once they agree to participate. a) random selection; random assignment b) random assignment; random selection c) external validity; internal validity d) internal validity; external validity

a) random selection; random assignment

It is important to note any biases in the literature review. a) true b) false

a) true

When writing the reflection section of your annotation, it is important to focus on what is relevant to your study and how you plan to integrate the information into your work. a) true b) false

a) true

In the discussion section, the researchers should summarize the results by ______. a) not using any numbers or statistics b) relating results to previous research c) relating results to theories and practice d) all of the above

d) all of the above

In evaluating the discussion section, it is necessary to review the potential threats to validity based on ______. a) the research design used b) the methods of selecting participants c) the tactics used for coding d) both the research design used and the methods of selecting participants

d) both the research design used and the methods of selecting participants

The three types of hypotheses mentioned by Houser are null, nondirectional, and ______. a) working b) bidirectional c) major d) directional

d) directional

Which types of statistical methods are used by researchers to generalize results back to the population of interest? a) qualitative statistics b) parametric statistics c) descriptive statistics d) inferential statistics

d) inferential statistics

As consumers of research, practitioners are particularly interested in the discussion because ______. a) it provides an overview of the participants b) it provides an overview of instrumentation c) it delineates the variables used d) it provides what worked and how it may be applied

d) it provides what worked and how it may be applied

Thorndike and Thorndike-Christ noted that many tests and measures are designed to "reflect the values and experiences of typical ______." a) upper class b) lower class c) poor/working class d) middle class

d) middle class

In the discussion section, the researchers will want to relate the results to ______. a) format utilized by the type of data collected b) format which delineates the type of statistical methods used c) manner which explains the tactics or strategies for coding used d) previous research that either supports or refutes prior findings

d) previous research that either supports or refutes prior findings

The literature review should include ______. a) only supportive evidence of the problem you are interested in b) structural equation modeling c) multiple regression d) relevant definitions and descriptions of unknown concepts

d) relevant definitions and descriptions of unknown concepts