Stats and research methods exam 3
Measures of ____________________________ are established when the results of one test are compared with the results obtained when using an accepted standard or criterion.
criterion-based validity
Identify which kind of observational study design is being described: Snapshot; Assesses information about a population at one point in time:
cross-sectional studies
Which coefficient reflects the occurrence of perfect reliability?
1.00
_______________ variables are uncontrolled factors other than the independent variable that that may influence the measures of the dependent variable, thus negatively impacting internal validity.
Confounding
The behavior or measure that is observed
Dependent variable
In evaluating the method section of a research report, which is a very important question to keep in mind?
Did the author provide enough information that the study could be repeated?
_________________________ is the conscientious, explicit, and judicious use of best current evidence in decision making.
Evidence Based Practice
The extent to which the results of a study may be generalized to different conditions or subjects is known as
External validity
External validity is the:
Generalizability of a study
Which threat to internal validity occurs when members of the control group adopt a competitive attitude towards the experimental group, thereby negating their status as controls? ______________________
John Henry Effect
What type of research attempts to systematically describe specific characteristics or conditions related to a subject group but can't explain the underlying causal mechanisms?
Non-experimental
____ research involves the collection of numerical data whereas ____ research asks questions such as how or why via interviews and surveys
Quantitative, qualitative
Which of the following would be given the rank of the highest form of evidence?
Systematic review of randomized controlled trials
Which threat to internal validity refers to the behavioral effect introduced on research subjects when they know they are being observed? ___________________________
The Hawthorne Effect
The __________________ is the part of a score attributed to measurement error.
The error score
The actual or measured score is called:
The observed score
If a practitioner wishes to be evidence-based, what are the 3 major areas needed to integrate?
best scientific evidence, patient values, clinical experience
An in-depth analysis of a unique condition or situation to reach a greater understanding about other similar situations is known as a _________________.
case study
Identify which kind of observational study design is being described: Retrospective; starts with an end point and work backward, figuring out what might have caused that outcome:
case-control studies
_____________________________ reasoning starts with a general premise and creates specific conclusion.
deductive
Creating specific examples from generalized statements is an example of what?
deductive reasoning
When measuring the effects of water consumption on a runner's performance, speed and distance are examples of ______.
dependent variables.
The most accurate & definitive measure of a variable is sometimes referred to as a __________________
gold standard
This threat to external validity is concerned with when pre-testing subjects, it may alter their perception of the experimental treatment and motivate them to perform better than if they had not been exposed to the pre-test.
reactive effects of pre-testing
This concept explores the question "how do I know that the test, scale, instrument, etc. will be consistent every time I use it?"
reliability
This threat to external validity occurs when the unique characteristic of the subjects in a study makes the treatment effective only for those that possess that trait.
subject and treatment interaction
True or False, If a measurement is valid, its scores will be reliable.
true
_______ research typically deals with theoretical concepts and has no immediate concern for application. In contrast, _______ research is designed to answer specific questions aimed at solving practical problems.
Basic, applied
This type of research involves the manipulation of an independent variable(s) to establish or disestablish a cause-effect relationship
Experimental
_________________________is a threat to internal validity referring to the loss or dropout of subjects in a study.
Experimental Mortality
The _____________________ refers to the threat to internal validity when a researcher has some expectation about the performance of a subject.
Halo Effect
A ____ is a proposed explanation for a phenomenon made as a starting point for further investigation
Hypothesis
The variable that is manipulated by the researcher
Independent variable
The extent to which any changes measured in the dependent variable can be directly attributed to manipulation of the independent variable is known as
Internal validity
Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is calculated. This is an example of which type of reliability?
Interrater reliability
_____ research is research conducted under highly controlled conditions (not necessarily a laboratory), where accurate measurements are possible. In contrast, ______ research is done in the everyday (I.e. real life) environment of the participants. The experimental still manipulated the independent variable, but in a real-life setting with less control of extraneous variables.
Laboratory, field
A survey authorized by the CDC to assess daily physical activity and nutritional habits in American children is an example of what type of evidence?
Observational research
_______________________ is the threat to internal validity in which an extreme performance on a test is followed by a less extreme performance.
Regression to the mean
Primary reason for a detailed step-by-step account of the methods used in a research study is for the ability of an entire experiment or study to be duplicated, either by the same researcher or by someone else working independently
Replication
The time honored research methodology used to solve problems or discover new knowledge, in which a highly structured, sequential series of steps is followed is known as the
Scientific method
A _____ is a well-substantiated explanation, acquired through the scientific method, that has been repeatedly tested and confirmed through observation and experimentation
Theory
This threat to external validity is whether a subject will perform in the same manner under experimental conditions as they would in the real world.
artificial nature of experimental condition
As a result of your brain's attempt to simplify information processing, _____________________ are predispositions towards certain kinds of thinking that occurs when people are rapidly processing and interpreting information in the world around them.
cognitive bias
As a result of the brain's attempt to simply information processing, ________________ are predispositions towards certain kinds of thinking that occurs when people are rapidly processing and interpreting information
cognitive biases
Identify which kind of observational study design is being described: Longitudinal/Prospective; tracks the same groups of people over an extended period of time:
cohort studies
__________________________ is a type of statistical validity in which a proposed test is compared to a criterion standard within a close period of time to establish its accuracy
concurrent
_______________ is the extent to how well a test measures a theoretical attribute that has no definitive criterion, is difficult to measure, or cannot be directly observed.
construct validity
A group of subjects that is similar to the experimental group except that they do not receive the experimental treatment is known as the _________________________.
control group
A _________________________ study occurs when both subject and researcher do not know who receives a given treatment.
double blind
In a meta-analysis, the results of various studies on a topic are quantified using a standard measure that is called the _________________
effect size
_________________________ is the study of the distribution and determinants of disease and health conditions and the subsequent application to control health problems.
epidemiology
The conscientious, explicit and judicious use of best current evidence indecision making is known as what?
evidence-based practice
What is the major difference between an experimental and an observational study?
experimental can determine cause and effect. observational cannot
In a research study in which the treatment involved quite intense physical training, 40% of the participants in the treatment group dropped out as compared with 5% of the control group. This threat to internal validity is called
experimental mortality
The only type of research that can manipulate treatments and establish a cause and effect is
experimental research
From least prone to bias to most prone to bias, what are the 3 tiers of hierarchy that most EBP models use when ranking evidence?
experimental research, observational research, practical experience
_______________ validity is the weakest type of validity because all that can be said is that it appears to be obvious that the test or device is measuring what it is supposed to measure.
face
True or False? An observational study design has less potential for bias than a randomized controlled trial (RCT).
false
Which threat to internal validity is introduced when the researcher has some expectation about the performance of a subject and is also involved in assessing the subject, possibly biasing the researcher's judgment?
halo effect
Just before the posttest, students in the control group were shown a film in another class that related directly to the subject matter being studied in the treatment group. This represents what kind of threat to internal validity?
history
A researcher conducts a study on the effectiveness of plyometric exercise by comparing sport teams that use this method with teams that do not. The researcher expects the teams that utilize plyometrics to show higher gains in power production. This statement is:
hypothesis
The major weakness of epidemiologic studies is
inability to experimentally establish cause and effect
In epidemiology/biostatistics, the ___________________________ is the rate at which NEW cases occur in a population during a specified time period.
incidence rate
______________________________ reasoning starts with a specific premise leading to a generalized conclusion.
inductive
Creating generalized statements from specific examples is an example of what?
inductive reasoning
The extent to which the results of a study can be attributed to the treatments used in the study is the definition of what kind of validity?
internal
The degree to which a study establishes the cause-and-effect relationship between the treatment and the observed outcome is known as ______________
internal validity
_____________________ is the degree of agreement among repeated administrations of a test performed by a single test administrator
intra-rater reliability
The dependent variable
is the one that is expected to change as a result of the treatment the variable that is observed or measured in the research process represents the response or outcome from the manipulation of the independent variable
_____________ are errors or flaws in reasoning when deceptive, invalid or otherwise faulty reasoning are used in the construction of an argument.
logical fallacies
_____________________ are errors or flaws in reasoning when deceptive, invalid or otherwise faulty reasoning, are used in the construction of an argument.
logical fallacies
_________________________ is the threat to internal validity that refers to the physiological processes occurring within the participants that could account for any changes in their behavior.
maturation
This threat to external validity occurs when a research introduces more than one experimental variable, risking the treatments inhibiting or enhancing each other.
multiple treatment interference
A double-blind experiment is one in which
neither the researcher nor the participants know which participants receive the experimental treatment
National Heart, Lung, and Blood Institute's evidence category C includes evidence from ______.
non-randomized trials, observational studies.
National Heart, Lung, and Blood Institute's evidence category D includes evidence from ______.
panel consensus judgment.
Prevalence of disease differs from incidence of disease in that prevalence refers to the number of
people who presently have a disease, whereas incidence relates to new cases
When a control group receives a false treatment while the experimental group receives the real treatment, the control group has been given a _______________.
placebo
______________________________ is the extent to which a score on a scale or test predicts scores on some criterion measure.
predictive validity
In epidemiology/biostatistics, _______________________________ is the proportion of people in a population who have a condition/attribute at a specified time.
prevalence rate
The chance placement of subjects into groups so that the groups do not differ at the beginning of the experiment is known as ____________________________.
randomization
The gold standard for research in the health sciences is the
randomized control trial
The gold standard study design that is most robust and least prone to bias is the ______________________________.
randomized control trial
National Heart, Lung, and Blood Institute's evidence category B includes evidence from ______.
randomized controlled trials with a limited body of data.
National Heart, Lung, and Blood Institute's evidence category A includes evidence from ______.
randomized controlled trials with a rich body of data.
A researcher predicts that there will be a positive relationship between attitude scores and grade point average. This is an example of a
research hypothesis
_________________________ of measurement is the degree to which small differences can be detected
sensitivity
In experimental design, when comparisons are made of groups that have been selected on the basis of their extreme scores, the posttest means of the groups tend to move toward the mean of the entire population from which the extreme groups were selected. This threat to internal validity is called
statistical regression
At the top of the research/evidence hierarchy are ____________________, which collect, review, and summarize all empirical evidence that fits pre-specified eligibility criteria, and ___________________, which is a statistical procedure for combining data from multiple studies.
systemic review, meta-analysis
"A measure of how stable a test is over time" is an example of which of the following types of reliability?
test-retest
A pretest of knowledge about microcomputers is given to a group of students 5 min prior to a film on the subject. A posttest given 10 min after the film showed a 10-point gain from the pretest. The researcher concludes that the film produced the gain. Which of the following is likely the threat to internal validity?
testing
When a hypothesis is repeatedly supported by multiple investigations and laboratories, it can become a ______.
theory
True or false, a test can be reliable, but not valid.
true
This is the score that you would receive if the test contained no error.
true score
The extent to which an instrument measures what it is intended to measure is known as
validity
