Stats and research methods exam 3

Measures of ____________________________ are established when the results of one test are compared with the results obtained when using an accepted standard or criterion.

criterion-based validity

Identify which kind of observational study design is being described: Snapshot; Assesses information about a population at one point in time:

cross-sectional studies

Which coefficient reflects the occurrence of perfect reliability?

1.00

_______________ variables are uncontrolled factors other than the independent variable that that may influence the measures of the dependent variable, thus negatively impacting internal validity.

Confounding

The behavior or measure that is observed

Dependent variable

In evaluating the method section of a research report, which is a very important question to keep in mind?

Did the author provide enough information that the study could be repeated?

_________________________ is the conscientious, explicit, and judicious use of best current evidence in decision making.

Evidence Based Practice

The extent to which the results of a study may be generalized to different conditions or subjects is known as

External validity

External validity is the:

Generalizability of a study

Which threat to internal validity occurs when members of the control group adopt a competitive attitude towards the experimental group, thereby negating their status as controls? ______________________

John Henry Effect

What type of research attempts to systematically describe specific characteristics or conditions related to a subject group but can't explain the underlying causal mechanisms?

Non-experimental

____ research involves the collection of numerical data whereas ____ research asks questions such as how or why via interviews and surveys

Quantitative, qualitative

Which of the following would be given the rank of the highest form of evidence?

Systematic review of randomized controlled trials

Which threat to internal validity refers to the behavioral effect introduced on research subjects when they know they are being observed? ___________________________

The Hawthorne Effect

The __________________ is the part of a score attributed to measurement error.

The error score

The actual or measured score is called:

The observed score

If a practitioner wishes to be evidence-based, what are the 3 major areas needed to integrate?

best scientific evidence, patient values, clinical experience

An in-depth analysis of a unique condition or situation to reach a greater understanding about other similar situations is known as a _________________.

case study

Identify which kind of observational study design is being described: Retrospective; starts with an end point and work backward, figuring out what might have caused that outcome:

case-control studies

_____________________________ reasoning starts with a general premise and creates specific conclusion.

deductive

Creating specific examples from generalized statements is an example of what?

deductive reasoning

When measuring the effects of water consumption on a runner's performance, speed and distance are examples of ______.

dependent variables.

The most accurate & definitive measure of a variable is sometimes referred to as a __________________

gold standard

This threat to external validity is concerned with when pre-testing subjects, it may alter their perception of the experimental treatment and motivate them to perform better than if they had not been exposed to the pre-test.

reactive effects of pre-testing

This concept explores the question "how do I know that the test, scale, instrument, etc. will be consistent every time I use it?"

reliability

This threat to external validity occurs when the unique characteristic of the subjects in a study makes the treatment effective only for those that possess that trait.

subject and treatment interaction

True or False, If a measurement is valid, its scores will be reliable.

true

_______ research typically deals with theoretical concepts and has no immediate concern for application. In contrast, _______ research is designed to answer specific questions aimed at solving practical problems.

Basic, applied

This type of research involves the manipulation of an independent variable(s) to establish or disestablish a cause-effect relationship

Experimental

_________________________is a threat to internal validity referring to the loss or dropout of subjects in a study.

Experimental Mortality

The _____________________ refers to the threat to internal validity when a researcher has some expectation about the performance of a subject.

Halo Effect

A ____ is a proposed explanation for a phenomenon made as a starting point for further investigation

Hypothesis

The variable that is manipulated by the researcher

Independent variable

The extent to which any changes measured in the dependent variable can be directly attributed to manipulation of the independent variable is known as

Internal validity

Two trained professionals observe the behavior of children in a classroom. They each rate observed behaviors using the same form and the number of items that were rated the same is calculated. This is an example of which type of reliability?

Interrater reliability

_____ research is research conducted under highly controlled conditions (not necessarily a laboratory), where accurate measurements are possible. In contrast, ______ research is done in the everyday (I.e. real life) environment of the participants. The experimental still manipulated the independent variable, but in a real-life setting with less control of extraneous variables.

Laboratory, field

A survey authorized by the CDC to assess daily physical activity and nutritional habits in American children is an example of what type of evidence?

Observational research

_______________________ is the threat to internal validity in which an extreme performance on a test is followed by a less extreme performance.

Regression to the mean

Primary reason for a detailed step-by-step account of the methods used in a research study is for the ability of an entire experiment or study to be duplicated, either by the same researcher or by someone else working independently

Replication

The time honored research methodology used to solve problems or discover new knowledge, in which a highly structured, sequential series of steps is followed is known as the

Scientific method

A _____ is a well-substantiated explanation, acquired through the scientific method, that has been repeatedly tested and confirmed through observation and experimentation

Theory

This threat to external validity is whether a subject will perform in the same manner under experimental conditions as they would in the real world.

artificial nature of experimental condition

As a result of your brain's attempt to simplify information processing, _____________________ are predispositions towards certain kinds of thinking that occurs when people are rapidly processing and interpreting information in the world around them.

cognitive bias

As a result of the brain's attempt to simply information processing, ________________ are predispositions towards certain kinds of thinking that occurs when people are rapidly processing and interpreting information

cognitive biases

Identify which kind of observational study design is being described: Longitudinal/Prospective; tracks the same groups of people over an extended period of time:

cohort studies

__________________________ is a type of statistical validity in which a proposed test is compared to a criterion standard within a close period of time to establish its accuracy

concurrent

_______________ is the extent to how well a test measures a theoretical attribute that has no definitive criterion, is difficult to measure, or cannot be directly observed.

construct validity

A group of subjects that is similar to the experimental group except that they do not receive the experimental treatment is known as the _________________________.

control group

A _________________________ study occurs when both subject and researcher do not know who receives a given treatment.

double blind

In a meta-analysis, the results of various studies on a topic are quantified using a standard measure that is called the _________________

effect size

_________________________ is the study of the distribution and determinants of disease and health conditions and the subsequent application to control health problems.

epidemiology

The conscientious, explicit and judicious use of best current evidence indecision making is known as what?

evidence-based practice

What is the major difference between an experimental and an observational study?

experimental can determine cause and effect. observational cannot

In a research study in which the treatment involved quite intense physical training, 40% of the participants in the treatment group dropped out as compared with 5% of the control group. This threat to internal validity is called

experimental mortality

The only type of research that can manipulate treatments and establish a cause and effect is

experimental research

From least prone to bias to most prone to bias, what are the 3 tiers of hierarchy that most EBP models use when ranking evidence?

experimental research, observational research, practical experience

_______________ validity is the weakest type of validity because all that can be said is that it appears to be obvious that the test or device is measuring what it is supposed to measure.

face

True or False? An observational study design has less potential for bias than a randomized controlled trial (RCT).

false

Which threat to internal validity is introduced when the researcher has some expectation about the performance of a subject and is also involved in assessing the subject, possibly biasing the researcher's judgment?

halo effect

Just before the posttest, students in the control group were shown a film in another class that related directly to the subject matter being studied in the treatment group. This represents what kind of threat to internal validity?

history

A researcher conducts a study on the effectiveness of plyometric exercise by comparing sport teams that use this method with teams that do not. The researcher expects the teams that utilize plyometrics to show higher gains in power production. This statement is:

hypothesis

The major weakness of epidemiologic studies is

inability to experimentally establish cause and effect

In epidemiology/biostatistics, the ___________________________ is the rate at which NEW cases occur in a population during a specified time period.

incidence rate

______________________________ reasoning starts with a specific premise leading to a generalized conclusion.

inductive

Creating generalized statements from specific examples is an example of what?

inductive reasoning

The extent to which the results of a study can be attributed to the treatments used in the study is the definition of what kind of validity?

internal

The degree to which a study establishes the cause-and-effect relationship between the treatment and the observed outcome is known as ______________

internal validity

_____________________ is the degree of agreement among repeated administrations of a test performed by a single test administrator

intra-rater reliability

The dependent variable

is the one that is expected to change as a result of the treatment the variable that is observed or measured in the research process represents the response or outcome from the manipulation of the independent variable

_____________ are errors or flaws in reasoning when deceptive, invalid or otherwise faulty reasoning are used in the construction of an argument.

logical fallacies

_____________________ are errors or flaws in reasoning when deceptive, invalid or otherwise faulty reasoning, are used in the construction of an argument.

logical fallacies

_________________________ is the threat to internal validity that refers to the physiological processes occurring within the participants that could account for any changes in their behavior.

maturation

This threat to external validity occurs when a research introduces more than one experimental variable, risking the treatments inhibiting or enhancing each other.

multiple treatment interference

A double-blind experiment is one in which

neither the researcher nor the participants know which participants receive the experimental treatment

National Heart, Lung, and Blood Institute's evidence category C includes evidence from ______.

non-randomized trials, observational studies.

National Heart, Lung, and Blood Institute's evidence category D includes evidence from ______.

panel consensus judgment.

Prevalence of disease differs from incidence of disease in that prevalence refers to the number of

people who presently have a disease, whereas incidence relates to new cases

When a control group receives a false treatment while the experimental group receives the real treatment, the control group has been given a _______________.

placebo

______________________________ is the extent to which a score on a scale or test predicts scores on some criterion measure.

predictive validity

In epidemiology/biostatistics, _______________________________ is the proportion of people in a population who have a condition/attribute at a specified time.

prevalence rate

The chance placement of subjects into groups so that the groups do not differ at the beginning of the experiment is known as ____________________________.

randomization

The gold standard for research in the health sciences is the

randomized control trial

The gold standard study design that is most robust and least prone to bias is the ______________________________.

randomized control trial

National Heart, Lung, and Blood Institute's evidence category B includes evidence from ______.

randomized controlled trials with a limited body of data.

National Heart, Lung, and Blood Institute's evidence category A includes evidence from ______.

randomized controlled trials with a rich body of data.

A researcher predicts that there will be a positive relationship between attitude scores and grade point average. This is an example of a

research hypothesis

_________________________ of measurement is the degree to which small differences can be detected

sensitivity

In experimental design, when comparisons are made of groups that have been selected on the basis of their extreme scores, the posttest means of the groups tend to move toward the mean of the entire population from which the extreme groups were selected. This threat to internal validity is called

statistical regression

At the top of the research/evidence hierarchy are ____________________, which collect, review, and summarize all empirical evidence that fits pre-specified eligibility criteria, and ___________________, which is a statistical procedure for combining data from multiple studies.

systemic review, meta-analysis

"A measure of how stable a test is over time" is an example of which of the following types of reliability?

test-retest

A pretest of knowledge about microcomputers is given to a group of students 5 min prior to a film on the subject. A posttest given 10 min after the film showed a 10-point gain from the pretest. The researcher concludes that the film produced the gain. Which of the following is likely the threat to internal validity?

testing

When a hypothesis is repeatedly supported by multiple investigations and laboratories, it can become a ______.

theory

True or false, a test can be reliable, but not valid.

true

This is the score that you would receive if the test contained no error.

true score

The extent to which an instrument measures what it is intended to measure is known as

validity