Research Exam 2
measurement effects are a threat to _____ validity
External validity Administration of a pretest in a study that affects the generalizability of the findings to other populations.
The nurse researcher should strive for subjects to demonstrate homogeneity with respect to which variables? Independent Dependent Extraneous Outcome
Extraneous In order to control extraneous variables, subjects should be similar.
To avoid threats to validity, a researcher must identify, plan for, and control what? Independent variables Unexpected findings The control group Extraneous variables
Extraneous variables
For large experimental studies, conducting a pilot study helps the researcher determine what? Degree of internal control over dependent variables Accuracy and objectivity of the design Feasibility of the research design Constancy of data collection
Feasibility of the research design A pilot study informs the researcher of pragmatical considerations in conducting the research study.
Administration of an intervention to one group of subjects and not another is an example of what? (Select all that apply.) Homogeneity of subjects Manipulation of the independent variable An experimental study The introduction of bias
Manipulation of the independent variable An experimental study
History is a threat to ______ validity
internal validity
Testing is a threat to ______ validity.
internal validity
Researchers used an instrument to measure self-esteem in adolescent mothers. To measure the validity of this instrument, they used a second instrument known to measure self-esteem in women. What type of validity were they measuring? Predictive validity Face validity Concurrent validity Correct Construct validity
Concurrent validity Concurrent validity refers to the degree of correlation of two measures of the same concept administered at the same time.
When a subject is answering a question in a socially desirable way, the data will contain what? Error variance Random error Constant error Correct Unreliability
Constant error Social desirability is a form of constant error.
___________ is the extent to which a test measures a theoretical construct, attribute, or trait. It attempts to validate the theory underlying the measurement by testing of the hypothesized relationships. This validity is ensured by using convergent and divergent approaches _________ validity, sometimes called concurrent validity, refers to a search for other measures of the construct. Two or more instruments that theoretically measure the same construct are identified, and both are administered to the same subjects. A positive correlation (closer to 1) between the instruments shows the instrument favorably measures the construct it is supposed to. ________ validity, sometimes called discriminant validity, uses measurement approaches that differentiate one construct from others that may be similar. Sometimes researchers search for instruments that measure the opposite of the construct. If the divergent measure is negatively related to other measures, validity for the measure is strengthened.
Construct validity is based on the extent to which a test measures a theoretical construct, attribute, or trait. It attempts to validate the theory underlying the measurement by testing of the hypothesized relationships. Convergent validity, sometimes called concurrent validity, refers to a search for other measures of the construct. Sometimes two or more instruments that theoretically measure the same construct are identified, and both are administered to the same subjects. A positive correlation (closer to 1) between the instruments shows the instrument favorably measures the construct it is supposed to. Divergent validity, sometimes called discriminant validity, uses measurement approaches that differentiate one construct from others that may be similar. Sometimes researchers search for instruments that measure the opposite of the construct. If the divergent measure is negatively related to other measures, validity for the measure is strengthened.
The nurse researcher is working with an experimental design in a research project. The design allows each participant to have an equal chance of being assigned to one of several groups. This is known as: control. manipulation. randomization. selection effect.
randomization. Randomization allows each subject to be given an equal chance of being assigned to one of several groups.
The nurse researcher strives for accuracy in the research design for which purpose? All aspects of the study logically flow from the research question. All mediating variables have been controlled. Gaps in the literature have been identified. The timing of data collection was the same for each subject.
All aspects of the study logically flow from the research question.
In quantitative research, control is used to avoid what? Duplication Bias Randomization Homogeneity
Bias The researcher holds conditions of the study uniform to avoid possible impact of bias on the outcome.
convenience sample: Probability or non-probability? Explain how it works Explain the risks of this type of sample
Conveinience = non-probability Conveinience sampling works by using the most readily available subjects. The major disadvantage of a convenience sample is that the risk of bias is greater than in any other type of sample The fact that convenience samples use voluntary participation increases the probability of researchers recruiting those people who feel strongly about the issue being studied, which may favor certain outcomes.
What must occur for the nurse researcher to randomly select a sample of subjects? Each subject should have an equal chance of being selected. Subjects who might die or leave the study voluntarily should be eliminated. Subjects should be grouped according to homogeneity. Each subject should be selected on the basis of his or her ability to participate.
Each subject should have an equal chance of being selected.
The nurse researcher randomly selects subjects in order to do what? Increase the number of participants. Eliminate bias. Prevent contamination of subjects. Control the dependent variables.
Eliminate bias.
What does a test score or measurement consist of? Random errors plus constant errors Random errors plus the true score Constant errors plus error variance Error variance plus the true score
Error variance plus the true score A test score includes the inherent bias of the study (error variance) and the true measurement
A research study was under way looking at the frequency of mammograms in perimenopausal women. During the study a celebrity was diagnosed with breast cancer. The effect of this event on the research findings is called what? Maturation Reactivity Constancy History
History
The nurse researcher defines control as what? Having a large sample size Manipulating the dependent variable Having a basis of comparison for each experimental group of subjects Holding conditions of the study constant
Holding conditions of the study constant
A researcher decides to use six people to help collect data for a quantitative study. What is a potential threat to the internal validity of this study? History Instrumentation Maturation Selection effects
Instrumentation
A researcher studies the differences in IQ between girls and boys. The researcher tests cohorts of girls and boys in the third grade and then tests the same girls and boys when they are in the sixth grade. Which are threats to internal validity in this study? (Select all that apply.) Maturation History Testing Measurement effects
Maturation Testing Maturation refers to developmental processes within subjects over time. Testing refers to the influence on subjects' responses caused by taking the same test repeatedly.
Meta-analysis - Same as a systematic review, but uses _______ to analyze studies. Treats studies as one large data set Data is pooled and then a calculation is performed to determine the effect of the studies The ________are determined by measuring the difference (subtracting) the average scores between intervention and control groups from each study. The ______ is determined for each study being reviewed. A single _______ then becomes an estimate of how large a difference exists between the intervention and control groups (the difference between them is how big of an effect the intervention had on the dependent variable.
Meta-analysis - Same as a systematic review, but uses statistical methods to analyze studies Data is pooled and then a calculation is performed to determine the effect of the studies The effect sizes are determined by measuring the difference (subtracting) the average scores between intervention and control groups from each study. The effect size is determined for each study being reviewed. A single effect size then becomes an estimate of how large a difference exists between the intervention and control groups (the difference between them is how big of an effect the intervention had on the dependent variable.
A ___________ = Qualitative counterpart to Systematic reviews that uses more than just RCT's It is a summary and assessment of many research studies on a specific topic.
Meta-synthesis
Which design would be most effective when the nurse researcher needs to collect data before and after an experimental treatment on a group of subjects? One-group (pretest-posttest) design After-only nonequivalent control group design Time series design Solomon four-group design Incorrect
One-group (pretest-posttest) design The one-group (pretest-posttest) design allows for collection of data before and after an experimental treatment on one group of subjects.
Name each design as experimental or quasi experimental Pretest-posttest control group Nonequivalent control group design Solomon four-group design Time series design After-only design After-only nonequivalent control group design One-group (pretest-posttest) design
Pretest-posttest control group - experimental Nonequivalent control group design - Quasi Solomon four-group design - Experimental Time series design - Quasi After-only design - Experimental After-only nonequivalent control group design - quasi One-group (pretest-posttest) design - quasi
Quota sampling: Probability or non-probability? Explain how quota sampling works What are strata in quota sampling and why are they important?
Quota = non-probability Explain how quota sampling works: Subjects who meet inclusion criteria for study are recruited and enrolled in study until a target sample size is reached Strata are groups within the population identified by the researcher. (ex. in a population of 5000 nurses 50% are BSNs, 40% ASN, and 10% DNPs) In a quota sample of 500 of this population, nurses would be contacted and enrolled until the a proportional percentage of each group was represented in the sample of 500. Strata are important because they must accurately reflect the population being studied. Each strata should be homogenous enough to be able to draw meaningful comparisons between them (EG. BSN Vs ASN)
Extraneous variables can be controlled by what? (Select all that apply.) Randomly selecting subjects Using a homogeneous sample Manipulating the dependent variable Conducting a pilot test
Randomly selecting subjects Using a homogeneous sample Randomization is a means of controlling extraneous variables. Homogeneity of the sample is a means of controlling extraneous variables.
Systemaic reviews are usually based on and include a a clear ________ AKA PICO The goal is to assess the strength and quality of the evidence found in the literature on a clinical subject. The purpose is to report the most current and valid research on intervention effectiveness and clinical knowledge, which will ultimately inform evidence-based decision making about the applicability of findings to practice. Ultimately practice recommendations are made once the studies have been synthesized and examined and presented in an article.
Systemaic reviews usually include a clear clinical question AKA (PICO)
Objectivity in the conceptualization of the research question is derived from what? A random sample of subjects A control group The review of literature The selection of instruments to be used
The review of literature The review of the literature, as well as the theoretical framework, informs the researcher of the breadth and depth of available knowledge in the area.
Which design would be most effective when the nurse researcher is interested in deterring trends over time? One-group (pretest-posttest) design After-only nonequivalent control group design Time series design Solomon four-group design
Time series design
When an instrument is able to represent all aspects of a given construct, it is said to have _____ validity. For example. A tool can assess the construct of depression and represents both the emotional aspect of depression, as well as the behavioral dimension. This type of validity is measured with the: ______ scale (score of 0.78-1.0) ______ validity - Which is an intuitive type of validity where colleagues or subjects are asked to read the instrument and evaluate the content in terms of whether it appears to reflect the concept the researcher intends to measure.
When an instrument is able to represent all aspects of a given construct, it is said to have Content validity. For example. A tool can assess both the emotional aspect of depression, as well as the behavioral dimension. This type of validity is measured with the: Content validity Index (CVI) scale (score of 0.78-1.0) Face Validity - Which is an intuitive type of validity where colleagues or subjects are asked to read the instrument and evaluate the content in terms of whether it appears to reflect the concept the researcher intends to measure.
Internal validity is important to the nurse researcher because it asks what? If the study is generalizable to the larger population If the Hawthorne effect affected the findings Whether the independent variable caused the change in the dependent variable Whether study findings are a result of measurement effects
Whether the independent variable caused the change in the dependent variable
selection effect is a threat to ____ validity
a threat to external validity. Refers to the generalizability of the findings to other populations. This type of threat to external validity occurs when an ideal sample cannot be acquired. The subjects may not be accessible, or in low number. This effects a studies applicability to the population as a whole because the sample being studied may not representative of it.
The nurse researcher is working with an experimental design in a research project. The design allows the researcher to hold conditions constant to limit bias that could influence the dependent variable. This is known as: control. manipulation. randomization. selection effect.
control.
Instrumentation is considered to be a threat to _____ validity
internal validity Measurement of the relationship between independent and dependent variable is impacted by the instruments used to measure, or the observational techniques used. Ex: thermometers being compared may not be calibrated properly before comparing, or researchers doing observational study may not be using a standardized approach.
criterion-related validity tests validity of Instruments. It measures how well one instrument predicts the outcome for instrument in a different situation The two main types are: ______ validity: correlation of one test with the scores of another more established instrument measuring the same concept when both are administered at the same time. When correlation is high it shows the instrument is valid
two or more instruments that theoretically measure the same construct are identified, and both are administered to the same subjects. A correlational analysis