(Exam 1) Validity and Reliability
Reliability implies validity True or false
False
What is an example of internal validity? What is an example of external validity?
Like the example with the water causing the death Like the example with the kids from the playground https://www.youtube.com/watch?v=4jX38E5mtNk
What are the 2 types of validity?
internal and external
Refers to the extent to which the results of a study are generalizable or transferable: Internal validity External validity
External validity
A measure is said to have a high validity if it produces similar results under consistent conditions True or false
False A measure is said to have a high reliability if it produces similar results under consistent conditions
Reliability implies validity True or false
False Reliability does not imply validity
Internal validity is the degree to which the conclusions in your study would hold for other persons in other places and at other times True or false
False That is external validity
An outside event or occurrence that might have produced effects on the independent variable: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
History
An example are scores from ACT and SAT: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Inter-method reliability
Assesses the degree to which test scores are consistent when there is a variation in the methods or instruments used: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Inter-method reliability
An example is two or more hygienists who are measuring PD's for a research study: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Inter-rater reliability
Assesses the degree of agreement between two or more raters in their appraisals: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Inter-rater reliability
Degree to which the study accurately reflects event that would occur in a real situation: Internal validity External validity
Internal
How well a study is conducted; depends on the controls placed during the conduct of research study: Internal validity External validity
Internal
Assess the consistency of results across items within a test: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Internal consistency
Measures whether several items that propose to measure the same general construct produce similar scores: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Internal consistency reliability
Good experiment techniques in which the effect of an independent variable on a dependent variable is studied under highly controlled conditions: Internal validity External validity
Internal validity
An example would be if a respondent agreed with the statements "I like to ride bicycles" and "I've enjoyed riding bicycles in the past", and disagreed with the statement "I hate bicycles": Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Internal-consistency reliability
If a person weighs 200 pounds and the scale measures 150, 250, 195 and 140, what does that mean?
It is not reliable
If a person weighs 200 pounds and the scale measures 200 pounds each time, what does that mean?
It is reliable and valid
If you weigh 150 and your scale measures 125 every time, is it reliable or valid? Or both?
It is reliable because it gives consistent values But it is not correct It can be reliable but not correct
If a person weighs 200 pounds and the scale measures 150 each time, what does that mean?
It is reliable but not valid
Produced by internal (physical and psychological) changes in subjects Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Maturation
Produced by differences in dropout rates across the conditions of the experiment: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Mortality
An example is the NBDHE having different versions: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Parallel-forms reliability
Develops forms of a test that are equivalent in the sense that a person's true score from version A of a test would be identical to their true score from version B of an exam: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Parallel-forms reliability
What is the hawthorne (placebo) effect?
People who are being tested to see how hardworking they are will work harder if they KNOW that they are being tested
Which is a more accurate way of describing precision and which is a more precise way of describing accuracy: Validity Reliability
Precision: Reliability Accuracy: Validity
A test or measurement is considered __________ if it produces consistent results over repeated testings: Reliability Validity
Reliability
Consistency of a measure: Reliability Validity
Reliability
Precision: Reliability Validity
Reliability
Occurs when nonrandom procedures are used to assign subjects to conditions or when the random assignment fails to balance out differences among subjects across the different conditions of the experiment: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Selection threat Subject selection bias It's like people who volunteer to participate in a study, they might be more curious, have a higher IQ and are highly motivated
Involves ensuring the use of adequate sampling procedures, appropriate statistical tests, and reliable measurement procedures: What is that?
Statistical conclusion validity
When extreme scores regress toward the mean when a test or task is re-administered: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Statistical regression
An example is an IQ test given a couple of months apart to the same individual should result in similar scores: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Test-retest reliability
Assess the degree to which test scores are consistent from one test administration to the next: Inter-rater reliability Test-retest reliability Inter-method reliability Parallel-forms reliability Internal consistency reliability
Test-retest reliability
Produced by a previous administration of the same test or other measures: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Testing
Study in which the participants and researchers are unaware of whether a treatment is being administered: Single blind study Double blind study Triple blind study
Triple blind study
A measure is said to have a high reliability if it produces similar results under consistent conditions True or false
True
Reliability does imply validity True or false
True
Which is concerned with the study's success at measuring what the researchers set out to measure: Reliability or validity
Validity
_______ refers to the degree to which a study accurately reflects or assesses the specific concept that the researcher is attempting to measure: Reliability or validity
Validity
____________ in a research study determines whether the research truly measures that which it was intended to measure: Reliability or validity
Validity
What is statistical regression?
When extreme scores regress toward the mean when a test or task is re-administered.
Test-retest reliability includes intra-rater reliability True or false
True
What is statistical conclusion validity mainly concerned about?
Concerned mainly with the relationship that is found among variable, the relationship may be solely a correlation
Study participants, as well as the researchers and examiners, are unaware of the study: Single blind study Double blind study Triple blind study
Double blind study
Refers to the extent to which study results can be generalized: Internal validity External validity
External
Changes produced by changes in the instrument itself: Maturation History Testing Instrumentation Statistical regression Subject selection bias Mortality Hawthorne effect
Instrumentation
Study participants or examiners are unaware of the group assignment: Single blind study Double blind study Triple blind study
Single blind study
Accuracy: Reliability Validity
Validity
The degree to which it measures what it is supposed to measure: Reliability Validity
Validity