P301: Quiz 5
reliability; validity validity; reliability
Can have _________ without ________ but not ________without __________
reliability
________ tells us how consistent scores are
cronbach's alpha
an average of all of the possible item-total correlations. want it to be greater than .70
internal reliability
how consistent are the participant's responses to the variously phrased questions?
test-retest reliability
how consistent of scores do we get for multiple administrations of the test?
interrater reliability
if two researchers code the same data, how well do their codes match up?
content validity
the extent to which a measure captures all parts of the construct
A measure is valid but not reliable
Which of the following NOT is possible?
number of panic attacks a patient reports
Which of the following is NOT an example of physiological measurement?
They are the preferred method for examining all types of reliability.
Which of the following is NOT true of scatterplots?
The specification of operational definitions is one of the creative aspects of the research process.
Which of the following is true of operational definitions?
known groups method
looks at how well scores on a measure can discriminate between groups whose behaviors are already understood
validity
tells us how well we are measuring what we are supposed to be measuring
criterion validity
the extent to which a measure is related to a concrete outcome
face validity
the extent to which a scale appears to be measuring the variable of interest
discriminant validity
the extent to which scores on a measure of the construct of interest do not correlate well with scores on a measure of a different construct
cancel out measurement error
Asking many similar questions when trying to measure a concept is done to:
He finds that the measure of gambling is not correlated with a measure of life satisfaction in the same two groups of people.
Dr. Sheffield has decided to test the discriminant validity of his new measure. He has a group of first-time Gamblers Anonymous (GA) attendants complete his measure and finds that they score higher than a group of people who do not attend the group. Which of the following results would provide evidence for discriminant validity?
That his measure is not strongly correlated with a measure of impulsivity
Dr. Sheffield wants to establish the discriminant validity of his pathological gambling measure. He gives his measure and three others to a group of 100 people. Which of the following provides the best evidence for discriminant validity?
There appears to be good internal reliability in the scale.
Dr. Valencia calculates a correlation coefficient (r) to examine the relationship between Question 1 and Question 2 and between Question 1 and Question 3. She finds a correlation coefficient of r = -0.73 between Questions 1 and 2 and a correlation coefficient of r = 0.74 between Questions 1 and 3. Which of the following is true of her findings?
validity
Dr. Valencia is concerned whether her measure will really measure narcissism or if it will measure some other related concept. She is concerned about the scale's ________.
an abstract concept
Establishing construct validity is most important for which of the following?
self-report measure
For her research methods class, Serena plans to interview several teachers about their attitude toward teaching children who have attention-deficit/hyperactivity disorder (ADHD). This is an example of what type of measurement?
observational measurement
For his research methods class, Felipe plans to watch how teachers treat children in their classrooms who have ADHD. He will evaluate how positively or negatively the children are treated. This is an example of what type of measurement?
three
How many subcategories of quantitative variables exist?
validity
If Dr. Sheffield's measure does not actually measure pathological gambling, his measure is said to lack which of the following?
an ordinal scale of measurement
Naomi is studying the effect of popularity on academic success for her research methods project. To do this, she has elementary school students rate how popular each member of their class is. She then uses this information to rank the students on popularity (e.g., John is the most popular, Vanessa is the second-most popular). Which of the following best describes this variable?
to obtain evidence for criterion validity
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. Why did Dr. Sheffield do this?
known-groups paradigm
To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group of people in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. This procedure is known as a:
a ratio scale of measurement
Todd is also studying the effect of popularity on academic success for his research methods project. He decides to measure popularity by asking each elementary school student to tell him how many friends he or she has. He assumes that more friends means the student is more popular. Which of the following best describes this variable?
if a measure is valid, it is also relaible
What does it mean that "reliability is necessary but not sufficient for validity"?
A ratio scale of measurement has a zero value that actually means "nothing" or "the absence of something," but an interval scale does not.
What is the difference between a ratio scale of measurement and an interval scale of measurement?
convergent validity
the extent to which scores on one measure of a construct correlate with scores on another measure of the same construct
