P301: Quiz 5

reliability; validity validity; reliability

Can have _________ without ________ but not ________without __________

reliability

________ tells us how consistent scores are

cronbach's alpha

an average of all of the possible item-total correlations. want it to be greater than .70

internal reliability

how consistent are the participant's responses to the variously phrased questions?

test-retest reliability

how consistent of scores do we get for multiple administrations of the test?

interrater reliability

if two researchers code the same data, how well do their codes match up?

content validity

the extent to which a measure captures all parts of the construct

A measure is valid but not reliable

Which of the following NOT is possible?

number of panic attacks a patient reports

Which of the following is NOT an example of physiological measurement?

They are the preferred method for examining all types of reliability.

Which of the following is NOT true of scatterplots?

The specification of operational definitions is one of the creative aspects of the research process.

Which of the following is true of operational definitions?

known groups method

looks at how well scores on a measure can discriminate between groups whose behaviors are already understood

validity

tells us how well we are measuring what we are supposed to be measuring

criterion validity

the extent to which a measure is related to a concrete outcome

face validity

the extent to which a scale appears to be measuring the variable of interest

discriminant validity

the extent to which scores on a measure of the construct of interest do not correlate well with scores on a measure of a different construct

cancel out measurement error

Asking many similar questions when trying to measure a concept is done to:

He finds that the measure of gambling is not correlated with a measure of life satisfaction in the same two groups of people.

Dr. Sheffield has decided to test the discriminant validity of his new measure. He has a group of first-time Gamblers Anonymous (GA) attendants complete his measure and finds that they score higher than a group of people who do not attend the group. Which of the following results would provide evidence for discriminant validity?

That his measure is not strongly correlated with a measure of impulsivity

Dr. Sheffield wants to establish the discriminant validity of his pathological gambling measure. He gives his measure and three others to a group of 100 people. Which of the following provides the best evidence for discriminant validity?

There appears to be good internal reliability in the scale.

Dr. Valencia calculates a correlation coefficient (r) to examine the relationship between Question 1 and Question 2 and between Question 1 and Question 3. She finds a correlation coefficient of r = -0.73 between Questions 1 and 2 and a correlation coefficient of r = 0.74 between Questions 1 and 3. Which of the following is true of her findings?

validity

Dr. Valencia is concerned whether her measure will really measure narcissism or if it will measure some other related concept. She is concerned about the scale's ________.

an abstract concept

Establishing construct validity is most important for which of the following?

self-report measure

For her research methods class, Serena plans to interview several teachers about their attitude toward teaching children who have attention-deficit/hyperactivity disorder (ADHD). This is an example of what type of measurement?

observational measurement

For his research methods class, Felipe plans to watch how teachers treat children in their classrooms who have ADHD. He will evaluate how positively or negatively the children are treated. This is an example of what type of measurement?

three

How many subcategories of quantitative variables exist?

validity

If Dr. Sheffield's measure does not actually measure pathological gambling, his measure is said to lack which of the following?

an ordinal scale of measurement

Naomi is studying the effect of popularity on academic success for her research methods project. To do this, she has elementary school students rate how popular each member of their class is. She then uses this information to rank the students on popularity (e.g., John is the most popular, Vanessa is the second-most popular). Which of the following best describes this variable?

to obtain evidence for criterion validity

To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. Why did Dr. Sheffield do this?

known-groups paradigm

To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group of people in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. This procedure is known as a:

a ratio scale of measurement

Todd is also studying the effect of popularity on academic success for his research methods project. He decides to measure popularity by asking each elementary school student to tell him how many friends he or she has. He assumes that more friends means the student is more popular. Which of the following best describes this variable?

if a measure is valid, it is also relaible

What does it mean that "reliability is necessary but not sufficient for validity"?

A ratio scale of measurement has a zero value that actually means "nothing" or "the absence of something," but an interval scale does not.

What is the difference between a ratio scale of measurement and an interval scale of measurement?

convergent validity

the extent to which scores on one measure of a construct correlate with scores on another measure of the same construct