Chapter 5
# of calories consumed
Operational variable
degrees Fahrenheit
Operational variable
it looks like what you want to measure
face validity
seconds spent on a task
Operational variable
Some colleges no longer require SAT or ACT scores. A major reason they have done this is because there is a low correlation between these scores and students' first-year GPA.
criterion validity
does the measure correlate with relevant behaviors
criterion validity
your measure is correlated with a relevant behavioral outcome.
criterion validity
Dr. Kamran studies domestic violence and has designed a self-report scale that is meant to assess men's negative attitudes toward women. To validate her scale, she administers it to two groups of recently incarcerated male prisoners: prisoners convicted of domestic violence and prisoners convicted of other crimes. Dr. Kamran finds a statistically significant difference in the mean scores of the two groups. What technique is Dr. Kamran using to validate her scale?
known-groups paradigm
Lorenzo could record the amount of pushing and shoving each child engages in during recess.
observational
Lorenzo could record the number of verbal attacks on a playground.
observational
records behaviors of traces of behaviors
observational
The following is an example of: the number of seconds someone spends smiling during an interaction
observational measure
The following is an example of: the number of times someone checks the clock in a waiting room
observational measure
how many seconds it takes to recognize previously read stories on a list
operational definition
the number of correct details recalled from a story
operational definition
Lorenzo ranks the children in the classroom from most to least aggressive.
ordinal
records participants own views of themselves
sel-report
The following is an example of: how outgoing someone claims to be
sel-report measure
Children could answer questions about how frequently they argue with classmates.
self-report
What can you learn from a scatterplot that you cannot learn from the correlation coefficient r?
the specific values of each pair of measurements
Santiago is a leading researcher on video game addiction. He finds that the items on a new survey on game addiction do not seem to assess game addiction in a reasonable way.
face validity
recognition of previously read stories
conceptual definition
Fitness
conceptual variable
Lorenzo counts the total number of aggressive behaviors each child demonstrates.
ratio
Are the same people responding to a measure in a consistent manner across multiple time points?
test-retest reliability
people get consistent scores every time they take the test
test-retest reliability
Rebecca is conducting a study on stress in which she is measuring the levels of cortisol (a hormone that denotes a stress response in the body) in participants after they complete a difficult task. In this case, a reading of zero would mean no cortisol. Which of the following descriptors apply to the variable "cortisol" in Rebecca's study? A. physiological B. quantitative C. categorical D. self-report G. ratio E. operational F. ordinal G. ratio
Applicable: A, B, G, E,
The following is a example of: exam scores
ratio scale
Two ____ ways to assess validity
subjective
Lorenzo could take saliva samples from children to measure their levels of testosterone (a hormonal, or physiological, measure of aggression).
physiological
The following is an example of: someone's electroencephalogram reading
physiological measure
The following is a example of: the amount of fuel in a gas tank
ratio scale
Choose 1 ,2, 3 graph that demonstrates strong interrupter reliability
1
People give consistent reposes on every item of a questionnaire
Internal reliablity
Three _______ways to assess validity
empirical
Is the measure a plausible operationalization of the conceptual variable?
face validity
Identify the true and false statements about the relationship between reliability and validity. A. Establishing reliability in a measure is not sufficient for validity. B. A measure that is reliable will always be valid. C. A measure can be very reliable but not very valid. D. The validity of a measure is the same as its reliability.
True Statement(s) A, C
the ability to recall previously read stories
conceptual definition
fear
conceptual variable
social mediaa usage
conceptual variable
Does the measure include all aspects of the conceptual variable?
content validity
the measure contains all the parts that your theory says it should contain
content validity
The local Department of Motor Vehicles (DMV) receives a complaint that some of the employees who administer the road test pass a much higher percentage of test-takers than others. In this example, what aspect of the road test is being questioned?
interrater reliability
two coders rating of a set of targets are consistent with each other
interrater reliability
Clarence created a checklist for hospitals to observe and assess obsessive-compulsive disorder in people admitted to inpatient wards. He sent the checklist to three other psychiatric hospitals to see how it would fare in other locations. In Clarence's hospital, his checklist revealed that 10% of the patients showed symptoms of obsessive-compulsive disorder, a figure similar to the national average. The other three hospitals reported rates of 1%, 25%, and 35%. With what type of reliability may Clarence's measure have a problem?
interrupter reliablilty
Lorenzo rates each child's aggression on a scale of 1 to 7.
interval
The following is a example of: SAT scores
interval scale
The following is a example of: calendar years
interval scale
Professor Ngobila questions whether the ratings related to teaching effectiveness that he receives from his students in his end-of-term evaluation indicate how much the students learned in his class, or whether they are just a reflection of how much his students like his personality. Which aspect of his students' ratings is Professor Ngobila questioning?
measurement validity
The following is a example of: college major preferences
ordinal scale
The following is a example of: sports team rankings
ordinal scale
records biological information from a living thing
physchological
Children could wear a heart monitor to assess the change in their heart rate after an altercation with a classmate.
physiological
The following is an example of: someone's blood pressure
physiological measure
Teachers could respond to a questionnaire about their perceptions of aggression levels in their classrooms.
self-report
The following is an example of: how depressed someone says they feel
self-reporting measure
Andrés is interested in testing a new measure of extroversion in college students. He gives the measure to a group of 20 college students and then administers it again 3 and 6 months later. He finds that some of the students who initially reported moderate levels of extroversion report lower levels 6 months later, while several of the students who initially reported low levels of extroversion report higher levels 6 months later. With what type of reliability may Andrés' measure have a problem?
test-retest reliability
In measurement, _________ refers to a measure's ability to accurately represent the variable the researcher is investigating. But this concept is made up of many different components. ___________ is the extent to which a given measure appears to be measuring the variable in question. _____________ evaluates how well a measure taps into all aspects of a particular variable. ____________represents how well a measure relates to actual behavior.
validity, Face validity, Content validity, Criterion validity
Identify the true and false statements about this table representing a five-item measure. A. One item in this scale is skewing the AIC. B. This measure has low interrater reliability. C. This measure has a Cronbach's alpha above .80. D. This measure has low internal reliability.
Identify the true and false statements about this table representing a five-item measure. True Statement(s) A. One item in this scale is skewing the AIC. B. This measure has low interrater reliability. C. This measure has a Cronbach's alpha above .80. D. This measure has low internal reliability. False Statement(s) B. This measure has low interrater reliability. C. This measure has a Cronbach's alpha above .80.
An online IQ test consists of the primary task of choosing the correct definitions for a series of words. Josiane, an authority on IQ, is concerned that it doesn't test other things that are part of IQ, such as problem solving or visual-spatial ability.
content validity
Anjali has created a new measure of social anxiety. She gives a test group of college students her measure, along with several other measures of social anxiety. In her results she sees that her measure does not correlate with the other established measures of social anxiety. With what type of validity may Anjali's measure have a problem?
convergent validity
Is the measure strongly correlated with theoretically similar constructs?
convergent validity
Karin is concerned because her new scale on extroversion does not correlate with a well-established extroversion scale.
convergent validity
your self-report measure is more strongly associated with self-report measures of similar constructs
convergent validity
Che is tracking young participants over a 1-year period in a study on extroversion. In her baseline survey, 35% of the sample report being extremely extroverted. However, when Che observes the participants at school, fewer than 10% demonstrate behaviors such as engaging in conversation with strangers, attempting to make new friends, or expressing themselves freely. With what type of validity may Che's measure have a problem?
criterion validity
Hewlett is attempting to measure spatial intelligence. He creates a specialized task to measure spatial ability and recognition and uses it along with other measures. His data show that the results from his new task are highly correlated with measures of other constructs, like memory and language intelligence. With what type of validity may Hewlett's measure have a problem?
discriminant validity
Is the measure not as strongly correlated with theoretically different constructs?
discriminant validity
Xia is creating a measure of conscientiousness. She wants to ensure that her scale doesn't instead assess concern for social desirability.
discriminant validity
your self-report measure is strongly associated with self-report measures of dissimilar constructs.
discriminant validity
Teresa is creating a new measure on hyperactivity in children. She has read some research stating that understanding energy level and the ability to focus is key to understanding hyperactivity. However, Teresa's measure of hyperactivity only contains items about diet and exercise. With what type of validity may Teresa's measure have a problem?
face validity
Lorenzo is studying aggression in children. He administers a questionnaire to some children that asks them about their feelings of aggression. Lorenzo then runs a statistical test to determine how consistent the responses are to different items on the questionnaire. This test is examining __________reliability, and the statistic that represents this type of reliability is ___________.
internal , Cronbach's alpha
Are people responding in a consistent manner to all of the items on a 10-item scale?
internal reliability
Do all of the raters who are observing behaviors agree about the number of behaviors they see?
interrater reliability
In general, a measure's ability to remain consistent is referred to as __________. But this concept can be broken down in nuanced ways. For example,___________ refers to whether results are uniform after repeated use of a measure. In addition, _____________ refers to whether results are uniform when multiple administrators use the measure. Finally, a measure with__________ will generate similar responses across all of the items, even with different wording.
reliability, test-retest reliability, interrater reliability, internal reliability
