methods test 2

discriminate validity

scores should not correlate with other tests

Establishing construct validity would probably be most important for which of the following? A measure of income A measure of spirituality A measure of heart rate A measure of the number of times a person eats alone during a month

A measure of spirituality

When examining an association claim using a bar graph, an association is indicated by which of the following? The number of observations that make each bar The direction of the bars A difference in the height between the bars The number of bars in the graph

A difference in the height between the bars

in which of the following ways are content and face validity similar? Both are very difficult to establish Both involve subjective judgments Both are preferred by psychologists as ideal measures of validity Both involve asking participants for their opinions about the measurement

Both involve subjective judgments

According to its conceptual definition, a variable should be related to a particular behavior. If a researcher is able to demonstrate that his measure of the variable is related to the behavior, then he has established which of the following? Criterion validity Content validity Convergent validity Discriminant validity

Criterion validity

A correlation-based statistic called is commonly used to determine internal reliability. Cronbach's alpha a scatterplot Pearson's r kappa

Cronbach's alpha

Which of the following determines the construct validity of a survey question? How many response options it has How well it is worded How short it is How many people answer it

How well it is worded

Which types of reliability can be analyzed with scatterplots? Internal reliability and test-retest reliability All types of reliability Internal reliability and interrater reliability Interrater reliability and test-retest reliability

Interrater reliability and test-retest reliability

Which of the following is true of behavioral observation? It requires recording technology, such as video cameras It is a more reliable and valid method than self-report methodology It requires a research assistant to be with the participant at all times It may tell a different story than data collected by self-report questions

It may tell a different story than data collected by self-report questions

Martin has found a correlation of r = .18 between the two variables of using prescription stimulants (e.g., Adderall) and frontal lobe activity. This correlation is more likely to be statistically significant if: the study can be applied to the real world Martin used a larger number of subjects Martin's measure of prescription stimulant use is categorical Martin measured frontal lobe activity extremely accurately

Martin used a larger number of subjects

Which of the following is a unique threat to construct validity found only in behavioral observation? Yea-saying Observer bias Fence sitting Socially desirable responding

Observer bias

Validity

The ability of a test to measure what it is intended to measure

content validity

The degree to which the content of a test is representative of the domain it's supposed to cover.

While reading about a research study, which of the following would tell you that an association claim is being made? The presence of a scatterplot or bar graph The measurement of two variables The discussion of internal validity The use of a correlation coefficient

The measurement of two variables

A study finds a correlation coefficient of r = .52 and reports p < .05. The p value indicates which of the following? The effect size is large The null hypothesis (r = 0.00) is unlikely to be true for the sample The correlation is not statistically significant The correlation is negative

The null hypothesis (r = 0.00) is unlikely to be true for the sample

Two researchers tell you they study the same thing. However, when you look at their research papers, they do not use similar methodologies or measurements. How is this possible? The researchers have the same conceptual definitions (constructs) and operational definitions The researchers do not have the same conceptual definitions (constructs) nor the same operational definitions The researchers have the same operational definitions The researchers have the same conceptual definitions (constructs)

The researchers have the same conceptual definitions (constructs)

Which of the following is true of operational definitions? Conceptual definitions are created after operational definitions are determined. Operational definitions and conceptual definitions are the same thing. There is only one operational definition that is possible for each conceptual definition. The specification of operational definitions is one of the creative aspects of the research process.

The specification of operational definitions is one of the creative aspects of the research process.

Which of the following is NOT true of finding a stronger effect size in an association claim? There will be greater accuracy in predicting one variable from the other There will be greater likelihood of a finding being important in the real world There will be greater construct validity There will be a greater likelihood of finding a statistically significant relationship

There will be greater construct validity

Cronbach's alpha

a correlation-based statistic that measures a scale's internal reliability

known-groups paradigm

a method for establishing criterion validity, in which a researcher tests two or more groups, who are known to differ on the variable of interest, to ensure that they score differently on a measure of that variable

Likert Scale

a numerical scale used to assess people's attitudes; it includes a set of possible answers with labeled anchors on each extreme

directionality problem

a situation in which it is unclear which variable in an association came first

Supurious association

bivariate correlation is there but only because of the third variable

third variable problem

alternative explanation for association of 2 variables

ratio scale

numbers with equal intervals and 0 means none

Bivariate association claims' failure to meet the criteria of temporal precedence and internal validity means that __________ cannot be established. external validity statistical significance causal inference covariance

causal inference

Realiability

consistency of measurement

If a person is asking whether the variables in an association claim are measured appropriately, __________ is being interrogated. internal validity statistical validity external validity construct validity

construct validity

bivariate correlation

correlation between two variables

effect size

describes the strength of an relationship between 2 or more variables

t-tests

difference between 2 means

internal reliability

different parts of the same test produce similar results

interval scale

equal intervals between levels and no true 0

restriction of range

full range isn't show making association seem smaller than it is

A study finds a correlation coefficient of r = .52. According to Cohen's benchmarks, the magnitude of this effect is: small medium large statistically significant

large

A question that leads people to answer in a particular way is known as a(n) negatively worded question double-barreled question ordered question leading question

leading question

Cirterion Validity

measure correlates with key behavioral outcome

Masked, or blind, study designs are designed to deal with bystander effect observer bias yea-saying biases faking good

observer bias

A study finds a correlation coefficient of r = .52 and reports p < .05. The p is a plausible significance approximation proportion assessment probability estimate population value

probability estimate

statistical significance

refers to the conclusion a researcher reaches regarding how likely it is they'd get a correlation of that size just by chance, assuming that there's no correlation in the real world

ordinal scale

represent ranked numbers

Observer bias relates mainly to ______, whereas observer effects stem from ______. outcomes; expectations researchers; participants validity; reliability faking good; faking bad

researchers; participants

Faking good is also known as socially desirable responding acquiescence nondifferentiation fence sitting

socially desirable responding

interrater reliability

the amount of agreement in the observations of different raters who witness the same behavior

face validity

the extent to which a test item appears to fit the particular trait it is measuring

curvilinear association

the relationship between two variables is not a straight line

test-retest reliability

using the same test on two occasions to measure consistency

moderator

when relationship between variables changes depending on the levels

observer effect

Changes in an organism's behavior brought about by an awareness of being observed.

Which of the following graph formats is the best way to examine an association claim between two quantitative variables? bar graph line graph pie chart scatterplot

scatterplot

For his research methods class, Felipe plans to watch how students treat other children in their classrooms who have attention-deficit/hyperactivitydisorder (ADHD). He will evaluate how positively or negatively the children are treated by their classmates. This is an example of what type of measurement? Physiological measurement Observational measurement Self-report measurement Archival measurement

Observational measurement

convergent validity

scores on the measure are related to other measures of the same construct

Which of the following is NOT an example of physiological measurement? Measurements of hormones in the bloodstream Number of panic attacks a patient reports A brain scan made using an fMRI Blood pressure measurements

Number of panic attacks a patient reports

Which of the following is the most direct way to control for question order effects? Order effects cannot be controlled for Prepare different versions of the survey, varying the order of the questions Give the survey questions to different groups of people Combine multiple questions into single questions

Prepare different versions of the survey, varying the order of the questions

Which of the following is NOT possible? Scores from a measure are reliable but not valid Scores from a measure are neither reliable nor valid Scores from a measure are valid but not reliable Scores from a measure are both reliable and valid

Scores from a measure are valid but not reliable

Which of the following is NOT a good way to deal with reactivity? Measuring the behavior unobtrusively Which of the following is NOT a good way to deal with reactivity? Measuring the behavior unobtrusively Using multiple observers Waiting to begin observations Blending in with the surroundings Waiting to begin observations Blending in with the surroundings

Using multiple observers