Unit 2 (RSM)
A strong relationship was found. Children with more positive relationships with their parents had higher academic performance than children with less positive relationships with their parents. From this information, you know that the r in the study was closest to
+.50
Which of the following is not possible?
A measure is valid but not reliable
When using correlation coefficients to evaluate reliability, which of the following is undesirable
A negative correlation coefficient
Which of the following is a poll likely to measure?
A person's opinion about a healthcare law.
In order to use the known groups Paradigm to establish Criterion validity, which of the following is necessary?
After testing, the groups should have significantly different scores on the measure
Which of the following is true about large effect sizes in an association claim ?
All else being equal, there will be greater likelihood of a finding being important in the real world
Naomi is studying the effect of popularity on academic success for her research methods project. To do this, she has elementary school students rate how popular each member of their class is. She then uses this information to rank the students on popularity. Which of the following best describes this variable?
An ordinal scale of measurement
How are quota sampling and stratified random sampling similar?
Both identify subgroups that need to be studied.
Your friend Alana says that when examining validity, you always want to see positive correlations. Why is she wrong?
Both the strengths and the direction of a correlation matter when examining validity
Dr. Pierre is interested in studying levels of anxiety in children who have lived through a major natural disaster. As she plans her study, she is considering various operational definitions of anxiety. Which of the following is an example of an operational definition for anxiety that she could consider?
Changes in heart rate while viewing images of the aftereffect of a natural disaster
Which of the following hypotheses would be best tested with a survey?
College students with part-time jobs have high self-esteem.
What is the term for a researchers definition of the variable in question at a theoretical level
Conceptual definition
A correlation based statistic called ___ is commonly used to determine internal reliability
Cronbach's Alpha
The Yerkes-Dodson law (1908), shows that performance increases with arousal up to a point, but beyond that, performance decreases with increasing arousal. What type of correlation is this?
Curvilinear
Temporal precedence Criterion is known as the ___ problem
Directionality
Why might a researcher choose purposive sampling over systematic sampling?
External validity is not vital to the researchers study
Forced choice question formats are especially good at dealing with which of the following issues?
Fence sitting
Dr Gahan decides to create a questionnaire asking about people's attitudes toward immigration (a socially sensitive topic). He should most be concerned about which of the following?
Fence sitting.
Which of the questions above is an example of a question that uses semantic differential scale?
How easy did you feel this class was? (1) easy - - - (5) hard
When you are interrogating the external validity of a sample, which is the most important question to ask?
How was the sample collected?
Which of the following is a good reason a researcher might give for using observational methods as opposed to self-report methods?
I want to measure something that people may not know how often they do it
What does it mean that "reliability is necessary but not sufficient for validity"?
If a measure is valid, it is also reliable
Which of the following is an advantage of polling organizations using Internet panels over landline panels?
It is easier to follow up with Internet panels and track how their opinions change over time.
Which of the following is true of sample size?
It primarily affects statistical validity.
Which of the following is true of inter-rater reliability?
It requires the use of two or more raters/observers.
Danesh has just read an article that describes a study that used a survey completed by participants to assess anxiety levels in adults. He is interested in the reliability of the survey and finds that the authors have provided information about both internal and test-retest reliability. However, there is no information about interrater reliability. Which of the following reasons explains why the authors do not report interrater reliability?
The anxiety scale is a self-report measure, and interrater reliability is needed only when two or more observers are providing ratings
Martin has found a correlation of r - .18 between the two variables of using prescription stimulants (e.g., Adderall) and frontal lobe activity. This correlation is more likely to be statistically significant if ...
Martin used a larger number of subjects
Which of the following statements is true of observational data?
Observational measures can be used to make frequency claims.
Masked or blind study designs are designed to deal with
Observer bias.
How are quota sampling and stratified random sampling different?
Only stratified random sampling will result in a representative sample
Which of the following are correct about question format of surveys and polls?
Open-ended questions usually include rich and spontaneous information.
Why might question order affect how people respond to a survey or poll?
People may try to appear consistent.
Dr Jewel is interested in measuring people's attitudes about proposed tax cuts. One of his items read, "People who support cutting taxes are not well informed about how the government works." Which of the following items should Dr Jewel use instead to improve construct validity?
Please rate your opinions about tax cuts on a (1) strongly disagree to (7) strongly agree scale
Which of the following is the most direct way to control for question order effects?
Prepare different versions of the survey, varying the question order.
Which of the following is true of question wording?
Researchers may alter the wording of a question to determine if it does have an effect on the results
Which type of measure operationalizes a variable by recording the answers of a participant using a questionnaire?
Self-report measure
Which of the following does NOT result in a representative sample?
Snowball sample.
Convenience sampling relies on which of the following?
Studying people who are easy to find.
A study finds a correlation coefficient of r = .52 and reports 95% CI [.37, .67]. The 95% CI indicates which of the following?
The correlation is unlikely to have come from a zero Association population
According to your textbook and lecture videos, which of the following statements is correct regarding frequency claims?
The main issue in evaluating a frequency claim is the type of sampling technique that was used.
Dr Sanchez conducts a simple random sample of 500 men who become fathers for the first time in the past year. He finds that 23% of them report being unsure of their ability to be good fathers, plus or minus 4%. If Dr Sanchez increased his sample size to 1,000, which of the following would happen?
The margin of error would become smaller.
Which of the following is true of operational definitions
The specification of operational definitions is one of the creative aspects of the research process
A correlation coefficient and a scatter plot both provide which of the following pieces of information?
The strength and direction of the relationship between two measurements
For a third variable to be plausible as the explanation in an established association , which of the following must also be true ?
The third variable must be related to both of the measured variables in the original association
Why are techniques like cluster sampling and multistage sampling just as externally valid as simple random sampling?
They all contain elements of random selection
Which of the following is true of moderators ?
They can inform external validity.
Why are double-barreled questions problematic?
They may have poor construct validity.
How do reverse worded items address the issue of shortcuts in surveys?
They slow down readers, making them answer more carefully
Tyler Swift is conducting a study and decides to use purposive sampling instead of systematic sampling. Why might Tyler have made this choice?
Tyler is not particularly concerned with external validity in the study.
Lupin and Black (2015) conducted a study in which they found that 65% of Australians reported experiencing at least one adverse childhood experience (ACE). However, the researchers did not use a random sample. What conclusion should you reach about the results of the study?
We cannot be certain about the generalizability of the results
Which of the following is an open-ended question?
What was your favorite part of this class?
Marc is planning to purchase a new pair of Nikes. Which of the following should Mark consider when looking at the Zappos.com summary "72% said the shoe felt true to size"?
Whether the people who rated the shoe share the same characteristics as others who bought the shoe but did not rate it
Which of the following is an example of a forced choice question?
Which is most true of you? A I am serious, B I try only as hard as I have to
Which of the following is true of a nonrepresentative sample in a research claim?
You should ask whether it is relevant to what the researchers are measuring.
When examining an association claim using a bar graph , an association is indicated by which of the following ?
a difference in the height between the bars
Which of the following is correct about simple size?
a large sample size still needs to be a random sample in order to be generalizable
If the relationship between two variables changes depending on the level of another variable, what is this other variable called?
a moderator
In which of the following cases would a large sample especially be needed?
a study of teenagers whose parents are both deployed overseas in the military
If you are reading a research article and you see terms like random sample, unbiased sample, or representative sample used to describe the study, you can
be confident in a study's external validity.
When bivariate association claims do not meet the criteria of temporal precedence and internal validity , this means that ______ cannot be ________.
causal inferences ; made
The difference between a cluster sample and a stratified random sample is
cluster samples use randomly selected clusters; stratified random samples use predetermined strata
If researchers measure every tenth member of a population, they have
collected a sample.
If a person is asking whether the variables in an association claim are measured appropriately , what is being interrogated ?
construct validity
Which of the following determines the construct validity of a survey question?
how well it is worded
What information should you consider to examine the external validity of the claim, "⅔ of American college students sleep less than six hours a day"?
if the study used probability sampling
Which of the following is true of 95% CIs?
it deals with precision estimates about the population
Why is the use of representative samples especially important in frequency claims?
it is unlikely that the accuracy of estimates can be checked
A question that suggests a particular viewpoint to respondents is known as a
leading question.
Dr. Tanaka is an educational psychologist interested in students' attitudes toward science and the effect of those attitudes on performance on standardized tests. He chooses his local school district to study. There are 15 high schools, and he randomly chooses five. Then, of the 2,500 students in each of those five schools, he randomly recruits 250 students. This is an example of which of the following sampling techniques?
multistage sample
A sample is to ___ as a population is to ___.
part; entire.
A researcher most likely prepared two versions of a survey with different questions sequencing to address the issue of
question order
Another term for probability sampling is
random sampling.
What other information, in addition to effect size, must you know in order to determine if a correlation is statistically significant?
sample size
Statistical significance depends on which of the following ?
sample size and effect size
Faking good is also known as
socially desirable responding.
Using a computerized measure of implicit opinions, such as the implicit Association test, is a way to address
socially desirable responding.
Professor Adeyemi is examining well-being after retirement in a city, and it is important to have excellent external validity. If Professor Adeyemi obtains a sample that reflects the demographic proportions of their city, which of the following sampling techniques is most likely being used?
stratified random sampling
A study finds a correlation coefficient of r = .52 this number gives you information about which of the following?
strength and direction of the relationship
If an association study did not select people for the study by using random sampling, which of the following statements is true?
the findings should be replicated in another population
A biased sample consists of too many ___ cases.
unusual
When is an outlier most likely to be problematic?
when the sample size is small and the outlier is extreme on both variables