PSY3100 ch 7
Which of the following results in an unrepresentative sample? systematic sample simple random sample snowball sample stratified random sample
snowball sample
If a study uses an unrepresentative sample, which of the following questions should you ask when assessing its external validity? "Are the characteristics that make the sample biased actually relevant to what is being measured?" "Is the sample size sufficiently large?" "Is the study making a frequency, association, or causal claim?" "Could the study have used a representative sample instead?"
"Are the characteristics that make the sample biased actually relevant to what is being measured?"
Having a representative sample is most important in which of the following example claims? "Having a dark triad personality is associated with having greater relationship problems." "Receiving weekly feedback from your supervisor increases work productivity." "People who report knowing someone who has been diagnosed with skin cancer also report having greater sunscreen use." "Forty-three percent of psychology majors report being frustrated by people asking them if they are psychoanalyzing them."
"Forty-three percent of psychology majors report being frustrated by people asking them if they are psychoanalyzing them."
Which of the following is correct about sample size? A large sample size is more representative of the population than a small sample. A large sample size still needs to be a random sample in order to be generalizable. A sample size of 1,000 allows for the most statistically accurate conclusions. A sample size of 1,000 has the optimal balance of external validity and statistical accuracy.
A large sample size still needs to be a random sample in order to be generalizable.
Why do studies that use probability samples have excellent external validity? They also ensure excellent internal validity. They study every member of the population of interest. They use a larger number of measures. All members of the population are equally likely to be represented in the sample.
All members of the population are equally likely to be represented in the sample.
Which of the following is necessary for a sample to be considered representative? All members of the population must be included in the sample. All members of the population have an equal chance of being included in the sample. All members of the sample belong only to the population of interest. All members of the sample are likely to provide the same data/information.
All members of the population have an equal chance of being included in the sample.
How are quota sampling and stratified random sampling similar? Both identify subgroups that need to be studied. Both randomly sample subgroups to be studied. Both result in nonrepresentative samples. Both result in representative samples.
Both identify subgroups that need to be studied.
Why might a researcher choose purposive sampling over systematic sampling? Purposive sampling is always cheaper. External validity is not vital to the researcher's study. Only purposive sampling allows the researcher to study a particular type of participant. The researcher does not have to specify a population of interest ahead of time.
External validity is not vital to the researcher's study.
For his research methods class project, Hiro is studying the effect of pet ownership on stress levels. Although a lot of research has been done on dog and cat owners, not much is known about other pets, so Hiro decides to study bird owners. Which of the following would demonstrate a snowball sampling technique? He contacts the Twitter followers of Dr. Oiseau, a famous biologist who studies birds. He recruits bird owners by e-mailing members of the National Bird Owners Association and asking for participants. His participants are all the people who have purchased birds at his local pet store in the past six months. He asks bird owners to give him the names of other bird owners.
He asks bird owners to give him the names of other bird owners.
For his research methods class project, Hiro is studying the effect of pet ownership on stress levels. Although a lot of research has been done on dog and cat owners, not much is known about other pets, so Hiro decides to study bird owners. Which of the following would demonstrate a purposive sampling technique? He contacts the Twitter followers of Dr. Oiseau, a famous biologist who studies birds. He recruits bird owners by e-mailing members of the National Bird Owners Association and asking for participants. His participants are all the people who have purchased birds at his local pet store in the past six months. He asks bird owners to give him the names of other bird owners.
He recruits bird owners by e-mailing members of the National Bird Owners Association and asking for participants.
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. In Introduction to Neuroscience, 43 of 50 students complete the survey, and in Psychology and Law, 46 of 48 students complete the survey. Based on this information, which of the following can Dr. Kramer say? His sample is larger than his population. His sample is representative. His sample is biased. His sample came from his population of interest.
His sample came from his population of interest.
When you are interrogating the external validity of a sample, which is the most important question to ask? How many people are in the sample? How was the sample collected? How were the participants measured? How many people are in the population?
How was the sample collected?
Dr. Sanchez conducts a simple random sample of 500 men who became fathers for the first time in the past year. He finds that 23% of them report being unsure of their ability to be good fathers, plus or minus 4%. What does this mean? The true percentage of fathers who feel this way is 23%. If this study was done many times, the estimate of father uncertainty would be 23% about 4% of the time. We can be 4% sure that the estimate of father uncertainty would be 23% of fathers. If the study was done many times, the estimate of father uncertainty would be between 19% and 27%.
If the study was done many times, the estimate of father uncertainty would be between 19% and 27%.
Which of the following is an advantage of polling organizations using Internet panels over landline panels? It is easier to follow up with Internet panels and track how their opinions change over time. Internet panels are always representative of the population of Americans. Landline panels are biased through self-selection, while Internet panels are not. Internet panels give more accurate responses than samples obtained through landlines.
It is easier to follow up with Internet panels and track how their opinions change over time.
Which of the following is true of probability sampling? It is the best way to obtain a representative sample. It is the same as random assignment. It results in larger samples than nonprobability sampling. It should be used only when external validity is not the goal of the study.
It is the best way to obtain a representative sample.
Why is the use of representative samples especially important in frequency claims? Frequency claims require very large samples, and representative samples are always large. It is unethical to make frequency claims without representative samples. It is unlikely that the accuracy of estimates can be checked. Representative samples allow for enhanced internal and external validity.
It is unlikely that the accuracy of estimates can be checked.
Which of the following is true of sample size? It primarily affects external validity. It primarily affects construct validity. It primarily affects internal validity. It primarily affects statistical validity.
It primarily affects statistical validity.
Which of the following statements is true of random assignment and random sampling? Random assignment is necessary for internal validity, whereas random sampling is necessary for external validity. They both are necessary for frequency claims. They both mean the same thing. Random sampling is more important than random assignment.
Random assignment is necessary for internal validity, whereas random sampling is necessary for external validity.
Which of the following is an example of convenience sampling? Researchers recruited participants from online websites, such as Prolific Academic. Researchers oversampled Latinx participants for their study and adjusted their results. Researchers reached out to participants attending Gambler's Anonymous meetings. Researchers asked international college students to recommend other international students to participate in their study.
Researchers recruited participants from online websites, such as Prolific Academic.
Which of the following is true regarding interrogating frequency claims? Their accuracy can usually be determined. The chief concern is to evaluate the sampling technique. The most important thing to consider is the size of the sample. Frequency claims cannot be interrogated.
The chief concern is to evaluate the sampling technique.
Shoppers often leave reviews for products that they purchased online. Which of the following best describes the external validity of product reviews on an online shopping site? The external validity is high because this is a randomly selected sample of online shoppers. The external validity is high because online shoppers are more likely to be honest about their opinions. The external validity is low because online shoppers are more likely to change their mind. The external validity is low because this is a self-selected sample of online shoppers.
The external validity is low because this is a self-selected sample of online shoppers.
Dr. Sanchez conducts a simple random sample of 500 men who became fathers for the first time in the past year. He finds that 23% of them report being unsure of their ability to be good fathers, plus or minus 4%. If Dr. Sanchez increased his sample size to 1,000, which of the following would happen? The true estimate would increase. The margin of error would become smaller. External validity would become less important. Statistical validity would become negatively affected.
The margin of error would become smaller.
Why are techniques like cluster sampling and multistage sampling just as externally valid as simple random sampling? They all contain elements of random selection. They all measure every member of the population of interest. They all use lists of all population members. They all rely on large samples.
They all contain elements of random selection.
What do purposive, convenience, quota, and snowball sampling have in common? They are considered ethical sampling options. They are all probability sampling techniques. They produce large samples. They result in samples where some people are systematically left out.
They result in samples where some people are systematically left out.
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. Dr. Kramer plans to give his survey only to his Psychology and Law students because he sees them on Mondays, Wednesdays, and Fridays, and he can spare the class time (unlike in his Introduction to Neuroscience class, which only meets on Tuesdays and Thursdays). Which of the following is true? This will lead to a biased sample because the type of students who take Psychology and Law may be different from the type of students who take Introduction to Neuroscience. This will lead to a biased sample because of self-selection. This will lead to a biased sample because the Psychology and Law students have a lot of time to complete the survey. The will lead to a sample that is representative of both of his classes.
This will lead to a biased sample because the type of students who take Psychology and Law may be different from the type of students who take Introduction to Neuroscience.
The study that found that two-thirds of Americans had experienced at least one adverse childhood experience (ACE) did not use a random sample. What conclusion should you make about the results of the study? We can generalize the results of the study to all Americans. We can generalize the results of the study only to Americans with adverse childhood experiences. The results are incorrect because the study did not use a random sample. We are uncertain about the generalizability of the results.
We are uncertain about the generalizability of the results.
Which of the following is true of a nonrepresentative sample in a research claim? You should automatically disregard the claim. You should automatically accept the claim. You should ask whether it is relevant to what the researchers are measuring. You should ask whether more participants are necessary.
You should ask whether it is relevant to what the researchers are measuring.
In which of the following cases would a large sample especially be needed? a study of high school students a study of first-time homeowners a study of people who have been to the doctor in the past year a study of teenagers whose parents are both deployed overseas in the military
a study of teenagers whose parents are both deployed overseas in the military
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. What is Dr. Kramer's likely population of interest? all students at the university all psychology majors and minors all students he is currently teaching all students in his Introduction to Neuroscience class
all students he is currently teaching
Research articles that use terms such as unbiased sample, random samples, or representative sample allow for readers to skip interrogating statistical validity. make a frequency claim. reject the conclusions made by the researcher(s). be confident in a study's external validity.
be confident in a study's external validity.
What is the most common sampling technique in behavioral research? simple random sampling purposive sampling cluster sampling convenience sampling
convenience sampling
External validity is most important for which of the following claims? frequency claims association claims causal claims external validity is equally important for all claims.
frequency claims
The difference between a cluster sample and a stratified random sample is cluster samples study all possible clusters; stratified random samples randomly select strata. cluster samples use oversampling; stratified random samples use undersampling. cluster samples use randomly selected clusters; stratified random samples use predetermined strata. There is no difference between cluster samples and stratified random samples.
cluster samples use randomly selected clusters; stratified random samples use predetermined strata.
If researchers measure every tenth member of a population, they have conducted a census. collected a sample. increased internal validity. biased the study.
collected a sample.
If researchers measure every member of a population, they have conducted a census. collected a sample. increased internal validity. biased the study.
conducted a census.
Which of the following is an example of a nonprobability sample? simple random sample convenience sample systematic sample cluster sample
convenience sample
What information should you consider to examine the external validity of the claim, "Two-thirds of American college students sleep less than six hours a day"? if the sample size is large enough if random assignment was used in the study if the study used probability sampling if the sample includes non-American participants
if the study used probability sampling
Dr. Sanchez conducts a simple random sample of 500 men who became fathers for the first time in the past year. He finds that 23% of them report being unsure of their ability to be good fathers, plus or minus 4%. What is another term for the 4% value? margin of error sampling bias probability value statistical significance
margin of error
Dr. Tanaka is an educational psychologist interested in students' attitudes toward science and the effect of those attitudes on performance on standardized tests. He chooses his local school district to study. There are 15 high schools, and he randomly chooses five. Then, of the 2,500 students in each of those five schools, he randomly recruits 250 students. This is an example of which of the following sampling techniques? snowball sample systematic sample multistage sample cluster sample
multistage sample
The difference between a cluster sample and a multistage sample is cluster samples are probability samples; multistage samples are not. multistage samples sample both clusters and participants; cluster samples just sample clusters. cluster samples rely on clusters of participants; multistage samples collect data from participants at different stages. There is no difference between cluster samples and multistage samples.
multistage samples sample both clusters and participants; cluster samples just sample clusters.
A sample is to ________ as a population is to ________. part; entire external; internal people; groups participants; researchers
part; entire
Dr. Choi is studying the extent to which Asian American mothers enforce gender roles at home. She wants to ensure that her sample includes 50 first generation, 50 second generation, and 50 third generation immigrants. If Dr. Choi obtains her particular sample by putting flyers in the local Asian grocery store, which of the following sampling techniques is she using? snowball sampling purposive sampling quota sampling stratified random sampling
quota sampling
Another term for probability sampling is purposive sampling. convenience sampling. random sampling. cluster sampling.
random sampling.
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. If all the students in Dr. Kramer's two classes complete the survey, then Dr. Kramer has done which of the following? decreased the external validity of his study collected too much data relied on a census enhanced sampling bias
relied on a census
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. Dr. Kramer needs to avoid which of the following if he hopes to have an unbiased sample? sampling only those students who come to class frequently sampling only those students whose student ID numbers end with an odd number sampling only those students who sign the consent form sampling only those students who finish the survey
sampling only those students who come to class frequently
Online surveys commonly suffer from which of the following? poor reliability self-selection probability sampling over sampling
self-selection
A sample is always ________ a population. more expensive to measure than smaller than more interesting than more scientific than
smaller than
Dr. Chandler is a personality psychologist who is interested in studying the characteristics of people who report being abducted by UFOs. She finds several people in an online support group for UFO abductees to participate and asks them if they can provide the names and contact information of other people who have also been abducted. Upon contacting these new participants, she asks them to refer her to even more people they may know who have been abducted. This is an example of what kind of sampling? purposive sampling snowball sampling convenience sampling self-selection sampling
snowball sampling
Which of the following sampling techniques would you recommend to a researcher interested in studying rare individuals, like people who have been struck by lightning? snowball sampling purposive sampling quota sampling convenience sampling
snowball sampling
Oversampling is a variant used in which of the following sampling techniques? simple random sampling cluster sampling convenience sampling stratified random sampling
stratified random sampling
Professor Adeyemi is examining well-being after retirement in a city, and it is important to have excellent external validity. If Professor Adeyemi obtains a sample that reflects the demographic proportions of their city, which of the following sampling techniques is most likely being used? cluster sampling stratified random sampling systematic sampling quota sampling
stratified random sampling
RESEARCH STUDY 7.1: Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. Dr. Kramer could reasonably use his sample to say something about which of the following populations of interest? students enrolled at the university students who are political science majors students who have taken a class with Dr. Kramer students currently taking a psychology class
students who have taken a class with Dr. Kramer
Convenience sampling relies on which of the following? studying people who are easy to find studying people who are willing to participate studying people who are typical studying people who are colleagues of the researcher
studying people who are easy to find
Which of the following results in an unbiased sample? snowball sample convenience sample purposive sample systematic sample
systematic sample
Professor Adeyemi is examining well-being after retirement in a city, and it is important to have excellent external validity. Professor Adeyemi selects two random numbers, 4 and 6, and gets a list of all of the retired people in the city. If Professor Adeyemi obtains the sample by starting with the 4th person on the list and selecting every 6th person, which of the following sampling techniques is most likely being used? cluster sampling stratified random sampling systematic sampling quota sampling
systematic sampling
Studies that use nonprobability samples have ________ external validity. zero unknown guaranteed enhanced
unknown
If a sample is biased, then it is ________ the population of interest. unrepresentative of unrelated to incorrectly compared to unfairly applied to
unrepresentative of
A biased sample consists of too many ________ cases. basic ideal complicated unusual
unusual
Which of the following may lead to a biased sample? using people who accept compensation (e.g., money) to participate using people who agree to participate using people who are readily available to the researcher using people who have participated in other research studies
using people who are readily available to the researcher
You are looking to purchase a new pair of running shoes. Which of the following should you consider when looking at the Zappos.com headline "61% said this shoe felt true to size"? whether the people who rated the shoe were randomly assigned to the running shoe whether the people who rated the show were more conscientious than average whether the people who rated the shoe had Internet access whether the people who rated the shoe share same characteristics as others who bought the shoe
whether the people who rated the shoe share same characteristics as others who bought the shoe
