Exam 2 Research Methods

Is the measure strongly correlated with theoretically similar constructs?

convergent validity

all of the sampling techniques that lead to an unbiased sample.

multistage sampling, stratified random sampling, systematic sampling, over-sampling, cluster sampling

Karim could visit a local hospital and pass out his survey to health care workers that walk by until he reaches his goal of 15 physicians, 50 nurses, and 35 administrative staff.

quota sampling

Researchers conducting an online survey collect 50 men and 50 women in order to have equal gender representation.

quota sampling

Which practice is an example of self-plagiarism?

repeating your hypothesis sentence from the introduction in the discussion

The APA Ethical Principles set similar ethical principles to the earlier ____________________ but tailored them specifically to psychology. However, two additional principles were added. The first was the principle of ______________, which has to do with relationships between psychologists and others. The second was the principle of ___________, which emphasizes truthfulness and up-to-date practices.

Belmont Report, fidelity and responsibility, integrity

_________________ evaluates how well a measure taps into all aspects of a particular variable.

Content validity

______________________ represents how well a measure relates to actual behavior.

Criterion validity

Internet-based survey samples are always biased through self-selection.

False

Samples of people who have rated a specific product online are generally representative of the whole population of people who purchased the product.

False

T or F: Combining sampling techniques increases bias.

False

T or F: Researchers must never conduct research on vulnerable populations that have less autonomy.

False

Which of the following are reasons why it is important for frequency claims to use random sampling?

Frequency claims make statements about a population. External validity is a priority for frequency claims.

in what order should the steps occur for the study to be ethical.

IRB approves the study--> participants give informed consent--> the study occurs--> the participants are debriefed

Procedures should use the smallest possible number of animal subjects.

Reduction

Internet-based samples might consist of people who have stronger opinions than those who do not post their opinions online.

True

The external validity of an Internet-based survey sample depends on how the sample is recruited.

True

Identify the advantages of using Internet panels for polling.

You can avoid the problem of unanswered phone calls. You can track how participants' opinions change over time.

What kind of sample is best for external validity?

a sample in which each member of the population has an equal chance of being selected

Activists draw upon the principle of justice from the Belmont Report to argue against the use of _____________ in experiments, since this principle requires that research participants must be drawn from the same population that will ultimately benefit from the research.

animals

____________________ is a concept in research ethics which states that researchers should have the welfare of the research participant as a goal of any clinical trial or other research study.

beneficence

biased or unbiased: Ami randomly selects phone numbers for a telephone survey and then asks the people she calls to recruit additional participants.

biased

biased or unbiased: Dr. Lin recruits participants from her psychology class and then randomly assigns them to one of three conditions.

biased

biased or unbiased: Zeynep posts advertisements for a study and then recruits every sixth person who contacts her.

biased

A researcher at a nearby university wants to look at what teachers in a certain school district think about new policy changes. The researcher makes a list of all the schools in the district and uses a random number generator to select five schools from the district. Then the researcher interviews every teacher at each of those five schools. The researcher is using ____________________ in this study.

cluster sampling

Karim could randomly select five hospitals from his county and recruit all of the health care workers from those five hospitals.

cluster sampling

Researchers select five hospitals at random and survey all the nurses in each hospital

cluster sampling

Data fabrication and falsification go against Merton's scientific norm of disinterestedness, while open data upholds Merton's scientific norm of __________________.

communality

Data fabrication and falsification go against Merton's scientific norm of disinterestedness, while open data upholds Merton's scientific norm of ____________________________

communality

An online IQ test consists of the primary task of choosing the correct definitions for a series of words. Josiane, an authority on IQ, is concerned that it doesn't test other things that are part of IQ, such as problem solving or visual-spatial ability.

content validity

Does the measure include all aspects of the conceptual variable?

content validity

Dr. Khan asks his intro psych students to fill out a survey on sleep quality and stress after class.

convenience sampling

Anjali has created a new measure of social anxiety. She gives a test group of college students her measure, along with several other measures of social anxiety. In her results she sees that her measure does not correlate with the other established measures of social anxiety. With what type of validity may Anjali's measure have a problem?

convergent validity

Karin is concerned because her new scale on extroversion does not correlate with a well-established extroversion scale.

convergent validity

Does the measure correlate with relevant behaviors?

criterion validity

Some colleges no longer require SAT or ACT scores. A major reason they have done this is because there is a low correlation between these scores and students' first-year GPA.

criterion validity

A researcher creates fake data, meaning the data were not produced from a study.

data fabrication

A researcher alters the data they collected.

data falsification

Researchers are conducting a study on aggression in video games. They tell participants that the study is about teamwork in video games.

deception

Researchers are conducting a study to see taking a quiz by hand versus on the computer results in different scores. They tell participants that the study is about quizzes, but they do not explain the different conditions they're comparing.

deception

Hewlett is attempting to measure spatial intelligence. He creates a specialized task to measure spatial ability and recognition and uses it along with other measures. His data show that the results from his new task are highly correlated with measures of other constructs, like memory and language intelligence. With what type of validity may Hewlett's measure have a problem?

discriminant validity

Is the measure not as strongly correlated with theoretically different constructs?

discriminant validity

Xia is creating a measure of conscientiousness. She wants to ensure that her scale doesn't instead assess concern for social desirability.

discriminant validity

If a study's sample is not generalizable to the rest of the population, we would say that the study has ____________ validity that is _______

external; poor

Is the measure a plausible operationalization of the conceptual variable?

face validity

Santiago is a leading researcher on video game addiction. He finds that the items on a new survey on game addiction do not seem to assess game addiction in a reasonable way.

face validity

Teresa is creating a new measure on hyperactivity in children. She has read some research stating that understanding energy level and the ability to focus is key to understanding hyperactivity. However, Teresa's measure of hyperactivity only contains items about diet and exercise. With what type of validity may Teresa's measure have a problem?

face validity

______________ is the extent to which a given measure appears to be measuring the variable in question.

face validity

A large sample is always more representative than a small sample.

false

A measure that is reliable will always be valid.

false

External validity is always the highest priority in every type of claim.

false

If a finding does not generalize to other populations, it is invalid.

false

T or F: If research has significant risks, it should not be conducted.

false

T or F: Most IRBs will not approve controversial research, even if participants are not at risk.

false

T or F: Research participants must always sign an informed consent form.

false

T or F: Researchers are never permitted to deceive their participants.

false

T or F: Self-selection is a form of unbiased sampling.

false

The validity of a measure is the same as its reliability.

false

true or false: Both probability and nonprobability sampling techniques allow researchers to generalize their results to the population of interest.

false

true or false: Nonprobability sampling techniques lead to larger sample sizes.

false

APA principle it potentially violates. Several of the students in Dr. Silva's abnormal psychology course are also her clients.

fidelity and responsibility

The APA Ethical Principles set similar ethical principles to the earlier Belmont Report but tailored them specifically to psychology. However, two additional principles were added. The first was the principle of ________________________________________, which has to do with relationships between psychologists and others. The second was the principle of ________________, which emphasizes truthfulness and up-to-date practices.

fidelity and responsibility, integrity

what claim is most supported with external validity?

frequency claim

External validity is especially important for supporting ___________ claims. The external validity, or generalizability, of a claim is based on the ______________________

frequency, sampling method

APA principle it potentially violates. Dr. Silva has used the same therapeutic technique for 10 years and has not kept up with the most recent empirical evidence.

integrity

Lorenzo is studying aggression in children. He administers a questionnaire to some children that asks them about their feelings of aggression. Lorenzo then runs a statistical test to determine how consistent the responses are to different items on the questionnaire. This test is examining __________ reliability, and the statistic that represents this type of reliability is ______________________

internal, Cronbach's alpha.

The local Department of Motor Vehicles (DMV) receives a complaint that some of the employees who administer the road test pass a much higher percentage of test-takers than others. In this example, what aspect of the road test is being questioned?

interrater reliability

____________________ refers to whether results are uniform when multiple administrators use the measure. Finally, a measure with internal reliability will generate similar responses across all of the items, even with different wording.

interrater reliability

Omar has developed an intervention to improve the relationship between parents and their preschool-aged children. To evaluate the effectiveness of his intervention, Omar video-records parents interacting with their children and has two research assistants score the level of warmth in each interaction. Omar then compares the two sets of scores to examine ___________ reliability. He finds a high positive correlation of ________ between the two raters' scores. If the observers were rating a categorical variable, Omar could have also looked at the __________ statistic.

interrater, r = .87, kappa

the points on a(n) ___________ scale are equally distant from one another.

interval

The principle of _______________ may be defined as the ethical obligation to distribute the benefits and burdens of research fairly

justice

Dr. Kamran studies domestic violence and has designed a self-report scale that is meant to assess men's negative attitudes toward women. To validate her scale, she administers it to two groups of recently incarcerated male prisoners: prisoners convicted of domestic violence and prisoners convicted of other crimes. Dr. Kamran finds a statistically significant difference in the mean scores of the two groups. What technique is Dr. Kamran using to validate her scale?

known groups paradigm

____________ samples are not more representative than smaller samples its more important of how you got your participants.

large

Karim could randomly select five hospitals from his county and then randomly select 50 health care workers from each of the selected hospitals.

multistage sampling

Researchers select children at three different elementary schools at random by birth date.

multistage sampling

The campus safety committee has asked Professor Ibrahim to study bicycling on his campus. He trains two observers to rate the safety behaviors of cyclists at various locations around campus. He randomly selects 10 observation locations from the places where bicycles can be ridden on campus and randomly selects five 1-hour durations for each location. He has his observers make observations at each of the 10 places for each of the five durations. Dr. Ibrahim is using ___________________

multistage sampling.

Researchers are conducting a study on weight and body image. They tell participants that they will fill out surveys about their physical characteristics and their thoughts on their bodies.

non-deception

records behaviors or traces of behaviors

observational

a ___________ scale shows values that are ranked or ordered in a particular series but that do not have consistent differences between them.

ordinal

A survey interested in comparing prisoners to non-prisoners includes prisoners as 10% of its sample, even though they only make up 2.5% of the total population.

oversampling

Karim is concerned that 15 physicians might not give him a precise statistical estimate, so he could recruit more physicians and then adjust the results later.

oversampling

Select all of the sampling techniques that use meaningful categories from the population (e.g., demographics) and involve recruiting a certain number of participants from each of the categories in the population.

oversampling, stratified random sampling, quota sampling

records biological information from a living thing

physiological

A researcher attempts to pass off the ideas of others as their own.

plagiarism

A(n) ________________ is the entire group of people that a researcher is interested in, while a(n) __________ is the smaller subset of that entire group that researchers study.A(n) ____________ is conducted when a researcher investigates the entire group of people they are interested in.

population; sample; census

examples of unbiased sampling

probability, systematic, stratified random

Dr. Saetang is conducting a study on the experience of being a racial minority on a college campus. He goes to the Asian Student Association, Black Student Union, and Hispanic Student Group on his campus to recruit Asian, Black, and Hispanic participants for his study. Dr. Saetang is using

purposive sampling

When _____________________ occurs, researchers target and recruit a particular group in a nonrandom way. When participants help recruit others to participate, _________________ occurs. When researchers recruit participants from a group of people who are readily available to them, ________________________ occurs. All three of these techniques are ______________ sampling techniques.

purposive sampling, snowball sampling, convenience sampling, unrepresentative

examples of biased sampling

purposive, snowball, convenience

which of these enhance internal validity?

random assignment experimental design

which of these enhance external validity?

random sampling probability sampling

When a study uses __________________, each member of a population has an equal chance of being selected. __________________ occurs when researchers randomly sample subsets of the population and then use all individuals within the subsets. ______________ is often used to select participants to represent, in an unbiased way, subsets of the population that are not large enough to be accurately measured. All three of these techniques are ____________________ sampling techniques.

random sampling, Cluster sampling, Oversampling, representative

________ scale also has points that are equally distant from one another, but it also has a true zero, or a value of 0 that truly illustrates no value.

ratio

Procedures should minimize animal distress.

refinement

In general, a measure's ability to remain consistent is referred to as __________ . But this concept can be broken down in nuanced ways. For example, _____________________ refers to whether results are uniform after repeated use of a measure.

reliability, test-retest reliability

Research should find alternatives to using animals.

replacement

___________________ samples are better than biased samples

representative

APA principle it potentially violates. At her clinic, Dr. Silva often has folders lying open with clients' names and information visible to others.

respect for people's rights and dignity

Luther is conducting a study on whether a new medicine developed to combat grass allergies has any potentially dangerous long-term side effects. For his experiment, Luther is planning to advertise and recruit participants in lower-income urban areas, and he decides to give the participants new laptops to compensate for exposing them to potentially dangerous side effects. His consent form lists all the possible side effects and risks. If he discovers that there are harmful side effects, Luther will discontinue the study. Which of the following principles of the Belmont Report does Luther's study violate?

respect for persons and justice

records participants' own views of themselves

self report

The student government at a college is interested in determining how important intercollegiate sports are to the students. Because all students have e-mail accounts, the student government can send a survey to all the students at the college. About 50% of the students respond. What is the most likely bias in this sample?

self selection

A researcher copies a sentence from the Method section of a paper they published a year ago and pastes it into their new paper's introduction.

self-plagiarism

Researchers choose students at random by selecting the last digit of their student IDs.simple random sampling

simple random sampling

At the end of an online survey, participants are asked to tell their friends about it.

snowball sampling

Jada is working on a study focused on attention span in children and notices that 11-year-old boys are underrepresented in her sample. After her 11-year-old brother participates in her study, she asks him to distribute flyers about the study to his male classmates and soccer team. Jada is using

snowball sampling

what category is oversampling associated with?

stratified

A college administrator knows that 30% of the students at her college are from out of state, and she wants to make sure that she maintains this proportion in her survey about admission practices at the college. She has a list of all the out-of-state and in-state students and randomly selects 30 students from the out-of-state list and 70 students from the in-state list. She is using

stratified random sampling

Karim could randomly select 15 physicians, 50 nurses, and 35 administrative staff for his sample of 100 participants.

stratified random sampling

A researcher approaches every fifth shopper who walks into a grocery store.

systematic sampling

The directors of an annual community concert want to learn the musical preferences of the audience. The directors choose 2 and 6 from a random number generator and place a survey card on every sixth seat beginning with the second seat. All the cards are returned as the audience leaves. They are using

systematic sampling

Andrés is interested in testing a new measure of extroversion in college students. He gives the measure to a group of 20 college students and then administers it again 3 and 6 months later. He finds that some of the students who initially reported moderate levels of extroversion report lower levels 6 months later, while several of the students who initially reported low levels of extroversion report higher levels 6 months later. With what type of reliability may Andrés' measure have a problem?

test retest reliability

These are the results of a BuzzFeed poll about superstitions with 29,000 participants. To whom can we likely generalize the results of this poll?

the 29,000 participants

What can you learn from a scatterplot that you cannot learn from the correlation coefficient r?

the specific values of each pair of measurements

A measure can be very reliable but not very valid.

true

A random sample of 1,000 people is enough to generalize to a population of 100 million people.

true

Establishing reliability in a measure is not sufficient for validity.

true

T or F: Convenience sampling is the most commonly used sampling technique.

true

T or F: Random assignment is only used in experimental designs.

true

T or F: Research on human participants conducted by a university must be approved by an institutional review board.

true

T or F: The potential risks of a study should never outweigh the potential benefits.

true

true or false: Only probability sampling techniques lead to externally valid results.

true

true or false: Probability sampling techniques are a priority for frequency claims.

true

Bre is the president of a national organization of LGBTQIA rights in the United States. He wants to survey 1,000 members of his organization about their position on several political issues. He knows that transgender people make up only 5% of his organization, but he wants to make sure their views are accurately represented. He decides to randomly sample 100 transgender members and then adjust the final results so that transgender people are weighted to reflect their actual proportion of the organization.

true- Bre is using a representative sample. Bre is using oversampling. false- Bre is using cluster sampling. Bre's study will have poor external validity.

biased or unbiased: Nasir selects telephone numbers from a random-digit dialer and then asks for the youngest male in the house who is at least 18.

unbiased

biased or unbiased: Travis randomly selects 15 major universities and then randomly selects 15 students from each of those universities.

unbiased

Which of the following approaches increase external validity in a study?

using a probability sampling technique random sampling

In measurement, __________ refers to a measure's ability to accurately represent the variable the researcher is investigating.

validity