P211 final exam
regression threat (internal validity)
(results extreme toward mean in test 1. likely to be closer to its mean level the next time it is measured) Extreme scores gravitate back toward average.
snowball sampling
(variation on purposive sampling) participants are asked to recommend other participants
A study has a 2 × 2 × 3 within-groups factorial design. Researchers would need to investigate __ main effect(s) (overall effects), __ two-way interaction(s), and __ three-way interaction(s) in this study.
3 (because 3 IV's), 3, 1
If Julio designs a 2 × 3 × 4 study, his study includes ___ independent variables
3 (dont confuse IV w levels)
experiment where the amount of stress someone is experiencing (high versus low) may change depression medication types (SSRI, NDRI, or placebo) effectiveness accounting for the differences in people with major vs persistent depressive disorder. __ two-way Interactions ,__ main effects and __ three-way interactions
3, 3, 1
The American Psychological Association's ethical guidelines have ________ principles and ________ standards.
5; 10
A researcher wants to run a 2 × 3 mixed factorial design. The first factor, with two levels, is within-groups, and the second factor, with three levels, is independent-groups. If the researcher wants 20 observations per cell, how many participants will he need in total?
60
Which of the following hypotheses would be best tested with a survey? A. College students with part-time jobs have high self-esteem B. Children who are exposed to more words per day have faster brain development C. Drinking coffee makes people walk faster D. Sharing with others increases dopamine levels
A
Which of the following is a causal claim? A. Texting interferes with a driver's ability to pay attention. B. Most drivers have reported texting while driving. C. Texting while driving is associated with poor impulse control. D. Teens spend too much time texting and driving.
A
Which of the following is an association claim? A. "Owning a dog is related to higher life satisfaction." B. "A majority of Americans like dogs." C. "Dog traveled 500 miles to find its owners." D. "Being visited by dogs in the hospital causes decreases in recovery time."
A
temporal precedence
A comes first in time, before B
What is the difference between a ratio scale of measurement and an interval scale of measurement?
A ratio scale of measurement has a zero value
Regression is especially problematic in which of the following situations? A when the experimental and comparison groups are equal at posttest B Answer when one group has an extremely high score at pretest C when the experimental and comparison groups are equal at pretest D when one group has an extremely low score at posttest
B
Which of the following ethical violations did NOT occur in the Tuskegee Study? A. Researchers told participants they were receiving treatment even though they were not. B. Participants in the study were given/infected with the disease. C. Participants were not told they had been infected with the disease. D. Researchers prevented participants from seeking treatment.
B
study on how toddlers learn their colors. She wrote this in the results section: "Analyses indicated significant main effects of place and object. However, the place × object interaction was not significant. This latter finding suggests that the benefit of using puzzle pieces to learn about colors is not dependent on where the puzzle is completed." Given this excerpt, which of the following statements could also be found in the paper? A Toddlers talked about colors with every toy equally B Toddlers talked more about colors in the living room C Toddlers talked more about colors in the living room but only when they played with the puzzle pieces D Toddlers did not change their answers based on location
B
"Researchers tested different forms of textbooks. interactive textbooks with online exercises were more effective than static text, but only for students who had high levels of previous technology experience." What term or phrase best describes the main result in this study? A. not a factorial design Btwo-way interaction C three-way interaction Dno interaction
B (describes two independent variables (type of textbook and technology experience), indicating a likely two-way interaction.)
Which of the following is an example of applied research? A. a social psychologist who is interested in the components of self-concept B. an educational psychologist who looks for a way to increase math skills in eight-year-olds C. a personality psychologist who studies the difference between introverts and extroverts D. a cognitive psychologist who looks at the difference in problem-solving abilities of men and women
B.
Which of the following is correct about sample size? A. A large sample size is more representative of the population than a small sample. B. A large sample size still needs to be a random sample in order to be generalizable. C. A sample size of 1,000 allows for the most statistically accurate conclusions. D. A sample size of 1,000 has the optimal balance of external validity and statistical accuracy.
B.
d = 0.32, 95% CI [.13, .51]. is stastically significant T or F?
Because the 95% CI does not include zero, we can infer that this result is statistically significant.
A "difference in the difference between the differences" would indicate which of the following? A crossover interaction B multiple main effects C a three-way interaction D a within-groups factorial design
C
Which of the following is NOT included on an APA style title page? A. Author affiliation B. Title C. Date of publication D. Author name(s)
C
Which of the following is a reason that a study might yield a null result? A too much between-group difference B too much within-group variance C a false positive D use of a within-subjects design
C
Which of the following is true of instrumentation threats? A. They are the same as testing threats. B. They occur only when using mechanical instruments (e.g., blood pressure cuffs, scales). C. They can be avoided with counterbalancing. D. They are problematic only in observational research
C
Which of the following phrases might a person encounter in a popular media article that indicates an interaction? A "statistically significant" B "mixed factorial design" C "it depends" D "mediator variables"
C
Which of the following results in an unrepresentative sample? A. systematic sample B. simple random sample C. snowball sample D. stratified random sample
C.
All of the following are true of institutional review boards (IRBs) in the United States EXCEPT that A. IRBs can be found in settings other than colleges and universities. B. IRBs are mandated by federal law. C. IRBs must have a psychologist as a member. D. IRBs must have at least five members.
C. IRBs must have a psychologist as a member.
cluster sampling
Clusters of participants randomly selected
___ the order of levels addresses order effects in within-groups designs.
Counterbalancing
A study finds that exercise improves concentration, especially for students who took a yoga class as opposed to step aerobics. Which of the following statements can we infer about the study based on this finding? AThere was no main effect of exercise on concentration. B This was a within-group study. C The researchers were biased against step aerobics. DThere was an interaction in the results.
D
An educational psychologist is testing the discriminant validity of a new measure of numerical learning difficulties. He gives his measure to a group of students along with another measure of verbal learning difficulties, which he predicts should not be strongly related to numerical learning difficulties. Which of the following correlations would the psychologist hope to find in order to establish discriminant validity? A. r= 1.0 B. r=-1.0 C. r= 0.83 D. r=-0.18
D
a white, odorless, tasteless powder additive could help people consume fewer calories during a meal. Collected random sample of 63 overweight students on campus and measures the calories using a calorimeter at lunch then dinner. Which of the following threats to internal validity should Dr. Bloedorn be worried about? A observer bias B attrition C blinding D placebo effects
D
study comparing the effects of mindfulness training to cognitive training on flexible thinking. an appropriate manipulation check? A. testing that the flexible thinking task is hard enough to show group differences B. measuring heart rate to ensure that mindfulness has a calming effect C. ensuring that no participants had prior experience with mindfulness training D. adding a third group that receives flexibility training
D
Having a representative sample is most important in which of the following example claims? A. "Having a dark triad personality is associated with having greater relationship problems." B. "Receiving weekly feedback from your supervisor increases work productivity." C. "People who report knowing someone who has been diagnosed with skin cancer also report having greater sunscreen use." D. "Forty-three percent of psychology majors report being frustrated by people asking them if they are psychoanalyzing them."
D.
A local committee that reviews research that is conducted on animals is known as
IACUC
Ceiling effects can affect (IV, Dv, or both?)
IV and DV
Dr. Sanchez conducts a simple random sample of 500 men who became fathers for the first time in the past year. He finds that 23% of them report being unsure of their ability to be good fathers, plus or minus 4%. What does this mean?
If the study was done many times, the estimate of father uncertainty would be between 19% and 27%.
Experiments that compare different participants who are placed in different conditions are known as ____ designs. There are two basic forms of this design. The first is the____ design, in which participants are tested on the dependent variable only once after the manipulation. The second is the_____ design, in which participants are tested on the dependent variable before and after the manipulation.
Independant groups, post-test only, pre-test/post-test
The dependent variable isn't responsive enough to detect change from the independent variable
Insensitive measure
Dr. Knepp studies Extrasensory Perception (ESP) which is the ability to perceive things through telepathy or clairvoyance. She theorizes that ESP exists but only in people who believe it exists and who are not skeptical of ESP. She surveys a large number of adults about their beliefs in ESP and, as expected, only adults who believe in ESP report having those abilities. What is true about Dr. Knepp's theory?
It does not have a hypothesis.
Why is the use of representative samples especially important in frequency claims?
It is unlikely that the accuracy of estimates can be checked
What does the "M" stand for in the QuALRMI method?
Method
Why would behavioral observation be a good research method for studying a high-frequency behavior? (ex: number of words spoken in a day or number of steps taken in a week)
Participants would not be able to accurately keep track of so much data
___ is the ability to detect an effect if it really exists, so it would not contribute to a null effect.
Power
The study hypotheses belong in which section of the introduction?
Prediction
Animal Ethics 3 R's
Reduction (least amount of subjects), Replacement (find alternative to animal), Refinement (minimize distress)
Adding a participant variable to a design with an existing independent variable is one way to increase external validity. T or F?
T
If the manipulation of the independent variable causes a change in the dependent variable, covariance is established T or F
T
The validity of a measure is not the same as its reliability. t or f
T
With three independent variables, there are three potential two-way interactions. T or F
T
When describing a main effect, you do not need to mention any other independent variable.
T ( Main effects involve only one variable, so no other independent variable needs to be mentioned.)
Tim tells you that the best way to make friends is by opening the conversation with a joke. He can easily recall all the friends he met by telling a joke and also the times he opened with chitchat and didn't befriend the person. If you were concerned that Tim was making the present/present bias, what would you ask him?
What about the times you opened with a joke and didn't become friends with the person?
When reading an empirical journal article "with a purpose", which two questions should you ask yourself as you read?
What is the argument and evidence?
___ designs make it easier to be certain of differences between conditions than independent-groups designs.
Within-groups
Which of the following is true of a nonrepresentative sample in a research claim?
You should ask whether it is relevant to what the researchers are measuring.
Translational research is best thought of as ________ basic research and applied research.
a bridge between
covariance
a causes b
maturation threat
a change in behavior that emerges more or less spontaneously over time
Considering a measure's face validity is
a good way to interrogate the construct validity of the dependent variable.
selection-history threat
a historical or seasonal event systematically affects only the subjects in the treatment group or only those in the comparison group, not both.
divergent validity
a measure that is uncorrelated with different measures of a similar type (impulsivity vs gambling; test used by a company for hiring purposes that measures how proficient someone is at a particular skill. If the test correlates too strongly with an IQ test then it essentially is just another IQ test instead of measuring something different.)
You increase external validity with
a more diverse or altogether different sample (All else being equal, a larger sample size would not improve external validity)
frequency claim describes ___ and has____
a particular level or degree of a single variable, one measured variable
selection effects (ex: assigning the first 20 ppl to show up to the study to group A and second to group B)
a threat to internal validity that occurs in an independent-groups design when the kinds of participants at one level of the independent variable are systematically different from those at the other level
Dr. Gore survey examining people's opinions toward funding for athletics. Several participants agree with all 12 questions. This is most likely due to
acquiescence
Research that is done specifically to solve a practical problem, like increasing memory ability or decreasing symptoms of depression, is known as
applied research
a study in your research methods class in which you measure two variables and a a correlational study conducted by Harvard University are both a assocation, frequency, causal claim
association (A correlational study cannot imply causation; instead, it examines the connection between two variables.)
Dr. Ramon makes the following claim: "Watching television leads people to spend less time communicating with their spouses, study says." Dr. LaSalle makes the claim: "Research shows that making more money correlates with spending less time talking with your spouse." Which type of claim is Dr. LaSalle making?
association claim
Order effects also include ___, in which some form of contamination carries over from one condition to the next. (For example, imagine sipping orange juice right after brushing your teeth; the first taste contaminates your experience of the second one.)
carryover effects
Science journalists have argued that cigarette smoking leads to a variety of health problems. What type of claim are they making?
causal claim
an experiment in psychological science association, frequency, causal claim
causal claim
History threat (threat to internal validity)
changes make come from external factor or event that affects all or most members of the group (ex: historical event of 9/11 affected most americans)
What is the term for a researcher's definition of the variable in question at a theoretical level?
conceptual definition
Experience is __ whereas research is ___
confounded, probabalistic (its findings are not expected to explain all the cases all the time)
Internal validity involves _____ and can be measured by
consistent answers, no matter phrasing of question, counterbalancing the order of conditions, random assignment, ensure there were no variables that systematically varied with the independent variable (overall decreasing selection effects)
Content validity
contains all the parts that your theory says it should contain.
Researchers often keep ___ variables constant on purpose.
control
What is the most common sampling technique in behavioral research?
convenience sampling
Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. Dr. Sheffield decides to test the criterion validity of his measure. Dr. Sheffield gives his measure to a group of people that includes suspected problem gamblers and non-gamblers. What options could he also do to get evidence for criterion validity?
correlate the measure with a behavior, such as amount of money lost in a casino during the past year
Regression is most often associated with correlational or factoral designs.
correlational
Establish causation based off of
covariance, temporal precedence, internal validity
According to its conceptual definition, a variable should be related to a particular behavior. If a researcher is able to demonstrate that his measure of the variable is related to the behavior, then he has established what?
criterion validity
Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. To test his measure, Dr. Sheffield gives his measure to a group of his clients and at the same time measures how many times they have been gambling in the past month. He predicts that clients who score higher on his measure will also report gambling more times in the past month. This procedure is meant to provide evidence for which of the following?
criterion validity
1/2 interaction effects where in a line graph, the data from one independent variable intersects with the data from the other
crossover interaction.
What must a researcher do when using deception in an experiment?
debrief the participants afterward
Effect sizes are larger when there is a greater ____ between the conditions of the independent variable. In general, the larger the effect size, the ____ the effect of the ___ on the __ (aka covariance). Effect sizes can vary depending on
difference, stronger, IV, DV, how many participants there are, the amount of variance in the experimental group, and mean differences.
Another word for discriminant validity is ________ validity.
divergent
Articles that could be considered journalism
do not require specialized education to read.
The d score is a standardized measure of the degree to which the independent variable caused a change in the dependent variable. This is also known as the
effect size
If we cannot observe a behavior, we cannot study it. What does this statement refer to?
empiricism
Which of the following involves using evidence from the senses or from instruments that assist the senses as the basis for conclusions?
empiricism
known-groups paradigm
examine whether scores on a measure distinguish between previously identified groups
Another word for observer effects is
expectancy effects
external validity
extent to which the results of a study generalize to some larger population (e.g., whether the results from this sample of teenagers apply to all U.S. teens), other times or situations (e.g., whether the results based on coffee apply to other types of caffeine)
A manipulation check is an
extra dependent variable in the main study to check whether the manipulation is successful
experimental design that tests all possible combinations of more than one independent variable (in these exp. IVs are also called factors)
factorial design
Present/present bias
failing to think about what we cannot see
Forced-choice question formats are especially good at dealing with which of the following issues?
fence sitting
APA added this to belmont report ethic principles
fidelity, responsibility and integrity
What is an advantage of polling organizations using Internet panels over landline panels?
follow up with Internet panels and track change
External validity is most important for which of the following claims?
frequency claims
beneficience
harm reduction, ethical costs of withholding info, prevent sensitive info being released
In a within-groups design, each participant experiences all levels of the ____. There are two types of this design. The first is the _____, in which researchers expose participants to various levels of the independent variable and measure the dependent variable after each exposure. The second is the ____ in which participants interact with the various levels of the independent variable simultaneously.
independent variable, repeated-measures design, concurrent-measures design,
Each cell of each of the independent variables has unique subjects
independent-groups factorial design
Which of the following threats to internal validity can apply even when a control group is used?
instrumentation threats
the effect of one independent variable depends on the level of another independent variable, also known as
interaction effect
Two independent variables mean that there is one ___whether the relationship between one independent variable and the dependent variable depends on the other independent variable.
interaction effect:
To establish a causal claim, researchers often prioritize ___ validity over ___ validity. They focus more on ensuring the independent variable does not accidentally systematically vary with another variable.
internal, external
Which types of reliability can be analyzed with scatterplots?
interrater reliability and test-retest reliability
Interrator reliability relies on
kappa
statistical validity increased w
larger sample
A question that suggests a particular viewpoint to respondents is known as a(n)
leading question
condition
level of the independent variable
Face validity
looks like what you want to measure
A ___ (overall effect) is one independent variable's relationship with the dependent variable, averaged across levels of the other independent variable. Researchers need to consider the ___ for each independent variable.
main effect
an extra dependent variable that can be used to help researchers evaluate how well an experimental manipulation worked
manipulation check
Spontaneous remission in clinical studies is an example of which of the following threats to internal validity? a. regression b. attrition c. maturation d. placebo effects
maturation
Researchers must calculate the __ for each level of each independent variable, so in a design with two independent variables that have two levels each, they would need to calculate _____ ______ ___
means, four marginal means
instrumentation threat (threat to internal validity)
measuring instrument changes from first use (ex: coders that are human may change judging criteria)
selection-attrition threat
members are likely to drop out of either the treatment group or the comparison group, not both.
All participants experience all levels of one independent variable but only one level of another independent variable
mixed factorial design
A ___ changes the relationship between an independent variable and a dependent variable, not two independent variables.
moderator
Acquiescence
mostly positive responses
The phrase "controlling for" suggests that the study uses ___ , researchers control for several potential third variables to get closer to establishing internal validity.)
multiple regression
If a narrow confidence interval contains zero, then the effect is
null
For his research methods class, Felipe plans to watch how students treat other children in their classrooms who have attention-deficit/hyperactivity disorder (ADHD). He will evaluate how positively or negatively the children are treated by their classmates. This is an example of what type of measurement?
observational measurement
Telling teachers that some of their students would be academic achievers within the next year but weren't different than the students in the class. At the end of the year, the "bloomers" showed more gains in IQ. The teacher had unintentionally treated the "bloomers" in special ways. This is an example of which of the following?
observer effects
association claim argues that____ and has____. If they ASSOCIATE they _____
one level of a variable is likely to be associated with a level of another, 2+ variables, correlate
Compared with doing a generic internet search, why is PsycINFO a superior way to find scientific sources?
only psych sources and related fields.
In a within-groups design, exposing participants to one level of the independent variable can change how they respond to the other levels of the independent variable, aka ___. One type ____: exposure to one level of the independent variable contaminates how other levels of the independent variable are perceived. ___, which occurs when participants change their responses because of repetition of the dependent variable rather than because of the independent variable itself. Repeated exposure to the independent variable may cause participants to guess the hypothesis of the experiment, also known as a(n) _____.
order effect, carryover effect, practice effect, demand characteristic
Describes the gap and research that needs to happen
path
study completed separately from the main study to confirm the effectiveness of a manipulation
pilot study
states the RQ and current study in intro
plan
___, also known as fatigue effects, in which a long sequence might lead participants to get better at the task or to get tired or bored toward the end.
practice effects
The 95% CI would be less ____ and ____ if the study used a smaller sample.
precise, wider
QuALRMI
question, alternatives/hypothesis, logic, method, result, inference
Dr. Choi is studying the extent to which Asian American mothers enforce gender roles at home. She wants to ensure that her sample includes 50 first generation, 50 second generation, and 50 third generation immigrants. If Dr. Choi obtains her particular sample by putting flyers in the local Asian grocery store, what sampling techniques is she using?
quota sampling
What is the best way to balance characteristics about participants that can lead to alternative explanations for findings?
random assignment
multistage sampling
random sampling from cluster sampling
Stratified random sampling
random sampling from specific demographics race and gender etc
The construct validity of observations can be threatened by
reactivity
Professor Kramer has decided to measure how happy his students are with his teaching this semester. He is teaching two classes this semester—Psychology and Law and Introduction to Neuroscience. He gives his students a survey. If all the students in Dr. Kramer's two classes complete the survey, then Dr. Kramer has done what?
relied on a census
In looking at a scatterplot of interrater reliability, why would a researcher want to see all the dots close to the line of agreement?
researchers making similar measurements
If you wanted to know exactly which statistical analyses were used in a particular study, you should consult the
results section of a journal article
In considering whether research is ethical, which of the following are balanced against each other?
risk to participants versus value of the knowledge gained
purposive sampling
sampling of specific target demographic (smokers) (His participants are all the people who have purchased birds at his local pet store in the past six months)
applied research
scientific study that aims to solve practical problems
convergent validity
scores on the measure are related to other measures of the same construct (self-esteem and the other measuring extroversion, are likely to be correlated high convergent validity between 2)
systematic sampling
select some starting point and then select every kth element in the population
when the kinds of participants in one level of the independent variable are systematically different from those in the other, ___ can result. You can decrease this with____.
selection effects, random assignment
Online surveys commonly suffer from what?
self-selection
If a question has response options that are anchored with adjectives, this is known as a(n)
semantic differential format
Response sets
similiar responses
2/2 interaction effects in a line graph would have points moving away from one another as the dependent variable increases
spreading effect
Dr. Guidry conducts a study examining the relationship between the number of friends one has and the experience of daily stress and life satisfaction. She randomly samples 1,500 elderly men and women in Nashville, Tennessee (the state capital), located in the southern United States. Below are her findings: • Life satisfaction and experience of daily stress: r = -.57, 95% CI [-.77, -.37] • Number of friends one has and experience of daily stress: r = .09, 95% CI [-.27, .45] • Number of friends one has and life satisfaction: r = .36, 95% CI [.12, .60] Dr. Guidry realizes that the women in her study have more friends than the men in her study. This might result in what?
spurious associations due to subgroups
Semantic differential format vs likert
strongly agree/disagree v this is hard/easy
Surveys and polls can efficiently measure people's
subjective feelings
A repeated measure study already has
temporal precedence
testing effects (threat to internal validity)
tested more than once in a study with early testing affecting later testing (includes practice effects)
Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. Dr. Sheffield wants to establish the discriminant validity of his pathological gambling measure. He gives his measure and three others to a group of 100 people. What provides the best evidence for discriminant validity?
that his measure is not strongly correlated with a measure of impulsivity
Which aspect of the peer-review cycle allows for the greatest amount of honesty in reviews?
the anonymity of the peer reviewers
Neither r nor d use the original units of measurement, but both are standardized effect sizes. An effect size in original units is the mean difference between groups, whereas a standardized effect size takes into account
the differences between the means and standard deviations of the groups.
criterion validity
the extent to which a measure is related to an outcome
construct validity
the extent to which variables measure what they are supposed to measure
What is a confidence interval constructed around?
the margin of error
Hannah just finished reading an empirical journal article for a class project. What information might she get out of reading the references section of her article?
the name of an article that researched a similar topic
Construct, conceptual variable
the name of the concept being studied
What is the primary difference between pretest/posttest designs and within-groups designs?
the number of levels of the independent variable participants are exposed to
It might be more helpful to use d when estimating
the real-world impact of an intervention or comparing results within one body of literature.
Who is responsible for deciding which validity is prioritized in a study?
the researcher
quota sampling
the researcher identifies subsets of the population and then sets a target number (i.e., a quota) for each category in the sample
Which of the following is a reason that a researcher might choose a pretest/posttest design?
to ensure that random assignment made the treatment/comparison groups equal
Dr. Sheffield is a clinical psychologist who specializes in treating pathological gambling. Bothered by not having a good measure that he can give to clients to determine whether they are suffering from this condition, he creates a new measure of pathological gambling. To test his measure, Dr. Sheffield gives his measure to a group of people in Gamblers Anonymous (GA) and another group in Alcoholics Anonymous (AA). He finds that people in the GA group have higher scores on his new measure than people in the AA group. Why did Dr. Sheffield do this?
to obtain evidence for criterion validity
too much within-groups variability metaphor salsa
too many other ingrediants
Studies that use nonprobability samples have ________ external validity.
unknown
What might you recommend to decrease fence sitting?
using scales with an even number of response options
___ important for the construct validity of studies and for reducing measurement error, but it does not address individual differences.
validated scales
causal claim argues that____. They are___
variable causes changes in the level of another variable, supported by experiments
You are looking to purchase a new pair of running shoes. What should you consider when looking at the Zappos.com headline "61% said this shoe felt true to size"?
whether the people who rated the shoe share same characteristics as others who bought the shoe
Each participant experiences all combinations of the independent variables
within-groups factorial design
