Research Methods Exam 1

2 types of intuition

'thinking the easy way' & 'thinking what we want'

which of the following is a causal claim? A) holding a gun may make you think others are too. B) younger people can't read emotions on wrinkled faces C) strange but true: babies born in the autumn are likely to live to 100. D) check out the baby! Many new moms show signs of OCD.

A) holding a gun may MAKE you think others are too

Which of the following is true of the relationship between hypotheses and theories? A) hypotheses are steps taken to determine if the theory is accurate B) theories are used to determine if hypotheses are accurate C) multiple theories are needed to test if a hypothesis is accurate D) hypotheses and theories are synonymous terms

A) hypotheses are steps taken to determine if the theory is accurate

Basing our conclusions on personal experience is faulty because experience has confounds. In this context, a confound means: A) in real-world experiences, more than 1 thing changes at the same time. B) the conclusion we draw from the experience has left us puzzled or confused. C) there has been no comparison group D) we will have trouble thinking of counterexamples

A) in real-world experiences, more than 1 thing changes at a time. these things may impact the experience so we can't know for sure. in research we can control these confounding variables in order to study what we want to study.

IN most experiments, trade-offs are made between validities because it is not possible to achieve all 4 at once. what is the most common trade-off? A) internal and external B) construct and statistical C) statistical and internal D) external and statistical

A) internal and external internal: confounding variables external: generalizability

the two biases of intuition are: A) thinking the easy way and thinking what we want to think B) the present-present bias and the confederate bias C) overconfidence bias and oversimplification bias D) none of the above

A) thinking the easy way and thinking what we want to think

An alternative explanation for an outcome is known as a: A) confound B) bias C) confederate D) secondary explanation

A- confound

3. Which of the following headlines is a frequency claim? A) obese kids less sensitive to tastes B) exercise: 45% of you shake your booty in Zumba C) feeling fat? maybe Facebook is to blame. D) daycare and behavior problems are not linked

B) Exercise: 45% of you shake it in Zumba

After 2 students from his school commit suicide, Marcelino concludes that the most likely cause of death in teens is suicide. In fact, it is not. what happened? A) bias blind spot B) availability heuristic C)he thought about too many examples of teens who died from other causes besides suicide D) He didn't consider confounds

B) Probably influenced by the availability heuristic; he was too influenced by cases the came easily to mind

If Z causes both X and Y, but X doesn't cause Y, and Y doesn't cause X, then ____. A) the correlation between x and y must be zero. B) any correlation between x and y would be spurious C) both of the above D) neither of the above

B) any correlation between X and Y would be spurious.

which of the following is not a place where psychological scientists publish their research? A) scientific journals B)popular magazines C) chapters in edited books D) full-length books

B) popular magazines

A common finding in the study of aggression is that exposure to television is associated with increased aggressive behavior in children. You suspect this relationship may not be causal because you are not sure which occurred first—watching television or being aggressive. You are questioning which of the following rules of causation? A) rule of covariance B) rule of temporal precedence C) third variable rule D) all of the above

B) rule of temporal precedence

Benjamin is a social psychologist who studies marriage. He believes that marital satisfaction has 2 components: ability to trust one's partner and a belief that one can be a good spouse. This is known as: A)law B)theory C)hypothesis D)data E)research

B) theory

Psychologists are empirical scientists therefore, ____. A) they use logic to prove that their theories are correct B) they use data to test whether their theories make the correct predictions C) they let the leader of the empire tell them what to do D) all of the above

B) they use data to test whether their theories make the correct predictions (hypotheses)

when is it a good idea to base conclusions on the advice of authorities? A) when they have advanced degrees such as PhD or masters B) when they have conducted research on which their advice is based, by systematically an objectively comparing different conditions C) it is never good to base conclusions off advice of authorities D) when authorities have several years of experience in their specialty area

B) when they have done research

Last class you drew the scatterplot for the relationship between extraversion and frequency of a student raising their hand in class. We said: "the more extraverted someone is, the more likely they will raise their hand in class." What kind of correlation is this? A) negative association B)positive association C) zero association D) not enough info

B)positive association more of 1 means more of the other

Assuming Benjamin now collects data that match his theory, which of the following statements should he make? A) the data prove my theory B) my theory is generalizable C) the data provide support for my theory D) the data complicate my theory

C) the data SUPPORT the theory. no causation

theory-data cycle

First, theory. Overall belief that shapes the questions you ask. Then, you ask the questions. These questions lead you to predictions, so you set up a situation to test the prediction. then you can use the data to either support or revise your theory.

Modus Ponens

VALID way to affirm if P(rain), then Q(wet) P(rain) therefore, Q(wet)

modus tollens

Valid way to falsify data If P(rain), then Q(wet) not Q(wet) therefore, not P(rain)

can a measure be reliable but not valid?

Yes

experiments

a study in which one variable is manipulated to determine the effects on another variable that is measured

To be an empiricist, one should: a)Base ones conclusions on direct observations b)strive for parsimony c)Be sure that one's research can be applied in a real world setting d)discuss one's ideas in a public setting such as an online chat room

a) base one's conclusions on direct observations

conceptual variables

abstract concepts such as shyness or intelligence

components of an empirical journal article

abstract, introduction, method, results, discussion, and references

categorical variables

also called nominal variables, they are categories such as sex: 2 levels, male and female; species: chimpanzee, macaque, and bonobo. NO SPECIFIC LOGICAL ORDER

confounds

alternative explanation

covariance

as A changes, B changes.

Why is publication an important part of the empirical process? a)because publication enables practitioners to read the research and use it in applied settings b)because publication contributes to making empirical observations independently verifiable c)because journalists can make the knowledge available to the general public d)because publication is the first step of the theory-data cycle

b) because publication contributes to making empirical observations independently verifiable

Which of the following jobs most likely involves producer of research skills rather than consumer of research skills? a)police officer b)university professor c)physician d)journalist

b)university professor

thinking what we want: cherry picking the evidence, asking biased questions, and bias blind spot definitions

cherry picking: seek and accept evidence that supports our view asking biased questions: ask questions more likely to give us the desired answers (confirmatory hypothesis testing) bias blind spot: belief that we are immune to these types of faulty reasoning

which operationalization(s) are best?

combination of self report, observational (behavioral), and physiological

scientific journal

comes out monthly, peer-reviewed articles. these articles may be picked up by journalists who publish them in more common places like psychology today or women's health

reliability

consistency of the measure

which validities are important in frequency claims?

construct, external, and statistical (kind of)

which validities are important for association claims?

construct, external, statistical

which validities are important for causal claims? internal

construct, statistical, internal, external (mildly important)

difference between correlation and causation

correlation could be a coincidence or an underlying causal link

3 rules for establishing causation between variables A and B

covariance, temporal precedence, and internal validity

A statement, or set of statements, that describes general principles about how variables relate to one another is a(n)__. a)prediction b)hypothesis c)empirical observation d)theory

d)theory

hypothesis: definition and role in theory-data cycle

definition: also known as prediction, hypothesis is a way of stating the specific outcome the researcher expects to observe if the theory is accurate. role in cycle: after the theory leads to questions, questions lead to research design, then researchers formulate the hypothesis, which is followed by finding data to feed back into the cycle.

Data : definition and role in theory-data cycle

definition: set of observations role: data is collected through the study and then it is fed back through the cycle to either support or revise the theory.

theory - definition and function in theory-data cycle

definition: set of statements that describes general principles about how variables relate to one another. function: leads researchers to pose particular research questions & hypotheses

validity definition & 4 types

definition: the appropriateness of a conclusion or decision. a valid claim is reasonable, accurate, and justifiable. 4 types: construct, external, statistical, and internal.

external validity

degree to which the results of the study (conclusions) generalize to some larger population & other situations consider study as a whole: people & context

statistical validity

degree to which the statistical results support the claim

directionality problem

does watching violent TV cause someone to be violent or were they already violent which led them to watch violent TV?

Best way to satisfy covariance, temporal precedence, and internal validity?

experiments

third variable problem

internal validity studied this; could C have caused A and B? if yes, then you have the third variable problem

what differentiates quantitative variables from categorical variables?

levels of these are coded with meaningful numbers. height, weight, age, IQ score, etc.

independent variable

manipulated variable within an experiment

ordinal

meaningful values but unequal intervals between units. represent rank order

ratio

meaningful values, equal intervals between units, and a meaningful zero

interval

meaningful values, equal intervals between units, but no meaningful zero

dependent variable

measured variable within an experiment

basic research

not intended to address a specific, practical problem; the goal is to enhance the general body of knowledge. -basic processes of behavior and cognition -designed to advance theory -takes longer to affect policy -cares about "why"

what are the 3 types of quantitative variables?

ordinal, interval, and ratio

internal reliability

study participant fives a consistent pattern of answers, no matter how the researcher has phrased the question

review journal articles

summary of all the published studies that have been done in one research area

features of good theories

supported by data, falsifiable, parsimonious (all other things being equal, the simplest solution is best), and they do not prove anything. the theories are based on the weight of the evidence (for and against)

3 types of reliability

test-retest reliability, interrater reliability, internal reliability

internal validity

the extent to which a significant relationship between 2 variables is causal and not spurious how confidently can we say that A is associated with B, not A&B and associated with C?

thinking the easy way: the good story, pop-up principle, and present/present bias definitions

the good story: makes good sense. pop-up principle: things that easily come to mind guide our thinking (availability heuristic) Present/present bias: tendency to rely on the evidence that is present and ignore evidence that is absent

applied research

the research is done with a practical problem in mid; the researchers hope their findings will be directly applied to the solution of that problem in a real world context -immediate practical implications -designed to answer a practical problem -can affect policy quickly -cares about "so what" question

evidence-based treatments

therapies support by research

to operationalize variables means..

to turn a concept of interest into a measured or manipulated variable

With an experimental group and a control group, what 4 categories need to exist?

treated/improved, treated/unimproved, untreated/improved, and untreated/unimproved.

interrater reliability

two different people should be able to test the same person and get similar results

translational research

use of lessons from basic research to develop and test applications to health care, psychotherapy, or other forms of treatment and intervention

problems with experience & strengths for research

we are not able to control for multiple, co-occuring effects. in research we can isolate variables we think are causing change

validity

whether you're measuring what you think you're measuring

Producer role

work in research lab; go to grad school in a science field etc. create experiments & find data.

test-retest reliability

you should be able to test the same person again at a later time and get a similar score

How often do you feel so anxious you cannot leave the house? Never Once in a while 1-5 times per day More than 5 times per day what type of variable would the answer to the question be? A) nominal B) ordinal C) interval D) ratio

1. logical order? YES 2. equal increments between categories? NO B) ordinal

which of the following is an association claim? A) Owning a dog related to higher life satisfaction B) a majority of Americans like dogs C) a dog traveled 500 miles to find its owners D) being visited by dogs in the hospital causes decreased recovery time

A) Owning a dog is RELATED TO higher life satisfaction

which validity would you be interrogating by asking: how well did the researchers measure sensitivity to tastes in this study? A) construct B) statistical C) external D)internal

A) construct how did they operationalize the conceptual variable of taste?

the claim: over half of college students are narcissistic. What kind of claim? A) frequency B) association C) causal

A) frequency

empirical journal article

1st time results of empirical research. includes details about the study's method, statistical test, and numeric results

temporal precedence

A comes first in time, before B

2 errors in statistical validity

1. false alarm 2. missed effect

reading with a purpose; 2 questions to ask while reading empirical journal articles

1) what is the argument? 2) what is the evidence to support the argument?

When trying to decide which measurement scale to use, what are the questions you should ask yourself (in order)?

1. Are they meaningful values (is there a logical order)? 2. Are there equal intervals between the categories? 3. Is there a meaningful zero?

Which of the following variables is manipulated, rather than measured? A) number of pairs of shoes owned, in pairs B) a persons height, in cm C) amount of aspirin a researcher gives a person to take, either 325mg or 500mg D) degree of happiness, rated on a scale of 1-10.

C) amount of aspirin a researcher gives a person to take; either 325mg or 500mg

Which validity is appropriate to interrogate with rigor for every study? A) external B) internal C) construct D) statistical

C) construct

Which validity would you be interrogating by asking: how did the researchers get their sample of people for this study? A) construct B) statistical C) external D) internal

C) external

Dr. Light is examining the association between stress and satisfaction with life. To do this, he surveyed 200 high school students. He found that with more stress, students were less satisfied with life, and this was significant (using correlational analyses). From this, he concluded that stress interventions at nursing homes were necessary to increase life satisfaction in the elderly. which 2 validities are weakest? A) construct and internal B) external and statistical C) external and internal D) construct and statistical

C) external and internal external validity is weak because he studied it in high schoolers and applied it to the elderly. internal validity is weak because this is not a causal relationship. It could have a confounding variable.

measured variables are ___ and ___. Whereas, manipulated variables are ___ by the experimenter. A) controlled; recorded; observed B) observed; controlled; recorded C) observed; recorded; controlled D) none of the above

C) measured variables are observed and recorded, whereas manipulated variables are controlled by the experimenter

What does it mean to say research is probabilistic? A) researchers refer to the probability that their theories are correct B) research predicts all possible results C) research conclusions are meant to explain a certain proportion of possible cases, but not all possible cases D) if there are exceptions to a research result, it means that the theory is probably incorrect

C) research conclusions are meant to explain a certain proportion of cases, but not all possible cases

which of the following headlines is an association claim? A) chewing gum can improve your mood and focus B) want to cheer up? cheer harder. Hard-core sports fans show less depression. C) swine flu shot tied to narcolepsy, study finds. D) eating kiwis may hep you fall asleep

C) swine flu TIED TO narcolepsy, studies find

which is a likely third variable in the association between grip strength and memory? A) hair color B) books read per month C) creativity D) age

D age

Which of the following phrases would indicate a causal claim? A) causes B)may decrease C) affects D) all of the above

D) all of them, even though MAY is included, still followed by decrease which is causal

Which of the following research questions best illustrates an example of basic research? a) has our company's new marketing campaign led to an increase in sales? b) how satisfied are our patients with their wait-time in the waiting room? How satisfied are our patients with the sensitivity of the nursing staff? c) do neuro-boosting soft drinks really work? d) can 2-month-old human infants discern the difference between 4 objects and 6 objects?

D) can 2 month old human infants discern the difference between 4 objects and 6 objects?

Which of the following is NOT an example of applied research? A) an industrial-organizational psychologist who is interested in the components of job satisfaction B) a clinical psychologist who examines the effectiveness of art therapy in decreasing symptoms of ADHD C) a sports psychologist who examines how mind-set affects athletic performance D) a cognitive psychologist who maps the processes involved in inhibiting a well-learned (automatic) response E) all of the above are examples of applied research

D) cognitive psychologist who maps the processes involved in inhibiting a well-learned response -might need translational research in order to apply this to specific circumstances

DR. Hadden wants to conduct a study that will allow him to make claims that apply to all college students. Which of the following validities is he prioritizing? A) statistical B) internal C) construct D) external

D) external who can it be generalized to

affirming the consequent

INVALID way to affirm. if P(rain), then Q(wet) Q(wet) therefore, P(rain)

denying the antecedent

INVALID way to falsify if P(rain), then Q(wet) not P(rain) therefore, not Q(wet)

can a measure be valid but not reliable?

No

consumer role

Seeing news articles with claims based on 'research', evidence-based treatments, shapes public policy etc.

construct validity

how well the variables in the study are measured or manipulated how well is the study actually studying what you want it to study?

2 parts to construct validity

reliability and validity