Research Final Exam-Morling
interrater reliability
-2 + independent observers -agreement between observations
Simple experiment types:
-Independent groups designs (diff group-diff particip) (each group get diff. level of IV) -within groups designs-(each part. receives all lev of IV)
internal reliability
-correlation song items on a scale. (agreement on item 1 should correspond with agreement on item 2)
matthew is reading an empirical journal article and wants to know whether the authors used the Big Five Inventory (BFI-44) or the NEO-PI to measure extraversion. In which section would he find this information?
-method,
what is required of causal claims
-req. experimental control and manipulation of 1 variable. -the DV must be measured - the IV is the manipulated variable.
reliability 3 components-
-test retest -interrater reliability -internal reliability
what are the three principles in the Belmont report?
1-respect for persons 2. principle of beneficence 3. principle of justice.
Name the steps (in order) of the theory-data cycle.
1. theory 2. research design 3. hypothesis 4. data
Name the steps in the theory data cycle
1. theory 2.prediction 3. data
Name the 4 data scientific cycles
1. theory data cycle 2. basic-applied research cycle 3. peer review cycle 4. journal to journalism cycle
name the 5 ethical principles
1.beneficience and nonmaleficence 2. fidelity and responsibility 3.integrity 4. justice 5. respect for people's rights and dignity
Research that is done to understand a practical problem, hoping the research done will be directly applied to the solution is known as:
Applied research why? there is a specific problem that needs further information. applied research is done when there is a specific topic that needs to be better understood in order to solve the problem
which of the following is an association claim? a. teenage pot smoking affects intelligence b. depression in the elderly may predict dementia c. tanning changes the brain d. a thoughtful gift makes the giver feel closer to the recipient.
B. depression in the elderly may predict dementia
Research that is done to SPECIFICALLY ADD TO OUR GENERAL UNDERSTANDING of psychology (like distinguishing the components of extraversion or predicting the time it takes a person to determine whether an object is a face, or something else) is known as:
BASIC RESEARCH. why? the key words here are: ADD TO OUR GENERAL UNDERSTANDING. this is research done to better understand a general concept.
What is the last section of an empirical journal article?
Discussion
What is an example of a causal claim?
Ice applied to a twisted ankle prevents swelling
In most experiments, tradeoffs are made between validities because it is not possible to achieved all 4 at once, what is the most common trade off?
Increased Internal validity results in decreased external validity
if a theory is not falsifiable, what does that mean?
It means the theory cannot be disproven. (proven inaccurate)
Which of the following is NOT a section or subsection commonly found in an empirical journal article
Outcomes
What is another word for hypothesis?
Prediction
when data from a study does not support the theory behind the study's hypothesis, what should happen to the theory?
The theory should be revised.
What is the theory that states the simplest solution is the best?
Theory of Parsimony
What is the main difference between personal experience and research?
There is no comparison group in personal experience
design confound
a second variable that unintentionally varies with the IV
testing
a type of order effect: an experimental group changes over time because of repeated testing has affected the participants.
what is an example of being a producer of research a. administering an anxiety questionnaire b.applying a new therapy technique c. writing an opinion article about a psych study d. undergoing a brain scan
a. administering an anxiety questionnaire. why? because they are supplying a population with means to collect new data.
In the theory data cycle, theories first lead to: a. questions b. answers. c.data d. research
a. questions. why? The theory led you to ask specific questions. example: you go to check your email on your phone. You click the mail icon, but no emails pop up. you wonder if its the device or the internet connection. you check a few other apps. the apps that do not need internet work, but the ones that do, do not. you then wonder if its the router. you check and connection is low. you then ask your roommate if he is having internet problems. if he says no, you may restart your phone. the theory led you in a specific direction. you were not lead to ask if aliens possessed your phone. this is the theory data cycle
Which of the following criteria is NOT required for a causal claim? a. the correlation between the IV and DV is zero. b. the IV's and DV's are correlated c. the IV came first and the DV came later d. there is no other explanation for the relationship
a. the correlation between the IV and DV is zero
the problem with the availability heuristic is which of the following? a. we do not examine all of the evidence, only what we can quickly think of. b. we rely on the opinions of others rather than on our own opinions c. it keeps us from examining our own experience d. we will never be right in our conclusions
a. we do not examine all of the evidence, only what we can quickly think of.
what are type 1 errors
accepting the experimental hypothesis when the null hypothesis is true (AKA false positive)
what are type 2 errors
accepting the null hypothesis when the experimental hypothesis is true. (AKA missed effect)
What type of research method is the theory data cycle
an empirical method
history
an experimental group changes over time because of an external factor of event that effects all of most of the members
attrition
an experimental group changes over time but only because the most extreme cases have systematically dropped out and their scores are not included in the posttest
Instrumentation
an experimental group changes over time, but only because repeated measurements have changed the quality of the measurement instrument
maturation
an experimental group improves over time only bc of their natural development or spontaneous improvement
regression to the mean
an experimental group who's average is extremely low or high at pretest will get better or worse over time, because the random events that caused the extreme pretest scores do nor recur the same way at posttest (example: depression at pretest)
observer bias
an experimental groups ratings differ from a comparison groups but only because the researcher expects the groups rating to differ
what/who does the IACUC approve for research?
animals
cross-lag correlations are NOT helpful for determining which of rule of causation
are there 3rd variables that explain the causation?
What kind of claim is this: " Former NFLers at Higher Risk for Brain, Mood problems."
association claim
what are some benefits and risks of journal to journalism cycle?
benefits: science reaches more people. risks: misinterpretation, shock value, misinforms public policy example: mozart effect
which of the following scales of measurement is NOT quantitative? a. ordinal b.ratio c.nominal d.interval
c. nominal
Within groups designs factors & advantages:
concurrent-measures designs repeated measures designs -advantages: covariance, temp prec, internal validity (fewer people)
An alternative explanation for an outcome is known as a:
confound- describes when a third variable, or research design flaw, or researcher bias changes the way we interpret data for the worse.
a standardized number that expresses both the strength and direction of a relationship (varying from -1.00-1.00)
correlational coefficient
Which of the following groups of people are NOT recognized in the Belmont Report as entitled to special protection a.children b. people with intellectual or developmental probs. c. prisoners d. vets
d. veterans
Name the threats to experiments
design confound, selection effect, order effect, maturation, history, regression to the mean, attrition, testing, instrumentation, observer bias, demand characteristic, placebo effect.
What is empirical evidence?
evidence gathered from the senses, or from instruments that assist the senses. for example: thermometer, timers, photographs, weight scales, questionnaires.
What is construct validity?
how well the researcher measured or manipulated a variable.
order effect
in a within groups design, when the effect of the IV variable is confounded with carryover from one level to the other, or with practice, fatigue, or boredom.
selection effect:
in an independent groups design, when the two IV groups have systematically different kinds of participants in them.
What does it mean that behavioral research is probabilistic?
inferences drawn from behavioral research are not expected to explain all cases.
Which claim does not need to be interrogated for an association claim
internal validity
why is the theory-data cycle an empirical method?
it satisfies the definition of empiricism by collecting data, using it to investigate a theory, and then revising the theory.
compared with doing a generic internet search, why is PSYCinfo a superior way to find scientific sources?
it searches ONLY in psych and related fields.
who write journals?
journalists or laypeople for general public.. usually not scientists.
A statistically significant outcome is an outcome that:
leads us to reject the null hypothesis
A cog. psychologist wants to do an experiment testing the memory of old people. the psychologist only has 12 people available as possible participants. the IV she is manipulating requires the use of separate groups for each condition and she has a reliable and valid pretest she plants to use. which design is this psychologist likely to use?
matched group designs. why? has the advantage of randomness. since each set is randomly assigned, this technique prevents selection effects. also ensures the groups are =
what is journal-journalism cycle
news reports, magazine articles, blogs, etc...
what type of scale is used for the quantitative variable of class ranking. (valedictorian)
ordinal scale
demand characteristic
participants guess what the study's purpose is and change their behavior in the expected direction
this type of measure is operationalized by recording biological data such as brain activity, hormone levels, or heart rate:
physiological
what is the availability heuristic also known as?
pop up principle
A researcher computes an inferential stat to test the difference between mean scores for an experimental group and a control group. the probability of the obtained stat value is .025, which is less that the alpha level of significance (p<.05). the researcher should:
reject the null of no difference between the experimental and control groups bc the probability is so small; thus the IV had a reliable effect on the DV
what are the typical tests used in causal claims?
t-test, ANOVA
what is the first section of an empirical journal article?
the abstract
Statistical validity:
the extent to which those statistical conclusions are accurate and reasonable. -there are type 1 errors, and type 2 errors.
What info can you learn from a scatterplot that you cannot learn from a correlation coefficient
the values of each pair of measurements
What is the bridge between basic, and applied research called?
translational research
A type 1 error occurs when...
we reject the null when the null is actually true and we should have kept it.
anecdotal evidence is:
your own experience on a certain event. usually people assume what they observed is how it works all the time.
