Research Methods and Statistics
Applied Research
Research focused on real problems in society.
Respondent
a person who provides data for analysis by responding to a survey questionnaire
Unipolar system
A type of international system that describes a single country with complete global hegemony.
content validity
degree to which test is representative of total domain its supposed to cover.
sampling bias
distortions that arise when sample is not representative of population from which it was drawn
stratified random sample
subgroups compiled. representative according to predetermined proportions
quadratic regression
used to model quadratic data
continuous variable
variable that can have unlimited number of possible values eg length, mass, area, temp
Properties
Characteristics, attributes, or types of behavior of the units
Trial Level has
Judges
Extraneous Variables
Any variable other than the IV that can cause change in the DV and therefore affect results in an unwanted way
Quantitative research
A research paradigm in which objective data are gathered and analyzed numerically.
If the law you find is not ______nothing else matters
On Point
Ex post facto research
Research that investigates events that have already occurred and implies a cause-and-effect relationship from the results.
Restatements are ______Authority
Secondary
Line graph
a continuous line that represents the distribution of interval variables
representative sample
a group of subjects whose characteristics fairly reflect the characteristics of the population they belong to
Research Design
an overall plan for obtaining the information needed to address the problem/issue
Random Assignment
assignment of subjects/participants so that both the criteria of equal probability and independence are fullfilled
Hawthorne Effect
change in subject's behavior caused simply by awareness of being studied
Ordinal level
They indicate only relative amount of a property
experimental condition
condition of experiment that exposes participants to treatment, that is, to one version of the IV
counterbalancing
controlling for order and sequence effects by arranging that subjects experience the various conditions in differeent orders
experimenter bias
expectations by researcher that might influence results of experiment or its interpretation
ecological validity
extent to which an experiemtnal situatuon mimics a real world situation
research variables
independent or dependent
Interquartile range
indicates the high and low categories of the middle 50% of the units
element
individual memer of a sampling frame
force
intensity or strength of a behaviour
Information garnered from factorial design
interaction and main effect
frequency polygon
type of line graph that shows frequency distributions
nominal example
types of defense mechanisms
Bimodal
units concentrate around two nonadjacent values
frequency distribution
placing values for a variable in order of magnitude to show the number of times each is score occurred eg number of visits 1 2 3 4 age 10 11 12 13
ordinal example
preferences
ubiquitous
present or appearing everywhere
Linear regression equation to calculate regression line points for scatterplot
Y'=[(b)(x) + a]
When R= +/- 1 how much is the eror in predictions
Zero error and Sy' equals zero.
Life histories
a narrative self disclosure about ideas and chronological experience regarding a theme
statistic
a number resulting in the manipulation of some data according to certain specified procedures eg mean age for students in class, add up all ages and divide by number of students
Restatements
a scholarly compilation of the common law by the American Law Institute.
Conceptual Definition
a theoretical definition of a concept that uses other constructs to explain the meaning
popular source
articles based on journalistic reporting and widely available to the public
Critical Incidents technique
asking subjects to describe critical incidents related to behavior being studied
archival research
examines pre-existing records
Ineffective/effective purpose statement:"The purpose of this report is to discuss the eating disorders Anorexia and Bulimia
Ineffective: to vague
Strength of relationships
Positive correlations range 0-+1.00; indicates as variable X increases so does Y
What authority are American Law Reports
Secondary
sufficient condition
a correlation does not show causation
scatter plot
a graph of data points
survey
a technique for ascertaining the self-reported attitudes or behaviors of people, usually by questioning a representative, random sample of them. (Myers Psychology 8e p. 027)
random assignment
equal chance of being in either group
Quantitative Research
research that involves polls and surveys using highly precise scientific sampling methods
convenience sampling
selection of most readily available persons as participants in study
culture
the enduring behaviors, ideas, attitudes, and traditions shared by a large group of people and transmitted from one generation to the next. (Myers Psychology 8e p. 045)
Theoretical Population
the group of objects to which an explanation applies
words without acoustic features
think, grass, rubber, plant, pensive, loneliness
Exploratory Research
to gather more information about a topic or to make a tentative hypothesis more specific
Fair correlations
0.26 to 0.50
What % of what we learn is by participation
70%
4th Marketing Research Step
Interpreting Research Findings
Range, Standard Deviation, Normal distribution, Percentiles and quartiles
Measures of variability; determination of the spread of a groups scores
Behavior
The portion of an organism's interaction with it's environment
Questionnaires
data collection method which is low cost, little time, anonymous, has no interviewer bias, can not clarify, has a low response rate, and has little control over subject.
Correlational Research
investigate relationships among variables studied
haphazard sampling
literary digest election poll
types of questionnaire questions
open ended - advantages: get complete answers, reasoning, and unexpected information / disadvantages: hard to code, answers must be rated (categorized); closed ended - advantages: easy / disadvantage - simplistic answers, forced choices USE BOTH
Standard deviation
the square root of the variation
third variable problem
third variable causes both sides of a relationship; heat increases ice cream eating and murder
Coefficient of alienation
1- r2
Conclusion
A judgement or decision about what the results obtained from an investigation mean
Shopping Mall Intercept Interviews
a research method that involves interviewing a percentage of persons passing by "intercept" points in a mall
Secondary source
a source analyzing or commenting on a primary source
Representative sample
A characteristically resemblant portion of the population of interest.
nominal scale
A set of categories for classifying objects
Sample
All the units we are analyzing
When your scale correlates with other procedures or scales that are valid, it has__________ validity ?
Convergent
Point biserial correlation coefficient
Describes the linear relationship between the scores from one continuous variable and one dichotomous variable (ex: correlating male/female with interval scores from a personality test).Can be used for one continuous interval or ration and one dichotomous, symbol is Rpb.
Legal Periodicals examples
Newspapers, legal magazines, law reviews
Respect for persons
Proper regard by the researcher for the welfare, rights, beliefs, perceptions, customs and cultural heritage of all individuals involved in research.
rs
Spearman correlation coefficient symbol
Personal Interview Survey
a research method in which participants respond to survey questions face to face
Experimental Research
allows marketers to make casual inferences about relationships
pathos
appeals to emotions
categorical variables
differ in kind
belligerent
fond of fighting
Control group
group that has controlled conditions and the IV is not present
Code
is a grouping of statutes
What are some of the strengths of using an interview?
large amount of data quickly, wide range of info, large number of topics, immediate follow- up, allows for observation, allows for checking.
Frame
material around a direct quotation that helps to introduce and contextualize a quote
frame
materialaround a direct quotation that helps to introduce and contextualize a quote
wording effects
occur when the questions asked on a sample survey are confusing or leading
Analysis of Covariance (ANCOVA)
parametric test used to compare 2 or more treatment groups or conditions while also controlling for the effects of intervening variables ie. subjects in one group taller than subjects in the second group-ht is covariate.
sampling error
part of a sampling process that results in a biased sample
Control variables
past research and theory, guiding to show what might need to be controlled
measurement variables
qualitative or quantitative
p<.05
results of experiment are SIGNIFICANT - they are not likely caused by chance
One way ANOVA
test for difference between 2 or more groups, is strictly univariate in nature.
Linear regression is defined as?
the best fitting straight line in a linear relationship
Residual
the difference between a Y value estimated from the regression equation and the actual Y value for each unit - the lower the values of r, the larger the residuals will be
range
the difference between the highest and lowest scores in a distribution. (Myers Psychology 8e p. 042)
case study
the study of an single person whose behavior is rare, unique
copy testing
when the target audience is asked to read or view the material in draft form before it is mass-produced and distributed.
alpha (a)
Ŷ - B X
secondary source
second hand accounts of events or facts; in research, description of study prepared by someone other than original researcher
State-centric system
A system describing the current world system wherein states are the principal actors.
Types of Qualitative Research Design
1) Ethnographic- elicits cultural data 2) Phenomenological- real world, see thru eyes of others and can describe the essences of the experience. 3) Grounded theory-to find a basic problem or major concern.
What are two levels of IV
2 experimental groups: compare a standard level of treatment with other levels of treatments / Placebo (control) group & treatment group: have to make sure everything experiences the same thing - same treatment, etc
When talking about the US court of appeals, Texas is in the
5th Circuit
Frequency of scores decreases further from the mean (Normal distribution)
95% of scores fall +2 or -2 SD of mean. 99% of scores fall +3 or -3 SD of the mean.
High Correlations
>0.76 to +1.00
Control Group
A group for which all conditions are identical to those of the experimental group except that participants are not exposed to the manipulation of the independent variable. This enables the researcher to determine whether the independent variable has affected the dependent variable.
Focus groups
A group interview technique that obtains data through discussion between research participants in a group setting.
Convenience Sampling
A group that is selected for an investigation from a population that is first encountered when sampling
hypothetical abstract construct
A hypothesis is a proposed explanation for an observable phenomenon, hypothetical: "being assumed to exist as an immediate consequence of a hypothesis,"
Single-blind procedure
A procedure in an experiment to ensure participants are not aware of the group to which they have been allocated
Stratified Sample
A procedure that involves diving the population to be sampled into distinct groups (or strata) then selecting a sample from each stratum
Frustration-aggression theory
A psychologically based theory that frustrated societies sometimes become collectively aggressive.
continuous variable
A quantitative variable that can assume an uncountable number of values
Hypothesis
A testable predication that an independent variable(s) or treatment(s) will cause an effect on the dependent variable(s).
Controlled variables
A type of extraneous variable whose influence has been removed from the research via sampling, experimental method and/or statistical control.
alternate form reliability
A type of reliability, where different versions of same instrument are used and scores are compared
Independent Groups Design
An experimental design in which each participant is randomly allocated to one of two or more entirely separate groups
Matched Participants Design
An experimental design that involves selection of pairs of participants who are similar in a characteristic that can influence the DV, then allocating each member of the pair to a different group
Repeated Measures Design
An experimental design which uses the same participants in both the experimental and control groups
Case study
An in-depth study of some particular behaviour or phenomenon of interest in a particular individual, group or situation.
Idiosyncratic analysis
An individual-level analysis approach to decision making that assumes that individuals make foreign policy decisions and that different individuals are likely to make different decisions.
heteroscedasticity
An unequal spread of Y scores around the regression line (that is around the values of Y')
Writing References in APA style
Author (alphabetical) month/year, journal name, article name, where it was retrieved
Effective delivery factors
Enthusiasm, Audience Bonding, Posture/Movement, Gestures, Eye Contact, Voice Quality
Type I error
Error of rejecting null hypothesis when in fact it is true (also called a "false positive"). You think you found a cause effect relationship but ONE IS NOT THERE
Intuition
Information is accepted based on a hunch, or a 'gut feeling'
Authority
Information is accepted because it is derived from an expert in the subject area
Informed consent
The process whereby an experimental subject is given all the necessary details in order to reach a decision to agree to being a part of an experiment. Such information should point out any potential risks that may be present in the research design.
Independent property (variable)
The property that is asserted to cause the variation
Independent variable (IV)
The treatment variable (the factor or the characteristic) in an experiment that has been deliberately varied or systematically manipulated by the experimenter in order to measure whether it produced a change in the dependent variable, measured by a change in the subjects' behaviour or performance
Survey research
The use of a questionnaire or interview to assess the current opinions, beliefs, and attitudes of members of a known population.
Example research question for t-test:
There will be no significant differences between Ele/Sec and HE students with respect to years of full time work experience
confounding variables
They make the independant variable and dependant variable relationship unclear
Confounds
When the results are not just due to the manipulated - challenges the conclusion that there may be other variables
Quasi-experimental Research
When the two groups are different from the beginning of the experiment
Percentage crosstables
When there are few (2-3) categories to the dependent variable, one uses a percentage crosstable (calculated down, read across)
subject variable
an independent variable that the researcher doesnt manipulate but measures instead
Two-tailed t-test
based on a nondirectional hypothesis; evals differences in data on both positive and negative ends of a distribution; tests of significance are almost always two-tailed.
As the variability--differences--in Y scores at each X become larger, the relationship does what?
becomes weaker and results in a smaller correlation coefficient
dependent variable
behavior affected by another variable, it is observed and measured (usually before and after and experiment takes place)
directionality problem
can't say which variable causes the change in the other; either variable could be the explanation
ambiguity
capability of being understood in two or more ways
content words or "open class"
carry meaning; numerous; variable lengths; can add new ones to language; mainly consist of nouns, verbs, adjectives, adverbs
r2
coefficient of determination
standard deviation
computed measure of how much scores vary around the mean score.
Interviews
data collection method which has a higher cost, takes more time, is not anonymous, has interviewer bias, has a high response rate, can control subjects, and can clarify questions.
ordinal data
data exists in categories that are ordered but differences cannot be determined or they are meaningless. (Example: 1st, 2nd, 3rd)
verbose
full of words; using or containing too many words
ratio scale
interval with an absolute bottom
Valid
measures the property as it was defined
lexicon
mental dictionary in brain
median
middle number in a set of data
ordinal scales
numerical values with a rank order
experimental group
receives the critical part of the experiment (the independent variable)
basic research
research w/ no immediate application; done for sake of advancing knowledge base
snowball sampling
selection of participants through referrals from earlier participants; also called network sampling
Confound
Extraneous variables that effect the IV
Negative correlation
Indicates that two variables share a relationship to one another which occurs in an opposite direction.' Thus, as one variable increases, the other variable decreases. For example, as the amount of study time increases, failure rate tends to decrease.
Correlation coefficient
Indicates the strength and direction displayed in a table - (positive, negative) summarizes the findings of each table in a single number
ineffective/effective purpose statement: This article will cover the different ways a company can become organized
Ineffective: obscure and misleading
experimental validity
It asks if the experiment actually answered the intended question
measurement validity
It asks if the measurement procedures actually measure what you intend to measure
Reliable
It must yield the same results in the same circumstances the same way, regardless of who does the measuring
Examples of Secondary Authority
Legal Dictionaries, Treatises, Practice Guides, Form Books, Horn Books, Digests, Restatements, Legal Encyclopedias, Legal Periodicals, American Law Reports
Systematic review of multiple RCT's (large N)substantial agreement of size and direction of tx.
Level 1a (A)
Credentials needed to subscribe to the SW Reporter
Money
inter-rater reliability
More than one individual scores same test, regardless of who rates test - scores should be the same for _____ reliability
Zero association means that?
No linear relationship is present
Is Tex Jur National?
No, Restricted to Texas
Subject
Nonhuman that participates in a study
What are some of the limitations when using an interview?
Not familiar with jargon. Interviwers must be trained listeners and observers. Know hoe to construct converstation.
Quantitative data
Numerical measures/values used to quantify, /describe the characteristics or behaviours being measured.
Extraneous Variable
Other variables in the environment that may affect experimental control
Informed Consent
Participants are made aware of the nature and purpose of the investigation beforehand and usually involves signed a consent form
Cross-sectional study
Research in which individuals of differing ages drawn from a representative sample are compared in a single study.
The US District Court's Reporter has more than one series
True
Descriptive Statistics
Used to analyse, summarise, organise and describe important features of data so they can be further interpreted
Secondary Research
Using existing and more qualitative research that has to do with...archival research, reference books, computer databases, and online searches.
Causal association
Variation in the independent property tends to cause directly or indirectly variation in the dependent variable
Variables
a set of numbers or values you get after measuring a property
between subjects design
all about comparison, experimental group/control group
population
all cases in a group, from which samples may be drawn for a study
exhaustive
all categories must fall into one case or another ex. bachelor degree
incorrigible
bad beyond correction or reform
One tailed t test
based on a directional hypothesis; evals difference in data only on 1 end of distribution, either negative or positive.
Percentiles
data divided in 100 equal parts
Suppose you find a restriction of range in your study of IQ scores and school achievement at school. Restricting the range is likely to _____ the correlation coefficient.
decrease the size of
lethargic
deficient in alertness or activity
Linear Regression
defines a line of best fit for correlational data that can be used as a prediction equation
operational definition
demonstration of a process
Descriptive Research
describes what is without inferring causation
Stonger correlations produce what size SEE
smaller SEE
Variable
something that can change the results of an experiment over time
model
sometimes a line or an equation used to represent data
standard deviation
square root of variance
Longitudinal Research
studies the same people at different times; inferences about the developmental variable are based on repeated measures comparisons
subject heading
subject codes
Attorneys
tells you who the attorneys were for each of the parties
construct validity
the degree to which the test measures a theoretical construct
validity
the extent to which a concept, conclusion or measurement is well-founded and corresponds accurately to the real world
within subjects control
using same ppts for different experiment
Linear association
what r measures the extent of between X and Y (dots closer to the line - higher number / farther dots - low number)
dependent variable
what you use to make measurements; i.e. words to write, read, etc. when studying aphasia
Concurring Opinion is written by?
written by a person that agrees with the result, but for different reasons
a=
y-intercept
Standard error of measurement
estimate of expected errors in individual's score; a measure of response stability or reliability.
equation to determine the sampling interval width (k)
estimated number of people in population / desired sample size
threats to validity
events outside the laboratory, maturation, effects of testing, regression effect, selection, mortality
F-Test
for difference between the means
criterion validity
form of validity in which a psychological measure is able to predict some future behavior or is meaningfully related to some other measure
Majority Opinion is written by?
one of the members of the panel is chose to write this
discrete variable
one that falls into a certain number of distinct bins
threats to external validity
other subjects, other times, other settings
Participatory Research
participants participate in the research process- Cooperative Inquiry or Participatory Action Research
nuisance variables
potential confounds that can't be easily removed so made as IV as a means of control
Matching
pre-test ppts on an important(potentially confounding) variable so that it can be controlled for
In the fomula Y' what does Y" stand for {Y'= (b)(x) + a}?
predicted Y score
p value < .01
probability of an error in rejecting the null is 1/100
block quote
quote of 4+ lines that is offset from the main body text with two tabs
Symbol for Pearson correlation coefficeint
r symbol
How do you calculate proportion of variance accounted for?
r2 which is also known as "coefficient of determination"
Indicators of central tendency
reflect the middle, central, or most common value in a distribution: mode, mean, and median
Degrees of freedom (df)
reflect the number of cells in the table: (number of rows - 1)(number of columns - 1)
aloof
removed or distant in interest
replication
repeating the essence of a research study, usually with different participants in different situations, to see whether the basic finding extends to other participants and circumstances. (Myers Psychology 8e p. 025)
survey
research method in which info is obtained by asking many individuals a fixed set of questions
Quota Sampling
researchers divide the population into groups and then arbitrarily choose participants from each group
Theoretical survey research
gender differences in teen drug use
encyclopedias have two kinds of index
general and topic
problems with case study
generalizability, objectivity
dispersion
how far spread from mean
external validity
how well the findings of an experiment generalize to other situatons or populations; different subjects, settings, times, etc
interviewer bias
intentional or unintentional influence exerted by an interviewer in such a way that the actual or interpreted behavior of respondents is consistent with the interviewer's expectations
plausible
seeming reasonable or something that can happen
systematic sampling
selection of sample members such that every kth (every 10th) person or element in sampling frame is chosen
probability sampling
selection of sampling units (eg participants) from population using random procedures (eg simple random sampling)
nonprobability sampling
selection of sampling units (eg ppl) from population using nonrandom procedures (eg convenience and quota sampling)
Negative associations
lower values of Y are more common as values of X increase
Nonexperimental Research
making observations and asking questions; includes descriptive research, correlational research, Case study, Archival Research, Content analysis
increasing reliability - reduce error
many items or observations brings us closer to the true score, eliminate unclear items, standardize conditions, make instructions clear, clear evaluation criteria
Types of measures
self-report, behavioral measures, physical measures
validity
measuring what it claims to measure
median
middle score in a distribution; half scores are above it and half are below it.
mode
most frequently occurring score(s) in a distribution.
response rate
number of people who complete your survey
sample size
number of subjects in sample, major issue in conducting and evaluating quantitative research
Tied rank variables
occcurs when two aprticipants receive the same ranking score in SPearman's rank coefficient, resolved by averaging the score and assigning it to both participant to correlate their scores.
cluster sampling
similar to stratified
quota sampling
similar to stratified too; the sample is chosen to reflect the numerical composition of various subgroups in the population; ie: if UAA is 60% men and 40% women, our sample of UAA students would be 40% women and 60% men too but otherwise randomish
morphological paragraphias
learn > learning; powerful > powerfully; picked > pick
Issue areas
Substantive categories of policy that must be considered when evaluating national interest.
Define linear regression
THe statistical procedure for using a relationship to predict scores aka the statistic that summarizes the linear relationship.It produces the line that summarzes the relationship
Convenience sampling
The process of selecting members of a population to participate in research who are easily obtainable. Examples include newspaper polls and radio station phone-ins, as well as approaching individuals in a shopping centre. Such a sample may not be representative of the population as individuals actively volunteering to participate in the study, or drawn from a narrow strata of the population, may be biased.
Validity
evidence that an instrument/study measures the construct it claims to
hypothesis
a testable prediction, often implied by a theory. (Myers Psychology 8e p. 025)
cluster sampling
form of sampling in which large groupings ("clusters") are selected first (eg nursing schools), with successive subsampling of smaller units (eg nursing students)
If heterodasticity is present Sy' will be?
greater than the actual average error in predictions of Y for some scores and less than the actual average error for other X scores
participant variables
includes things like beliefs, characteristics,emotional characteristics, how much sleep they've had
Nonparametric statistics
testing not based on population parameters; includes tests of significance based on ordinal or nominal data. Less powerful than parametric tests, more difficult to reject null hypothesis.
internal consistency reliability
the assessment of reliability using responses at only one point in time
measurement error
the degree to which a measured score deviates from the true score or value
Bibliography
a complete or selective list of works complied upon some common principle, as authorship, or subject
control group
Research done with no treatment and no independant variable manipulation
Levels of measurement
ordinal, interval, nominal
Population
The larger group from which a sample is drawn for a research study
How are American Law Reports kept current
by the Pocket Part.
How is a digest kept current
by the slot in the back cover called the pocket part sent each year
reversal design
a single case design in which the treatment is introduced after a baseline period and is then withdrawn during a second baseline period; demonstrates 'reversibility'; helps show that the manipulation of the IV had an effect; called ABA design
Mode
A measure of central tendency corresponding to the most frequently occurring score in a distribution of scores.
Standard deviation
A measure of the variability of scores in a distribution indicating the average difference between the scores and their mean.
random assignment
Assigning participants to experimental and control conditions by chance, thus minimizing preexisting differences between those assigned to different groups.
Standard error of the mean is defined as?
Average spread of actual Y scores around the predicted Y scores
Units of analysis (cases)
Each subject about which the data are gathered; objects
Standardised instructions and procedures
Instructions and procedures used with all groups to make sure only the independent variable differs between them
Nonexperimental Research
Research in which no manipulation of variables is involved and no cause-and-effect relationship is studied between two groups.
PICO approach
Patient/problem, intervention, comparison intervention, outcomes. Works best for quantitative designs
subjective data
Personal opinions, not verifiable by others
5th Marketing Research Step
Report findings
Rationalism
Uses logical reasoning to obtain answers.
Placebo Effect
When a participant's response is changed by their belief that they are receiving some kind of experimental treatment as opposed to change caused by the actual experimental treatment
sequential method
a combination of the cross-sectional and longitudinal design to study developmental research questions
Case of 1st Impression
an issue before a court that has never been answered or heard before
independent variable
the experimental factor that is manipulated; the variable whose effect is being studied. (Myers Psychology 8e p. 038)
case study
used to collect descriptive data through the intensive examination of a phenomenon in a particular individual, group, or setting (particularly useful for rare or complex phenomena)
A-B-A Design
3-phase design consisting of initial baseline phase (A) until steady state (B) implemented until behavior has changed and steady state, return to baseline (A) by withdrawing IV (B)",
confederates
"fake subjects" that look & behave like real subjects in study.
likert scale
5 choices. ex pain on a scale from 1 to 10
statistical significance
a statistical statement of how likely it is that an obtained result occurred by chance. (Myers Psychology 8e p. 043)
random sample
a subset of a population selected so that each member of the population has an equal opportunity of being selected, out of a hat
sample
a subset of population selected according to some scheme eg 10 students out of 65
Instrument Decay
any decrease in the accuracy of your measurement tool; when you are making observations, sometimes you have raters who get tired or bored
range
measure of variability that is the difference between the highest and lowest values in a set of data
correlation research
measures 2 or more variables to determine the degree of relationship btw them
two types of error
method - related to the instrument being used; trait - participant characteristics
phenomenology
purpose: to understand how people attribute meaning to events and interactions with others during daily living
If we use knowledge of SAT scores to predict his or her GPA. wHAT IS THE PREdicTOR AND WHAT IS THE CRITERION?
sat IS PREDICTOR AND GPA IS CRITERION
Path diagrams
shows the cause and effect of a z variable on X and Y
In general, the greater the proportion of variance accounted for...
the more accurately we can predict the behaviour
mode
the most frequently occurring score(s) in a distribution. (Myers Psychology 8e p. 041)
f -
a cohen's effect size measure for ANOVA.
verification key
a collection of items on a questionnaire designed to detect dishonest answers
Interview
a data-callection encounter in which one person asks questions of another. May be conducted face-to-face or bu telephone.
Sentence completion
Subjects are given a series of incomplete sentences about an object or event and are asked to complete the sentences
Social Desirability
Subjects tendency to respond in socially desirable ways or consistent with social mores. Control with anonymity
When r=0 what doe Sy and S2y equal?
Sy and S2y equal each other
confounding variable
any factor that affects the dependent variable, along with or instead of the independent variable
consecutive sampling
recruitment of all ppl from accessible population who meet eligibility criteria over specific time interval or for specified sample size
Percentile Scores
refer to the percentage of cases in a norm sample who scored below an individual's score
Balance of power
A concept that describes the degree of equilibrium (balance) or disequilibrium (imbalance) of power in the global or regional system. 44,
Oral history
A form of historical research in which individuals' spoken words and testimonies about the past are recorded.
Reasons behind making outlines
Aids in the process of writing, Helps organize ideas
Experiment
Comparison of some measure of the DV under 2 or more different conditions in which the IV differs from one condition to another
Internal Validity Threats Quantitative
Compensatory rivalry by the contol group, compensatory equallization of treatments, resentful demoralization of the control group.
Ways to participate in natural observation
Concealed - join the group and not tell the group you've joined and are collecting data; Open - tell the group and get their permission, can get valuable information - the why behind the what, problem: bias - can lose objectivity
abstract concept made concrete
Concrete thinking involves facts and descriptions about everyday, tangible objects, while abstract (formal operational) thinking involves a mental process
Concurrent validity
Extent to which a procedure correlates with an individuals current behavior
Predictive validity
Extent to which a procedure correlates with an individuals future behavior
Official reporters are published by
Government
What does the equation r2 aka coefficient of determination aka proortion of variance indicate?
How important the realtionship is by comparing amount of error obtained using the regression equation for XY to errors without the regression equation for XY
interval example
IQ
Unstructured Interview
Interview that is conversational but meant to determine the subjects' perception of phenomenon. It is taped, lasts several hours, and latter transcribed.
Horn Book
It is 1 volume, and used for instructional puposes only. It's intent is to give you a general overview of the law. Not something you can use for research.
Why is the correlation coefficient important?
It is one number that allows us to envision and summarize the important information in a scatterplot, in terms of it's strength and direction.
1st Marketing Research Step
Locating and defining issues and problems
Mixed ANOVA
Means one of the two factors is between subjects, while the other factor is within subjects.
Continuous Measurement
Measurement conducted so that all instances of the response class are detected during the observation period
Projective data collection techniques
Pictorial (thematic apperception test (TAT), Rorschah Test, projective cartoon), verbal (word association, sentence completion), expressive (playing with dolls, drawing, painting, role playing).
Interval level
Quantitative type variables
Open-ended questions
Questions that are unstructured, have no predetermined response, provides a depth of response, takes a long time to administer, and is hard to analyze
Citation means
Reference
Guttman scale
Scale in which items are arranged in a hierarchy. Subject picks a "yes or agree" to all items lower and "no or disagree" to all items higher. often used to test child development.
3 stages in the publication of a case
Slip opinion, Advanced sheets, reporter
Sr'
Standard error of estimate
n
Symbol used to represent the total number of subjects in a research study
Halo effect
Tendency for observers to rate everything positively
Acquiescence
Tendency to consistently agree or disagree with attitudinal statements. control by constructing scales so some items are phrased negative and some are positive.
Random assignment / allocation
The allocation of subjects to different groups in an experiment ensuring that each subject has an equal chance of being selected in any of the groups to be utilised.
Thesis
The answer to the question is the thesis statement for the paper.
Bureaucracy
The bulk of the state's administrative structure that continues even when leaders change.
The 4 Patterns are
The case and the court are in the same jurisdiction, One state does not have to follow what aother state did, Does state court have to follow a federal case, does federal court have to follow a state case
Gender opinion gap
The difference between males and females along any one of a number of dimensions, including foreign policy preferences.
Population
The entire group of research interest from which a sample is drawn.
Identify participants or subject for the study
The fourth step in the research process
Replication
The retesting of hypotheses to see whether they are confirmed with different unit of analysis (justified)
How do we translate S2y'?
The sample variance of the Y scores around the Y'.
How to define and measure variables
The third stage in the research process were you will go about with your experiment, this includes deciding location, who, what, where etc.
bibliography
a complete or selective list of works compiled upon some common principle, as authorship, or subject
population
a complete set of individuals/objecfts/measurements having some common observable characteristic eg census that measures all sorts of variables
paradox
a seeming contradiction
Sample
a subset of the theoretical population
1 US District Court Reporter
Federal Supplement
Debriefing
Feedback given to experimental subjects about the purposes and results of the research of which they were a part. Such feedback should remove any misconceptions caused by deception within the experimental design, and should provide results and interpretations to the participants. The aim is to ensure that subjects leave the experiment in as similar a state as possible as they entered it.
Types of response bias
Guessing, social desirability, acquiescence, and deviation
Role
How an individual's position influences his or her thinking and actions.
SEE (Sy) is acronym for
Standard error of estimate which is the standardized difference between predicted Y' and actual Y scores
Ethics
Standards that guide individuals to identify good, desirable or acceptable conduct
Define the purpose of computing a correlation coefficient.
Statistical technique for demonstrating the reliability and the validity of a measurement procedure in any experiment or correlational design.
Descriptive statistics
Statistics that describe or summarise the data and typically include a measure of central tendency and dispersion
Qualitative Data
Actual numerical data or statistical information collected during an investigation
How can you locate what you are looking for in a law review
By Author, Title or Topic
R2
Coefficient of determination represents the proportion or percentage of the variability in the dependent variable that has been accounted for or explained by the study's independent variables. (Used in multiple regression analysis.)
Cognitive decision making
Making choices within the limits of what you consciously know.
How can the power of a correlational design be increased?
Minimizing error variance and avoiding a restricted range, so that thelargest possible coefficient is obtained.
Normal distribution
Most scores are near the mean, within 1 SD; approx 68% of scores fall within +1 or -1 SD of mean.
R
Multiple correlation coefficients used in multiple regression studies, R quantifies the extent to which the regression analysis achieves its objectives.
Suppose you have several different predictor variables and one criterion variable. all your variables are measured using interval or rations scales. What is the appropriate statistical test to use?
Multiple regression
Homogeneity
Systematic review free of variations in the directions and degree of results b/w individual studies.
Internal Validity Threats Quantitative
Testing, Instrumentation, statistical regression, differential selection, experimental treatment diffusion.
Examples of Hybrid Treatises
Texas Transaction Guide & Texas Litigation Guide
Democratic government
The governmental system a country has in terms of free and fair elections and levels of participation.
Inter observer agreement
When 2 or more observers report the same observed values after measuring the same event
When would you use an interview?
Obtain percetions, feelings, attitudes, values. To obtain greater clarity. To build relationships.
In order to determine when a court will have to follow something or not, you break it down into
Patterns
What is the most common method of correlation coefficient?
Pearson correlation coefficient
Mobile positioning
When the observer gets the consent to follow the subject around.
Single positioning
When the observer staying in one spot and observes subjects
Control Group
The group of participants that is not exposed to the IV providing a standard against which the experimenter can compare the performance of the experimental group
Proportion of variance accounted for indicates what?
The importance of a relationship
systematic error
When there is a constant bias
All legal material fall into what 2 categories
Primary Authority or Secondary Authority
Maximum variation sampling
Purposefully handpicking subjects with a wide variation on the dimension of interest
The larger the correlation coeficient (whether pos. or neg.), the stronger the relationship. Why?
The less the Ys are spread out at each X and the closer the data come to forming a straight line
Intermestic
The merger of international and domestic concerns and decisions. 8,
Median
The middle scores in a set of scores
Experimental Group
The participants exposed to the IV
Correlation
The relationship between the IV and the DV
Beneficence
The researchers responsibility to maximize the potential benefits of research and minimise the risks of harm or discomfort to all research participants
Ways to increase control
Random assignment, nuisancem statistical control, replication,
Mean
The statistical average for a set of measurements/scores.
Mirror-image perception
The tendency of two countries or individuals to see each other in similar ways, whether positive or negative.
Statistical significance
The term used to indicate whether the results obtained in an experiment do not occur by chance and may therefore be the result to other variables.
necessary condition
a correlation needed for causation
Empirical
Verifiable or provable by means of observation or experiment
If we can claim to account for .65 of the vvariance in Y scores by knowing a relationship, it means that?
We are on average, 65% more accurate at predicting Y' scores than we would be if we did not know the relationship.
Main Digest in Texas
West's Texas Digest
Criterion Variable
a variable being studied in a correlational project, regarding the extent to which it is correctly predicted by one or more predictor variables
Independent Variable
a variable that is manipulated to determine its influence on the dependent variable
Left-skewed (negative)
mean is lower than the median; outlying cases are lower than the midpoint of the distribution
Rank biserial correlation
one variable is dichotomous (nominal) and other is ordinal ie. relationship b/w gender and functional ability
quota sampling
population numerical composition is maintained. data collected haphardly. ex study males in caf
sampling techniques
population, sample, representative - sample needs to represent the population, probability and non-probability
The absence of random assignemnt in any study allows for what?
potential confounding
Non experimental research
qualitative, correlation, archival
Likert scaling
question with the high number always indicating that more of the property being measured is present
replication
repeating of research study to determine if its finding extends to other participants and circumstances
longitudinal research
research in which the same people are re-studied and re-tested over a long period
stratified sample
sample drawn in such a way that known subgroups within a population are represented in proportion to their numbers in general population
Probability Sampling
sample is drawn in such a way that makes it probable that the sample is approximately the same as the population on the variables to be studied (SRS, systematic, stratified, cluster, multistage)
ordinal scale
scale indicating order or relative position of items according to some criterion
ratio scale
scale with equal distances between the points or values and with a true zero
convergent validity
the extent to which scores on the measure are related to scores on other measures of the same or similar construct
What value of "r" would yield the smallest Sy'(standard error)?
the highest numbered "r"
median
the middle score in a distribution; half the scores are above it and half are below it. (Myers Psychology 8e p. 041)
spatial imagery
the ability to manipulate a mental image of an object
ambivalence
the coexistence within an individual of positive and negative feelings
predictive validity
the construct validity is measured by examining the ability of the measure to predict a future behavior
Autonomy
the right or condition of self-government
Hybrid Treatises
treatises that has elements of a form book and a practice guide built in
Phi
used for summarizing bivariate (2*2) tables - it is a special case of correlation coefficient for interval variables calculated: (ad-bc)/√(a+b)(a+c)(c+d)(b+d)
Pearson product-moment coefficient (r)
used to correlate continuous data with underlying normal distribution on interval or ration scales. ie relationship b/w proximal and distal development in infants examined.
Social Networking Sites
used to gather useful information in understanding consumer decisions
Condition
variables that make the relationship different for types of units
quantitative variables
vary in the amount
Laboratory setting
when an experiment is conducted in strictly controlled conditions
omnibus surveys (piggyback survey)
when an organization "buys" 1 or 2 questions in a national survey conducted by a national polling firm
benchmarking
when companies use software programs to track and monitor a client's reputation almost on a daily basis
causation
when one event causes a second event
convenience sample
when researchers draw participants from the populations that are readily available to them
Voluntary Participation
without threat or undue inducement
3rd Marketing Research Step
Collecting Data
ratio
comparison measurement, eg scale of tests, height
Q-sort distribution
data collection method in which the subject is given 50-120 cards with statements on them and are told to sort them into categorical piles.
ratio data
data with an absolute 0. Ratios are meaningful. (Length, Width, Weight, Distance)
primary source
first hand reports of facts or findings; in research, original report prepared by investigator who conducted study
External sources of secondary data
government publications, periodicals, CNN, Lexis Nexis, U.S. Census
coefficient of determination
r2
operational definition
statement of procedures used to define research variables which helps to enable replication
operational definition
statement that describes how to measure a particular variable or define a particular term specifically in a study
Symmetrical
values are equally distributed on each side of the midpoint
operational definition
a statement of the specific methods used to measure a variable; a detailed explanation of the variable
Operationalism
a theory must be quantitatively defined; the conditions in which it was measured should be included
pilot study
a trial run of the experiment
Every measure is comprised of:
a true score - the real score on the variable, and measurement error
psychobiography
a type of case study in which the life of an individual is analysed using psych theory
Mean
average, the sum of the values divided by the number of units
Types of manipulations
Straightforward: manipulate variables with instructions and stimulus presentations; Staged: staging events that occur during the experiment in order to manipulate the independent variable successfully
Political executives
Those officials, usually but not always in the executive branch of a government, who are at the center of foreign policy-making and whose tenures are variable and dependent on the political contest for power.
theoretical sampling
in qualitative studies, selection of sample members based on emerging findings to ensure adequate representation of important theoretical categories
deception
in research, method by which participants are misinformed or misled about study's methods and purposes - must be told truth about this in debriefing
MLA style
paper formatting and citation system used by most English and humanities classes
method is written in
past tense
accessible population
population of ppl available for particular study--often nonrandom subset of target population
sideways px
population standard deviation symbol
PET
positron emission tomography
discussion is written in
present tense
quandary
a state of perplexity or uncertainty
Ethology
The comparison of animal and human behavior.
Dependent Variable
The consequence or effect caused by manipulating the independent variable
Mode
The most frequently occurring score in a set of scores
non-experimental research
attempts to descrie variables. looks at variables as they exist naturally, identify correlations btw variables by comparing
THe defining formula for the Pearson correlation coefficient shows that it is the?
average correspondence of paired X and Y z-scores
maximum variation sampling
sampling approach used by qualitative researchers involving purposeful selection of cases with wide range of variation
Probability Sampling design
sampling design most commonly used in qualitative research
Visual Analog scale
scale that rates the amount of sensation experienced on a 100mm long line. Score is derived by measuring distance from end of the line to the subjects mark.
Frequency distribution
shows the distribution of how much there is of items
mortality effect
the drop out factor in experiments
mortality
the dropping out of some subjects before an experiment is completed
Statistical inference
the educated guess as to the population's numerical characteristics is called a statistical inference
interaction
the effect that an IV has on the DV depends on the level of the other IV
appease
to bring to a state of peace, quiet, ease, calm, or contentment; pacify; soothe
multielement design
Design in which baseline period is followed by a second phase in which 2 IVs are administered, and the more effective IV is continues to phase 3
Reversal Design
Design in which to verify the effect of the IV by reversing responding to a level in a previous level
Levels of analysis
Different perspectives (system, state, individual) from which international politics can be analyzed.
Assimilatory
Distorting observations in the direction of identity with previous input or data (looking for regularities)
Enhancement of contrast effect
Distorting observations into clear-cut entities or categories
Central Tendency
Distorting observations of extreme events toward a middle ground
What do courts use as their filing systems
Docket Numbers
Event Recording
Documents individual occurrences of a response or stimulus during an observation period
Basic research
Research that tests or refines theory; not designed to be applied immediately to practice.
quasi-experimental research
Research with a more reasonable level of control in comparison to experimental and may even require no manipulation at all
Inferential statistics
Statistics that use mathematical procedures to measure and make judgments about how likely it is that the results are obtained in an experiment came about by chance
Inferential Statistics
Statistics used to make judgements about whether the results for a sample would be the same for the population - how likely the results occurred by chance
obscuring variables
They are factors which make changes in the dependant variable hard to observe and also cause increased measurement error and more noise in the data
Bonferroni technique
This method is used to insure that the overall experiment wise error rate does not exceed a=.05. Reduces the likelihood of a Type I error.
Mean
average of all scores (X). Add all scores together and divide by the number of subjects (N). Used for interval and ratio data. Most common measure for central tendency.
Slope equation
b
block randomization
control procedure in wich the order of conditions is randomized but with each condition being presented once before any condition is repeated
independent variable
controlled by the researcher, experienced by the control group, this is what the researcher thinks will HAVE an effect on some other behavior
Mean
The arithmetical average of all individual scores in a set of scores
types of validity
face, content
independent variable
one that is maipulated
Practice Guides
tells you what steps you have to take to achieve something (like a cookbook)
Y intercept
value of Y when it corsses the Y axis
Web/E-mail surveys
(1) large samples in short amount of time (2) more economical than mail or questionnaires (3) data can be analyzed continually
mail questionnaires
(1) researchers have more control of who gets them. (2) large geographic areas can be covered economically. (3) less expensive to use a paper-base. (4) large #s of people can be reached at minimal cost
In-home interview
(door to door) a personal interview that takes place in respondent's home
Power pole
An actor in the international system that has enough military, economic, and/or diplomatic strength to often have an important role in determining the rules and operation of the system. They have generally beeneither (1) a single countryorempire or (2) agroup of countries that constitute an alliance or bloc.
Baseline
Condition of an experiment in which IV is not present; data obtained during baseline is basis for determining effects of IV.
Trustworthiness of Data
Credibility (triangulation), Dependability (stability of findings), Conformability(inquiry audit trail), Transferability (thick description), Authencticity( portray-mood, feelings)
Nonprobability Sampling design
sampling design most commonly used in quantitative research
2nd Marketing Research Step
Designing the research projects
Discriminant validity
Extent to which scores obtained from one procedure are not correlated with scores from another procedure that measures OTHER variables or constructs.
Hawthorne Effect
If participants are aware they are part of an experimental group they may simply improve because of that fact
Reporters are published
In Hard Bound Volumes
Positive correlation
Indicates that two variables share a relationship to one another that occurs in the same direction. Thus, as one variable increases the other variable also tends to increase. For example, as the amount of exercise an individual performs increases, fitness level also tends to increase.
Operational reality
The process by which what is perceived, whether that perception is accurate or not, assumes a level of reality in the mind of the beholder and becomes the basis for making an operational decision (a decision about what to do).
Experimental group
The subjects in an experiment who are allocated the independent variable which is changed or manipulated in order to observe its effects on their behaviour or experience.
Guessing
The subjects tendency to guess when in doubt about the answer to an item. Control by instructing to or not to guess or by using a correction formula
Independent Variable
The variable that is systematically manipulated to see whether changes in the IV produce reliable changes in the DV
Regression coefficient
Y' = a + bX is the regression equation, b is the regression coefficient. When the regression line has been positioned within the data points of a scatter diagram, b simply indicates the slope of the line.
construct validity
a test that the measurements actually measure the constructs they are designed to measure but no others
Systematic replication
based on an extensionof theory, most common type, ex if this theory is correct the following should happen
access date
date a researcher retrieves info from a computerized source
Majority
how cases are decided (majority Opinion)
Mode
most frequently occurring score; used for nominal data.
Criteria for a theory
must be emperical, explain known facts, and stimulate further research
critical thinking
thinking that does not blindly accept arguments and conclusions. Rather, it examines assumptions, discerns hidden values, evaluates evidence, and assesses conclusions. (Myers Psychology 8e p. 024)
American Law Reports
this is a mixture of a whole bunch of things, it is more complex
Cross Sectional Research
"cohort design" based on independent group comparisons among samples who have reached different stages of development at the time the study is conducted
observer consistency
%; agreement w/ kappa statistic; inter/intra observer
phonologically plausible
(like kids spelling) fabric > phabric; cabin > kabbin
Descending Trend
A decreasing data path
objective data
Data verifiable by others
Literature review strategies
Find a focus - organize around an idea, Construct a working thesis statement, Organize: Basic categories include: Introduction Body Conclusions Organizing the body methods include: Chronological, Thematic, Methodological
Where do we find cases?
In Reporters
Generalization
Is the result of the experiment useful or concrete enough to be shared with the population
What is the importance of linear regression?
It is used to predict a individual's unknown Y score based on his/her X score from a correlated variable. Usually more external validity and more accurate description of the relationship.USed to predict unknown Y scores based on X scores from correlated variable.
Parenthetical citation
MLA in text- citation typically consisting of the source author's name & a pg. no. or in the case of no author, a key word from the title
Descriptive statistics -
Mathematical techniques for organizing, summarizing, and displaying a set of numerical data.
Types of purposive sampling
Maximum variation, extreme/deviant case, and typical case sampling
Permanent Product
Measuring a behavior after it occurred by measuring it's effects on the environment
Meta Analysis
Method designed to increase the reliability of research by combining and analyzing the result of all types of the same product.
Are CJS & Am Jur National or Federal?
National
The States' system for Reporters is called
National Reporter System
Does official mean better in researching cases
No
Is a court ever bound by their own prior decisions
No
Experimenter effect
Occurs when the unconscious expectations, personal characteristics or treatment of the data by the experimenter may adversely affect the dependent variable which may bias the experimental results. This may occur when the experimental and control groups are treated differently.
Participant
Person selected to take part in a research study or experiment
Hazards of presentations
Poor Introduction, Equipment Failure, Missing Materials, Lighting, Hecklers, Late Returners
Frequency
Ratio of count per observation time
range
difference between highest and lowest scores in a distribution.
Primary Data
observed and recorded directly from respondents
physiological measures
recordings of responses of the body
Experiment Question
A statement of what the researcher seeks to learn by conducting the experiment
branching items
answer different question sets based on prior answers ex drinking portion on a health questionnaire
What is the range of a coefficient?
0-+/-1.0
stimulus presentation rate
14 items/min to 60 items/min in 5 studies reviewed
qualitative research
asks questions regarding how people make meaning out of the world
ANOVA
analysis of variance- a test for the significance of differences among three of more means; parametric
Statistical Interpretation
analysis of what is typical or deviates from the average
Y intercept equation
a=mean of Y- (b) (mean of x)
apathy
absence or suppression of passion, emotion, or excitement
Degrees of Freedom
based on # of subjects and # of groups; allows determination of level of significance based on consulting appropriate tables for each statistical test.
simple random sampling
basic probability sampling involving selection of sample members from sampling frame through completely random procedures
Digests
contain short summaries of points of law found in cases
qualitative data
can be descriptions, words, meanings or pictures which provides information about what is being studied.
manipulation check question
did you notice anything.....? If they don't mention your IV, your IV did not effect them
Population
"universe," includes all elements, units, or individuals of interest in a specific study
telephone surveys
(1) feedback is immediate (2) more personal form of comm. (3) less intrusive than door-2-door. (4) response rate can be higher
Confidence interval
(I-alpha) The confidence interval is the probability of correctly concluding that there is no-treatment effect
good questionnaires
(also applies to an interview) have a purpose/objective (big research question operationalized), short and sweet (solicit essential info only), directions are clear and explicit, include conditional information prior to key ideas (in directions), include transitions between sections, reliable, types of questions, vocabulary, questions short & concise (20 words or fewer), positive slant, consistent response formats within a section, edit questions, clear/specific/objective/forthright, avoid assumptions, avoid leading questions (suggest a right answer), avoid loaded questions (volatile, emotional), avoid double barreled (two questions at once), avoid insulting
Random Sampling
(probability) all units in a population have an equal chance of appearing in the sample
Stratified Sampling
(probability) the population of interest is divided into groups according to a common attribute, and a random sample is then chosen within a group
How high does a coefficient have to be in order to be considered reliable?
+.80 or higher
Probability sample
, if each member of the population has at least some chance of being included in the sample, if the probability of any member of the population being drawn is known, the resulting sample is referred to as a probability sample. The four types of probability samples that we will consider are called simple random samples, stratified random samples, systematic samples, and cluster samples (allprobability samples
Non-participant observation
- A scientific research method in which the researchers endeavour to conceal their presence when recording their observations.
Sample
- A subset of the population that is used for research purposes.
Null hypothesis.
- A testable prediction that there is no evidence that the treatment has an effect. Thus, any difference between the experimental and control groups is due to chance. If one rejects the null hypothesis, they accept the experimental hypothesis. One cannot accept the null hypothesis
ANOVA
- Analysis of Variance is a Macro level Analysis of difference among or between 2 or more groups.
Experimental condition
- The condition in an experiment which contains the presence of the independent variable.
Experiment
-A method of data collection used to systematically measure the relationship between variables which have been operationalised in an hypothesis.
Low correlations
0.00 to 0.25, 0 means no correlation
Alpha levels (preselected level of statistical significance)
0.05 or 0.01; indicates expected difference is due to chance ie. 0.05, only 5 X out of 100 or 5% chance. P value. Allows rejection of null hypothesis; there are true differences on the measured DV.
If we plot a scatterplot, and the data points form a shape that appears to be random dots and is far from forming a slanted straight line as possible, the correlation for the data is?
0.0: there is no relationship
Moderate correlations
0.51 to 0.75
Waht are some of the limitations whe using Depth Interviews?
1) Bias becasue of interactions 2) Cooperation is essential 3) May not be truthful 4) Technique may compromise data
External Validity of Research "Generalizability"
1) Explicit descrition of treatment 2) Multiple treatment interfernece, 3) Hawthron effect, 4) Novelty and disruption effects 4) Experimeter effect, 5) Pretest sensitization, 5) Measurment of dependent variable.
Threats to Internal Validity
1) History 2) Maturation 3) Testing 4) Instrumentation 5) Statistical Regression 6) Differential Selection 7) Experimental Mortality 8) Selection-Maturation Interaction 9) Experimental Treatment Diffusion 10) Compensatory Rivalry by Control Group- John Henry Effect 11) Compensatory Equalization Diffusion 12) Resentful Demoralization of the Control Group
Characteristics of a Good Research Question:
1) It elicits an explanation or description, not an answer 2) It links contructs & suggests associations or relationships 3) It can be addressed w/ empirical evidence 4) It is focused and feasible
What are the four types of Case Study Designs
1) Single case-holistic 2) Single case embedded 3) Mutiple case-holistic 4) Multiple case-embedded
When are case studies used?
1) The reasercher has little control over the events 2) The focus is on contemporary phenomenon within some real life context 3) "How" and "Why" questions are posted.
What are the three types of Depth Interviews
1) Unstructured-social conv-allows preliminary issues to surface 2) Semi Structured-Reseacher guides sequence, questions, probes. 3) Standardized structured-generally quantitative, tightly controlled, response options, no conversation
Defining Characteristics of Experimental Research
1) change x & observe y 2) control as many variables as possible, manipulate 1 to yield causation 3) results are interpreted as "true" within a certain degree of probability
Steps in the Research Process
1) select topic, 2) focus question, 3) design study, 4)collect data, 5) Analyze data, 6)interpret data, 7) inform others
A-B Design
2 phase experimental design consisting of a pre-treatment baseline condition (A) followed by a treatment condition (B),
Research Ethics
3 Principles: Beneficence, Respect, Justice 6 Norms: Valid Research Design, Researcher Competence, Identify Consequences, Appropriate Sample Selection, Voluntary Informed Consent, Inform Participants whether harm will be compensated
A-B-A Design
3-phase design consisting of initial baseline phase (A) until steady state (B) implemented until behavior has changed and steady state, return to baseline (A) by withdrawing IV (B)
Comparisons of central tendency
4-5 categories of the DV, one uses a comparison of central tendency - a table showing the mean or median value of Y for each category of X
What % of what % of we learn is from what we see and hear
50%
What % of what we learned is by sight?
87%
Crisis situation
A circumstance or event that is a surprise to decision makers, that evokes a sense of threat (particularly physical peril), and that must be responded to within a limited amount of time.
Integrity
A commitment by the researcher to the search for knowledge, to recognised principles for conducting research and in the honest and ethical conduct of research (including reporting)
Foreign policy process
A concept that includes the influences and activities within a country that cause its government to decide to adopt one or another foreign policy.
Political culture
A concept that refers to a society's general, long-held, and fundamental practices and attitudes. These are based on a country's historical experience and on the values (norms) of its citizens. These attitudes are often an important part of the internal setting in which national leaders make foreign policy.
Control condition
A condition in an experiment used as a baseline or comparison with the experimental condition involving the treatment variable. Thus, subjects experiencing the control condition should be identical in characteristics and experience similar standardised conditions to those experiencing the experimental condition; however they should not experience the independent variable.
Conclusion.
A decision made by the researcher about whether the hypothesis was supported based on the results obtained in an experiment
Ethnography
A description and interpretation of a culture, social group, or system.
factorial design
A design in which all levels of each independent variable are combined with all levels of the other independent variables. Allows investigation of the separate main effects and interactions of two or more independent variables.
Literature review
A detailed discussion of how your research fits into the existing body of research on the subject
Dependent variable (DV)
A factor or characteristic of a subject's behaviour or experience that can be observed or measured as being changed in some way as a result of being manipulated by the independent variable. This measure is obtained to test the outcome of the experiment.
Variable
A factor pertaining to the property of an individual or object that can alter in amount or kind and can be measured.
Placebo
A fake treatment
placebo
A fake treatment often used in medical research in the form of sugar tablets or injections. It has no medical or pharmacological effects. It is often used as a control condition in experiments, to counter the effect of subjects knowing they have taken something.
Random sampling
A form of allocating subjects from the population of interest to form part of the sample in such a manner that each member of the population has an equal chance to be selected. One method of doing this is using random number tables of selection. If the sample is of sufficient size, it is usually representative of the population.
Scatter diagram (scattergram; scatterplot)
A graphical representation of the strength and the direction of the relationship between variables.
T test
A mathematical procedure that involves a comparison of the means of two groups or treatment conditions to establish statistical significance.
psychological test
A measuring device or procedure designed to measure psychology-related variables. A measurement that results in a score or result that is standardized
Stratified sampling
A method of subject selection used to attempt to prevent biases by making the sample more representative of the population. It involves identifying some of the factors (strata) present in the population such as age, sex, or income level and then selecting a separate sample from each stratum in the same proportions.
Subject
A participant in an experiment.
Operational code
A perceptual phenomenon that describes how an individual acts and responds when faced with specific types of situations.
Authoritarian government
A political system that allows little or no participation in decision making by individuals and groups outside the upper reaches of the government.
Null Hypothesis
A predicted where there is no relationship between variable being studied - it is made to be disproved
Operational Hypothesis
A prediction of how the variables being studied will be manipulated, observed and measured as well as the population from which the sample was taken
Interest group
A private (nongovernmental) association of people who have similar policy views and who pressure the government to adopt those views as policy.
Unofficial reporters are published by
A private Company
Significant
A probability value considered rare in the sampling distribution, specified under the null hypothesis where one is willing to acknowledge the operation of chance factors. Common significance levels are .01, .05, .10.
p value
A probability value that shows the statistical level at which chance is likely to have operated on the results obtained from research
Random Allocation
A procedure for assigning participants to the various groups in an experiment which ensures that participants have an equal chance of selection to each group
Dichotomous
A property or variable for which the units are classified into just one of two categories
Leadership capabilities
A range of personal job skills including administrative skills, legislative skills, public persuasion abilities, and intellectual capacity that affect the authority of political leaders.
Heuristic devices
A range of psychological strategies that allow individuals to simplify complex decisions. Such devices include evaluating people and events in terms of how well they coincide with your own belief system ("I am anticommunist; therefore all communists are dangerous"), stereotypes ("all Muslims are fanatics"), or analogies ("appeasing Hitler was wrong; therefore all compromise with aggressors is wrong").
Independent-groups design
A research design in which subjects are randomly allocated to groups and it is assumed that relevant variables are balanced between the groups. This makes it equally likely for an individual to be in the experimental or control group.
Matched-subjects design
A research design involving the placement of equivalent pairs of subjects into each group, matched on relevant characteristics such as gender, intelligence scores, age. Subjects are paired on variables which, if not controlled, may have a confounding effect on the research.
Direct observation
A research method involving investigating overt or directly measurable behaviour through the process of watching and recording it as it occurs.
Correlational method
A research method that identifies and describes the relationship between two variables, events or measures.
Observation
A research method that involves watching and describing behaviour as it occurs
Experiment
A research methods used to test a hypothesis under controlled conditions in order to measure effects of an IV on a DV
Emergent design
A research plan in which each step depends on the results of the field data obtained in the previous step.
Meta-Analysis
A research procedure that uses statistical techniques to synthesize the results of prior independently conducted studies.
force scale
A scale which measures the intensity or strength of a behaviour
topography scale
A scale which measures the shape and style of the behaviour
locus scale
A scale which measures where in the environment the behaviour occurs
latency scale
A scale which records the amount of time between an instruction and when the behaviour is atually performed
Observation
A scientific research method which involves watching and recording behaviour as it occurs in a clinical or naturalistic setting.
Participant observation
A scientific research the study; analysing the data; communicating the method in which the researcher watches and records the behaviour to be observed while engaging in the activity themselves in the hope of being mistaken by the subjects as a member of the activity
Scientific method
A series of orderly steps on clearly defined goals, objectivity and to obtain empirical evidence. are: preparing the study; conducting research reporting findings; and replicating or repeating the study.
Scientific Method
A series of orderly steps which are followed in conducting and reporting scientific research
Ethics
A set of moral principles and practices that have been used by psychologists to provide guidelines relating to what is acceptable conduct in terms of right or wrong that researchers follow when considering using humans or animals as research subjects.
Hegemonic power
A single country or alliance that is so dominant in the international system that it plays the key role in determining the rules and norms by which the system operates. As the dominant power in the system, it has a central position in both making and enforcing the norms and modes of behavior.
Hypothesis
A statement asserting that specific variation in one property results in or causes specific variation in the property we are seeking to explain.
Correlation
A statistical measure of the strength and direction of the relationship between two variables, events or measures that occur together so that changes in one are accompanied by changes in the other. It is not a causative measure, meaning that it does not explain the reason behind a relationship between two variables.
Multiple regression
A statistical procedure for determining the magnitude of the relationship between a single dependent variable and 2 or more independent variables. (Regression is used to either predict or explain.)
Test of significance
A statistical test used to determine whether the mean scores of two groups differ significantly.
Sample
A study group which is selected from the population for allocation to the experimental and control groups
Historiography
A study of the procedures that different historians use in their research; also a study of the changing revisions and interpretations of the past.
Replication
A study that duplicates the findings of a prior study using different participants, settings, or techniques.
Sample
A subsection, or smaller group, of research participants selected from a larger group(population) of reseach interest.
Contingency Question
A survey question intended for only some respondents, determined by their responses to some other question. p279 for example
Horizontal authority structure
A system in which authority is fragmented, like the international system.
Vertical authority structure
A system in which subordinate units answer to higher levels of authority.
Scientific Method
A systematic approach to acquiring knowledge
Delphi Technique
A technique which uses a series of self administered questionaires and feedback to obtain the opinion of experts in a field of interest.
Double-blind study
A test in which neither the experimenters or subjects are aware of which subjects have been allocated to the experimental group.
split half reliability
A test is divided into 2 halves and scores on the halves are compared to see if test is consistent within itself. Ex. compare odds & evens
Chi square
A test of statistical significance when the research data are in the form of frequency counts for two or more categories.
Confounding Variable
A variable that is uncontrolled and allowed to change together with the IV, thereby having an unwanted effect on the DV
Independent Variable
A variable which is manipulated or varied by the experimenter in order to measure its effect on the DV
Dependent Variable
A variable which shows any effects of the IV; the observed or measured response of the participants
Poliheuristic theory
A view of decision making that holds it occurs in two stages. During the first stage, nonrational considerations such as how an issue and the response to it will affect a decision maker's political or professional future are applied to narrow the range of choices. Then in the second stage decision makers use strategic considerations and other rational criteria to make a final policy choice.
A-B-A-B Design
A-B-A design with addition of second intervention phase to see if initial treatment effects are replicated
A-B-A-B Design
A-B-A design with addition of second intervention phase to see if initial treatment effects are replicated,
Abbreviation for American Law Reports
ALR
Non-probability sampling designs
Accidental sampling, quota sampling, and purposive sampling
Hypothesis testing:
Allows us to use sample data to test a claim about a population, such as testing whether a population proportion or population mean = some #. EX: is the true avg amount that students spent weekly on alcohol $20
How are Legal Encyclopedias Organized
Alphabetically by topic, further subdivided into sections
Types of Outlines
Alphanumeric, Full Sentence, Decimal
Opportunity sampling
Also called convenience sampling. Participants are selected from groups that are readily available
Abbreviations for the 3 Legal Encyclopedias
Am Jur, Tex Jur & CJS
3 Legal Encyclopedias
American Jurisprudence 2nd Edition, Texas Jurisprudence 3rd edition & Corpus Juris Secundum
Analytical research
An analysis of documents to investigate historical concepts and events.
State-level analysis
An analytical approach that emphasizes the actions of states and the internal (domestic) causes of their policies.
System-level analysis
An analytical approach that emphasizes the importance of the impact of world conditions (economics, technology, power relationships, and so forth) on the actions of states and other international actors.
Individual-level analysis
An analytical approach that emphasizes the role of individuals as either distinct personalities or biological/psychological beings.
Homodasticity
An equal spread of Y scores around the regression line (that is the values of Y')
Single-blind study
An experiment in which subjects are unaware of the experimental or control condition to which they have been assigned. This reduces the likelihood of the Hawthorne effect occurring.
Small N and Single Research
An experiment with just an manipulation group, no comparison group.
Experimental Design
An experiment's specific procedures for data collection, particularly the types of groups used - independent groups, matched participants & repeated measures
Double-blind procedure
An experimental procedure where both the experimenter and participant are unaware of the experimental conditions
case study
An in-depth, intensive investigation of an individual or small group of people which involves interviews and personal interpretations by the experimenter. It may also be supplemented with psychological or medical tests
Ascending trend
An increasing data path
Correlation coefficient
An indication of the strength and direction of a correlation between two variables. It ranges from -1.00, indicating a strong negative relationship to, + 1.00, indicating a strong positive relationship. 0.00 indicates no correlation. Furthermore, a correlation level of 0.05 is needed in order to consider a correlation as being moderately strong, an indication of statistical significance.
Experimenter bias
An unconscious expectation of the experimenter which may influence their observations of data.
Confounding variable
An unwanted factor occurring in the procedures, experimenters or subjects in an experiment that has an effect on the dependent variable, along with or instead of the dependent variable.
Discontinous Measurement
Any form of measurement in which some instances of the response class may not be detected
Adjusted means
Any group with an above-average mean on the covariate has it's mean on the dependent variable adjusted downward, while any group with a below-average mean on the covariate has its mean on the dependent variable adjusted upward. These adjusted means constitute the best estimates of how the two groups would have performed on the dependent variable if they had possessed identical mean on the control (i.e. covariate) variable(s) used in the study.
Placebo effect
Any observed change in functioning or behaviour that is 'caused' by a placebo, where there is a demonstrated difference between those taking the placebo treatment and those offered no treatment.
Extraneous variables
Any potential independent variable that is of no direct interest to the researcher, but may have an effect on the dependent variable. The two types of extraneous variables are controlled and uncontrolled variables.
Generalisation
Applying the results for a sample more widely to the population from which the sample was drawn
In general a positive relaitonship means that?
As one variable increases the other variable also increases
Informal powers
Authority to act or to exert influence that is derived from custom or from the prestige within a political system of either an individual leader or an institution.
Formal powers
Authority to act or to exert influence that is granted by statutory law or by the constitution to a political executive or to another element of government.
Rules for writing well (the 6 C's)
Be Correct, Clear, Coherent, Concise, Cautious, Creative
Form Book
Book that has forms
Professional literature
Books, publications, or journals with regular research; the primary source of explanations for more empirical research
Are reporters official or unofficial
Both
aggrammatism
Broca's aphasics show evidence for selective loss of closed class words while retaining open class
Types of Primary Authority
Case Opinions, Statutes, Codes, Agency Regulations, Constitutions, Ordinances, Treaties
Examples of Primary Authority
Cases, statutes, constitutions
Reporters are organized
Chronologically
Event sampling
Collecting data from subjects based on an event that is happening.
Time sampling
Collecting data from subjects based on the time of day, week, etc.
Define the Pearson correlation coefficient
Corelation coeffieccient that describes the strength and type of a linear relationship between interval and ratio variables, symbolized by r.
Existing data
Data collection method which entails collecting data that has already been gathered (health records, historical research, secondary analysis (data from previous study), and meta-analysis (combining data from several studies)).
Qualitative
Data in non-numerical form about the characteristics of what has been studied.
Quantitative
Data in numerical form.
Subjective data
Data obtained by self-report measures in which subjects give verbal or written responses to a series of research questions.
Objective data
Data that has been gathered using systematic observation which is not influenced by any personal bias.
Quantitative Data
Data that is obtained by questionnaire, self-report or observation
Interaction
Deals with the cell means, not the main effect means in a two-way ANOVA. Interaction exists to the extent that the difference between the levels of the first factor changes when we move from level to level of the second factor.
Undoing Deception
Debriefing, Dehoaxing, Guarding Privacy & Confidentiality of Participants, Obtain fully informed consent
Keys to a Successful Presentation:
Define Objectives, Know Your Audience, Organize Your Presentation, Develop Visual Aids, Address Your Delivery, Develop Your Q&A, Check Out Your Environment
establish cause and effect
Demonstrate a directional relationship between the variables; demonstrate that a change in one variable causes the change in the other variable. How? Manipulate one variable and measure the change in a second variable while controlling extraneous variables (any other variables within the situation we are studying)
Single Subject research designs
Demonstrate experimental control within a single subject
2 basic strategies of scientific research
Describe the relationship (descriptive designs & Correlational design), Explain the relationship (quasi-experimental designs & experimental design)
what does Sy2 refer too?
Describes the error variance when using regressinon to predict Y scores, measures error in prediction.
Withdrawal design
Design in which an effective treatment is withdrawn to promote maintenance of behavior
Changing Criterion Design
Design in which baseline is followed by phases of successive and gradually changing criteria
Closed-ended questions
Dichotomous question (yes or no), multiple-choice question, "cafeteria" question, rank ordered, forced-choice, and rating questions.
selection differences
Differences in the type of subjects who make up each group in an experimental design; this situation occurs when participants elect which group they are to be assigned to or when participants who form the two groups are chosen from existing natural groups
Leader-citizen opinion gap
Differences of opinion between leaders and public, which may have an impact on foreign policy in a democratic country.
Ineffective/effective purpose statment: This purpose of this report is to describe the main causes of traffic congestion in Seattle
Effective: leaves no doubt about the reporters main purpose
cohort effects
Effects of being born and raised in a particular time or situation where all other members of your group has similar experiences makes your group unique from others
Observational bias'
Enhancement of contrast effect, central tendency, assimilatory, halo effect, error of severity
Justice
Ensuring the fair distribution of benefits and burdens with the population of interest and well as for any research participant
Two different states, do not have to follow what each other says
Exceptions: Conflicts of Law or Full Faith and Credit
Criterion validity
Extent to which a procedure correlates with a behavior.
Predictive validity
Extent to which a procedure is correlated with future behaviour
Concurrent validity
Extent to which a procedure is correlated with present behaviour
Validity
Extent to which data from measurement are relevant to the target behavior and to the reason for measuring it
Convergent Validity
Extent to which scores obtained from one procedure are positively correlated with scores obtained from another procedure that is already accepted
construct validity
Extent to which scores suggest that a test is actually measuring an ABSTRACT theoretical idea (such as anxiety, personality, introversion, etc.).
Qualitative data
Factual or descriptive pieces of information about the qualities of the characteristics or behaviours being measured.
1 US Court of Appeals Reporter
Federal Reporter
Self-report measures
Forms of gaining data which rely on spoken or written responses to questions posed by the researcher. Examples include interviews, surveys and questionnaires.
Theories
General explanations
External Validity
Generalizability of results to other people, times, places & circumstances than those studied, as relevant to the project's mission
Groupthink
How an individual's membership in an organization/ decision-making group influences his or her thinking and actions. In particular there are tendencies within a group to think alike, to avoid discordance, and to ignore ideas or information that threaten to disrupt the consensus.
Participant
Humans that participates in a study
research process
ID problem, develop research design, collect data, analyze results, interpret results
Using the PubMed database
Identify the key concepts in your research question. Example: Find citations about bronchodilators for treating asthma in children.The key concepts are bronchodilators, asthma and children Enter the significant terms into the search box. Press the Enter key or click Go
Mode
In a set of scores/measurements, the mode is the score that occurs most frequently. There may be more than one mode in any given set of scores.
Importance of visual aids
Increase Audience Interest, Focus Audience Attention, Induce Audience Participation, Reinforce Points of Emphasis, Increase Retention of Content
Elements of an experiment
Independent variable (IV), Dependent variable (DV), Experimental Control, randomization
Adjusted R2
Indicates the degree to which variability in the dependent variable is explained by the set of independent variables included in the analysis. Adjust R2 is always smaller than regular R2 , because the adjustment anticipates the amount of shrinkage that would be observed if the study were to be replicated with a larger sample
Subjective Data
Information based on self-reports given by participants
Tenacity
Information is accepted as true because it has always been believed, or because superstition supports it.
another term for r
Is the correlation coefficient
confounded variable
Is the result of the independant variable being manipulated and cannot be separtated from the results
Trial Court level, who hears case
Judge
Appeallate level, who hears case
Justice
Apellate Level has
Justices
Which Legal Periodical is most beneficial for research?
Law Reviews
Law Reviews are published by?
Law Schools 4 x a year in paperback format
Levels of Evidence (best study design)
Level 1 (A), Level 2 (B) Level 3 (B) Level 4 (C)-Level 5(D)
Individual RCT w/narrow confidence level; tx effects precisely defined
Level 1b (A)
All or none case series. In absence of RCT, overwhelming evidence of substantial tx effect following intro of a new tx. (vaccine)
Level 1c (A)
Systematic review of cohort studies, prospective.
Level 2a (B)
Individual cohort study or low quality RCT (small N)
Level 2b (B)
Systematic review case controlled studies
Level 3a (B)
Individual case-control study, retrospective.
Level 3b (B)
Case series, poor quality cohort and case control studies. Descriptive
Level 4 (C)
Qualitative Data Analysis
Long Table Approach-case study focus, group, interviews Content Analysis- Looking for patterns or themes. Coding can be used for both.
parenthetical citation
MLA in text citation typically consisting of the source author's name and a page number or in the case of no author, a key word from the title
Mean, Median, Mode
Measures of central tendency; determination of avg or typical scores.
Validity
Measuring what you aim to measure.
Percent Correct
Number of correct responses expressed as a number of parts per 100
Partial Interval Recording
Observation is divided into brief time intervals; observer records whether target behavior occurs at ANY TIME during interval
Repeated-measures design
One group undertakes both experimental conditions, the experimental condition and the control condition.
Voluntary Participation
Participants are not placed under any pressure or coercion to participate in the investigation
Types of Correlational statistical tests
Pearson-product-moment coefficient (r) Spearman's rank correlation coefficient (rho), (rss) Point biserial correlation Rank biserial correlation Intraclass correlation coefficient (ICC) Strength of relationships Common variance
percentile rank
Percentage of scores falling at or below a specific score.
Meaning of p Values
Power-ability to detect deviations from the null hypothesis; ex. .5% chance will detect statistical significance if it is present
Level of significance
Probability that an outcome is statistically significant
Face validity
Procedure is valid because it looks valid/Extent to which a measurement procedure appears to measure what it was intended to measure
Participant Allocation
Process of assigning participants to different groups
Participant allocation
Process of assigning participants to different groups (or conditions in a research study)
Placebo selection
Process of choosing participants (sample) from a larger group for research study
Participant Selection
Process of choosing participants from a larger group for a research study
Grounded theory
Qualitative procedures that are used to develop detailed concepts or conditional propositions for situations; also, summaries of facts.
Case study
Qualitative research that examines a bounded system over time in detail, employing multiple sources of data found in the setting.
Mixed method
Refers to a study that combines qualitative and quantitative techniques and/or data anaylsis within different phases of the research process.
Descriptive research
Refers to research that describes an existing or past phenomenon in quantitative terms.
Positive Correlation
Relationship between two variables in which a high rank on one is accompanied by a high rank on the other
Replication
Repeating of experiments to determine the reliability and usefulness of findings and determine mistakes
Scientific Structure
Report of Literature Search, Methodology/Techniques, Results, Interpretation/Discussion, Future Implications
A Graph
Representation of data in picture form
Quasi-experimental design
Research designs in which there is no random assignment of subjects.
within subjects design
Research done where conditions are tested within individual subjects and each subject recieves every manipulation
Longitudinal study
Research in which a sample of individuals is studied over a long time period.
Prediction study
Research in which behaviors or skills are predicted by one or several variables.
Difference between a literature review and a research paper
Research paper - supports your own argument. Literature review-summary and synthesis of the arguments and ideas of others
Phenomenological
Research that describes the meanings or essence of a lived experience.
Applied Research
Research that is technologically useful??,
non-experimental research
Research that looks at variables by comparing different groups of scores and uses less manipulation of variables than experimental research
Basic Research
Research to further our understanding of fundamental questions about the nature of the world.
Policy analysis
Research to investigate and formulate policies and programs.
Depth Interviews
Researchers use to elicit info about beliefs, perceprtions, values
Case Control Study
Retrospective (backward in time) study; group with similar condition compared with group that does not have condition to determine factors that might have played a role in the condition.
Counterbalancing
Reversing the order of presentation for half the participants so that fatigue and practice effects occur in different orders to 'balance' their effects
Slope
Rise over run" How many predicted units of change (either up or down) in the dependent variable there are, for any one unit increase in the independent variable.
Stratified random sampling
Sampling technique in which the population as a whole is divided into parts or 'strata' and each stratum has participants drawn from it.
Empirical evidence
Scientific research gathered using the direct method of systematic observation.
Observational locations
Single positioning, Multiple positioning, and Mobile positioning
1 Texas Region Reporter
South Western Reporter
The 3 step outline of a presentation
Step One: Tell them what you will tell them Step Two: Tell them Step Three: Tell them what you told them
Word association
Subject is told a series of neutral and emotionally laden words and asked to respond to each word with the first thing that comes to mind.
r
Symbol used for Pearson Correlation Coefficient ranges from -1.0 to +1.0
Normal distribution
Symmetrical bell-shaped curve indicating the distribution of scores; the mean, median, and mode are similar. 1/2 the scores are above the mean and 1/2 below.
Error of severity
Tendency for observers to rate everything negatively
Deviation
Tendency to give unusual answers. Control with a forced-choice format.
test-retest reliability
Test in which participants receive the same score when tested at different times
If a statute etc is in conflict with the constitution, who wins
The Constitution
What procedure would be used to find out whether there is a relationship between SAT scores and GPA?
The Pearson correlation coefficient
Generalisation
The applications of the conclusions based on the results obtained to other settings outside the study. Extending or applying the results for a sample more widely to the population from which the sample was drawn or another population
Two-level game theory
The concept that in order to arrive at satisfactory international agreements, a country's diplomats actually have to deal with (at one level) the other country's negotiators and (at the second level) legislators, interest groups, and other domestic forces at home.
Reliability
The consistency and stability of the results obtained from a research study
Define the Spearman Rank order coefficient
The correlation coefficient that describes the linear relationship between pairs of ranked scores (ex: any two ordinal variables OR tied rank variables, symbolized by Rs
Population
The entire group of individuals related to the problem of interest that the researcher is testing. A sample is drawn from the population
Withdrawal Rights
The experimenter informs the participants that they are free to participate, decline or withdraw from the research at any time without reason should they wish to do so
Operational hypothesis
The expression of a hypothesis in terms of how the researcher will determine the presence and levels of the variables under investigation; that is, how the experimenter is going to put their hypothesis into operation.
Social Validity
The extent to which target behaviors are socially appropriate and the extent to which significant changes are produced
Select a research strategy
The fifth step in the research process where you chose between experimental or nonexperimental approach
Research Idea
The first thing you do before starting a project which involves finding an idea that interests you or has unknown answers.
Observer bias
The interference of an observer's personal expectations, motives and prior experience which detracts from the accuracy their research.
Decision-making process
The manner by which humans choose which policy to pursue and which actions to take in support of policy goals. The study of decision making seeks to identify patterns in the way that humans make decisions. This includes gathering information, analyzing information, and making choices. Decision making is a complex process that relates to personality and other human traits, to the sociopolitical setting in which decision makers function, and to the organizational structures involved.
Sampling
The method used to select subjects for a study. Types of sampling include random sampling and stratified sampling.
Likert Scale
The most commonly used scale that is composed of a series of favorable and unfavorable statements that the subject indicated their degree of agreement or disagreement.
Hawthorne effect
The notion that subjects who are aware that they are participants of an experiment may behave according to what they perceive to be the experimenter's expectations. The improved performance may be attributed to this factor, rather than the influence of the independent variable.
Trend
The overall direction of a data path
Order effect
The potential impact on the results of the order in which an experimental task is completed by participants
Operational definition
The precise, comprehensive description of the concept to be measured in an experiment, and the procedures that will be utilised to measure that concept.
p value
The probability level which forms basis for deciding if results are statistically significant (not due to chance).
Random Sampling
The procedure for selecting a group of participants from a population that ensures each member has an equal chance of being chosen
Dependent property (variable)
The property we are seeking to explain
Head of government
The ranking official in the executive branch who is politically and constitutionally invested with the preponderance of authority to administer the government and execute its laws and policies.
Withdrawal rights
The right of experimental subjects to remove themselves from the research situation at any point they decide (such as when the experiment is seen by the subjects as causing too much personal discomfort or distress).
Systematic study
The scientific approach of carrying out and reporting research.
Idea to research hypothesis
The second stage in the research process were a prediction is made on the idea.
Representative Sample
The selected group must represent the individual differences that exist in the population.
Bivariate regression
The simplest kind of regression analysis. It has only 2 variables, one serves as the dependent variable and the other serves as the independent variable. The purpose of this kind of regression can be either prediction or explanation;
Experimental design
The structure of the experiment
Dependent Variable
The variable in an experiment measured to determine if it changes as a result of manipulations of the IV
Independent Variable
The variable that is determined or manipulated by the researcher
Dependent Variable
The variable that may change in response to manipulations of another variable.
Main effect F
There are three values in the F column of a two-way ANOVA. Each of the three F's addresses a different null hypothesis. The first two Fs deal with the two sets of main effect menas. The third F deals with the interaction between the two factors with the focus of this F being on cell means
cause and effect relationships
They are determined by manipulating the independant variable, measuring the dependant variable, and controlling all other variables
Biopolitics
This theory examines the relationship between the physical nature and political behavior of humans.
Uncontrolled variables
Those variables that have influenced the result as their presence was not accounted for (and removed) in the experimental method. Uncontrolled variables which cause a change in the value of the dependent variable are termed 'confounding variables'.
Latency
Time from the onset of a stimulus to the initiation of a response
The South Western Reporter has more than one series
True
Experimental Design
Type and sequence of conditions in a study so that comparisons of the effects of the presence and absence of the IV can be made
Case Report
Type of descriptive research in which only one individual is studied in depth, often retrospectively.
Systematic review, RCT, cohort study,homogeneity, case control study, case report
Types of Evidence and Research
T-test for independent sample, Paired samples; one tailed and two tailed T-tests.
Types of T tests
There are 6 reporters
United States Reporters, Supreme Court Reporter, United States Supreme Court Reports, Federal Reporter, Federal Supplement, South Western Reporter
The only official Reporter is
United States Reports
Quantitative
Units classified by degree or quantity
Qualitative
Units classified by type
3 Supreme Court Reporters
Untied States Reports, Supreme Court Reporter, United States Supreme Court Reports
Legal Dictionaries
Used to look up terminology, it is hard to look things up from context
Topic & Key Number System
West's key number system
Parallel Citations
When a case can be found in more than one reporter
Functional Relation
When a change in the DV is produced by systematic manipulations of the IV and the change unlidely to be result of other extraneous variables
Experimental Control
When a predictable change in the DV can be produced by the systematic manipulation of the IV
Median
When all scores in a set of measurements are arranged in order, the median is the middle score within the set.
Negative Correlation
When one variable increases, the other goes down on a scatter diagram
Experimenter Bias
When the experimenter shows bias in the collection and treatment of data
Experimenter Effect
When the experimenter's personal characteristics, actions or treatment of data affect the accuracy of results
Irreversibility
When the level of responding in a previous phase cannot be reproduced even thought conditions are the same
Statistically significant
When the likelihood of results (e.g. the difference in the mean scores for an experiment) being due to change factors is at an acceptably low level. In scientific research, a level of 0.05 significance is commonly used as a benchmark to gauge whether a difference obtained in the findings is truly due to the influence of the independent variable and not attributed to chance. A 0.05 significance level occurs when the probability of chance is 5 or fewer times in 100 repetitions of the research. Stricter probability values (p) of significance are sometimes employed, such as < 0.01 (less than 1 in 100); and p <0.001 (less than 1 in 1000).
Statistically Significant
When the likelihood of results being due to chance is at an acceptably low level (p<0.05)
Multiple positioning
When the observer chooses several locations to observe subjects from
Voluntary participation
Where subjects become a part of an experiment because they choose to do so. This choice is often based on being provided with some information as to the purposes, nature and procedures involved in the research design
Debriefing
Where the experimenter informs the participant of the purpose of the investigation at the conclusion of the research, including correcting any mistaken beliefs
experimental group
Where the independant variable is being manipulated
Confidentiality
Where the results of an experiment are not disclosed to other participants or the participants' details remain anonymous when reporting on the experiment
How is Y' pronounced
Y prime
visual analogue scale
___________ based on that line how much does it hurt?
Dissenting Opinion is written by?
a Justice that says the majority messed up
standard deviation
a computed measure of how much scores vary around the mean score. (Myers Psychology 8e p. 042)
random variable
a confounding variable in which uncontrolled factors affected the dependent variable along with or instead of the independent variable
Diaries
a daily diary log on an aspect of life over a period of time
Purpose statement
a declarative sentence which summarizes the specific topic and goals of a document. It is typically included in the introduction to give the reader an accurate, concrete understanding what the document will cover and what he/she can gain from reading it. To be effective it should be: specific and precise, concise, clear, goal oriented
Accuracy
a description of how close a measurement is to the true value of the quantity measured
naturalistic observation
a descriptive method in which the experimenter observes people in natural settings/ natural social settings
independent groups design
a different group of participants will be assigned to each of the four conditions
Questionnaire
a document containing questions and other types of items designed to solicit information appropriate for analysis. Used primarily in survey research but also in experiments, field research, and other modes of observation
multistage sampling
a form of cluster sampling in whcih clisters are further broken down by taking samples from each cluster
Secondary Analysis
a form of research in which the data collected and processed by one researcher are reanalyzed by another. Especially appropriate in the case of survey data.
MIS
a framework for the management and structuring of information gathered regularly from sources inside and outside of an organization
scatterplot
a graphed cluster of dots, each of which represents the values of two variables. The slope of the points suggests the direction of the relationship between the two variables. The amount of scatter suggests the strength of the correlation (little scatter indicates high correlation). (Also called a scattergram or scatter diagram.) (Myers Psychology 8e p. 031)
Scatter plot
a graphic presentation in which a dot represents the X and Y value of each unit
cohort
a group of people - here refers to a group of people born about the same time
biased sample
a group of research subjects selected froma population whose members did not all have an equal chance of being chosen
random sample
a group of subjects selected froma population whose members all had an equal chance of being selected
Two-tailed test
a hypothesis that does not specify a direction. For example, if your hypothesis is that your program or intervention will have an effect on an outcome, but you are unwilling to specify whether that effect will be positive or negative, you are using a two-tailed hypothesis.
One-tailed test -
a hypothesis that specifies a direction; for example, when your hypothesis predicts that your program will increase the outcome.
Sample
a limited number of units to represent the characteristics of total population
Reliability
a measure of consistency
Pearson product-moment correlation coefficient
a measure of how well the regression equation fits the data
dependent variable
a measure of the behaviour of the subject on one of several different dimensions
correlation
a measure of the extent to which two factors vary together, and thus of how well either factor predicts the other. The correlation coefficient is the mathematical expression of the relationship, ranging from -1 to 1. (Myers Psychology 8e p. 030)
Asymptotic standard error
a measure similar to standard deviation , measures how much dispersion one would expect in correlation coefficients - no association
In vitro measurement
a measurement that is extracted from a subject and then conduct lab tests
In vivo measurement
a measurement that is made directly in or on a subject
median-median line
a method for calculating the line of best fit using the median
least squares method
a method of calculating the line of best fit using the distance each point is from the line of best fit
Stratified Sampling
a method of sampling in which the population is subdivided according to one or more stratification variables before the sample is selected, each subdivision of the population is represented by a corresponding subdivision in the sample
Non-response bias -
a mid-stream mini-study done to see whether a non-response bias exists to get a feel for whether less-than-perfect response rates will restrict the desired level of generalizability.
Ordinances
a miniature statute for a city or a county
Beta weight
a multiplier term added to each predictor variable in a multiple regression equation after the predictor variables have been converted to standard score form.
Pearson chi square (X2 )
a nonparametric test of statistical significance that is used when the research data are in the form of frequency counts for two or more categories.
syntactic positive shift
a positive shift in the ERP waveform after the syntactic violation
What does the symbol Y' stand for
a predicted Y score. Our best prediction of the Y score at a corresponding X
hypothesis
a prediction stated as a testable proposition, usually in the form of an if-then statement
reactivity
a problem of measurement when being aware of being measured causes a change in behavior
Research Hypothesis
a problem statement derived from theoretical reasoning, prior data, or both; used for predicting associative or causal relations between variables
Cluster Sampling
a procedure in which intact groups rather than individuals are sampled
discrete variable
a quantitative variable whose values are countable
Intraclass correlation coefficient (ICC)
a reliability coefficient based on an analysis of variance
test-retest reliability
a reliability coefficient determined by the correlation between scores on a measure given at one time with scores on the same measure given at a later time; assessed by measuring the same individuals at two points in time
experiment
a research method in which an investigator manipulates one or more factors (independent variables) to observe the effect on some behavior or mental process (the dependent variable). By random assignment of participants, the experimenter aims to control other relevant factors. (Myers Psychology 8e p. 036)
Mail survey
a research method in which respondents answer a questionnaire sent through the mail
Online survey
a research method in which respondents answer a questionnaire via e-mail or on a website
Telephone survey
a research method in which respondents' answers to a questionnaire are recorded by interviewers on the phone
Focus group interview
a research method involving observation of group interaction when members are exposed to an idea or concept
quasi experiment
a research method that looks like an experiment BUT subjects are not randomly assigned to control and experimental groups (no cause and effect can be drawn)
Systematic Review (including meta-analysis)
a review in which the primary studies are summarized, critically appraised, and statistically combined; quantitative w/specific inclusion/exclusion criteria.
random sample
a sample that fairly represents a population because each member has an equal chance of inclusion. (Myers Psychology 8e p. 028)
Focus Group
a semistructured group interview procedure
Bar graph
a series of bars, one for each number of units or percentage of units in a category
Convenience Sampling
a set of individuals studied in a research project because they are conveniently available, without regard to whether they are representative of a population
coding system
a set of rules used to categorize observations
Summarize
a significantly shortened version of source material that captures main ideas in your own words
summarize
a significantly shortened version of source material that captures main ideas in your own words
secondary source
a source analyzing or commenting on a primary source
operational definition
a statement of the procedures (operations) used to define research variables. For example, human intelligence may be operationally defined as what an intelligence test measures. (Myers Psychology 8e p. 025)
Experimental Hypothesis
a statement that expresses a prediction about what the answer to a research question will be or an idea about the phenomenon being studied
correlation coefficient
a statistic (r) that summarizes the strength and direction of a relationship between two variables
Null Hypothesis
a statistical hypothesis of "no difference" or "no relation" in populations represented by the samples
Correlational Coefficient
a statistical measure expressing the relationship between two or more variables with a single number between 1 & 1, inclusive
Stratum
a subgroup of the theoretical population that has some identifying characteristics in common
floor effect
a task is so difficult that hardly anyone can perform well
Probe
a technique employed in interviewing to solicit a more complete answer to a question. It is a nondirective phrase or question used to encourage a respondent to elaborate on an answer. Ex. "Anything more?" and "How is that?"
Latin square
a technique to control for order effects without having all possible orders; a limited set of orders constructed to ensure that each condition appears at each ordinal position and each condition precedes and follows each condition one time
statistical significance
a term used to describe research results that have been shown by a statistical test to be UNLIKELY to be due to random chance
Two-tail test
a test of significance in which an association in either direction can be statistically significant - test exploratory research
content validity
a test should sample the range of the behaviour that is represented by the theoretical concept being tested
Qualitative research
a type of research that refers to in-depth study using face-to-face or observation techniques to collect data from people in their natural settings.
Extreme outlier
a unit whose X or Y value is extremely far from the values of the other units
Predictor Variable
a variable being studied in a correlational project, regarding the extent to which it correctly predicts one or more criterion varialbes
Extraneous variables
a variable that can cause a chage in the results of an experiment, besides the independent variable
Independent Variable
a variable that is managed or manipulated in an experiment to determine whether it affects a dependent variable
Dependent Variable
a variable that is observed or measured in an experiment to determine whether it is affected by an independent variable
confederate
accomplice, person who appears to be another participant but is actually part of the manipulation
fMRI
add blood volume flow analysis: oxygenated blood has different magnetic properties relative to de-oxygenated blood, hence bigger signal
The 3 dispositions
affirmed, reversed & rendered, reversed & remanded
Informed Consent
agree to participate without threat or undue inducement knowing what a reasonable person in the same situation would want to know before giving consent & explicitly agreeing to participate
Quasi- experimental research
aim to define cause-effect relationships, fails to manipulate independent variable, often compares pre-existing groups(factory in ottawa vs. one in toronto)
Statistical regression
aka regression to the mean, extreme scores have the tendency to return to the mean; has to do with the idea that everyone/thing has a true score/innate ability, it's hard to measure because of confounds
extraneous variables
all other variables associated with the study
counterbalancing
all possible orders of presentation are included in the experiment; by counterbalancing, it is possible to determine the extent to which order is influencing the results; these principles can be extended to experiments with 3 or more groups
population
all the cases in a group, from which samples may be drawn for a study. (Note: Except for national studies, this does not refer to a country's whole population.) (Myers Psychology 8e p. 028)
The regression line can be thought of as a series of points representing?
all the possible Y' values associated with all possible X scores
Inferential statistics
allow determination of how likely results of study of a sample can be applied to whole population.
Confidence intervals:
allow us to use sample data to estimate a population value like the ture mean or the true proportion. EX: what is the true avg amount students spend weekly on alcohol
IV x PV design
allows examination of how types of people respond to the same manipulated variable
functional MRI
allows researchers to scan areas of the brain while a participant performs a physical or cognitive task
discriminant
also called divergent, our scores would be different than on tests that measure different things; can discriminate our construct from all other types of constructs
Null hypothesis:
always represents the status quo, i.e. the hypothesis that requires no change in current behavior.
sampling error
amount of discrepancy between population's characteristics and sample's characteristics - random sampling error; smaller is better
Treaties
an agreement between 2 or more countries
Secondary Authority
an aid to finding or understanding the law
ethnographic technique
an anthropology approach to conduct research through observation of group behavior
Internal Validity
an aspect of design validity: the extent to which all extraneous variables are controlled, enabling results to be interpreted unambiguously regarding the people, setting & occasions studied
manipulation check
an attempt to measure whether the independent variable manipulation has the intended effect on the participants
A case study is?
an empirical design inquiry that: investigates a contmeporary phenomenon within its real-life context especially when the boudries between the phenomenon and context are not clearly evident.
repeated measures design
an experiment in which the same subjects are assigned to each group
double-blind procedure
an experimental procedure in which both the research participants and the research staff are ignorant (blind) about whether the research participants have received the treatment or a placebo. Commonly used in drug-evaluation studies. (Myers Psychology 8e p. 037)
theory
an explanation using an integrated set of principles that organizes and predicts observations. (Myers Psychology 8e p. 024)
inter-rater reliability
an indicator of reliability that examines the agreement of observations made by two or more raters
true score
an individual's actual score without anything affecting it positively or negatively; can never get this score
Hypothesis
an informed guess or assumption about a certain problem or set of circumstances based on prior knowledge/research
Cronbach's alpha
an internal consistency indicator of reliability; the researcher calculates the correlation of each item with every other item
confidence interval
an interval of values within which there is a given level of confidence where the population value lies
Telephone Depth Interview
an interview that combines the traditional focus group's ability to probe with the confidentiality provided by telephone surveys
case study
an observation technique in which one person is studied in depth in the hope of revealing universal principles. (Myers Psychology 8e p. 026)
policy analysis
analysis of policy before it is undertaken.
analysis for policy
analysis of policy illuminating the causes and effects of policies without affecting the policy's outcomes.
nonreactive
another term for naturalistic observation, emphasize ppts are unaware of observation
maturation effects
any changes that occur systematically over time can cause changes from the pre to post tests
parameter
any characteristic of a population that is measureable eg mean age, gender split, number of individuals
Confounding variable
any extraneous variable that changes systematically with the IV and competes with the IV as the effect of the change in the DV
demand characteristics
any feature of an experiment that might inform participants about the purpose of the study
One-tail test
any test of significance in which the direction of association is hypothesized in advance, and only an association in that direction can be statistically significant - indicates the probability that an association as strongly supportive of the hypothesis would have occurred by chance in a sample drawn from a population in which there was no association - test hypotheses
extraneous variables
any variables other than IV variable that seem likely to influence the DV
Reversed & Rendered
appeals court fixes it themselves
logos
appeals to reason
line of best fit
approximates the trend in data
appeal to authority
argued that a statement is correct because the statement is made by a source that is regarded as authoritative
mean
arithmetic average of a distribution,
Popular source
articles based on journalistic reporting & widely available to the pubic
In general, a positive linear relationship means that?
as the values of one variable increase, there is a tendency for the values of the other variable to also increase.
3 ways to collect data on behavior
ask for self-report, Make direct observations, Record physiological and neurological responses
The case and the court are in the same jurisdiction
ask yourself if the case came from a higher court, if yes, you must follow.
manipulation check
aspect of an experiement designed to make certain that varible have changed in the way that was intended
dogmatic
asserted and opinionated; doctrinal
criterion-oriented validity
assesses the relationship between scores on the measures and an specified outcome
random assignment
assigning participants to experimental and control conditions by chance, thus minimizing preexisting differences between those assigned to the different groups
random assignment
assigning participants to experimental and control conditions by chance, thus minimizing preexisting differences between those assigned to the different groups. (Myers Psychology 8e p. 037)
measurement
assignment of numbers to objects according to rules
negative correlation
association between increases in one variable and decreases in another
Parametric statistics
based on population parameters; includes tests of significance based on interval and ratio data. Assume normal distribution in population, random sampling, variance in groups is equal.
normal distribution
bell-shaped curve that results when values of a trait in a population are plotted against their frequency
nonresponse bias
bias that can result when nonrandom subset of ppl invited to participate in study decline to participate
Works Cited
bibliographic information on an MLA style paper
works cited
bibliographic information on an MLA style paper
functional architecture
box and arrow flowchart, not like neuroanatomy, based on a patient's performance on multi-related language tasks, from sensory input (visual/auditory) to output (written/spoken)
extent of literature review
broad enough to uncover trends & controversies; specifically enough to discover gaps in literature
orthographic related errors
brush > bpush; happy > fabby; soft > ssoft
words with acoustic features
bugle, siren, horn, bell, whistle, sing, thunder
subtraction method
built-in assumption of "forward only" processing
How do you identify a case in a reporter?
by it's volume & page
Peterson study
by subtracting a "control state" from the current "stimulus state" one could isolate areas of activation related to mental operations present in the stimulus state, but not in the control state
Sum of Squares Between (SSb)
calculated from the squared deviations of the means for each X category about the mean for the whole sample - N1(mean - mean for entire sample)2 + N2 (mean - mean for the entire sample)2
self-report measures
can be used to measure attitudes, liking for someone, etc; rating scales with descriptive anchors are most commonly used
primary limitation of correlational research
can not assess cause and effect for the most part, can tell us if they are related - no control of extraneous variables, this limitation is referred to as the directionality problem and the thrid variable problem
qualitative variables
categorical or nominal; may be dichotomous or polyotomous
mutually exclusive
categories defined so that membership to one rules out membership to other. ex cant be both graduate and under grad student
sequence effects
changes in a subjects performance resulting from interactions among the conditions themselves
order effects
changes in a subjects performance resulting fromthe postion in which a condition appears in an experiment
variable
characteristic that may take changing forms called values, eg variable gender: one value is male
situational
characteristics of the environment that could have an effect and confuse our results
Why use more than 1 IV?
closer approximation of real world conditions
purposive sample
closer to sampling the whole population than conveniencce sampling
theory
cluster of explanations of a phenomenon that help predict, explain, and control that behavior
ethics
code used by psychologists dictating that they minimize discomfort or risk for research participants
What is another word for the degree of efficeincy in a relationship?
coefficient although it DOES NOT directly measure units of consistency
grouped frequency distribution
collapsing measuerment scale so scores assigned to mutually exclusive grouping intervals eg age group 10 to 20, 20 to 30 etc
data saturation
collection of qualitative data to point where sense of closure is attained because new data yield redundant info
Database
collection of reliable research material stored on a regular website
symposia
collection of talks 45 mins each, all on related theme/topic
database
collection or relliable research material stored on a regulated website
Statute
come from legislature
multiple conditions design
compare several variables/treatments for effectiveness, not usually yes/no questions, subjects experience all conditions
T-test for paired samples
compares difference b/w 2 matched samples; 2 subtests are one-tailed and two-tailed t-test.
Simple (one way) ANOVA
compares multiple groups on a single independent variable ie. 3 sets of posttest scores
Factorial ANOVA (multifactorial)
compares multiple groups on two or more independent variables.
T-test for independent samples
compares the difference b/w 2 independent groups;
Secondary Data
compiled both inside and outside of organization for some purpose other than current investigation
Control Group
composed of subjects that are alike in all preexisting characteristics to the experimental group, except for the treatment experienced by the experimental group
Variance
computed by finding the difference from each value and the mean for category; then squaring and averaging those differences
Validity
concerns the outcome of the test, not the test itself
control condition
condition of experiment that contrasts with experimental condition and serves as a comparison for evaluating the effect of the treatment.
Descriptive Research
conducted to clarify the characteristics of certain phenomena and thus solve a particular problem
systematic error
constant bias
Applied survey research
consumer research, job selection, law enforcement
Scholarly source
contains the work of experts & academics in a given field, circulated to a limited, expert audience
scholarly source
contains the work of experts and academics in a gived field, circulated to a limited, expert audience
latin square
control procedure in which each subject experiences each condition in a different order from other subjects
Stroop Test
correlates a person's perception of words and colors for a list
positive correlation
correlation where as one variable increases, the other also increases, or as one decreases so does the other. Both variables move in same direction.
CINAHL database
covers references to virtually all English-language nursing and allied health journals, as well as to books, book chapters, dissertations, and selected conference proceedings
eligibility criteria
criteria designating specific attributes of target population, by which ppl are selected for inclusion in study
literature review
critical summary of research on topic, often prepared to put research problem in context or to summarize existing evidence
Marketing Decision Support System
customized computer software that aids marketing managers in decision-making
Quartiles
data divided into 4 equal parts and position of score is placed accordingly.
nominal data
data of categories only. Data cannot be arranged in an ordering scheme. (Gender, Race, Religion)
Internal sources of secondary data
databases, reports, financial statements
Access date
date a researcher retrieves information from a computerized source
Correlation coefficients
dealt with after comparisons of central tendency, not as easily understood to the reader, summarizes the strength and direction displayed in a table (phi, Somer's d, Tavb, Tauc, and Gamma)
Annotation
description of a research source
annotation
description of a research source
Case Study
descriptive research approach- studies intensively a given social unit (individual, group, institution, etc.)
case study
descriptive research technique in which one person or a small group is studied in depth in hope of revealing universal principles
naturalistic observation
descriptive research that involves observing and recording behavior without trying to manipulate and control the situation.
double-blind design
design for research in which neither the experimenter nor the subjects know who is in the experimental or control group
Conclusive Research
designed to verify things through an objective procedure to help marketers in making decisions
SD (Standard Deviation)
determination of variability of scores (difference) from the mean. Subtract each score from the mean, square each difference, add up all the squares, and divide by the number of scores. For interval, ratio data.
MEDLINE database
developed by US National Library of Medicine and is widely recognized as premier source for bibliographic coverage of biomedical literature; covers about 5,000 medical, nursing, and health journals published in about 70 countries and contains more than 16 million records dating back to mid 1960s; abstracts of reviews from Cochrane Collaboration are also available
Range
difference b/w the highest score and lowest
interval data
differences between values can be found, but is NO absolute ZERO. Examples: temperature F, time
behavioral measures
direct observations of behavior
2 problems with variable relationships
directionality problem -does the first variable cause the second or does the second variable cause the first? Third variable problem (alternative explanation)- sometimes we see relationships between variables that don't rule out alternative explanations where a third variable causes both "A simple description of a relationship does not mean there is a cause and effect relationship" - prof.
When your scale does not correlate with other unrelated procedures or scales it has ________validity?
discriminant
z-score
divide the standard deviation from the value of d
function words or "closed class"
do not carry meanings by themselves; can't add new ones to language, usually small words (grammatical morphemes and endings); articles, conjunctions, prepositions, pronouns, quantifiers
Doctrine of Precedent
doctrine that requires a court to follow the law established in a prior decision, unless good cause exists to change it
face validity
does the study appear to accurately measure the variable?
pilot studies
done before large study, few participants, work out problems/adjust design
Ineffective/effective purpose statement: This report will explain how supervisors can use four planning strategies to improve employee productivity in the workplace
effective: very specific
Ineffective/effective purpose statement:This paper will describe four common causes of co-worker conflict in organizations and explain how to use a five-step procedure to constructively manage this conflict
effective: very specific
Open observation, nonparticipating
eliminates ethics problem, possible reactivity problem
scientific evidence
empirical evidence that supports and is properly documented in accordance with scientific method such as is applicable to the particular field of inquiry
survey
employs questionnaires and interviews to ask people questions about themselves
Triangulation
enhancing the value of the theory by using multiple methods & perspectives to research it
stratified random sampling
ensures that the sample matches the important characteristics of the population
ambivalent
entertaining contradictory emotions towards the same person or thing
target population
entire population in which researcher is interested and to which he or she would like to generalize study results
population
entire set of individuals or objects having some common characteristics (eg all RNs in New York); sometimes called universe
Linear regression equation [(b)(x) + a]
equation that creates the straight line by producing a value of Y' at each X, define sthe line that summarzies the relationship. Describes it's slope and Y intercept.
methodological constraints
equipment, participants, cost, time limitations
Type II error
error of failing to reject a null hypothesis when in fact it is false (also called a "false negative"). You think there is NO CAUSE EFFECT but THERE IS
Tests of significance
estimation of true differences, not due to chance; a rejection of the null hypothesis. ie. Probability levels or alpha levels.
How do you avoid confounding variables / unconfound
evaluate and determine if they will actually confound to issue, keep them constant across conditions; match values across conditions, make them as identical as possible
mutually exclusive events
events that cannot occur simultaneously eg being dead and alive at same time
Probability Sampling
every element in the population being studied has a known chance of being selected for study
Random assignment
everyone has a equal chance of being part of the experimental group or the controlled group
Simple random
everyone has an equal chance
random sample (aka probability sample)
everyone in the target audience (as defined by the researcher) has an equal or known chance of being selected for the survey.
systematic sample
everyone person from the first 10th on the list
simple main effects
examines mean differences at each level of the independent variable; the results are analyzed as if we had separate experiments at each level
discriminant validity
examines the extent to which scores on the measure are not related to scores that measure some other unrelated construct
concurrent validity
examines whether groups of people differ on the measure in expected ways
Standard Error
expected chance variation among the means, result of sampling error.
true experiments
experiemnter has complete control
Post test-only design
experimental design that uses a test measure only after presentation of the IV
independent variable
experimental factor that is manipulated; variable whose effect is being studied.
double-blind procedure
experimental procedure in which both research participants and research staff are ignorant about whether the research participants have received the treatment or a placebo.
placebo effect
experimental results caused by expectations alone; any effect on behavior caused by the administration of an inert substance or condition, which is assumed to be an active agent.
placebo [pluh-SEE-bo] effect
experimental results caused by expectations alone; any effect on behavior caused by the administration of an inert substance or condition, which is assumed to be an active agent. (Myers Psychology 8e p. 037)
RCT (Randomized Controlled Trial)
experimental study, random sampling, random assignment to experimental or control group to receive different tx or placebo.
Operational Definition
experimentally accessible population; moving from a theoretical definition of a concept to something that can be measured; practical, measurable
What or who determines the levels of the IV?
experimenter - in true experimental design, the levels are selected by the experimenter in experimental designs in quasi-experimental designs, the levels are predetermined (can't change political affiliation or hair color, anything that has been set by nature or selected by the environment, we can't change)
experimenter bias/expectancy effects
experimenters are usually aware of the purpose of the study and thus may develop expectations about how participants should respond
concise
expressing in few words
internal validity
extent to which a study provides evidence of a cause-effect relationship btw the independent and dependent variable
validity
extent to which a test measures or predicts what it is supposed to - test accuracy
reliability
extent to which a test yields consistent results - a measure is repeatable
validity of measurement
extent to which a test, instrument, or experimental method does what it is meant to
statistical validity
extent to which data are shown to be he result of cause-effect relationships rather than accident
construct validity
extent to which the results support the theory behind the research
Constructs
factors that can assume different values, variables
extraneous variables
factors unrelated to the Tx being studied that might influence the outcome of the study
type 2 (beta) error
failing to reject a false null hypothesis
sampling error
fluctuation of value of statistic from one sample to another drawn from one sample to another drawn from same population
candor
frankness; the quality of being open or honest in expression
Strength of association
further away from O towards +1 or -1 (.3 or .4 = moderate support)
Sum of Squares Within (SSw)
gained when calculated the variance - it is the sum of the squared deviations for each X category
Examples of physiological measures
galvanic skin response: measures general emotional arousal and anxiety, electromyogram: measures muscle tension and is frequently used as a measure of stress, electroencephalogram: measures electrical activity of the brain cells
Does a federal court have to follow a state case
generally no Exceptions: When they are required to interpret state law
Does state court have to follow a federal case
generally no Exceptions: when there is a federal question (involves us Constitution)
debriefing
giving participants in a research study a complete explanation of the study after the study is completed needed for deception
social desirability
giving the answer that is most socially acceptable
scatterplot
graphed cluster of dots, each of which represents the values of two variables. The slope of the points suggests the direction of the relationship between the two variables.
cluster sample
groupings from a larger population. ex. 1/10 of student of every class... not 1/10 of every class
Non-probability sampling
haphazard, purposive, convenience
Solomon 4 group design
has 4 groups: 2 pretest/post-test & 2 post-test only; solves problem of pretest sensitization because it allows us to see if their was a pretest sensitization
Standardized Tests
have instructions for uniform administration, procedures and norms & have been put through rigorous developmental cycles
Positive correlation
high values of one variable are paired with high values in another (+)
Negative correlation
high values of one variable are paired with low values of another (-)
Positive associations
higher values of Y are more common as values of X increase
grounded theory
how people use symbols to interact, or interpret/make sense of their experiences over time
Direction of association
how the Y values are paired with X values (+ or -)
Currency
how up to date the information that is being used
null hypothesis
hypothesis that states there is no difference between two or more sets of data making it opposite of the research hypothesis
non-probability sample
i.e. mall-intercept interviews. NOT random at all. Different people are present at different times
face validity
idea that a test shoud appear to any person to be a test of what it is supposed to test
criterion validity
idea that a test should correlate with other measures of the same theoretical construct
Longitudinal analysis
if the independent property is measured for different point in time then the units that differ with regard to the independent variable will tend to differ in a specified manner with respect to the dependent
Cross-sectional analysis
if the independent property is measured for different units at a given point in time then the units that differ with regard to the independent variable will tend to differ in a specified manner with respect to the dependent
History effects
if you are collecting data over a period of time and something happens in the real world that affects the study by changing attitudes or behaviors
test-retest reliability
if you take the same test 2x's & you get the same results it shows ______ reliability
keyword
important term used to search for references on topic in bibliographic database
threats to statistical validity
improper use of statistics in analyzing the data
increasing questionnaire reliability
improve appearance, proofread, test for understandability
placebo effect
improvement caused by a participant's knowledge and expectations: can be from a treatment that contains nothing known to be helpful, but that nevertheless produces benefits because a person believes it will be beneficial.
z score
in a normal distribution it tells you how far a number is above or below mean in terms of standard deviations.
baseline
in a single case design, the subject's behavior during a control period before introduction of the experimental manipulation
Hanging Indent
in citation entries, the first line flush with the margin, each consecutive line is indented 1/2 inch
hanging indent
in citation entries, the first line flush with the margin, each consecutive line is indented 1/2 inch
ordinal
in order, measurement rg, competition places, earthquake scale
Advanced sheets are published
in paper back books weekly
panel study
in survey research, questioning the same people at two or more points in time
Accessible populations
include who, what, where, and when to make a good representation of the target population.
Indicators of dispersion
indicates the extent to which the values of the units are spread out or concentrated together: variation and standard deviation
Range
indicates the highest and lowest categories in which the units of analysis are found
rejected null hypothesis
indicates the research results are significant; acceptance of the research
Participant variables
individual characteristics that participants bring with them to the experiment
Norm Referenced Tests
individuals performances can be compared with the norm group; results from 1 or more large samples with known characteristics
Effective/Ineffective purpose statement: "The purpose of this paper is to describe the changes that are occurring in corporate America
ineffective: too vague
T test
inferential statistical test- used to compare two groups; parametric
statistical control
inferential stats, allows us to determine if the effect is due to chance
subjective
influenced by personal feelings or opinions when considering facts
moderator variable
influences the relationship between two variables
primary source
info directly from someone involved in an event
Primary source
information directly from someone involved in an event (diaries, lab results, newspaper reports from the time)
policy research
information gathering and processing activities that public agencies engage in to facilitate decision making.
Single source data
information provided by a single marketing research firm
statement of fact, data
information, not necessarily the truth
"loaded questions"
intentionally skewed questions that generate a predictable response
Focused interview
interview that is an encouraged conversation with a set of questions or a topic guide
fatigue effect
is a deterioration in performance as the research participant becomes bored, tired, or distracted
practice effect
is an improvement in performance as a result of repeated practice with a task
reliability
is necessary for validity, is not the same as validity
confounded variable
is one whose effect cant be separated from the supposed independent variable
proportion of variance
is the amount we reduce errors in predicting Y scores when we use the relationship, compared too if we did not. Equals r2
Alternative hyposthesis
is the conclusion that the researcher is trying to make.
reliability
is the consistency of a set of measurements, used to describe a test
Level of statistical significance
it is reported as a proportion indicating the maximum probability of incorrectly finding that an association exists (.05 level = 5 chances out of 100)
Median
it is the middle category or value of a distribution
ways laws can change
legislature can amend existing statutes or enact a new statute, court can apply its own interpretation to an existing statute or they can make law where there is no statute, supreme court can declare something unconstitutional
pros/cons of projective techniques
less susceptible to faking, easy to build rapport with subjects, useful with children, questionable reliability and validity
content analysis
like Lori's coloring book article - examines the subjects and ideas in media/written documents
threats to construct validity
loose connection between the theory and method, ambiguous effect of independent variable
MRI
magnetic resonance imaging
bayesian method
mathematical basis for probability before data collection
Why is it important to make the manipulation as strong as possible?
maximizes the differences between the two groups, increases the chances the IV will be effective for a real world match
Beneficence
maximizing good outcomes for science, humanity, and the individual research participants & minimizing or avoiding unnecessary risk, harm, or wrong
Right-skewed (positive)
mean is greater than the median; the outlying cases are higher than the midpoint of the distribution
alternative hypothesis
mean x does not = mean y
Measures of Central Tendency
mean, median, mode
Validity
means that the research study has produced results that accuretly measure the behaviour or event that it claims to have measured.
mean
measure of central tendency that is the arithmetic average of the scores in a set of data
median
measure of central tendency that is the halfway point in a set of data
mode
measure of central tendency that is the value that occur most frequently in a data set
correlation
measure of the extent to which two factors vary together which can be positive or negative or non
standard deviation
measure of variability that is the average difference between each score and the mean of the data set (demonstrates consistency)
one group pretest postest design
measures the behavious of a single group of subjects both before and after treatment, know the behavious change, may be considered a quasi experiment
face validity
measures whether a test looks like it tests what it is supposed to test as determined by a quick look or evaluation by a non expert
naturalistic observation
method gathering descriptive information involving watching behaviors, without interfering, as they naturally occur
reverse counter balancing
method of control in which conditions are presented in order the first time and then in reverse order
Research Methods
methods that are used to obtain information that is reliable
median
midpoint, 50% of scores are above the mean and 50% are below, appropriate for ordinal data.
shared vs. dedicated neurons
neurons perform duties 'across functions' or are solely devoted to a specific language function
Nominal level
no actual relative amount of a property
Observation
no direct contact with participant; focuses on beahvior characteristics
nominal
no order, number to a thing, eg colours, political pref
what does a horizontal scatterplot, with a horizontal regression line indicate?
no relationship
null hypothesis
no significant difference exists between groups/treatments, etc
unsupported assertion
no validation, but asserted
Chi square test
non-parametric test of significance used to compare data in the form of frequency counts occurring in 2 or more mutually exclusive categories ie. subjects asked to rate tx preferences.
Purposive sampling
non-probability design in which you handpick subjects on the basis of personal judgment about their representativeness.
Quota sampling
non-probability design in which you identify a significant extraneous variable and use accidental sampling to select a predetermined number of subjects from each strata
Accidental sampling
non-probability design in which you use the most readily available persons as subjects. May use snowball sampling. Most commonly used because its convenient and least costly.
nominal scales
nonnumerical scales
Spearman's rank correlation coefficient (rss)(rho)
nonparametric test to correlate ordinal data ie. verbal and reading scores
purposive sampling
nonprobability sampling method in which researcher selects participants based on personal judgment about who will be most informative; also called judgmental sampling
quota sampling
nonrandom sampling method in which "quotas" for certain sample characteristics are established to increase representativeness of sample
Concealed observation, nonparticipating
nonreactive, ethical problems if you are doing this in a place where people expect privacy
objective
not influenced by personal feelings or opinions when considering facts
purposive sample
not random selection, certain characteristics
Type II Error
null hypothesis is NOT rejected by the researcher when it is false.
Type I Error
null hypothesis rejected by the researcher when it is true
data
numbers or measurements collected by observation
descriptive statistics
numbers that describe and summarize a set of research data
data
numbers that represent research findings and provide the basis for research conclusions
quantitative variables
numerical and can be ordered and ranked
correlation coefficient
numerical index that represents the relationship between two variables; -1.00 to +1.00; represented by r
interval scale
numerical values with equal distance in between the scores
systematic observation
observations made of a specific variable in a predefined setting
naturalistic observation
observing and recording behavior in naturally occurring situations without trying to manipulate and control the situation. (Myers Psychology 8e p. 029)
experimenter bias
occurs when experimenters ask leading questions or otherwise search for evidence that supports their hypothesis and don't look for evidence that refutes it
contrast effect
occurs when the response to the second condition in the experiment is altered because the two conditions are contrasted to one another
Statistical Significance
of a magnitude rarely obtained by random sampling from populations for which the null hypothesis is true; probability that the difference in scores occurred because of reasons other than error
main effect
of an IV - the effect of each IV taken by itself
interval measurement
one in which the differences between the numbers on the scale are meaningful. equal differences between the numbers on the scale must represent equal differences between the event or objects
ratio measurement
one that has a meaningful 0 point as well as meaningful differences btw the numbers on the scale. the ratios btw the numbers on the scale must represent the ratios btw the evnts/objects
continuous variable
one that is not limited to a certain number of values
Point biserial correlation
one variable is dichotomous (nominal) and other is ratio or interval eg. the relationship b/w elbow flexor spasticity and side of stroke.
ambiguous
open to having many meanings or interpretations
Confounds
other factors that can affect an outcome in an experiment- not measured, but explains results
T-test
parametric test compares 2 independent groups created by random assignment and identifies difference at a selected probability level ie 0.05.
Analysis of Variance (ANOVA)
parametric test too compare 3+ independent tx groups or conditions at a selected probability level.
independent group designs
participants are randomly assigned to the various conditions so that each participates in only one group
test/retest reliability
pearson; consider practice effect
cross-sectional research
people of different ages are compared to one another at a single point in time
habituation
people or animals get used to the experimentor or camera is there
illusory correlation
perception of a correlation between variables where none exists.
illusory correlation
perception of relationship where none exists.
fatigue effect
performance deteriorates with exposure
practice effect
performance improves with repated exposure
Voice marker
phrases indicating whether the writer of the paper is speaking, or if they are using outside source materal
voice marker
phrases indicating whether the writer of the paper is speaking, or if they are using outside source material
complacent
pleased especially with one's self or one's merit
rpb
point-biserial correlation coefficient sign
practice effects
practicing and repeating an experimental task can affect blood flow over a few trials. So test and control must have the same effect.
criterion validity
predictive or concurrent; how well results compare to those achieved on another measure
construct validity
predictive, discriminant and convergent/concurrent - the scores on similar types of measures come together and are similar
plagiarism
presenting other's thoughts, ideas, or facts as your own
Plagiarism
presenting others' thoughts, ideas, words, or facts as your own
Reversed & Remanded
prior court messed up, send back to lower court to fix
Simple random sampling
probability design in which a table of random numbers is used to draw a sample from the population.
Cluster sampling
probability design in which large groupings or clusters are randomly selected first with successive random sub-sampling of smaller units. Most commonly used for large-scale surveys because it is more economical and practical. Contains more sampling errors
Stratified random sampling
probability design in which you identify a significant extraneous variable and randomly select a predetermined number of subjects from each stratum.
Systematic sampling
probability design in which you select the every Kth case from a list. It may not be random if the list is arranged so certain types of elements are listed at particular intervals.
p value < .05
probability of an error in rejecting the null is 1/20
power analysis
procedure for estimating either needed sample size for study or likelihood of committing Type II error
meta analysis
procedure for statistically combining results of many different research studies
single-blind procedure
procedure in which info that could introduce bias the result is withheld from participants, but experimenter will be in full possession of facts
random selection
procedure that ensures every person in a population has an equal chance of being chosen to participate
critical thinking
process of evaluating claims or hypotheses and making judgments about them on the basis of well-supported evidence
sampling
process of selecting potion of population to represent entire population
When we square hte correlation coefficient to produce r2, the result is equal to the?
proportion of variance accounted for
Cohort Study
prospective (forward in time) study; cohort w/similar condition is followed for defined period of time; comparison made to matched group w/out the condition.
control group
provides a baseline for comparison, does not receive critical treatment (independent variable)
ethnography
purpose is to document the customs, social patterns, and rule-governed behavior of a culture or group of individuals
Correlational research
purpose is to evaluate the strength and direction of the covariation of two variables; relationships and associations
Extreme/deviant case sampling
purposefully selecting subjects that are the most unusual or extreme with regard to the dimension of interest
Typical case sampling
purposefully selecting subjects who are typical or average with regard to the dimension of interest
survey
questionnaire or interview administered to a large group; designed to obtain descriptions of peoples' behaviors/beliefs
data collection methods
questionnaires (open structured vs close-ended structured), Interviews, diaries, scales (likert, guttman, semantic differential, and visual analog)
Open-ended questions
questions for which the respondent is asked to provide his or her own answers. In-depth qualitative interviewing relies almost exclusively on open-ended
Block quote
quote of 4+ lines that is offset from the main body text with 2 tabs
true experimental research
random assignment, active manipulation, Tx and control groups
random assignment
random distribution of participants to experimental or control groups - used to distribute the impact of uncontrolled variables randomly, and most likely evenly, across the groups, minimizing the chance they will distort the results
Simple Random Sampling
random sampling applied to the entire frame at once; requires access to the entire population-every person has equal probability of being selected
stratified random sampling
random selection of study participants from two or more strata of population independently
erratic
random, irrational, having no fixed purpose
probability sampling
random, systematic
Negative correlations
range from -1.0 to 0, indicates as variable X increases, variable Y decreases; an inverse relationship.
ordinal measurement
ranks objects/events inorder of their magnitude. the position of the numbers on the scale must represent the rank order of the psychological attributes of the object
response rate
rate of participation in study, calculated by dividing number of some individuals to respond to items in characteristic ways (eg always agreeing) independently of item content
Postpositivist Paradigm
rational, empiricist, value free & causal nature of what we observe can be concluded; prefer experimental design & random assignment
Constructivist Paradigm
reality is socially constructed, research-attempt to understand from POV of those experiencing ; research can not be separated from researcher bias
How does a restricted range affect a correlation coefficient?
reduces the accuracy, producing a smaller coefficient than if hte range were not restricted and leads to an underestimate of the degree of association between the two variables. Avoiding this increases power.
reliability
refers to the consistency or stability of a measure of behavior
N400
reflects postlexical process involved in lexical integration of words in sentence
The best-fitting straight line through a scatterplot is known as the?
regression line
The best-fitting line through a scatterplot is known as the?
regression line.
type 1 (alpha) error
rejecting a true null hypothesis
Dependent variable
related to the measurement / data and it is the variable that we are measuring. The tendency is for this to be the demographic data.
Common variance
representation of the degree that variation in one variable is attributable to another variable. Determined by squaring the correlation coefficient ie. coefficient of .70 means common variance is 49%.
Controlling
required for associations to be proved causal, controls for the effects that other variables have on the association
one group posttest only design
research design that measures the behaviour of a single group of subjects after they are given a treatment, threats to validity uncontrollable
Experimental research
research in which the scientists determine the amount or level of the independent variable to which each unit is exposed (rarely used)
Ethnographic Research
research method designed to describe & analyze practices & beliefs of cultures & communities; involves entering into first hand interaction with people in their everyday lives
experiment
research method in which investigator manipulates one or more factors (IV) to observe effect on some behavior or mental process (DV)
correlational studies
research method that examines relationships between variables in order to analyze trends in data, test predictions, etc. (they do NOT discern cause and effect relationships)
program evaluation
research on programs that are proposed and implemented to achieve some positive effect on a group of individuals
correlational study
research project designed to discover degree to which two variables are related to each other
advocacy research
research that is done by organizations who send out surveys w/ questions that use highly charged words that elicit an emotional reaction from the respondent
Qualitative Research
research that is good for probing attitudes and perceptions, assessing penetration of messages, and testing messages
quasi-experiment
researchers takes subjects & conditions as they naturally occur, with little if any control over what happens.
Sx
sample standard deviation symbol
random sample
sample that fairly represents a population because each member has an equal chance of inclusion.
S2x
sample variance symbol
interval scale
scale with equal distances between the points or values, but without a true zero
Likert Scale
scaled response; from 1 to 5
applied research
scientific research that focuses on solutions to problems that have immediate application
Boolean search
searching the web or databases using limiting or expanding Boolean terms, including AND, NOT or OR
boolean search
searching the web or databases using limiting or expanding boolean terms including: AND OR and NOT
We should always draw a scatterplot of the data when we compute a correlation because hte scatterplot allows us to?
see the nature of the relationship between the two variables
scientific method
series of steps followed to solve problems including collecting data, formulating a hypothesis, testing the hypothesis, and stating conclusions
theory
set of assumptions used to explain phenomena & offered for scientific study
inferential statistics
set of mathematical procedures that help researchers learn if their research data reflects a true relationship or could be due to random chance
multiple baseline across behaviors
several different behaviors of a single subject are measured over time
brevity
shortness of time or duration
nominal measurement
similarities and differences. classifies objects or events into categories same event get same number
Probability sampling designs
simple random sampling, stratified random sampling, cluster sampling, systematic sampling
two codnition design
simplest, all subjects experience both conditions, yes-no questions
Intensity Sampling
sites or individuals are selected in which the phenomenon of interest is strongly represented , but not necessarily extreme
positive (right) skew
skewed distribution where data has many more scores toward the lower end of the distribution
negative (left) skew
skewed distribution with many more scores on the higher end of the distribution
Customer Advisory Boards
small groups of actual customers who share ideas and feelings regarding a company's products and marketing stratedy
When the relationship between two variables is high (for example, r=.98) the variability in the Ys at each X is ____________ realtive to the overall variability of Y scores in the sample.
smaller
internal consistency
spearman-brown; degree of relatedness between items: split test in 2
variables
specific factors or characteristics that are manipulated and measured in research
The consistency of participant response on different versions of the same test determines?
split-half reliability
Sr
standard error ofthe estimate symbol
operational definition
standard that applies to all, none subjective
correlation coefficient
statistical measure of strength of association between two variables ranging from -1.0 to 1.0
ANOVA
statistical method for making simultaneous comparisons between two or more means
3 types of archival research data
statistical records, survey archives, written and mass communications, documents
statistical significance
statistical statement of how likely it is that an obtained result occurred by chance - expressed as p or sig.
meta analysis
statistically combines and re-evaluates data from several primary papers
Known sampling distribution
statisticians have already determined the likelihood of getting each value when samples with given characteristics are drawn from a population in which there is no association (X2, t, z, and F)
ratio example
stevens law of sensation magnitude
Define regression line
straight line that summarizes the linear relationship in a scatterplot by,on average, passing through the center of the Y scores at each X and it consists of the predicted Y score-the Y'-for every possbile X
2 components of the relationship between two variables
strength -represented by the absolute value of r (0 to 1); direction - positive or negative; represented by the sign of r; direct has a positive sign, indirect is negative (Wesalowski likes terms direct/indirect over pos/neg)
The absolute value of a correlation coefficient indicates the?
strength of the relationship
If there is a large R there is a week or strong relationship?
stronger the relationship and a small value of Sy and S2y, because the Y scores are closer to Y', thus the smaller difference between Y and Y'
Longitudinal experiment
studies change as a function of age; same group of people at time 1, 2, 3; downsides-mortality, funding, harder to generalize
Cross Sectional experiment
studies differences as a function of age; same time with different age groups; downsides-cohort effect
Action research
studies undertaken by practitioners in schools that address an actual problem or issue in the school or classroom.
twin studies
study the heredity-environment question by comparing the similarity seen in identical twins with those of nonidentical pairs
strata
subdivisions of population according to some characteristics (eg males and females)
Thematic apperception test (TAT)
subject is given twenty cards that contain pictures and are asked to make up a story about each picture.
arbitrary
subject to individual will or judgement without restriction
within subjects design
subjects act as their own controls, each subject recieves every manipulation
projective cartoon
subjects are given an uncompleted cartoon and are asked to complete it.
Rorschah Test
subjects are given cards containing pictures of ink blots and are asked to describe the picture
Think about method
subjects audio-record problem solving and decisions being made over a period of time
Semantic Differential scale
subjects rate concepts on a series of 7 or 8 point bipolar rating scales.
quasi-experimental research
subjects typically assigned based on pre-existing condition; control group constructed
Sr' definitional formula/average error
subtract Y' from Y and square each deviation/divide by N then find hte square root of that to get the error of the estimate
whimsical
suddenly fascinating or enthralling
Pearson's r
summarizes the relationship of several things - measures the extent to which the Y values of units can be estimated from the X values of those units by using an equation of the type: Y′ = a + bX - a = intercept value / X = variable / b = coefficient slope (the explanation)
Headnotes
summary that the publisher made to make your life easier
Close-ended questions
survey questions in which the respondent is asked to select an answer from among a list provided by the researcher. These are popular in survey research because they provide a greater uniformity of responses and are more easily processed
haphazard sampling
take participants any way you can get them; not that representative because they are volunteers
regression effect
tendency of subject with extreme score closer to the mean on a second testing
acquiescence
tendency to agree regardless on content
hindsight bias
tendency to believe, after learning an outcome, that one would have foreseen it.
social desirability bias
tendency to give socially approved answers to questions about oneself.
false consensus effect
tendency to overestimate extent to which others share our beliefs and behaviors
Inferential statistics
term is used to label the portion of statistics dealing with the principles and techniques that allow researchers to generalize their findings beyond the actual data sets obtained- when based upon sample data but designed to extend beyond the sample, are called statistical inferences
Simple ANOVA
test for difference between 2 or more groups.
Sensitivity
test has to be strong enough without being too difficult - ceiling and floor effects (best way to avoid these effects is to have multiple measures)
Chi Square
test of statistical significance for categorical date; non-parametric
Tests of significance
test that tell us how likely it is that an association as strongly supportive as the one observed in a sample would be found when no supportive association exists in the population (showing it's not by chance) - can tell the odds are very small
Whe consistency of participants responses to the same test at two different times determines?
test-retest reliability
What are the types of reliability that a correlation coefficient is used to show?
test-retest, inter-rater, split-half
hypothesis
testable prediction, often implied by a theory
Bias
that quality of a measurement device that tends to result in a misprepresentation, in a particular direction, of what is being measured
ceiling effect
the IV appears to have no effect only because participants quickly reach the max performance level
Zero association
the X and Y values are paired in such a way that knowing the X value of a unit is no help in predicting its Y value - statistically independent
latency
the amount of time between an instrction and when the behaviousis actually performed
maturation
the amount of time btw measurements
discourse analysis
the analysis of spoken and written messages used to convey meaning/perform social functions
mean
the arithmetic average of a distribution, obtained by adding the scores and then dividing by the number of scores. (Myers Psychology 8e p. 041)
Define the Standard error of the estimate
the average spread of Y scores around predicted Y scores
Constitutions
the bases of it all
Linear regression is defined as the procedure for determining?
the best-fitting straight line in a linear relationship
Uniform distributions
the cases are distributed more or less evenly across the range of categories, may have no modal areas
Mode
the category that contains the largest number of units
Independent variable (IV)
the causative variable, we think there is a cause because we have identified a correlational relationship can be manipulated (i.e., has levels)
Dependent variable (DV)
the changed variable - change in variable can be observed and/or measured change is brought about by the IV; doesn't occur in the absence of IV
ethos
the character of the speaker
internal validity
the characteristic of an experiment that allows one to draw accurate inferences about the causal relationship between an independent and dependent variable
non-matching list
the color of ink does not match the color of the word
matching list
the color of ink matches the color of the word
control condition
the condition of an experiment that contrasts with the experimental condition and serves as a comparison for evaluating the effect of the treatment. (Myers Psychology 8e p. 037)
experimental condition
the condition of an experiment that exposes participants to the treatment, that is, to one version of the independent variable. (Myers Psychology 8e p. 037)
inter-rater reliability
the consistency of ratings by any two raters
Intercept
the constant that is added to or subtracted from the multiple of X - the point where the regression line crosses the Y axis - it is the value if X were zero, Y would be it (a)
r
the correlation coefficient that varies from 0 to +/- 1
Y' is the predicted Y score for what?
the corresponding X
Slope coefficient
the corresponding increase as X increases by _, Y increases by b
If it passes through the proper inferential procedure, a sample correlation coefficient is used to estimate what?
the corresponding population correlation coefficient: r=p,Rs estimates Ps, Rpb estimates Ppb.
Marginals
the crosstables' showing of the number (N) of cases in each column (the number the percentages are based on) and perhaps each row
construct validity
the degree to which a measurement device accurately measures the theoretical construct it is designed to measure
correlation
the degree to which one variable is related to another
Range
the difference between the highest and lowest scores in a frequency distribution. The range is the simplest measure of variability.
Sampling error
the distributions in samples are likely to be somewhat different from the distributions in the theoretical population (±4%)
multiple baseline design
the effectiveness of a treatment is demonstrated when a behavior changes only after the manipulation is introduced; to demonstrate the effectiveness of the treatment, change must be observed under multiple circumstances to rule out the possibility of extraneous variables
Field setting
the environment of the experiment is less controlled and is usually more natural conditions
Regression equation
the equation for the regression line
regression equation
the equation found to represent a set of data
Confidentiality
the ethical principle whereby a professional does not disclose to others information n given in confidence to them by a client/patient. In research studies, personal information should only be collected if it is relevant to the study and can only be reported in such a way that subjects' identities are not revealed. If subjects are dissatisfied after debriefing, they can demand that their data is destroyed. (In therapeutic situations, the patient's consent is required before the practitioner can disclose any information of a personal nature. Exceptions to this occur in cases with minors where discussions are held with parents or in cases where the client threatens, either directly or through their behaviour, to cause harm to themselves or others, in which case the professional is obligated to attempt to prevent such an occurrence.)
content validity
the extent to which a test samples the behavior that is of interest (such as a driving test that samples driving tasks).
Reliability
the extent to which a test yields consistent results
sampling frame
the individuals or clusters of individuals who might actually be selected for inclusion in the sample
Regression line
the line that best estimates the Y values from the X values
When r=0.0, the Y-intercept is equal to?
the mean of all the Y scores in the sample
median
the middle of a set of data
We should always draw a scatterplot of the data when we compute a correlation because it alows us to see?
the nature of the relationship between the two variables
Response Rate
the number of people participating in a survey divided by the number selected in the sample, in the form of a percentage. Also called Completion Rate or, in self-administered surveys, the Return Rate: the percentage of questionnaires sent out that are returned.
Regression coefficient (slope)
the one that multiplies times the X value , the amount by which Y is estimated to increase/decrease for each increase of 1 in the value of X)
Pretest-Posttest design
the only difference between this and the posttest only is that this design gives a test prior to introducing the IV to ascertain that the groups were, in fact, equivalent at the beginning of the experiment
experiment
the only research method to show causation, this involves obtaining a random sample of subjects and using control and experimental groups; allows a researcher to control the data-collection process
order effect
the order of presenting the treatments effects the DV. Types of order effects: practice effects and fatigue effect, contrast effect. To deal with these effects: employ counterbalancing techniques or devise a procedure in which the interval between conditions is long enough to minimize the influence of the first condition on the second condition
What is a Research Question:
the organizing principle for an individual study. It clarifies exactly what the researcher wants to understand, describe, or explain
dependent variable
the outcome factor; the variable that may change in response to manipulations of the independent variable. (Myers Psychology 8e p. 038)
Justices on the panel
the panel that hears the case (average case is heard by a the panel
illusory correlation
the perception of a relationship where none exists. (Myers Psychology 8e p. 033)
sampling frame
the population you will work with
hermeneutic approach
the principle of interpretation of a text's meaning. ex biblical research
Serendipity
the process of accidentally discovering scientifically valuable information while exploring an unrelated problem
sampling
the process of selecing participants for research who are members of the population the researcher wishes to study
Sampling
the process of selecting representative units from a total population
quantitative data
the quantity or amount of what is being studied, how much of something there is.
Bivariate relationship
the relationship between X (independent) and Y (dependent) (2 variables)
independent variable
the results of what you are testing; errors and correct answer, how long it takes to answer correctly, etc. when studying aphasia
direct replication
the same experiment is repeated, uncommon, only happens if systematic replication fails
repeated measures
the same individuals will participate in all the conditions
Random Selection
the selection of each unit is independent of the selection of any other unit; every person in a population has equal probability of being selected
topogrpahy
the shape or style of the behavious
When r=0, the standard erro of the estimate is at it's max. and that is equal to?
the standard deviation of all Y scores in the sample (Sy)
content analysis
the systematic and objective counting or categorizing of information
Marketing Research
the systematic design, collection, interpretation, and reporting of information to help marketers solve specific marketing problems or take advantage of marketing opportunities
hindsight bias
the tendency to believe, after learning an outcome, that one would have foreseen it. (Also known as the I-knew-it-all-along phenomenon.) (Myers Psychology 8e p. 020)
false consensus effect
the tendency to overestimate the extent to which others share our beliefs and behaviors. (Myers Psychology 8e p. 028)
acceptable risk of error
the tolerance for making an error in rejecting the null hypothesis
Tails
the two ends of the graph = the tails of the distribution
archival research
the use of existing sources of information for research
In this formula,{Y'= (b)(x) + a} what does the "a" stand for?
the value of Y that hits the Y axis
Perfect association
the values of the IV (X) and the DV (Y) are paired the same (1=1)
The differences (and error) between Y and Y' is also summarized by what?
the variance of the Y scores around Y' (S2y)
One-factor ANOVA
there is only one DV in factorial ANOVA, Factorial ANOVA has two independent variables which are crossed with each other and used as a treatment on the DV.
why are data from naturalistic observation primarily qualitative?
they are descriptions of behavior
Experimental group
this group is exposed to the experimental condition and the IV is always present
Primary Authority
thought of as the law, cases, statutes or regulation
concede
to acknowledge as true, just, or proper admit, to make a concession
acquiesce
to agree or comply without open opposition
generalize
to apply the results of one's study to people beyond just the researcher's sample
coerce
to compel by force, intimidation, or authority, esp. without regard for individual desire or volition
Why is "r" computed first?
to determine if a relationship exists. If r=0 their is no relationship
Correlational statistics
to determine relative strength of a relationship b/w 2 variables.
extricate
to free or release from entanglement
Interviewing
to obtain rich, descritpive data that is complex, subjective and details the particiapnts persepctive.
didactic
to teach or learn, used or intended for teaching or instruction
semantic paragraphias
truck > bus; leopard > tiger; apple > orange
A court is never bound by its own prior decision
true
observed score
true score + measurement error
clustered vs. distributed neurons
two binary choices that will decide between localizationist and holist positions; functionally homogeneous neurons are either one or the other
frequency histogram
type of bar graph that shows frequency distributions
purposive sampling
type of haphazard sampling conducted to obtain pre-determined types of individuals for the sample
Unimodal
units clustered about a single value
obstinate
unreasonably determined to have one's own way; stubborn
filler items
unrelated items on the questionnaire used to disguise the purpose of the study
casual observation
untested, unreferenced statement, conclusion is unreliable; it may not be untrue, but it doesn't follow from the "evidence", eg evidence can be anecdotal in both senses: "Goat yogurt prolongs life: I heard that a man in a mountain village who ate only yogurt lived to 120."
To avoid or mitigate expectancy effects
use automated procedures - rehearse, script; use single and double-blind procedures
Chi square x2
use for percentage difference, tables with 2*2, and difference between medians - values indicate how unlikely it is that the observed sample results came from a theoretical population with no association between X and Y
probability techniques
use if accuracy if representativeness is very important; simple random sampling, systematic random sampling (every kth person), stratified random sampling, cluster sampling
avoiding bias
use random selection and assignment
quasiexperimental design
use when a true experimental design can not be used because there are variables we can not change; group/condition has been assigned by factors other than the experimenter; has nonequivalent groups, static groups; used for single subject or program evaluation
non-probability techniques
use when representativeness is less important, test theoretical hypothesis; experimental designs, don't know who is going to show up to participate; the probability of the population being selected is usually not known because sampling is based on convenience; sample may not truly represent the population, may reduce external validity
single case experimental design
used to determine whether an experimental manipulation had an effect on a single research participant
Linear regression
used to establish relationship b/w 2 variables as a basis for prediction. X is the independent variable or predictor, Y is the dependent or criterion variable. ie. Can SBP be predicted from age?
Experimental design
used to test whether one variable influences a change in another variable
Quote
using a source's exact words in your own text
quote
using a source's exact words in your own text
Paraphrase
using material from a source in your own words & sentence structures, points are in the order the original author presents them
paraphrase
using material from a source in your own words and sentence structures, points are in the order the original author presents them
event-related potentials
using scalp electrodes, small electrical responses to specific inputs can only be observed by averaging the EEG traces over a series of trials
The Y-intercept of a line is the?
value of Y at the point where the regression line crosses the Y axis
error variance
variability in the dependent variable that is not associated with the dependent variable
The smaller the absolute value of the coefficient, the greater the ?
variability of the Ys at each X, the vertical width of the scatterplot, and the less accurately Y scores can be predicted from X
independent variable
variable that is manipulated by the experimenter
dependent variable
variable that may change in response to manipulations of the IV (what is measured)
quantitative variable
variable with values that alter in amount eg length, weight, height
qualitative variable
variable with values that alter in form but not quantity eg gender, eye colour, grade of moxa
Situational Variable
variables associated with the experimental situation itself that may affect the outcome
Intervening variables
variables caused by the IV, they intervene in a causal sequence between the IV and DV
discrete variable
varibale that may only take on specicifc, discrete values eg number of children in a fam, gender, number patients attending a clinic each day
Goal of the experimental research
verify the existence of a cause and effect relationship between two variables Why? Relationships between variables are complicated; cognitive biases for example
empiricism
view that science flourishes through observation and experiment.
R2 and adjusted r2
virtually the same if the sample is 50 or larger, tells us how much of the variance in Y in the sample was explained by X (same as proportion of explained variance)
Affirmed
we agree. decision stays the same
overconfidence effect
we overestimate our accuracy and our changes of success and ability to predict and explain
Disposition
what the current court did with the case
Mandatory Authority
when a case came from a higher court, you must follow it
Persuasive Authority
when a case did not come from a higher court, you don't have to follow it
Validity
when a research method measures what it is supposed to measure
Reliability
when a research method produces almost identical results in repeated trials
wording effects
when a specific word used in a question affects how respondents answer the question or the order of the questions
courtesy bias
when respondents often choose answers they think are "politically correct" or what the sponsor wants to hear
response set
when someone goes down the line on a survey and selects one consistent answer every time
Non-Probability Sampling
when there is no way to calculate the likelihood that a specific element of the population being studied will be chosen
confounding of variables
when two variables are linked together in a way that makes it difficult to sort out their specific effects.
PubMed
where MEDLINE database may be accessed for free
locus
where the behaviour occurs in the environment
External validity
whether the results obtained in the laboratory would be valid in the 'real world'.
Experimental Control
you want to control for everything except for your independent variable; control for any or all procedures that limit the possibility that the observed change in the DV is caused by some other variable that the IV. This is accomplished through random assignments - but still can never guarantee this 100%. When we control the experiment well, we can say that the experiment has high internal validity
