Research Methods 2

between-subjects design

1. A research design in which different groups of participants are randomly assigned to experimental conditions or to control conditions. 2. aka independent groups design 3. each participant only receives one level of the IV 4. Two separate groups of participants per condition

Describe the purpose of manipulation checks

1. attempt to directly measure whether the IV manipulation has the intended effect on the participants 2. helps with construct validity 3. asks whether the IV was successfully operationalized 4. positioned near the end of the experiment; after the DV but before debriefing

Define factorial design and discuss reasons why a research would use this design

1. designs w/more than 1 IV (or factor) 2. all levels of each IV are combined w/all levels of the other IVs 3.

behavioral

1. direct observations of behaviors 2. rate : # of times a behavior occurs in a given time period 3. rxn time : how quickly a response occurs after a stimulus 4. duration : how long a behavior lasts

Data in systematic observation studies are most likely to be A. quantitative. B. qualitative. C. hypothetical. D. nonempirical.

A. quantitative.

To observe the influence of external factors on students' performance, Raj asks participants to come to his laboratory, fill out a questionnaire, and attempt quizzes. He finds that over time, fewer participants show up to take part in the experiment. This decrease in the number of participants in the experiment is called A. the fatigue effect. B. mortality. C. regression. D. the practice effect.

A. the fatigue effect.

Three general types of questions:

Attitudes and Beliefs, Facts and Demographics, Behaviors (p.135)

Which of the following is an accurate statement about questionnaires? A. They do not lead to any problem of motivation. B. They are not as expensive as interviews. C. They do not require the respondents to read or understand the questions. D. They cannot be administered through the mail.

B. They are not as expensive as interviews.

If one cannot use all possible orders in a repeated measures design, a good alternative is to use A. an independent groups design. B. a Latin square. C. a reversal design. D. complete counterbalancing.

B. a Latin square.

During a survey, Alberto was asked to indicate his age, gender, and marital status. Which type of survey questions do these items represent? A. attitudes and beliefs B. facts and demographics C. behaviors D. objectives

B. facts and demographics

When examining the effect of appearances on judgments of criminal behavior, a researcher asks questions about the surroundings and the victim to disguise the dependent measures in the study. These unrelated questions are referred to as A. independent measures. B. filler items. C. task measures. D. placebo measures.

B. filler items.

The data in naturalistic observation studies are primarily ________ in nature. A. quantitative B. qualitative C. disruptive D. objective

B. qualitative

Students are asked to evaluate the food provided in the university cafeteria on 7-point scales with bipolar adjectives such as poor-good and inexpensive-expensive. What type of scales do these measures represent? A. graphic rating scales B. comparative rating scales C. semantic differential scales D. behavioral measure scales

C. semantic differential scales

The issue of ________ is particularly important when measuring human performance. A. physicality B. mentality C. sensitivity D. productivity

C. sensitivity

Different ways to construct questionnaire responses:

Closed-ended versus Open-ended (p.138)

Which of the following is an accurate statement about case studies? A. Case studies are not useful for examining rare or unusual events. B. Case studies are not useful in providing descriptions of individuals. C. Case studies do not overlap with naturalistic observation. D. Case studies do not necessarily involve naturalistic observation.

D. Case studies do not necessarily involve naturalistic observation.

_____ are a research tool that is used to ask people to tell us about themselves. A. Archival studies B. Direct observation C. Case studies D. Surveys

D. Surveys

Adam measures the amount of time two people spend gazing into each other's eyes as an indication of interpersonal attraction. In this scenario, Adam is most likely using a(n) A. archival measure. B. self-report measure. C. physiological measure. D. behavioral measure.

D. behavioral measure.

While interviewing Lia, Matthew nods his head and smiles whenever Lia responds with an answer that he likes. Matthew's behavior is an example of A. carryover effect. B. social desirability. C. sampling bias. D. interviewer bias.

D. interviewer bias

Raymond has designed a study to examine sexual arousal among male and female college students to erotic or nonerotic movies. A simple main effect of the type of movie would analyze whether arousal level is different for A. male and female viewers. B. viewers of erotic and nonerotic movies. C. males and females when the movie is erotic or nonerotic. D. movies when the viewer is a male and when the viewer is a female.

D. movies when the viewer is a male and when the viewer is a female.

The best research method to test the hypothesis that male elephants are more socially dominant than female elephants in the wild would be a(n) A. archival research study. B. experimental analysis. C. case study. D. naturalistic observation.

D. naturalistic observation

When testing the effect of noise on the performance of a task, Marco tests half the participants in a cool, quiet room and the other half in a hot, noisy room. In this case, what confounding variable has Marco failed to eliminate?

Room temperature

"Should residents of the city spend more money on parks and road improvements ?" is an example of a(n) __________ question. a. double-barreled b. negatively worded c. factual d. evaluative

a. double-barreled

Which general type of survey questions is exemplified by the question "Are you satisfied with the emergency services in your city?" a. facts and demographics b. attitudes and beliefs c. behaviors d. objectives

b. attitudes and beliefs

A good naturalistic observation report will support the analysis by using A. correlational analysis. B. multiple confirmations. C. only qualitative data. D. only quantitative data

b. multiple confirmations

which of the following is an accurate statement about open-ended questions ? a. They are cheaper to analyze than close-ended questions. b. They are less time consuming to code than close-ended questions. c. They are more useful in evaluating people's thoughts than close-ended questions

c. They are more useful in evaluating people's thoughts than close-ended questions

The question "Are you a full-time student?" with answer options "yes" or "no" is an example of a(n) _________ question. a. double-barreled b. open-ended c. close-ended d. loaded

c. close-ended

"Are you in a favor of programs designed to help lower the unreasonably high rent in the country ?" is an example of a __________ question. a. double-barreled b. simplistic c. socially undesirable d. loaded

d. loaded

"Do you agree that male teenage drivers are more dangerous than female teenage drivers ?" is an example of a _________ question. a. yea-saying and nay-saying b. simplistic c. double-barreled d. loaded

d. loaded

Behaviors

focus on past behaviors or future behaviors

Attitudes and Beliefs

focus on the ways that people evaluate and think about issues

When a confounding variable is present in an experiment, _____.

internal validity is challenged

A confounding variable is problematic for an experimental design because it

makes possible alternative explanations for the results

in the context of response sets, a person who tries to present himself or herself in positive way in a questionnaire is showing __________

social desirability (aka "faking good") (p.134)

response sets

tendency of research participants to distort their responses to questionnaire items from a particular perspective than to provide answers that are directly related to the questions (p.134)

Discuss the role of simple main effects in interpreting interactions

when there is a significant interaction, a simple main effect analysis examines the mean differences at each level of the IV

Question wording: (p.136-137)

1. Simplicity 2. Double-barreled 3. Loaded (Avoid emotionally charged words) 4. Negative wording 5. Yea-saying and Nay-saying

self-report

1. a method in which people provide subjective information about their own thoughts, feelings, or behaviors, typically via questionnaire or interview 2. ex: survey 3. rating scales with descriptive anchors (endpts) are most commonly used 4. measure attitudes, liking for someone, judgments, about someone's personality characteristics, intended behaviors, and many other aspects of human thought and behavior

pretest-posttest design

1. a type of research design (often a quasi-experiment) where behavior is measured both before and after a treatment or condition is implemented 2. pretest given before manipulation of IV 3. Disadvantage : can sensitize participants to what you're studying can be assessed into 2 ways a. ostensible b. embedded in other measures

Generalizability Issues with non-probability sampling

1. affect ability to generalize results to larger population 2. sample size increases statistical significance because it provides more accurate estimates of the populations values 3. haphazard/convenience

Counterbalancing

1. all possible orders of presentation are included in the experiment 2. possible to determine the extent to which order is influencing the results (p.171)

within-subjects design

1. an experimental design in which the same subjects are tested under each condition 2. aka repeated measures design 3. reduce participant variability 4. all participants receive every level of the IV 5. same group of participants in each condition 6. Advantages : fewer research participants, more skeptical power (less random error), more likely to detect effect 7. Disadvantages: a. order effect b. practice effect c. fatigue effect d. carryover effect

Demand characteristics

1. any feature of the experiment that might inform participants about the purpose of the study 2. social desirability is a risk 3. use deception to avoid demand characteristics 4. assess for demand during debriefing 5. placebo groups

Rating Scales

1. ask people to provide "how much" judgments on any number of dimensions 2. simplest and most direct scale presents people with five or seven response alternatives (p.139)

Random assignment

1. assigning participants to experimental and control conditions by chance, thus minimizing preexisting differences between those assigned to the different groups 2. w/a sufficiently large sample of participants, random assignment will produce groups that are nearly identical 3. as sample size increases, so does likelihood that you will find a significant effect (need 20-30 per condition)

Simplicity

1. easy to understand and respond to the questions 2. avoid jargon and technical terms that people will not understand 3. make the question long or a bit complex to make it easier to understand 4. ex. p.137

carryover effects

1. effect of the first treatment to carry over to influence the response of the second treatment 2. may also occur when the first condition produces a change that is still influencing the person when the second condition is introduced (p.170) 3. Lane, Cherek, Tcheremisssine, Lieving, and Pretras (2005) a. passed drug tests b. assigned to one of 3 marijuana doses c. measured risk-taking d. run on separate days at least 5 days apart. Why?

Identify factors to consider when writing questions

1. explicitly determine the research objectives 2. survey q's must be tied to the research q's that are being addressed 3. attitudes and beliefs, facts and demographics, and behaviors 4. wording (p.136)

non probability sampling techniques

1. haphazard sampling (convenience sampling) 2. purposive sampling : meet predetermined criteria 3. quota sampling : collect data using haphazard

Compare assignment of participants in an independent groups design, a repeated measures design, and a mixed factorial design

1. independent groups design : Participants are allocated to different groups where each group represents one experimental condition 2. repeated measures design : An experiment using a within-groups design in which the same participant participates in all conditions 3. mixed factorial design : A design that includes both independent groups (between-subjects) and repeated measures (within-subjects) variables.

closed-ended questions

1. limited number of response alternatives are given 2. more structured approach 3. easier to code and response alternatives are the same for everyone

semantic differential scale

1. measure of the meaning of concepts . 2. bipolar adjectives using 7 point scale (p.140)

physiological

1. recordings of responses of the body 2. ex: galvanic response (measures general emotional arousal and anxiety), electromyogram (measure of muscle tension, and frequently used as a measure of tension or stress), electroencephalogram (measure of electrical activity of brain cells)

graphic rating scale

1. requires a mark along continuous 100 millimeter line that is anchored with descriptions at each end 2. method of performance measurement that lists traits and provides a rating scale for each trait (p.140)

open-ended questions

1. respondents are free to answer in any way they like 2. require time to categorize and code the responses and are therefore more costly to conduct and more difficult to interpret 3. sometimes response cannot be categorized

Describe the purpose of pilot studies

1. reveal whether participants understand the instructions, identify confusions, etc 2. provides opportunity to make changes before doing the entire study

Describe three types of dependent variables

1. self-report 2. behavioral 3. physiological

probability sampling techniques

1. simple random sampling : each member has equal probability of being chosen 2. stratified random sampling (strata) : subdivided groups 3. cluster sampling *use if accuracy of representative is important *each member has equal probability of being chosen (p.153)

Framing Effect

1. the tendency for people's choices to be affected by how a choice is presented, or framed, such as whether it is worded in terms of potential losses or gains

Describe ways to control participant and experimenter expectations

1. training experimenters 2. run all conditions simultaneously 3. automate procedures 4. single-blind v. double-blind experiment a. participants/experimenters unaware of which condition he/she is assigned to

Double-barreled

1. two questions in one ex. p.137

Negative wording

1. using double negatives, people become confused about what a negative answer means 2. avoid phrasing questions with negatives ex. p.137

Yea-saying and Nay-saying

1. when you ask several questions about a topic, a respondent may employ a response set to agree or disagree with all the questions ex. p.137

In a 2 × 3 factorial design, there are _____ main effect(s) and _____ interaction effect(s) possible. A. 2; 2 B. 2; 1 C. 3; 2 D. 2; 3

2; 1

Jane, a researcher, measured the performance of two groups of employees. One group received low monetary incentives first and was later given high monetary incentives. The other group was given high monetary incentives first and was later given low monetary incentives. At each stage, the employees' performance was measured. This scenario exemplifies a(n) A. independent groups design. B. repeated measures design. C. posttest-only design. D. Solomon four-group design.

B. repeated measures design.

Ralph, a researcher, employs a confederate to push into a queue at a grocery store checkout counter in front of a person who is second and then another person who is ninth in line. He then records the number of verbal responses toward the confederate at each instance as a measure of aggression. The manipulation employed in this scenario is an example of a ________ manipulation. A. sequential B. staged C. straightforward D. dependent

B. staged

Which of the following manipulates variables with instructions and stimulus presentations? A. staged manipulations B. straightforward manipulations C. stimulus manipulations D. physical manipulations

B. straightforward manipulations

A researcher tries to understand the aggressive driving behaviors of drivers by observing the honking patterns and hand gestures displayed by those drivers. This is an example of ________ observation. A. concealed B. systematic C. qualitative D. archival

B. systematic

An interaction occurs whenever A. the manipulation check indicates a manipulation failure. B. the effect of one independent variable changes across levels of a second independent variable. C. both independent variables have an effect. D. the dependent variable is effectively manipulated in a factorial design

B. the effect of one independent variable changes across levels of a second independent variable.

A manipulation check is advantageous when A. the ethical and educational implications of a study have to be discussed with the participants. B. the results obtained indicate that no relationship exists between the independent and the dependent variables. C. a researcher wants to refrain his participants from discussing a specific study with others. D. a confederate needs to be employed to appear as another participant in an experiment.

B. the results obtained indicate that no relationship exists between the independent and the dependent variables.

An educational researcher examines the effect of speaker credibility on attitude change in university and community college students. The PV in this design is the A. credibility of the speaker. B. type of student. C. educational researcher. D. attitude change.

B. type of student.

A researcher employs an IV × PV design to examine attitudes toward cheating. She presents freshmen from a private university with a written account describing a male or female student who was accused of cheating on an exam. The same procedure is repeated for a sample of freshmen from a public university. After reading the account, the students are asked to assign an appropriate punishment. The PV in this design would be the A. gender of the student accused of cheating. B. university attended (private or public). C. class level of the participants (freshmen). D. punishment assigned.

B. university attended (private or public).

While Leo is performing a cognitive task, a researcher uses a physiological measure that scans various areas of his brain. In this case, the researcher is most likely using a(n) A. electrocardiogram. B. galvanic skin response. C. functional MRI. D. electromyogram.

C. functional MRI

If a researcher thinks that a nonmonotonic relationship may exist between two variables, he or she would need to A. manipulate two or more independent variables. B. have a stronger manipulation of the dependent variable. C. include more than two levels of the independent variable. D. measure more than one dependent variable

C. include more than two levels of the independent variable.

Individuals with work experience and those without work experience are given identical resumes of a male or a female applicant and asked to indicate the likelihood that they would hire the individual. The PV in this design is A. the gender of the applicant. B. the gender of the participant. C. individuals with or without work experience. D. the hiring likelihood

C. individuals with or without work experience.

A matched pairs design is most likely to be used when A. the sample size is large. B. the matching variable and the dependent variable are unrelated. C. only a few participants are available for the study. D. running large numbers of individuals in the experiment is inexpensive.

C. only a few participants are available for the study.

When Mr. Arthur, a researcher, submits a paper to a journal for publication, other researchers who are familiar with his area of research carefully scrutinize the paper and recommend acceptance or rejection. This process is known as A. a manipulation check. B. correspondence analysis. C. peer review. D. debriefing.

C. peer review.

In the context of the types of measures, ________ measures are recordings of responses of the body. A. archival B. self-report C. physiological D. behavioral

C. physiological

To study human behavioral patterns during crisis situations, Clara first conducts a trial run with a small number of participants. She does this to make sure that the instructions are clear to the participants and the whole experimental setting is plausible. This procedure is an example of a A. manipulation check. B. double-blind study. C. pilot study. D. research proposal.

C. pilot study.

Jacob, a researcher, asks the participants of his study to transfer data from 12 spreadsheets to 12 different documents. He observes that the participants gain more efficiency in transferring the data with each new spreadsheet. This scenario exemplifies a(n) A. carryover effect. B. primacy effect. C. practice effect. D. attrition effect.

C. practice effect.

It is important to use _____ sampling when researchers want to make precise statements about a specific population on the basis of the results of their survey. A. haphazard B. quota C. probability D. purposive

C. probability

A researcher wants to gather information on citizens' reactions to the local government's decision to construct a new airport in their neighborhood. The researcher gathers groups of citizens and asks them to discuss the advantages and disadvantages of the proposed airport. This type of data gathering can be referred to as a(n) ________ approach to describing behavior. A. intrinsic B. quantitative C. qualitative D. extrinsic

C. qualitative

In the early stages of research, a ________ is particularly important to demonstrate that a relationship exists between variables. A. moderate manipulation B. weak manipulation C. strong manipulation D. costly manipulation

C. strong manipulation

Dunn et al. (2005) conducted an experiment of the relationship between exercise and depression. Participants were randomly assigned to either a low or a high intensity workout regime. Some were assigned to work out 3 days a week, while other participants worked out 5 days a week. Identify the independent variable(s) in this study. A. energy condition B. the participants' interest in exercise and health conditions C. the amount of exercise and the frequency of exercise D. depression

C. the amount of exercise and the frequency of exercise

Mike wants to find out whether campers prefer cotton or nylon sleeping bags. He asks a group of female campers to try both nylon and cotton sleeping bags. The sleeping bags were rated for softness and warmth. Mike intends to generalize the findings to apply to all campers. What is the confounding variable in Mike's experiment? A. cotton or nylon material B. softness C. the gender of the campers D. sleeping bags

C. the gender of the campers

Kalim wants to study the effectiveness of a new teaching method. He includes two teachers of a class in the experiment. One teacher uses the new method of teaching, and the other teacher uses the old method. At the end of the semester, he finds that students who were taught in the new way had higher grades than students taught in the old way. What is the confounding variable? A. the grades B. the teaching methods C. the two teachers D. the clas

C. the two teachers

Which of the following does not increase the likelihood of internal validity? A. the use of control for extraneous variables B. the use of random assignment C. the use of a pretest D. the use of experimental control

C. the use of a pretest

Dr. Michael examines the messages displayed on Internet bulletin boards in order to study whether males and females differ in the way they describe themselves when interacting with others. What type of archival research data is Dr. Michael using? A. statistical records B. survey archives C. written records D. video observation

C. written records

Salma studies historical data published by the United States Census Bureau to determine if there has been an increase in the population of African Americans in the United States over the last decade. This study is an example of a(n) A. naturalistic observation study. B. psychobiography. C. field experiment. D. archival research study.

D. archival research study.

Michelle conducts an experiment on the effects of low and high anxiety on test performance. The results achieved are nonsignificant. She is unable to determine if anxiety truly has no effect on performance or whether the procedures used are faulty. In which of the following ways can this ambiguity be avoided? A. by conducting an ethics evaluation B. by checking the external validity of the variables C. by using factorial study with better controls D. by conducting a manipulation check

D. by conducting a manipulation check

Asking students "Does your instructor show up on time?" and requiring them to indicate their response with a "yes" or "no" is an example of a _____ question. A. loaded B. double-barreled C. negatively worded D. closed-ended

D. closed-ended

A researcher wants to study the effect of different levels of noise on the performance of students in a math test and a history test. The two levels of noise are low and high. The researcher uses different sets of individuals for each level and each type of test. This is an example of a(n) A. within-subjects design. B. repeated measures design. C. mixed factorial design. D. independent groups design.

D. independent groups design.

When individuals participate in only one experimental condition, it is a(n) _____ design. When individuals participate in all experimental conditions, it is a _____ design. A. single group; full measure B. partial; whole C. group; multigroup D. independent groups; repeated measures

D. independent groups; repeated measures

At the end of a three-year study, Lene finds that 12 percent of her participants did not take part in the final survey because they moved away to another city. In research terms, Lene is experiencing issues related to A. maturation. B. testing. C. regression. D. mortality.

D. mortality.

Do you agree that elected officials should not be allowed to run for more than two consecutive terms in office?" is an example of a _____ question. A. double-barreled B. simplistic C. yea-saying and nay-saying D. negatively worded

D. negatively worded

A floor effect can be best described as a A. situation in which it is difficult to determine the causal relationship between two variables. B. problem that occurs when participants try to look good by behaving in the most socially acceptable way. C. situation in which two variables are correlated because a third, unknown variable is causing them both to correlate. D. problem that occurs when a task is so difficult that hardly anyone can perform well.

D. problem that occurs when a task is so difficult that hardly anyone can perform well.

A researcher stands outside a restaurant and asks the youngsters leaving the restaurant if they enjoyed the food there. What type of sampling technique has the researcher employed? A. simple random sampling B. stratified random sampling C. cluster sampling D. purposive sampling

D. purposive sampling

Daniela and Alicia are conducting a systematic observation study on children's aggressive behavior in playgrounds. Daniela concludes that boys display more aggressive behaviors than do girls, whereas Alicia concludes the opposite. Which methodological issue would be of most concern in this study? A. reactivity B. sampling bias C. validity D. reliability

D. reliability

In a shopping mall, a marketing researcher asks customers if they would prefer soda in a bottle or in a can. Their responses would be an example of a ________ measure. A. marketing B. psychological C. multiple D. self-report

D. self-report

While analyzing the interaction between age and gender, Reba finds a difference in the likelihood of being hired between young and old applicants when they are females. However, she finds no such difference between young and old applicants that are males. Based on the findings, Reba has examined the A. main effect of age. B. main effect of gender. C. simple main effect of age. D. simple main effect of gender

D. simple main effect of gender

An employment agency wants to examine the employment rate in a city. The employment agency divides the population into the following subgroups: age, gender, graduates, nongraduates, and discipline of graduation. The employment agency then indiscriminately selects sample members from each of these subgroups. This is an example of A. simple random sampling. B. purposive sampling. C. convenience sampling. D. stratified random sampling

D. stratified random sampling

Which of the following is least likely to be considered when determining how to manipulate an independent variable? A. the external validity of the study B. the ethical considerations of a strong manipulation C. the cost of the manipulation D. the internal validity of the study

D. the internal validity of the study

Facts and Demographics

Factual questions ask people to indicate things they know about themselves and their situation

Straightforward manipulations of the IV

Operational definitions that involve manipulating the independent variable using instructions or other stimulus presentations ex. presented verbally, written form, videotape, or with computer (p.181)

Happiness Study

a very long-term Harvard study (started in the 1930s) following Harvard students (unfortunately men only) has found that the Three Most Important Components Found in a Happy Life are: 1) Partnership - doesn't matter with whom; 2) Keeping in touch with your siblings; 3) Having a job/career where you are working for some common good - Examples-teaching, writer, working for NGO. In contrast, the component found in many unhappy lives: alcoholism.

In a survey, participants were asked if they agree with the stmt "I like spending my free time with other people." They were also asked if they agree with the stmt "I enjoy being alone during my free time." This type of questioning helps in identifying _________. a. negative wording b. simplicity c. response sets d. loaded questions

c. response sets

Toby wants to see whether packaging information affects the way people rate breakfast cereal. The same cereal is put in three kinds of packages: a brown box that says "To start your day off with a smile"; a yellow box that says "For extra energy all day"; and a white box that says "Fortified with B complex and iron." In this study, the:

package information is confounded with the color of the box

Debriefing

the postexperimental explanation of a study, including its purpose and any deceptions, to its participants

Advantages/Diasadvantages of pre-test-posttest and post-test only

-Advantages of the pretest design: *Equivalence of groups in the experiment: It is possible that with a small sample size there is less randomization. So the pretest enables researchers to assess whether the groups are equivalent or not to begin with. *Pretest can also be used to help select participant in the experiment. For example a researcher might need to know the highest or lowest scores on math-anxiety tests or smoking tests. Once these are identified then the participants can be randomly assigned to the control and the experimental group. -Disadvantage of the pretest *It may be time-consuming and awkward to administer *Sensitize participants to what is being studied: Demand characteristics, Reduces external validity -Advantages to the pretest- protest•The pretest-protest design immediately makes us focus on the change from pretest to protest. The emphasis on the change is incorporated into the analysis of group differences. The extent of change is also recognized•Assess equivalency of groups with small sample size•Can use to select participants for the experiment•Pretest is also necessary when there is a possibility that a participant will drop out of the experiment. The dropout is called attrition of mortality. This usually happens when the experiment is too long. Pretest enables you to assess the affects of the attrition. -An advantage to the posttest only design is it allows basis for comparison of two groups. A disadvantage of only have a posttest design is you are less aware of the likelihood for participants to drop out during the study. An advantage to the pretest-posttest design is researchers are able to actively ensure that the two groups of participants are in fact equivalent. A disadvantage to this design is participants can gain knowledge from the pretest and assume the researcher's hypothesis. This may cause participants to act or answer different that they would without the pretest.

posttest-only design

1. A true experimental design in which the dependent variable (posttest) is measured only once, after manipulation of the independent variable. 2. obtain 2 equivalent groups (use random assignment; eliminates selection difference)

Multiple measures

1. Alternative measures 2. Different forms of formal and informal formative and summative assessments used together to provide accurate measures of what a student knows and can do. 3. if the IV has the same effect on several measures of the DV, there will be > confidence in the effect

Loaded

1. Avoid emotionally charged words 2. written to lead people to answer in one way ex. p.137

Discuss the sensitivity of the DV, contrasting floor effects and ceiling effects

1. DV should be able to detect diff. btwn groups 2. Sensitivity is important to consider in human performance a. ceiling effect : DV is too easy; everyone will do well; IV seems to have no effect b. floor effect : DV is too hard; everyone does poorly so IV seems to have no effect

Describe an IV x PV design

1. Includes both experimental (manipulated) and nonexperimental (measured or nonmanipulated) variables. 2. Independent variable x participant variables. 3. Allows researchers to investigate how different types (age, sex, test scores, introvert) of individuals respond to the same manipulated variable. 4. Simplest is one manipulated IV and one PV with at least two levels. For example, the effects of distraction for introverts and extroverts in silence and TV. (Furnham, Gunter and Peterson, 1994).

sample size

1. Larger sample sizes yield more reliable results, (reflect true population value) but are more expensive than smaller samples. 2. reduce the size of the confidence intervals

Describe the information provided by main effects and interaction effects in a factorial design

1. Main Effects a. effect of each IV by itself 2. Interaction Effects a. if there's an interaction btwn 2 IVs, the effect of 1 IV depends on the particular level of the other IV

simple design

1. One IV w/2 levels and One DV 2. Two forms: posttest-only design or a pretest-posttest design (p. 163)

staged manipulations (or event manipulation) of the IV

1. Operational definitions that involve creating a situation in which the independent variable is manipulated; participants then experience the situation and their responses are recorded. 2. Deception is often used to conceal the fact that the situation is 3. reasons its used : a. create some psychological state in participants such as anger or frustration b. stimulate some situation that occurs in the real world 4. frequently employ a confederate

The _____ is the actual population of individuals, or clusters, from which a random sample will be drawn. A. sampling frame B. response set C. confidence interval D. focus group

A. sampling frame

interviewer bias

A response bias that occurs because the presence of the interviewer influences respondents' answers.

Mike wants to study the effects of an energy drink on athletic performance. He designs a study in which he has two groups that are not given an energy drink (control groups) and two groups that are given an energy drink (experimental groups). In the design, one control group and one experimental group are asked to fill out a questionnaire before the experiment, while the other control group and experimental group are not given a questionnaire. Mike's design is an example of a A) Solomon four-group design. B) posttest-only design. C) repeated measures design. D) two-group control design.

A) Solomon four-group design. ???

A researcher attempts to study the effects of alcohol on task performance. One factor is alcohol (alcohol treatment, placebo control), and the other factor is task difficulty (easy, difficult. If the researcher uses a repeated measures design with 15 participants per condition, how many participants will he need for the study? A. 15 B. 30 C. 45 D. 60

A. 15

A researcher examined judgments of responsibility for an automobile accident by manipulating the type of injuries received (none, mild, or severe) and the time of the accident (7 a.m., 12 p.m., 6 p.m., or 3 a.m.). How many main effects are possible in this study? A. 2 B. 4 C. 7 D. 12

A. 2

A researcher studies the effect of room music (fast, slow) and room cleanliness (tidy, untidy) on people's dining experience at a restaurant. How many main effects are possible? A. 2 B. 4 C. 8 D. 1

A. 2

Which of the following is a probability sampling technique? A. simple random sampling B. quota sampling C. haphazard sampling D. purposive sampling

A. simple random sampling

A researcher examines the effect of noise levels on reading comprehension. He finds that the participants who were tested received the highest scores for their comprehension irrespective of the noise levels. The results are most likely due to a ________ effect. A. fatigue B. performance C. ceiling D. floor

C. ceiling

Which of the following is a reason why a researcher may design an experiment with more than two levels of an independent variable? A. A design with only two levels of one independent variable cannot provide much information about the exact form of the relationship between the independent and dependent variables. B. When there are only two levels of an independent variable, the relationship between the independent and dependent variables cannot be described with a straight line. C. An experiment with only two levels of one independent variable always tends to show that there is a positive relationship between the independent and dependent variables. D. An experimental design with only two levels of the independent variable can only detect curvilinear relationships between the independent and dependent variables.

A. A design with only two levels of one independent variable cannot provide much information about the exact form of the relationship between the independent and dependent variables.

A(n) _____ variable is a variable that varies along with an independent variable. A. confounding B. dependent C. criterion D. extraneous

A. Confounding

A 2 × 2 factorial design was used to study the effects of participant gender and style of persuasion on attitude change using 40 individuals. This is an example of a(n) _____ design. A. IV × PV B. repeated measures C. Latin Square D. Solomon four-group

A. IV × PV

Which of the following statements is true of statistical analysis of data? A. It allows a researcher to examine and interpret the pattern of results obtained in a study. B. It includes a literature review that provides the background for a study. C. It does not enable researchers to decide if there is any relationship between the variables. D. It is usually the first step in a research and precedes data collection.

A. It allows a researcher to examine and interpret the pattern of results obtained in a study.

Which of the following is the general format for describing factorial designs? A. Number of levels of first IV × Number of levels of second IV B. Number of IVs × Total number of levels C. Number of main effects × Number of interactions D. Number of conditions of first IV × Number of conditions of second IV

A. Number of levels of first IV × Number of levels of second IV

What is the difference between quantitative and qualitative methods of describing behavior? A. Qualitative research focuses on people behaving in natural settings, whereas quantitative research focuses on specific behaviors that can be easily counted. B. Quantitative research emphasizes collecting information from a few individuals, whereas qualitative research emphasizes collecting data from a higher number of individuals. C. Quantitative research draws conclusions based on interpretations of the investigator, whereas conclusions in qualitative research are based upon statistical analysis of data. D. Quantitative research focuses on people describing their world in their own words, whereas qualitative research focuses on people describing their experiences under experimental conditions.

A. Qualitative research focuses on people behaving in natural settings, whereas quantitative research focuses on specific behaviors that can be easily counted.

Tracy wants to study the different behavioral patterns displayed by the members of her organization through naturalistic participant observation. Which of the following will be true of her study? A. She might lose the objectivity required to conduct scientific observation. B. She will not be able to support the results of her study with multiple confirmations. C. She is unlikely to be biased, and her conclusions will be free of subjectivity. D. She will most likely use quantitative statistical data rather than qualitative data.

A. She might lose the objectivity required to conduct scientific observation.

Williams, a criminal investigator, measures a suspect's change in perspiration while being asked questions about a burglary case. In this scenario, which of the following physiological measures is used by the investigator? A. a galvanic skin response B. an electromyogram C. an electroencephalogram D. a functional MRI

A. a galvanic skin response

To control order effects in a repeated measures design, one should use a(n) A. counterbalancing technique. B. independent groups design. C. reversal design. D. short time interval between conditions

A. counterbalancing technique.

In a factorial design, a main effect is the A. effect of one independent variable at one level on another independent variable. B. effect of one independent variable averaged over the levels of the other independent variables. C. only effect of interest. D. effect of the dependent variable on the independent variable.

A. effect of one independent variable at one level on another independent variable.

In ________, the researcher makes observations of individuals in their natural environments. A. naturalistic observations B. laboratory experiments C. observational learning D. environmental research

A. naturalistic observations

In a repeated measures design, when the sequence of presenting the treatments determines the participants' responses in part, the researcher is dealing with A. order effects. B. incomplete counterbalancing. C. constancy. D. criterion variables.

A. order effects.

To analyze the effects of a new drug for anxiety developed by Solvit Wellness Inc., researchers conduct a study on two groups. Both the groups are informed about the usefulness of the drug in treating anxiety. However, only group A receives an injection of the actual drug, while group B receives an injection containing an inert substance. In this scenario, group B is known as a(n) A. placebo group. B. high-anxiety group. C. topical group. D. experimental group.

A. placebo group.

Jeanne wants to know whether wearing sunglasses improves driving performance. If she uses an independent groups design, she would manipulate the variable by A. randomly requiring half the drivers to drive with sunglasses and the other half to drive without sunglasses. B. having all drivers first drive without sunglasses and then with sunglasses. C. having half the drivers first drive without sunglasses and then with sunglasses and having the other half first drive with sunglasses and then without sunglasses. D. requiring all drivers to first drive with sunglasses and then without sunglasses.

A. randomly requiring half the drivers to drive with sunglasses and the other half to drive without sunglasses.

Content analysis and systematic observation are similar because both A. require researchers to devise coding systems. B. depend on qualitative data. C. are forms of laboratory experiments. D. require concealed participation.

A. require researchers to devise coding systems

An investigator wants to test the effectiveness of visualization on sports performance. She randomly assigns participants to two groups. Participants in the visualization group imagine themselves swinging a golf club perfectly for 20 minutes prior to a session on the driving range. Participants in the control group read a golf magazine for 20 minutes prior to a session on the driving range. All participants do this procedure each day for five days. The dependent measure, the average flight distance of the ball, is calculated for each participant after each session. This is an example of a(n) ________ design. A. two-group pretest-posttest B. 2 × 5 mixed factorial C. 2 × 5 independent groups factorial D. IV × PV factorial

B. 2 × 5 mixed factorial

A researcher designs an experiment by manipulating the following variables: type of movie (horror, comedy), gender of participants (male, female), and food intake (low, high). For a completely independent groups design with 12 participants per group, how many participants would the researcher need? A. 72 B. 96 C. 192 D. 36

B. 96

Which of the following is true of factorial designs? A. They eliminate the possibility of confounding variables. B. All levels of each independent variable are combined with all levels of the other independent variable. C. A control group is unnecessary. D. The simplest factorial design has three independent variables, each having three levels.

B. All levels of each independent variable are combined with all levels of the other independent variable.

Ahmed conducts a study to test the effectiveness of a drug. He surveys the participants twice—once at intake and then six months later. He finds that the drug was overall effective, but approximately 55 percent of the original sample stopped using the drug. Therefore, he does not have posttest data for them. In this case, what is likely to be an alternative explanation for the results obtained by Ahmed? A. maturation B. attrition C. statistical regression D. diffusion of treatment

B. Attrition

An experimenter's expectations are less likely to influence the results of a study with A. staged manipulations. B. automated procedures. C. single-blind procedures. D. straightforward manipulations.

B. Automated Procedure

Instead of providing true responses to questions on a survey, Ali answers in such a way that he could portray a better image of himself. This tendency of Ali to answer questions from a particular perspective is an example of A. self-serving bias. B. a response set. C. social loafing. D. a feedback response.

B. a response set.

Event manipulations often involve the use of A. videotapes. B. confederates. C. learning materials. D. stimulus presentations.

B. confederates.

Jim, a researcher, attempts to test the effect of the environment in an examination hall on a student's performance. However, he gives students question papers that differ in complexity and subject matter. His results would not be reliable because the complexity and subject matter of the examination are A. dependent variables. B. confounding variables. C. independent variables. D. control variables.

B. confounding variables.

Any feature of an experiment that might inform participants of the purpose of the study is called A. an experimenter expectancy effect. B. demand characteristics. C. a placebo effect. D. a manipulation check.

B. demand characteristics.

To study diversity in an organization, 10 employees belonging to different departments are brought together by a psychologist to discuss their perceptions of diversity in the company. In the context of interviews, this is an example of a(n) A. panel study. B. focus group. C. internet-based study. D. online survey research.

B. focus group.

A disadvantage of naturalistic observation is that it cannot be used to A. study all issues or phenomena. B. investigate complex social settings. C. provide a complete picture of what occurred in a setting. D. develop theories based on the observations of other research studies.

B. investigate complex social settings.

In general, staged manipulations are ________ than straightforward manipulations. A. less costly B. more costly C. weaker D. stronger

B. more costly

In the context of physiological measures, the electromyogram is used to measure A. brain activity. B. muscle tension. C. emotional arousal. D. learning ability.

B. muscle tension.

In the context of systematic observation, which methodological issue refers to the possibility that the presence of the observer will affect the behaviors of those being observed? A. contiguity B. reactivity C. validity D. reliability

B. reactivity

How can expectancy effects be reduced? A. by using experimenters who are aware of the hypothesis being investigated B. by examining participants in different groups C. by using a double-blind experiment D. by avoiding the use of balanced placebo design

C. by using a double-blind experiment

Identify the design of a study that manipulates the temperature in a room (warm or cold), difficulty of study material (easy, difficult), and the amount of material (low, moderate, high). A. 2 × 2 B. 2 × 3 C. 2 × 2 × 3 D. 3 × 3

C. 2 × 2 × 3

A researcher is interested in variables that may affect an individual's driving ability. He has people drive a course in wet, dry, and icy conditions. In addition, he has them drive a vehicle with or without power steering, and with an automatic or a manual transmission. This design is an example of a ________ factorial. A. 2 × 2 B. 3 × 2 C. 3 × 2 × 2 D. 2 × 2 × 2

C. 3 × 2 × 2

A researcher examines the physical attractiveness of a driver involved in an automobile accident (unattractive, average, or attractive) and the severity of damage caused ($500, $1500, or $2500) on judgments of responsibility assigned to the driver. Which of the following represents the factorial design? A. 2 × 2 B. 2 × 3 C. 3 × 3 D. 1 × 3

C. 3 × 3

You read in the newspaper that Proposition Q is favored by 57% of those polled. The results of the survey are said to be accurate within ±2 percentage points using a 95% level of confidence. From the information provided, it can be inferred that the actual population value is probably between A. 58% and 64%. B. 57% and 95%. C. 55% and 59%. D. 93% and 97%.

C. 55% and 59%.

Which of the following is an accurate statement about sample size? A. A smaller sample size will reduce the size of the confidence interval. B. Sample size is a constant percentage of the population size. C. A larger sample size is needed for increased accuracy. D. Sample size is independent of the confidence interval.

C. A larger sample size is needed for increased accuracy.

_____ is a process for controlling order effects with all possible orders. A. Elimination B. Randomization C. Counterbalancing D. A Latin square

C. Counterbalancing

Which of the following is a drawback of the matched pairs design? A. It is not useful when only a few participants are available. B. It fails to ensure that the groups are equivalent. C. It can be costly and time-consuming. D. It simply randomly assigns participants to groups.

C. It can be costly and time-consuming.

Which of the following statements is true about a loaded question? A. It asks two or more things at a time. B. It is commonly referred to as a nay-saying question. C. It is written to lead people to respond in one way. D. It is a question type that is mostly loaded with lots of jargon, technical terms, and slangs.

C. It is written to lead people to respond in one way.

Which of the following is true of a 2 × 2 × 2 factorial design? A. There are four possible conditions. B. There are six possible main effects. C. There are four possible interactions. D. There are six independent variables, each with two levels.

C. There are four possible interactions.

A researcher wants to understand if people's age and their religious affiliations are related to political conservatism. To do so, he analyzes data available on the Inter University Consortium for Political and Social Research. In this case, which type of research approach is employed by the researcher? A. a case study B. a field experiment C. a survey archive D. a participant observation

C. a survey archive

A researcher finds that for female applicants, the likelihood of being hired for a job increases as their work experience increases. However, for male applicants, the likelihood of being hired decreases as their work experience increases. This finding suggests A. a main effect of gender. B. a main effect of work experience. C. an interaction between gender and work experience. D. that gender and work experience have no effect on the likelihood of being hired for a job.

C. an interaction between gender and work experience.

Two researchers studied the relationship of positive emotions and longevity by examining the smile intensity of major league players in photographs from the past and comparing it to their age at the time of death. This research method can be regarded as an example of A. naturalistic observation. B. case study. C. archival research. D. a psychobiography.

C. archival research.

Good experimental design requires eliminating possible _____ variables that could result in alternative explanations

Confounding

In a 4 × 3 factorial design, for a repeated measures design, how many participants are needed in order to have 20 participants per condition? A. 70 B. 40 C. 10 D. 20

D. 20

A researcher had young or middle age participants watch a PG-13 or an R-rated film. After viewing the film, the participants rated the amount of violence in the films—the higher the assigned rating, the more violent the film. The mean results in the four conditions were: Which of the following statements is least likely to be true? A. An interaction between age and type of movie exists. B. A simple main effect of participant age exists when the movie is rated R. C. An interaction between age and type of movie exist for PG-13 movies but not for R-rated movies. D. A simple main effect of participant age does not exist when the movie is rated PG-13.

D. A simple main effect of participant age does not exist when the movie is rated PG-13.

Which of the following statements is true about a double-blind experiment? A. An accomplice is an actual part of the experiment and is unaware of any underlying manipulation. B. The experimenter does a trial run with a small number of participants to study the actual effects of an administered drug. C. A participant is informed about the actual purpose of the experiment and the expected results. D. The experimenter is unaware of whether a placebo or the actual drug is being administered.

D. The experimenter is unaware of whether a placebo or the actual drug is being administered.

Which of the following is an accurate statement about closed-ended questions? A. They allow the respondents to answer in any way they like. B. They require extra time to categorize the responses. C. They are costlier than open-ended questions. D. They are easier to code than open-ended questions.

D. They are easier to code than open-ended questions.

Irene wants to examine the effect of a defendant's appearance on the judgment of guilt for a crime. She has participants read an identical account of the crime except for the defendant's appearance. A group of high school students receives the description of an attractive defendant, while a group of senior citizens receives the description of an unattractive defendant. Both groups are then asked to rate the defendant's guilt on a seven-point scale. A major cause for confusion in Irene's experiment is the A. manipulation of appearance. B. measure of guilt. C. description of the crime. D. age of the participants.

D. age of the participants.

Dr. Parker finds that judgments of responsibility for an automobile accident is greater for male drivers if the outcome is severe rather than mild. However, for female drivers, ratings are the same irrespective of the outcome. These findings suggest A. a main effect of responsibility. B. a main effect of outcome. C. an interaction between gender and responsibility. D. an interaction between gender and outcome.

D. an interaction between gender and outcome.