Research methods
53. Dr. Frank-N-Furter has developed a measure of motivation that he believes is good because everyone scores close to 100%. This is an example of:
*a. A Ceiling Effect b. A very good measure of motivation c. A Window Effect d. A Truncated Range e. A Floor Effect
46. Numeric grades are an example of which scale of measurement?
*a. Ratio Scale b. Nominal Scale c. Ordinal Scale d. Additive Scale e. Interval Scale
70. A research design in which an individual is measured at baseline (no treatment), measured during a "treatment" phase, measured again at baseline (no treatment), and then measured again during a "treatment" phase in order to determine the change in behavior across the different conditions is called a:
a. Meta-Analytic Study b. Archival Study c. quasi-experiment *d. single-subject design e. case study
69. A research design in which researchers conduct a careful, detailed investigation of a single person or group is referred to as a ________________. Typically, a large amount of data are collected from a variety of sources using several methods (e.g. interviews of participant, friends, family, employers, examination of records from schools, employers, etc, observations, video recordings)
a. Meta-Analytic Study b. Archival Study c. quasi-experiment d. single-subject design *e. case study
33. Double-blind studies are conducted in order to control for:
a. Mortality Effects *b. Experimenter Bias c. Compensatory Rivalry d. Demand Characteristics e. Maturation Effects
32. Single-blind studies are conducted in order to control for:
a. Mortality Effects b. Experimenter Bias c. Compensatory Rivalry *d. Demand Characteristics e. Maturation Effects
56. Aspects of the Translation Phase emphasized in class include:
a. Number of Scale Points b. Importance of Anchor Points *c. Both (a) and (b) are correct d. Neither (a) nor (b) are correct e. I do not know
45. Letter grades are an example of which scale of measurement?
a. Ratio Scale b. Nominal Scale *c. Ordinal Scale d. Additive Scale e. Interval Scale
10. The "More is Better" rule of reliability means that, in general:
a. The more people administered the measurement instrument, the more reliable the measurement instrument b. The less items on the measurement instrument, the more reliable because more people will complete it c. The less people administered the measurement instrument, the more reliable the measurement instrument because there is less chance that weird people will take it. d. In general, the more times a single person is administered the measurement instrument, the more reliable. *e. The more items on the measurement instrument, the more reliable the measurement instrument
57. For most items on an inventory (e.g 'I like going to very large parties in which I meet lots of people), which of the following would be the best rating scale?
*a. 1 (Not At All True) to 7 (Extremely True) b. 1 (Not At All True) to 2 (Extremely True) c. 1 (Not At All True), 2 (Moderately True), 3 (Extremely True) d. 1 (Not At All True) to 50 (Extremely True) e. 1 (Not at All True) to 100 (Extremely True)
59. Pilot testing most often refers to the use of:
*a. A practice study b. A study specifically designed to address criticisms of a primary study c. The survey version of an experimental study d. A specific study format used in a great deal of aviation research e. Administering a flying test to individuals hoping to obtain their pilot license.
50. Dr. Nota Numbskull randomly assigns ½ of the participants play a violent video game and ½ of the participants play a nonviolent video game. For this study, Type of Video Game is:
*a. An IV b. A DV c. A Predictor Variable d. A Possible Confounding Variable e. Not a Variable
28. Testing Effects refer to:
*a. Changes in performance based upon repeated measurements b. Generalization of the results from a laboratory setting to a real world setting c. Assignment of the participants to the levels of the IV d. The effect that events outside the experiment might have an effect on the results e. Changes across time related to physical and mental development
22. Dr. Weaver developed a measure for assessing applicants' suitability for employment as forest rangers. Dr. Weaver administered her measure to 300 applicants for employment as forest rangers and also administered an IQ test to the same 300 applicants. Dr. Weaver correlates the total scores on the two measures and hopes that the correlation is low. Not because forest rangers should not be intelligent, but because she hopes she has not developed another form of IQ test. Dr. Weaver is assessing which of the following types of validity?
*a. Divergent Validity b. Content Validity c. Predictive Validity d. Face Validity e. Convergent Validity
12. Dr. Yuri Zhivago is interested in the extent to which the results of his study will generalize to other settings, individuals, and, times. Therefore, Dr. Yuri Zhivago is concerned with:
*a. External Validity b. Ecological Validity c. Construct Validity d. Internal Validity e. Statistical Conclusion Validity
18. Dr. Steven Tyler developed a new measure of antisocial behavior. In order to assess the validity of this new measure, he assembled a group of therapists who work extensively with antisocial patients and asked these 'experts' to rate the validity of his measure. Dr. Tyler assessed which of the following types of validity?
*a. Face Validity b. Content Validity c. Predictive Validity d. Concurrent Validity e. Convergent Validity
25. When a participant believes she has figured out the purpose of the experiment and acts in accordance with this purpose in an attempt to "help" the experimenter, she is displaying the:
*a. Good Participant Effect b. Bad Participant Effect c. Evaluation Apprehension d. Social Desirability Effect e. Statistical Conclusion Validity
5. Dr. Strangelove administers an aptitude inventory to a sample of college students at PCC. Dr. Strangelove then correlates each item on the aptitude inventory with every other item on the aptitude inventory and calculates the average of these correlations. Dr. Strangelove is most likely interested in specifically testing:
*a. Inter-Item reliability of the Aptitude Inventory b. TestRretest reliability of the Aptitude Inventory c. Split-half reliability of the Aptitude Inventory d. Inter-Rater Reliability of the Aptitude inventory e. Validity of the Aptitude Inventory
72. A researcher analyzes the results of all of the studies published during the last 5 years concerning the effects of behavior modification on language acquisition. This study is a(n):
*a. Meta-Analytic Study b. Archival Study c. quasi-experiment d. single-subject design e. case study
31. Dr. Joe Perry conducts a study on the effects of Anxiety on Motivation. Dr. Perry randomly assigns ½ of the participants to be put into a very high anxiety state and ½ of the participants to not be put into an anxious state. During the course of the study, many participants in the high anxiety state condition drop out of the study, however, no participant in the other condition drop out of the study. This is an example of:
*a. Mortality Effects b. Experimenter Bias c. Compensatory Rivalry d. Demand Characteristics e. Maturation Effects
41. A research design in which someone tests a claim about a variable by exposing a person to the variable and showing that the person thought, felt, or behaved as expected is referred to as a(n):
*a. Pseudo-Experiment b. Quasi-Experiment c. Clinical Trial d. True-Experiment e. Non-Experiment
44. When variables such as height, length, weight, scores, income, number of children, and number of marriages are recorded, these variables are measured on what scale of measurement?
*a. Ratio Scale b. Nominal Scale c. Ordinal Scale d. Additive Scale e. Interval Scale
36. Madeline plans to stand outside of a BMW dealership and ask the people she sees who they think will win the 2012 presidential election. Her study will most likely suffer from which of the following methodological problems?
*a. Selection Bias b. History c. Maturation d. The Hawthorne Effect e. Regression Toward the Mean
51. A widespread definition of measurement proposed by Stanley Smith Stevens (1946):
*a. The assignment of numerals to objects or events according to some rule b. The assignment of numerals to objects or events according to a random process c. The numerical estimation and expression of the magnitude of one quantity relative to another. d. Using a scale to measure the weight of an object e. Both (a) and (c) are definitions of measurement proposed by Stanley Smith Stevens (1946).
64. It is surprisingly difficult to translate psychological constructs into observable events
*a. True b. False
37. Dr. Pete Townsend conducted a successful experiment on modeling (i.e., social learning or copying) and helping behavior among American high school students. He then replicated this same experiment (using exactly the same independent and dependent variables) in a sample of Japanese senior citizens. Lincoln probably hoped that his replication study would reduce concerns about:
*a. artifacts b. linguistic biases c. confounds d. demand characteristics e. selection bias
34. One of the pairs of terms below consists of two very similar threats to validity. Which pair?
*a. history and maturation b. history and regression toward the mean c. experimenter bias and experimental mortality d. selection bias and testing effects e. histrionic effects and maternity effects
54. Dr. Everett V. Scott is interested in whether a correlation exists between IQ and Motivation. Therefore, Dr. Everett V. Scott measures the IQ and Motivation of a sample of students from Cal Tech. Which of the following is very likely true of the measurement of IQ for a group of students from Cal Tech?
a. A Ceiling Effect b. A very good measure of motivation c. A Window Effect *d. A Truncated Range e. A Floor Effect
2. Which of the following are the most accurate concerning reliability and validity?
a. A test can be valid and not reliable b. A test can be reliable and not valid c. If a test is not reliable it is not valid d. If a test is not valid it is not reliable *e. Both (b) and (c) are correct.
48. Dr. Granny Clampett conducts a study on the effects of Type of Video Game on Aggressive Behavior. Dr. Clampett measures Aggressive Behavior by having parents rate their children's aggression on a scale of 1 (not at all aggressive) to 7 (extremely aggressive). For this study, 'Aggressive Behavior' is __________.
a. An IV *b. A DV c. A Predictor Variable d. A Criterion Variable e. Not a Variable
49. Dr. Granny Clampett conducts a study on the effects of Type of Video Game on Aggressive Behavior in children. Dr. Clampett is not interested in the effects of age, however, she is afraid that age will have an effect on the results. Therefore, Dr. Clampett includes only 12-year-old children in her study. For this study, 'Age' is ___________________.
a. An IV b. A DV c. A Predictor Variable *d. A Possible Confounding Variable e. Not a Variable
47. Dr. Ima Numbskull has every participant play a violent video game. For this study, Type of Video Game is:
a. An IV b. A DV c. A Predictor Variable d. A Criterion Variable *e. Not a Variable
63. Providing participants with instructions and using practice questions:
a. Are crucial components of pilot studies b. Allow researchers to reduce the number of items in a multi-item survey c. Are more crucial in research with children than in research with adults *d. Establish a judgmental context in survey research e. Never a good idea
55. Aspects of the Judgment Phase emphasized in class include:
a. Avoid negations - People process affirmations more quickly and efficiently than negations. b. Avoid double-barreled questions - Questions that require two different things to be evaluated c. Avoid Forced-Choice Items d. Avoid Questions that yield no variance *e. All of these are correct
58. Which of the following was NOT mentioned in Chapter 4 as a rule for writing good survey questions?
a. Avoid negations b. Keep it simple c. Avoid forced-choice items d. Use questions that will yield a lot of variance *e. Use questions that will not yield a lot of variance
27. In terms of Internal Validity, 'Selection Effects' refers to:
a. Changes in performance based upon repeated measurements b. Generalization of the results from a laboratory setting to a real world setting *c. Assignment of the participants to the levels of the IV d. The effect that events outside the experiment might have an effect on the results e. Changes across time related to physical and mental development
19. Dr. Brad Whitford developed a new measure of bulimia. Dr. Whitford selects two groups of individuals those who meet the criteria for bulimia and have been diagnosed with bulimia and those who do not meet the criteria for and have not been diagnosed with bulimia. Dr. Whitford compares the scores of the two groups on his new measure of bulimia. Dr. Whitford is concerned with which of the following types of validity?
a. Convergent Validity *b. Divergent Validity c. Predictive Validity d. Content Validity e. Face Validity
17. Dr. John Paul Jones administered his new measure of personality and the Comrey Personality Scales to 200 students at PCC. Dr. Jones correlated the total scores for the personality inventories and found a high correlation (r = 0.85). Dr. Jones concludes the measure of personality is high in which of the following types of validity?
a. Convergent Validity b. Divergent Validity c. Concurrent Validity d. Predictive Validity *e. Both (a) and (c) are correct
20. Dr. Richard Kimble developed a new measure of borderline personality. Dr. Kimble is concerned with the extent to which his new measure covers a representative sample of the theoretical construct of borderline personality. Dr. Kimble is concerned with which of the following types of validity?
a. Convergent Validity b. Divergent Validity c. Predictive Validity *d. Content Validity e. Face Validity
21. Dr. Peter Venkman developed a new measure for assessing extraversion in infants. Dr. Venkman wants to assess the extent to which his measure for assessing extraversion in infants correlates with extraversion in adolescents. Dr. Venkman administers his measure of extraversion to a group of infants and then 15 years later administers another well established measure of extraversion. Dr. Venkman then calculates the correlation coefficient between the two measurements. Dr. Venkan is concerned with which of the following types of validity?
a. Convergent Validity b. Divergent Validity c. Predictive Validity d. Content Validity *e. Both (a) and (c) are correct
66. Response translation refers to the process by which:
a. Cross-cultural researchers convert survey questions from one language to another b. Participants conversion of thoughts or feelings into observable behavior. *c. Participants conversion of thoughts, feelings, or behavior into responses on a rating scale d. Participants convert their temperaments into desires e. Calculate the probability of their response
65. During the judgment phase of answering a self-report question, participants determine what question is being asked, and then they:
a. Decide whether they agree or disagree with a basic proposition *b. Form some initial response to the question c. Compare their psychological responses to those of other people d. Convert their psychological response to a numerical answer e. Calculate the probability of their response
38. The most common threat to the internal validity of research designs is probably:
a. Experimenter bias *b. Confounds c. Participant expectancies d. Regression toward the mean e. Maturation
24 Which of the following is related to Experimental Realism?
a. Extent to which the Experimental Setting LOOKS like the Real World Setting. *b. Extent to which the Experimental Setting Psychologically "FEELS" like the Real World Setting. c. Ecological Validity d. Both A and C e. Both B and C
23. Which of the following is related to Mundane Realism?
a. Extent to which the Experimental Setting LOOKS like the Real World Setting. b. Extent to which the Experimental Setting Psychologically "FEELS" like the Real World Setting. c. Ecological Validity *d. Both (a) and (c) e. Both (b) and (c)
13. Dr. Frank-N-Furter is concerned that the methods, materials and setting of his study approximate the real-life situation that is under investigation that his study approximates the actual look, feel, and procedure of a real-life situation. Therefore, Dr. Frank-N-Furter is concerned with:
a. External Validity *b. Ecological Validity c. Construct Validity d. Internal Validity e. Statistical Conclusion Validity
15. In a study on relationships and love, Dr. Dolittle measures "Love between Partners" as the total time partners look into each other's eyes. From this description, which of the following could pose a problem?
a. External Validity b. Ecological Validity *c. Construct Validity d. Internal Validity e. Statistical Conclusion Validity
11. Dr. Pete Townsend is concerned with the extent to which the results of his study provide evidence that the IV has a causal effect on the DV. Therefore, Dr. Pete Townsend is concerned with:
a. External Validity b. Ecological Validity c. Construct Validity *d. Internal Validity e. Statistical Conclusion Validity
14. Dr. Henry Jekyll is concerned with ruling out pure chance as a possible, plausible, alternative explanation for the observed relationship between the IV and the DV. Dr. Jekyll is concerned with:
a. External Validity b. Ecological Validity c. Construct Validity d. Internal Validity *e. Statistical Conclusion Validity
16. Dr. Ian Anderson conducts a study in which his data consisted of data collected on a nominal scale of measurement, yet he analyzed the data using ANOVA (note: ANOVA is not appropriate for use with data measured on a nominal scale). Dr. Anderson will have a problem with which of the following types of validity?
a. External Validity b. Ecological Validity c. Construct Validity d. Internal Validity *e. Statistical Conclusion Validity
26. When a participant believes she has figured out the purpose of the experiment and acts and acts in a way to disconfirm the researcher's hypothesis, she is displaying the:,
a. Good Participant Effect *b. Bad Participant Effect c. Evaluation Apprehension d. Social Desirability Effect e. Statistical Conclusion Validity
1. For measurement instruments, reliability is concerned with ________ and validity is concerned with ________.
a. How the concept is measured, Why the concept is measured b. Both are concerned with the instrument measuring what it purports to measure c. Both are concerned with the consistency of the results *d. Consistency of the results, Measuring what the instrument purports to measure e. Measuring what the instrument purports to measure, Consistency of the results
4. Dr. Everett V. Scott administers an aptitude inventory to a sample of college students at PCC. Dr. Scott then randomly divides the items on the aptitude inventory into two halves and calculates the Pearson product-moment correlation coefficient on the two randomly divided halves. Dr. Scott is most likely interested in:
a. Inter-Item Reliability of the Aptitude Inventory b. Test-Retest Reliability of the Aptitude Inventory c. Internal Consistency of the Aptitude Inventory d. Inter-Rater Reliability of the Aptitude Inventory *e. Split-half reliability of the aptitude inventory
3. Dr. Frank-N-Furter administers an IQ inventory on September 1, 2014 to a sample of college students at PCC and then administers the same exact IQ inventory to the same exact sample of students on September 30, 2014. Dr. Frank-N-Furter is most likely interested in the:
a. Inter-Item Reliability of the IQ Inventory *b. Test-Retest Reliability of the IQ Inventory c. Split-Half Reliability of the IQ Inventory d. Inter-Rater Reliability of the IQ Inventory e. Validity of the IQ Inventory
52. Major challenges to converting concepts to numeric values that we discussed in class include:
a. Judgment Phase (Extent to which participants thinking of same question as researcher). b. Response Translation Phase (Extent to which participants can translate internal state to numeric value). c. Understanding Phase (Extent to which participants can read and understand the question). d. Alternatives (a), (b), and (c) are all correct *e. Alternatives (a) and (b) are correct
71. A researcher contacts the Colorado Longitudinal Twin Study and requests data measuring temperament collected from monozygotic twins between the years 1985 - 1992: The research analyzes this data and publishes a paper concerning the effects of genetics and the environment on temperament. This study is a(n):
a. Meta-Analytic Study *b. Archival Study c. quasi-experiment d. single-subject design e. case study
43. When variables such as gender, ethnic identity, ethnicity, political affiliation, religious affiliation, and college major are recorded, these variables are measured on what scale of measurement?
a. Ratio Scale *b. Nominal Scale c. Ordinal Scale d. Additive Scale e. Interval Scale
42. Temperature, measured on a Fahrenheit Scale, is measured on what scale of measurement?
a. Ratio Scale b. Nominal Scale c. Ordinal Scale d. Additive Scale *e. Interval Scale
29. Dr. Arnold Schwarzenegger conducts a study on the effects of lifting weights on physical attraction. Dr. Schwarzenegger randomly assigns ½ of the participants to lift weights 2 hours per day for one year and ½ of the participants to not engage in any exercise for one year. Charles Atlas, a 99 pound weakling who always had sand kicked in his face, was randomly assigned to the no exercise condition. However, Charles learned of the experimental hypothesis and decided to lift weights for 4 hours per day for the year. This is an example of:
a. The Hawthorne Effect *b. Compensatory Rivalry c. Experimenter Bias d. Demand Characteristics e. Maturation Effects
30. Natural physiological or psychological changes that result from passage of time are examples of:
a. The Hawthorne Effect b. Mortality Effects c. Experimenter Bias d. Demand Characteristics *e. Maturation Effects
62. One of his items on Dr. Billy Gibbon's measurement instrument is: 'I am opposed to murder'. What is wrong with this question?
a. The word "opposed" introduces an unnecessary negation. b. The item addresses a sensitive legal issue. c. People's responses to the item will likely be confounded with their criminal status. *d. People's responses to the item will likely show ceiling effects. e. All of these are true.
60. Riff Raff has developed a measure of extraversion. One of his items is: 'Do you prefer very large parties where you know very few people or very small parties where you know everyone'. What is wrong with this question?
a. There is nothing wrong with this question *b. This is a forced-choice question c. Assumes people know how to read d. Introduces a social desirability bias e. This is a double-barreled question
61. One item on Dr. Jekyll's instrument is: 'I am a shy and lonely person'. What is wrong with this question?
a. There is nothing wrong with this question b. This is a forced-choice question c. Assumes people know how to read d. Introduces a social desirability bias *e. This is a double-barreled question
39. Which of the following procedures or techniques requires little or no active deception?
a. Use of a cover story b. Use of a confederate *c. Use of unobtrusive observations d. Use of a bogus pipeline e. Use of a balanced Latin square
7. Actually, both inter-item reliability and Chronbach's alpha are measures of:
a. Validity b. Test-Retest Reliability c. Split-Half Reliability *d. Internal Consistency e. Inter-Rater Reliability of the IQ test
8. Dr. Barron Von Boredom is interested in the extent to which the items on a measurement instrument measure the same concept. Which of the following would Dr. Boredom be most interested?
a. Validity of the Instrument b. Test-Retest Reliability of the Instrument c. Split-Half Reliability of the Instrument *d. Internal Consistency of the Instrument e. Inter-Rater Reliability of the instrument.
6. Dr. Kildare administers a personality inventory to a sample of college students at PCC. Dr. Kildare then calculates Chronbach's alpha for the items. Dr. Kildare is most likely interested in specifically testing:
a. Validity of the Personality Inventory b. Test-Retest Reliability of the Personality Inventory c. Split-Half reliability of the Personality Inventory *d. Internal Consistency of the Personality Inventory e. Inter-Rater Reliability of the IQ test
9. If you square the reliability estimate and subtract it from 1.00, this value gives you the:
a. Validity of the measurement instrument *b. Measurement error of the measurement instrument c. Reliability of the measurement instrument d. Conceptuality of the measurement instrument e. Nothing
67. Dr. Kieth Richards is ready to write his first questionnaire. What is the first step he should take?
a. Write 50 different questions *b. Think about exactly what he wants to measure c. Conduct a factor analysis to correlate his questions d. Conduct a pilot study e. Get a good night sleep
68. Dr. Rick Nielsen created a new rating scale designed to measure people's liking for plums. On this scale, the psychological distance implied by a single-unit difference on the rating scale remains constant across the entire range of the rating scale. This means, for example, that the difference in subjective liking between a 3 and a 4 on Dr. Rick Nielsen's scale is the same as the difference in subjective liking between a 6 and a 7. Dr. Rick Nielsen's scale makes use of:
a. a Likert format b. a Thurstone gradient *c. equal appearing intervals d. all of these e. none of these
35. During the first week of his 4th grade school year, John Bonham received the lowest score in his class on a vocabulary test. Nine months later John Bonham retook the test and scored much higher. John Bonham's improvement can be explained by:
a. maturation b. regression toward the mean c. testing effects d. Alternatives (a) and (b) *e. all of the above are possible explanations
40. In an experimental study of cooperation, the experimenter makes people in the experimental condition feel like they have no choice but to cooperate with a confederate. Wendy O. Williams was assigned to this condition of the study and felt that she was being treated like a puppet. As a result, she actively tried to disconfirm the experimenter's hypothesis by refusing to cooperate. This is an example of:
a. participant expectancies b. demand characteristics *c. participant reactance d. evaluation apprehension e. the good participant effect
