Survey Research
Do you like courses that use multiple choice test and have comprehensive final exams? This is an
Double barreld question
What do we mean by "mutually exclusive" response categories?
non-overlapping response categories.
What are "contingency" questions? Why should they be limited in surveys?
-An item directing the participant to different follow-up questions depending on initial response; -Should be eliminated because they are confusing.
What is "social desirability bias"? What can be done to help avoid it?
-Error occurring when participants try to respond the way they think makes them look good, -Bias can be minimize by making the survey anonymous,
What is the main advantage of a telephone interview? What is the main disadvantage? How can this problem be overcome?
-Less expensive than face to face. -Some numbers are unlisted; -Can be about with random dialing.
What does a "semantic differential" measure? What do participants do when completing a semantic differential?
-Measures the meaning that participants give to attitudinal objects; -Participants rate objects on a series of bipolar rating scales.
What are "ranking" scales? What potential problems do "ranking" scales have?
-Participant asked to rank responses in ascending or descending order; -Can be difficult to analyze if your goal is to rate ranking to other variables.
What are the advantages of "face to face" or personal interviews? What is the main disadvantage?
-Participants can ask question or elaborate -Takes a lot of time.
What are "closed-ended" questions? What are the two advantages of "closed-ended" questions?
-Participants must choose between pre-determined set of standards. -Advantages, more standardized data; easy to interpret.
In terms of writing survey questions, what is a "loaded" item? Give an example.
-Produce an emotional response. -What is your opinion of the liberal Barack Obama
What is a questionnaire? What is the man advantage of mail surveys? what is the main disadvantage of mail surveys?
-Self report data collection instrument filled out by participants -Mail surveys are cheap -Participants may not respond
What are "Response sets"? What can a researcher do to help minimize this problem?
-Tendency for participants to respond in a particular way to a set of items; -Can be minimized by breaking up questions question to different types.
"Trend studies" are another longitudinal survey technique. How is data collected in them? How do they differ from "panel studies"?
-Trend studies change over time. -The difference is that panel studies use the same people over time.
In survey research, what is a "panel study"?
A longitudinal study where data is collected from the same individuals at successive points over time.
"External validity" refers to the ability generalize results (the usual goal of a survey). To insure high external validity, what type of samples should be sued?
A random sample should be used.
What is "representative population"?
A sample that resembles the population; allows researcher to generalize.
What is a "Longitudinal" survey?
A study where data is collected at 2 or more points in time with the same group.
What are "open-ended"question? When should a researcher use "open-ended" questions?
Allows participants to respond in their own words; should be used when researcher wants to know what people are thinking.
In terms of writing survey questions, what are "double-barreled" questions? Give an example.
Asking about 2 or more issues in a single question; e.g Do you think the gov' spend more money on schools and welfare?
Why should surveys be kept short?
Because respondent interest and cooperating diminishes,
What is a "Cross-Sectional" survey?
Conducted at a single time period and data are collected from a certain group.
In terms of survey questions, what is the problem with double-negatives?
Confusing
What are "dichotomous" rating scales ?
Dichotomous rating is checking yes or no;
What are "multichotomous" rating scales?
Is 1-5 agree or disagree;
What are "mixed-format" questions?
Includes both open and close ended responses in a single item.
In terms of writing survey questions, what are "leading" questions? Give an example.
Indicates how people should response, e.g Do you believe you should keep our hard-earned money, or that govt. should get it
Why are the positive and most interesting question usually asked first in survey?
Interesting question are asked first because participants get tired.
What are the advantages of electronic surveys? We identified four in class.
Low cost; access to wide audience; flexible in layout; data in form easy for analysis.
A child psychologist is studying recurring dreams in young children. She only has vague notions regarding the topics young children dream about. This he questionnaire should utilize
Open-ended questions.
What is a "binary forced choice" scale? Is this type of scale usually recommend?
Participants must select from 2 response choice provided with an item; usually avoided.
What do surveys assess?
Peoples attitudes, activities, opinions and beliefs.
What are the disadvantages of electronic surveys? We identified in class?
Privacy and anonymity many not be upheld; may not be representative.
What is the major advantage of group based surveys?
Questions are completed quickly and conveniently
What do we mean by "exhaustive" response categories?
Response categories that cover a full range of possible responses.
What are "Likert Scales" Do they contain a single item or multiple items ? Whats done with scores?
Scale used to measure a single contract by summing each response to items on a scale.
What is "random sampling" When a researcher use a random sample? When would a researcher NOT use random sampling?
Selection of sample members using a statistically random process; used when trying to depict a general population.
Why are "mulichotomous" scales an improvement?
Superior because it measures direction and strength or intensity of attitude.
Who of the following is not a disadvantage of surveys?
Survey answer questions such as "how many"
What is "pilot testing"? Why should a researcher want to pilot test his her survey?
Testing for proper operation of data collection instrument; the purpose is to identify problems and fix them,
What are concepts or abstract concepts (e.g intelligence; self-esteem) measure by multiple items?
The are measured with items because they can't adequately measure a contract with one item.
What is "convenience sampling? When would a researcher use a convince sample?
Use of people who are readily available, volunteer or are easily recruited for inclusion in a sample; this would be used when not having a great deal of time or money to spend.
What is "sampling error"?
Variation of sample values from population values
Why is the "representativeness of samples" such an important issue for surveys?
You want the sample to represent the entire population.
