HDFS 361 midterm 2
Case Study
"an in-depth analysis of a case, often a program, event, activity, process, or one or more individuals. Cases are bounded by time and activity" and case studies typically involve multiple data collection types. Often researchers will choose a unique case
Online Surveys
- easy to administer - Reach a broader range of people (computers, smartphones, tablets, wifi access) - Data security - Anonymity
Methods of collecting qualitative data
- interviews (structured, semi-structured, unstructured) - Focus groups (6-12 groups) - Observation (participant observation, complete observation) - Field journal, audiovisual, other documents - EX: Photovoice
Features of Qualitative Research
-Data collection happens in natural settings -data may be interview transcripts, observation notes, pictures, audio or video recordings, etc. -use "thick" or rich description - focus is on understanding "meaning" (emic perspective vs. etic) - Research is an instrument/immersed in the setting
Experimentar bias vs. reactivity
-Experimenter bias is results are influenced by the researchers expectations and beliefs - Participants modify behavior being study
Ethnography
-The aim is to describe a group pf people and/or their culture -Researcher immerses herself in the culture to observe and (hopefully) understand -triangulation- multiple sources of data or methods (Jane goodall is an example and unequal childhood)
self administered questionnaire
-cheaper and faster than face to face -national is the same cost as local mailings -requires small stafff -more willigness to andwer controversial items
features of qualitative research
-data collection happens in natural setting -data may be interview, transcripts, observations notes, pictures, audio or video recordings, narratives etc -uses "thick" or rich description -focus is on understanding "meaning"
online surverys
-easy to administer -reach broader range of people (computers, smartphones, tablets) -representativeness? who participates, recruitment vs. stumbling upon -Data Security -anonymity
The researcher's role in qualitative research
-must gain trust (insider/outsider) -reflexivity -the researcher is the main instrument (she
Disadvantages of Telephone Surveys
- People are suspicious of what they can't see - theres a decrease in landline use - It's easy to hang up - Cant see face to face - Also get the answering machine/voicemail/caller ID
Advantages of Telephone Surveys
- phone is easy way to access people - time and money (doesn't require being 'in the field' w/respondents - Control (over protocol administration) - Personal Safety (interviewers and respondents in own home/office)
Grounded Theory
-"a general method for deriving a theory or theories from data systematically gathered and analyze" -useful for understanding processes -Analysis is iterative -- constant comparative analysis
External Validity
Results of a study can be generalized to people, settings, times, measures, and characteristics
Internal Validity
Results of research study provide a single, unambiguous explanation and it speaks to how well the study is designed and carried out
Double-Barreled Questions
When a question is asking for one answer but has two questions in it Examples: - How satisfied are you with your pay and job conditions? -How frequently do you feel calm and peaceful? -How frequently do you feel restless or fidgety? -
Results from a research study suggest that a stop-smoking program is a very successful. However, the participants who volunteered for the study were all highly motivated to quit smoking and the reaseracher is concerned that the same results may not be obtained for smokers who are not as motivated. This study has a problem with a) internal validity b) external validity c) experimental validity d) validity of measurement
b) external validity
In an observational study of classroom disruption, you record whether or not each child commits a disruptive act during each 60 second period a 30 min classroom observation. For this study, which method is being used to quantify the observations? a) frequency b) duration c) interval d) individual
c) internval
Interview Surverys
data collection where one person (interviewer) asks questions of another (respondent). Can be in person or on the telephone.
Research Strategies in quantitative research
descriptive, correlational, experimental, quasi and non-experimental
A research _______ is a general plan for implementing the research strategy. a) procedure b) design c) study d) protocol
design
Immersing yourself in another culture is an example of what type of qualitative approach? a) Phenomenological b) Grounded theory c) Narrative analysis d)Ethnography
ethnography
assignment bias
groups posess differnt characteristics -selection of children for inclusion in an after school program -relates to sampling bias
As the values for one variable decrease from one person to another, the values for a second variable also tend to decrease. This is an example of a __________ relationship. A) positive b) negative c) curvilinear d)These data show no consistent relationship.
postive
confouding varibles
unmeasured variable that could potentially explain the relationship between two variables. Threat to internal validity
extraneous varibles
varibles not directly examined
Emic
written in the perspective of the participants (dealing with qualitative research)
General Questionnaire Format
¤ Uncluttered ¤ One question per line ¤ Consistent format -avoid biased items and terms -short and simple items are best
telephone surveys advantages
-phone is an easy way to access people -time and money (dont require being in the field w/ respondents) -control over protocol administration -Personal Safety (in own home/office)
generating questionares
-questions should be relevant -short items best -avoid
benefits of interview approach
-solict higher response rats than mail surveys, harder to say no -interviewres minimize "dont know" and "no answer" -interviewers serve as a guard against confusion -interviewers can observe respondents while completeing the questionnaire (double edge sword can lead to bias)
telephone interview disadvantages
-unlisted phone numbers -decresing landline use -increasing moblie phone use -answering machines/voicemail/caller id -easier to just hang up and end interview than leaving an in person interview
Threats to Internal Validity
.confounding varibales, extraneous variables, etc
Validity of measurement
A measurement procedure is measuring what is supposed/intended to
Validity of research design
A study design answers the question that it is supposed/intended to
A drawback to an open-ended question is that A) the responses obtained may be difficult to code and analyze. B) it is more difficult to construct than other types of items. C) it may place too many restrictions on the participant's response. D) the other three choices are all drawbacks
A) the responses obtained may be difficult to code and analyze.
Threats to External Validity
Any characteristic of a study that limits the ability to generalize the results (volunteer bias, time of measurement,characteristics of participants)
The goal of the descriptive research strategy is A) to describe an individual person or patient in great detail. B) to describe a variable (or variables) as they exist naturally. C) to describe the relationship between two variables. D) to establish the existence of a cause and effect relationship between variables.
B) to describe a variable (or variables) as they exist naturally.
The primary distinction between quantitative research and qualitative research is based on differences in the A) type of participants. B) type of phenomena they study. C) type of data they produce. D) type of participants and type of phenomena they study
C) Type of Data they produce
One problem with mail surveys is non-response bias. This means A) usually none of the surveys are returned. B) many questionnaires will be returned with missing answers. C) individuals who return surveys may not be representative of the general population. D) attempts to increase the number of people who return the survey may produce a biased sample.
C) individuals who return surveys may not be representative of the general population.
Which of the following identifies a potential problem with Internet surveys? A)They tend to be costly and inefficient. B) They are difficult to administer C) It can be difficult to find a group of participants who share a specific interest. D) It can be difficult to control or even know the representativeness of the sample.
D) It can be difficult to control or even know the representativeness of the sample.
The multiple-personality study reported in Thigpen and Cleckley's The Threee Faces of Eve is an example of a) participant observation b) naturalistic observation c) correlational research d) case study research
D) case study research
Correlational Research
Describes relationship between two variables, but does not explain the relationship. Changes in one variable is related to change in another
Experimental Research
Determine cause and effect relationship, it requires prediction and direction, Can control an outcome (DV) by systematically changing a predictor (IV) An Example of this is a drug trial: Randomly assign participants to receive an experimental drug (treatment) or placebo (control)
Phenomenology
Focus is on the participants' points of view -- how they perceive and interpret the world (experiences, events, etc.) Often employ interviews
What is a contingency question?
Only intended for some people, basically it is a follow-up questions that are contingent on how you answer a previous question. Ex: have you smoked marijuana? If yes go answer the question below
Qualitative Strategies/Designs
Phenomenology, Ethnography, Grounded Theory, Case Studies
Open-ended Questions
Respondent is asked provide his/her own answers, short answer questions. Advantages: more insight, more indepth, more individualized Disadvantages: coding and analyzing is much harder
Close-ended question
Respondent is asked to select an answer from among a list provided by researcher for example multiple choice or likert scales. Advantages: easier to analyze and code Disadvantage: answers are very surface level and sometimes there are not enough options to choose from
Self-edministered Questionnaire
Respondents are asked to complete the questionnaire by themselves. Can be in-porson or not (mail, website, etc)
Types of Surveys
Self-administered, interview surveys, telephone surveys, online surveys
Quasi- and Non-Experimental
Similar to experimental strategy, the predictor or the independent variable is not completely under researchers control. This strategy is useful when it is impossible to manipulate IV, ex: Does smoking cause cancer? and during naturally occurring groups of interest ex: Do 3rd grade boys and girls differ in math and reading ability? The things can be inferred but never demonstrated
What is non response bias?
The people who respond to the survey have different characteristics than the people who don't respond. It is difficult to generalize
What is the goal of Descriptive Research?
To descrive a single variable to a particular group of people, it not concerned about the relationship or correlation between variables but is looking to take a 'snapshot', often represented in percentages or proportions
Evaluating Qualitative Research
We assess 'rigor" - trustworthiness - authenticity -credibility -Verisimilitude
What is reflexivity?
When a researcher reflects on bias and asks if own bias effects that answers or conclusions of the study
Etic
Written in perspective of the researcher (dealing with qualitative research)
Which research strategy is not concerned with examining relationships between variables? A) descriptive b) correlational c) experimental d) quasi-experimental
a) descriptive
A researcher uses a survey to obtain measurements of students' eating behavior at a local college. The researcher hopes to prepare a report describing where the students eat, what times they eat, and what kinds of food they eat. This researcher is using the a) descriptive research strategy. b) correlational research strategy. c)experimental research strategy. d) factorial research strategy.
a) descriptive research strategy.
If a researcher measures self-esteem with the Rosenberg Self-Esteem Scale, will an-other researcher get the same results measuring self-esteem with the Harter Self-Esteem Measure? This is a question of a. external validity b. internal validity c. reliabilty d. Accuracy
a) external validity
To help ensure that observational measurements are objective, which of the following techniques would be used? a) habituate the participants to the observer's presence b) prepare a list of behavior categories c) measure inter-rater reliability d) prepare a list of behavior categories and measures inter-rater relaibility
a) habituate the participants to the observer's presence
A case study is an example of a) idiographic approach b) nomothetic approach c) correlational approach d) interview approach
a) idiographic approach
A research study finds that a group of participants who received relaxation training had lower exam anxiety scores than a group who did not receive training. However, the researcher suspects that the difference between groups may be caused by the fact that the participants in one group are generally smarter than those in the other. This study has a problem with A) internal validity. b) external validity. c) experimental validity.
a) internal validity
Any factor that allows an alternative explanation for the results of a study is a threat to a) internal validity b) external validity c) reliability d) accuracy
a) internal validity
Essay questions on an exam are examples of _______ items. a) open-ended b) closed-ended c)rating scale d) physiological
a) open ended
The results of a study may be influenced by the fact that a participant knows he or she is being studied. This threat to external validity is a)reactivity. b) novelty. c) experimenter bias.
a) reactivity
The aim of qualitative research is to a) Test logical, falsifiable hypotheses through carefully designed experiments b) Describe or interpret social phenomena, most often by uncovering the meanings people attach to their experiences c) Search for causal explanations D) Both A and B are aims of qualitative research
b) Describe or interpret social phenomena, most often by uncovering the meanings people attach to their experiences
What is an advantage to administering a survey over the Internet? a) Always 100 percent response rate b) Reach broader range of people c) Risk of interviewer bias d) None of the options are advantages
b) Reach broader range of people
What (or who) is the main research instrument in qualitative research? a) The interview script b) The researcher c) The transcription d) The participant
b) The researcher
The "etic perspective" could be described as whose point of view? a) The participant's or the insider's b) The researcher's or the outsider's
b) The researcher's or the outsider's
What are the ways we assess (or judge) the rigour of qualitative research studies? a) Validity, reliability, generalizability b) Trustworthiness, authenticity, transferability c) Type of measurements used, nature and size of the sample, and type of analysis performed d) All of the above
b) Trustworthiness, authenticity, transferability
The multiple-choice questions on this quiz are examples of ________ items. a) open-ended b) closed-ended c) rating scale d) physiological
b) closed- ended
If a reasercher is recording instances of humor during a television show , that researcher is conducting a) archival research b) content analysis c) naturalistic observation d) participant observation
b) content analysis
A research study records scores measuring alcohol use and a score measuring income level for each indv. group of 40 yr old men. The study intends to determines whether there is a relationship between the two variables. This study is an example of a _________ reaserch strategy a) description b) correlational c) experimental d) nonexperimental
b) correlational
Any factor that limits the ability to generalize the results of the study is a threat to a) internal validity b) external validity c) reliability d) accuracy
b) external validity
As the values for one variable increase from one person to another, the values for a second variable tend to decrease. This is an example of a __________ relationship. a) positive b) negative c) curvilinear
b) negative
A researcher lives with a group of nomads to observe their behaviors. For this study, what kind of behavioral observation being used? a) naturalistic b) participant c) contrived d) unstructured
b) participant observation
Any factor that raises doubts about the research results or the interpretation of the results is a(n) a) threat to reliability. b) threat to validity. c) artifact. d) demand characteristic.
b) threat to validity
Any factor that raises doubts about the research results or the interpretation of the results is an a) threat to reliabilty b) threat to validity c) artifact d) demand characteristic
b) threat to validity
Results from a research study suggest that a stop-smoking program is very successful. However, the participants who volunteered for the study were all highly motivated to quit smoking and the researcher is concerned that the same results may not be obtained for smokers who are not as motivated. This study has a problem with a) internal validity. b)external validity. c)experimental validity. d)validity of measurement.
b)external validity.
Qualitative research is often "emic." In this context, what does emic mean? a) Applying a preformed or existing definition or theory to analysis of data b) Imposing a framework of meaning to data or phenomena c) Allowing theories and definitions to emerge through participants' accounts and explanations d) Using categories and theories already deemed appropriate by the scientific community for the study
c) Allowing theories and definitions to emerge through participants' accounts and explanations
On a questionnaire Dr. Allen asks participants to answer the following questions? "What do you think about the legalization of marijuana for medicinal purposes?" This is an example of a(n) ____________ question. a) restricted b) rating scale c) open-ended d) partially open-ended
c) open-ended
Where might qualitative researchers prefer to collect data? a) In a laboratory b) Via surveys c) In real life settings d) All of the above
c) real life settings
What is a disadvantage of administering an interview by phone versus in-person? a) More expensive to administer survey by phone. b) More time-consuming to administer survey by phone. C) Have less control over protocol administration. d) Answering machines and Caller ID reduce response rates.
d) Answering machines and Caller ID reduce response rates.
_______ effects occur when environmental events other than the treatment influence the participants' scores in one treatment differently than in another treatment. a) Subject selection bias b) Volunteerism c) Fatigue d) History
d) History
Qualitative research approaches include all of the following EXCEPT a) Phenomenological b) Grounded theory c) Ethnography d) Statistical/mathematical
d) Statistical/mathematical
The advantage to the case study design (compared to a group design) is that a) it can be used to study rare phenonma b) it can demonstrate a counterexample to a general principle c)it can be emotionally powerful and convincing d) all the above
d) all of the above
Because qualitative researchers have a high degree of contact and interaction with their study participants, they often examine and disclose their own preconceptions, assumptions, biases, and motivations about the study. This practice is called . . .? a) Contextualization b) Emic perspective c) Thick description d) Reflexivity
d) reflexivity
Which of the following is not one of the identified features of qualitative research listed at the beginning of the chapter? a) The data have primacy (priority) b) Qualitative research is context-bound c) Researchers immerse themselves in the natural setting d)Qualitative researchers focus on testing falsifiable hypotheses
d)Qualitative researchers focus on testing falsifiable hypotheses
A study examining what percentage of married couples is satisfied with their marriages is an example of what research approach? a. experimental b. quasi- expereimental c. correlational d. descriptive
d. descriptive