HDFS 361 midterm 2

Case Study

"an in-depth analysis of a case, often a program, event, activity, process, or one or more individuals. Cases are bounded by time and activity" and case studies typically involve multiple data collection types. Often researchers will choose a unique case

Online Surveys

- easy to administer - Reach a broader range of people (computers, smartphones, tablets, wifi access) - Data security - Anonymity

Methods of collecting qualitative data

- interviews (structured, semi-structured, unstructured) - Focus groups (6-12 groups) - Observation (participant observation, complete observation) - Field journal, audiovisual, other documents - EX: Photovoice

Features of Qualitative Research

-Data collection happens in natural settings -data may be interview transcripts, observation notes, pictures, audio or video recordings, etc. -use "thick" or rich description - focus is on understanding "meaning" (emic perspective vs. etic) - Research is an instrument/immersed in the setting

Experimentar bias vs. reactivity

-Experimenter bias is results are influenced by the researchers expectations and beliefs - Participants modify behavior being study

Ethnography

-The aim is to describe a group pf people and/or their culture -Researcher immerses herself in the culture to observe and (hopefully) understand -triangulation- multiple sources of data or methods (Jane goodall is an example and unequal childhood)

self administered questionnaire

-cheaper and faster than face to face -national is the same cost as local mailings -requires small stafff -more willigness to andwer controversial items

features of qualitative research

-data collection happens in natural setting -data may be interview, transcripts, observations notes, pictures, audio or video recordings, narratives etc -uses "thick" or rich description -focus is on understanding "meaning"

online surverys

-easy to administer -reach broader range of people (computers, smartphones, tablets) -representativeness? who participates, recruitment vs. stumbling upon -Data Security -anonymity

The researcher's role in qualitative research

-must gain trust (insider/outsider) -reflexivity -the researcher is the main instrument (she

Disadvantages of Telephone Surveys

- People are suspicious of what they can't see - theres a decrease in landline use - It's easy to hang up - Cant see face to face - Also get the answering machine/voicemail/caller ID

Advantages of Telephone Surveys

- phone is easy way to access people - time and money (doesn't require being 'in the field' w/respondents - Control (over protocol administration) - Personal Safety (interviewers and respondents in own home/office)

Grounded Theory

-"a general method for deriving a theory or theories from data systematically gathered and analyze" -useful for understanding processes -Analysis is iterative -- constant comparative analysis

External Validity

Results of a study can be generalized to people, settings, times, measures, and characteristics

Internal Validity

Results of research study provide a single, unambiguous explanation and it speaks to how well the study is designed and carried out

Double-Barreled Questions

When a question is asking for one answer but has two questions in it Examples: - How satisfied are you with your pay and job conditions? -How frequently do you feel calm and peaceful? -How frequently do you feel restless or fidgety? -

Results from a research study suggest that a stop-smoking program is a very successful. However, the participants who volunteered for the study were all highly motivated to quit smoking and the reaseracher is concerned that the same results may not be obtained for smokers who are not as motivated. This study has a problem with a) internal validity b) external validity c) experimental validity d) validity of measurement

b) external validity

In an observational study of classroom disruption, you record whether or not each child commits a disruptive act during each 60 second period a 30 min classroom observation. For this study, which method is being used to quantify the observations? a) frequency b) duration c) interval d) individual

c) internval

Interview Surverys

data collection where one person (interviewer) asks questions of another (respondent). Can be in person or on the telephone.

Research Strategies in quantitative research

descriptive, correlational, experimental, quasi and non-experimental

A research _______ is a general plan for implementing the research strategy. a) procedure b) design c) study d) protocol

design

Immersing yourself in another culture is an example of what type of qualitative approach? a) Phenomenological b) Grounded theory c) Narrative analysis d)Ethnography

ethnography

assignment bias

groups posess differnt characteristics -selection of children for inclusion in an after school program -relates to sampling bias

As the values for one variable decrease from one person to another, the values for a second variable also tend to decrease. This is an example of a __________ relationship. A) positive b) negative c) curvilinear d)These data show no consistent relationship.

postive

confouding varibles

unmeasured variable that could potentially explain the relationship between two variables. Threat to internal validity

extraneous varibles

varibles not directly examined

Emic

written in the perspective of the participants (dealing with qualitative research)

General Questionnaire Format

¤ Uncluttered ¤ One question per line ¤ Consistent format -avoid biased items and terms -short and simple items are best

telephone surveys advantages

-phone is an easy way to access people -time and money (dont require being in the field w/ respondents) -control over protocol administration -Personal Safety (in own home/office)

generating questionares

-questions should be relevant -short items best -avoid

benefits of interview approach

-solict higher response rats than mail surveys, harder to say no -interviewres minimize "dont know" and "no answer" -interviewers serve as a guard against confusion -interviewers can observe respondents while completeing the questionnaire (double edge sword can lead to bias)

telephone interview disadvantages

-unlisted phone numbers -decresing landline use -increasing moblie phone use -answering machines/voicemail/caller id -easier to just hang up and end interview than leaving an in person interview

Threats to Internal Validity

.confounding varibales, extraneous variables, etc

Validity of measurement

A measurement procedure is measuring what is supposed/intended to

Validity of research design

A study design answers the question that it is supposed/intended to

A drawback to an open-ended question is that A) the responses obtained may be difficult to code and analyze. B) it is more difficult to construct than other types of items. C) it may place too many restrictions on the participant's response. D) the other three choices are all drawbacks

A) the responses obtained may be difficult to code and analyze.

Threats to External Validity

Any characteristic of a study that limits the ability to generalize the results (volunteer bias, time of measurement,characteristics of participants)

The goal of the descriptive research strategy is A) to describe an individual person or patient in great detail. B) to describe a variable (or variables) as they exist naturally. C) to describe the relationship between two variables. D) to establish the existence of a cause and effect relationship between variables.

B) to describe a variable (or variables) as they exist naturally.

The primary distinction between quantitative research and qualitative research is based on differences in the A) type of participants. B) type of phenomena they study. C) type of data they produce. D) type of participants and type of phenomena they study

C) Type of Data they produce

One problem with mail surveys is non-response bias. This means A) usually none of the surveys are returned. B) many questionnaires will be returned with missing answers. C) individuals who return surveys may not be representative of the general population. D) attempts to increase the number of people who return the survey may produce a biased sample.

C) individuals who return surveys may not be representative of the general population.

Which of the following identifies a potential problem with Internet surveys? A)They tend to be costly and inefficient. B) They are difficult to administer C) It can be difficult to find a group of participants who share a specific interest. D) It can be difficult to control or even know the representativeness of the sample.

D) It can be difficult to control or even know the representativeness of the sample.

The multiple-personality study reported in Thigpen and Cleckley's The Threee Faces of Eve is an example of a) participant observation b) naturalistic observation c) correlational research d) case study research

D) case study research

Correlational Research

Describes relationship between two variables, but does not explain the relationship. Changes in one variable is related to change in another

Experimental Research

Determine cause and effect relationship, it requires prediction and direction, Can control an outcome (DV) by systematically changing a predictor (IV) An Example of this is a drug trial: Randomly assign participants to receive an experimental drug (treatment) or placebo (control)

Phenomenology

Focus is on the participants' points of view -- how they perceive and interpret the world (experiences, events, etc.) Often employ interviews

What is a contingency question?

Only intended for some people, basically it is a follow-up questions that are contingent on how you answer a previous question. Ex: have you smoked marijuana? If yes go answer the question below

Qualitative Strategies/Designs

Phenomenology, Ethnography, Grounded Theory, Case Studies

Open-ended Questions

Respondent is asked provide his/her own answers, short answer questions. Advantages: more insight, more indepth, more individualized Disadvantages: coding and analyzing is much harder

Close-ended question

Respondent is asked to select an answer from among a list provided by researcher for example multiple choice or likert scales. Advantages: easier to analyze and code Disadvantage: answers are very surface level and sometimes there are not enough options to choose from

Self-edministered Questionnaire

Respondents are asked to complete the questionnaire by themselves. Can be in-porson or not (mail, website, etc)

Types of Surveys

Self-administered, interview surveys, telephone surveys, online surveys

Quasi- and Non-Experimental

Similar to experimental strategy, the predictor or the independent variable is not completely under researchers control. This strategy is useful when it is impossible to manipulate IV, ex: Does smoking cause cancer? and during naturally occurring groups of interest ex: Do 3rd grade boys and girls differ in math and reading ability? The things can be inferred but never demonstrated

What is non response bias?

The people who respond to the survey have different characteristics than the people who don't respond. It is difficult to generalize

What is the goal of Descriptive Research?

To descrive a single variable to a particular group of people, it not concerned about the relationship or correlation between variables but is looking to take a 'snapshot', often represented in percentages or proportions

Evaluating Qualitative Research

We assess 'rigor" - trustworthiness - authenticity -credibility -Verisimilitude

What is reflexivity?

When a researcher reflects on bias and asks if own bias effects that answers or conclusions of the study

Etic

Written in perspective of the researcher (dealing with qualitative research)

Which research strategy is not concerned with examining relationships between variables? A) descriptive b) correlational c) experimental d) quasi-experimental

a) descriptive

A researcher uses a survey to obtain measurements of students' eating behavior at a local college. The researcher hopes to prepare a report describing where the students eat, what times they eat, and what kinds of food they eat. This researcher is using the a) descriptive research strategy. b) correlational research strategy. c)experimental research strategy. d) factorial research strategy.

a) descriptive research strategy.

If a researcher measures self-esteem with the Rosenberg Self-Esteem Scale, will an-other researcher get the same results measuring self-esteem with the Harter Self-Esteem Measure? This is a question of a. external validity b. internal validity c. reliabilty d. Accuracy

a) external validity

To help ensure that observational measurements are objective, which of the following techniques would be used? a) habituate the participants to the observer's presence b) prepare a list of behavior categories c) measure inter-rater reliability d) prepare a list of behavior categories and measures inter-rater relaibility

a) habituate the participants to the observer's presence

A case study is an example of a) idiographic approach b) nomothetic approach c) correlational approach d) interview approach

a) idiographic approach

A research study finds that a group of participants who received relaxation training had lower exam anxiety scores than a group who did not receive training. However, the researcher suspects that the difference between groups may be caused by the fact that the participants in one group are generally smarter than those in the other. This study has a problem with A) internal validity. b) external validity. c) experimental validity.

a) internal validity

Any factor that allows an alternative explanation for the results of a study is a threat to a) internal validity b) external validity c) reliability d) accuracy

a) internal validity

Essay questions on an exam are examples of _______ items. a) open-ended b) closed-ended c)rating scale d) physiological

a) open ended

The results of a study may be influenced by the fact that a participant knows he or she is being studied. This threat to external validity is a)reactivity. b) novelty. c) experimenter bias.

a) reactivity

The aim of qualitative research is to a) Test logical, falsifiable hypotheses through carefully designed experiments b) Describe or interpret social phenomena, most often by uncovering the meanings people attach to their experiences c) Search for causal explanations D) Both A and B are aims of qualitative research

b) Describe or interpret social phenomena, most often by uncovering the meanings people attach to their experiences

What is an advantage to administering a survey over the Internet? a) Always 100 percent response rate b) Reach broader range of people c) Risk of interviewer bias d) None of the options are advantages

b) Reach broader range of people

What (or who) is the main research instrument in qualitative research? a) The interview script b) The researcher c) The transcription d) The participant

b) The researcher

The "etic perspective" could be described as whose point of view? a) The participant's or the insider's b) The researcher's or the outsider's

b) The researcher's or the outsider's

What are the ways we assess (or judge) the rigour of qualitative research studies? a) Validity, reliability, generalizability b) Trustworthiness, authenticity, transferability c) Type of measurements used, nature and size of the sample, and type of analysis performed d) All of the above

b) Trustworthiness, authenticity, transferability

The multiple-choice questions on this quiz are examples of ________ items. a) open-ended b) closed-ended c) rating scale d) physiological

b) closed- ended

If a reasercher is recording instances of humor during a television show , that researcher is conducting a) archival research b) content analysis c) naturalistic observation d) participant observation

b) content analysis

A research study records scores measuring alcohol use and a score measuring income level for each indv. group of 40 yr old men. The study intends to determines whether there is a relationship between the two variables. This study is an example of a _________ reaserch strategy a) description b) correlational c) experimental d) nonexperimental

b) correlational

Any factor that limits the ability to generalize the results of the study is a threat to a) internal validity b) external validity c) reliability d) accuracy

b) external validity

As the values for one variable increase from one person to another, the values for a second variable tend to decrease. This is an example of a __________ relationship. a) positive b) negative c) curvilinear

b) negative

A researcher lives with a group of nomads to observe their behaviors. For this study, what kind of behavioral observation being used? a) naturalistic b) participant c) contrived d) unstructured

b) participant observation

Any factor that raises doubts about the research results or the interpretation of the results is a(n) a) threat to reliability. b) threat to validity. c) artifact. d) demand characteristic.

b) threat to validity

Any factor that raises doubts about the research results or the interpretation of the results is an a) threat to reliabilty b) threat to validity c) artifact d) demand characteristic

b) threat to validity

Results from a research study suggest that a stop-smoking program is very successful. However, the participants who volunteered for the study were all highly motivated to quit smoking and the researcher is concerned that the same results may not be obtained for smokers who are not as motivated. This study has a problem with a) internal validity. b)external validity. c)experimental validity. d)validity of measurement.

b)external validity.

Qualitative research is often "emic." In this context, what does emic mean? a) Applying a preformed or existing definition or theory to analysis of data b) Imposing a framework of meaning to data or phenomena c) Allowing theories and definitions to emerge through participants' accounts and explanations d) Using categories and theories already deemed appropriate by the scientific community for the study

c) Allowing theories and definitions to emerge through participants' accounts and explanations

On a questionnaire Dr. Allen asks participants to answer the following questions? "What do you think about the legalization of marijuana for medicinal purposes?" This is an example of a(n) ____________ question. a) restricted b) rating scale c) open-ended d) partially open-ended

c) open-ended

Where might qualitative researchers prefer to collect data? a) In a laboratory b) Via surveys c) In real life settings d) All of the above

c) real life settings

What is a disadvantage of administering an interview by phone versus in-person? a) More expensive to administer survey by phone. b) More time-consuming to administer survey by phone. C) Have less control over protocol administration. d) Answering machines and Caller ID reduce response rates.

d) Answering machines and Caller ID reduce response rates.

_______ effects occur when environmental events other than the treatment influence the participants' scores in one treatment differently than in another treatment. a) Subject selection bias b) Volunteerism c) Fatigue d) History

d) History

Qualitative research approaches include all of the following EXCEPT a) Phenomenological b) Grounded theory c) Ethnography d) Statistical/mathematical

d) Statistical/mathematical

The advantage to the case study design (compared to a group design) is that a) it can be used to study rare phenonma b) it can demonstrate a counterexample to a general principle c)it can be emotionally powerful and convincing d) all the above

d) all of the above

Because qualitative researchers have a high degree of contact and interaction with their study participants, they often examine and disclose their own preconceptions, assumptions, biases, and motivations about the study. This practice is called . . .? a) Contextualization b) Emic perspective c) Thick description d) Reflexivity

d) reflexivity

Which of the following is not one of the identified features of qualitative research listed at the beginning of the chapter? a) The data have primacy (priority) b) Qualitative research is context-bound c) Researchers immerse themselves in the natural setting d)Qualitative researchers focus on testing falsifiable hypotheses

d)Qualitative researchers focus on testing falsifiable hypotheses

A study examining what percentage of married couples is satisfied with their marriages is an example of what research approach? a. experimental b. quasi- expereimental c. correlational d. descriptive

d. descriptive