Research Midterm
Suggested acceptable response rate
50-70%
All of the following are important to consider with the Data Collection portion of your methodology EXCEPT: A. All instruments must be standardized B. IRB and Self Certification implications may determine details of the project's timeline C. In order to address your primary aims, variables of interest must be measurable D. Data collection approaches vary, based on the primary aims
A
Methods Section Outline
1. Research Design 2. Participants 3. Data Collection (includes) - Instrument Description - Processes and Timeline 4. Data Analysis 5. Limitations of the study
Response Bias:
1. Respondents unable to recall information accurately 2. Respondents interpret meaning of question differently than meaning intended by researcher 3. Response choices do not accurately express respondents' experiences or opinions
when nonprobability is used; researcher must
1. clearly define sampling process 2. acknowledge limitations of sampling procedure 3. justify why limitations do not jeopardize research question
Sample fundamentals include
1. inclusion and Exclusion criteria 2. defining the sample 3. ensuring representation
4 types of validity
1. statistical conclusion validity 2. internal validity 3. construct validity 4. external validity
THREE PROPOSAL INTRO ESSENTIALS
1.BRIEF BACKGROUND 2.SIGNIFICANCE / GAPS 3.PURPOSE & PRIMARY AIMS
To formulate survey questions you must
1.Identify Variables 2.Clarify Variables of Interest - Operationally - Conceptually - Level of Data Desired (Nominal, Ordinal, Ratio, Interval) 3.Develop Questions to elicit data on those variables
Legally appropriate informed consent will include the following elements:
1.Information that the study involves research. 2.A clear description of the risks or discomforts to the subject. 3.A description of the benefits to the subject or to others. 4.A disclosure of any alternative procedures or treatments that may be advantageous to the subject. 5.A description explaining how the institution/investigator will maintain confidentiality of records. 6. For research involving more than minimal risk, an explanation should describe: if theirs compensation, if thiers any medical treatment offered and who will bear the financial responsibility of said procedure, where subjects may obtain further information . The specific office, name, and telephone number (s) of whom to contact for further information regarding the research subjects' rights, the research study, or for research-related injury. 8. A statement that participation is voluntary, that refusal to participate involves no penalty or loss of benefits to which the person is otherwise entitled, and that the subject may discontinue at any time.
three problems with memory recall
1.Memory fades over time 2.Individual episodes or occurrences of regular and mundane events are general not precisely remembered. 3.People usually do not categorize information by precise month or year.
3 parts of a survey question
1.Question Stem: ◦Words that form the actual query itself 2.Additional Instructions: ◦To help comprehension may include: Definitions Examples 3.Answer Choices or Spaces
For research using surveys, two considerations are of prime importance:
1.Representative sampling 2.Survey/Question design (operationalization, validity, reliability)
Elements of a research proposal
1.Statement of the Research problem and questions 2.Statement of the research aim and hypothesis 3.Background and significance 4.Methodological approach 5.Data analysis approach 6.Timeline 7.Key personnel 8.Budget
survey research needs a minimum of __________ in each major subgroup
100 - 20-50 in each minor subgroup whose responses will be analyzed
Experimental- causal comparative studies must have at least ________ subjects
15
correlational studies must have at least _________ subjects
30
double blinding
A research design that controls for the influence of the researcher and research participants since neither group knows which participants are in the control group and which participants are in the experimental group.
The purpose statement is ...
A single sentence or two that provides the "BIG PICTURE" of what will be addressed/accomplished in the research. Generally - what is the broad overarching goal of your research? •The purpose of this study is to... •The goal of our study is to... •The objective of this research is to..
True or False Informed consent primarily includes a written document.
False
a mechanism for regulatory oversight in which one or more committees of informed individuals review research proposals to ensure the proposed study is safe and ethical for all participants.
IRB
considerations to statistical validity
IV and DV relationship effect size statistical power (sample size) statistical significance (p value)
All of the units to which one desires to generalize results
Target population
True or False When constructing your own cover letter and/or recruitment email for your OTD study, a good place to start is by referencing past examples of student research projects of a similar methodology.
True
US Public Health Service studied syphilis in African American males over 40 yrswhile deceiving subjects into receiving "treatment" and not informing them of their disease
Tuskegee Experiments
Filter Questions
Used to determine whether or not the questions that follow are relevant to the research participant.
Accomplishing research aims requires information on the ______________ of intrest
Variables
blinding
any individual associated with an experiment who is not aware of how subjects have been allocated to treatment groups
rule of thumb on variables
as many as necessary and as few as possible
placebo control group
believe they are receiving a treatment but are not
Qualitative reseach design
captures subjective meanings, actions perception of social contexts
nominal
catagories (no inherent order)
ordinal
category & order (has a ranking)
interval
category, order, equal intervals (spacing; no 0)
ratio
category, order, equal intervals, has a 0
all the units that complete the study
completed sample
examples of non probability sampling
convenience purposive snowball or network quota
drawback of mailed surveys
cost
All research depends on
data
ensuring representation
decisions should consider gender and race/ethnicity or other subcategories
sample size influences ___________ & _______________ especially costs and time
design & implementation of sstudy
Ranking Questions
participants RANK items on a list
includes respect for persons, beneficence, and justice
principles of Belmont
recruiting + retaining subjects =
project sucess
A broad overarching statement that provides the big picture to be accomplished by the research is referred to as ____________________________.
purpose
grounded theory, phenomenology, and ethnographic studies are all
qualitative
surveys might be ________, ________ or ________
qualitative (open ended questions; textual) quantitative (used forces- choice) mixed
one group post test only two group post test only one group pre & post test two group pre and post test these are all examples of
quasi - experimental research design
Experimental research design
random assignment, two groups, outcome measures
considered to be the cornerstone of quantitative research
randomization
anything from a short Paper/Pencil feedback form to an intensive one- on-one in-depth interview.
survey
Figures that add special meaning based on what they represent to respondents
symbols
Inferential stats
t-test, ANOVA, regression, chi square, correlations, trying to reach conclusions that extend beyond the immediate data alone
construct validity
the degree to which a test measures what it claims, purports, to be measuring - meaures what is says its going to measure
internal validity
the extent we can infer- explanation for a phenomenon is true - an intervention caused by an effect - how true/accurate something is
The larger the sample size ______ statistical power
the more
placebo effect
the phenomenon in which the expectations of the participants in a study can influence their behavior
regression to the mean
the tendency of extreme scores on a variable to be followed by, or associated with, less extreme scores
random error
those that happen by chance (fluke) increased number; decrease random error
Assent
utilized for minors to express willingness to participate, in addition parental permission (informed consent) must be obtained
probability sampling
utilizes some form of random selection - procedure assures that different units of population have equal probabilities of being chosen - power comes from ability to estimate closely the distribution of a characteristic in a population by obtaining info from relatively few elements of that population
delayed treatment control group
wait list, recieve after treatment group
coverage error
when the target population does not coincide with the population actually sampled - under coverage- refers to extent that elements in the population are missing from the frame - over coverage- refers to the extent that element in the population are on the frame more than once
Validity
whether data collected actually represents variables under study - degree to which reserch offers best evidence to approximate the truth
Fundamental source of meaning help respondents understand what is being asked.
words
Elements that communicate information
words, numbers, symbols, graphics
the variables you want to measure should be chosen from
your aims and research questions
Primary aims SHOULD be:
•2-4 objective statements with a logical sequence (first, second, third...) •Explicitly states desired outcomes, or specific intentions of research •More specific than a purpose statement; measurable. •Emphasize what will be accomplished, not how it is to be accomplished •Must be focused and feasible
Key aspects of the background of the introduction section of the proposal
•BRIEF OVERVIEW - of the facts - grabs attention/interest! •EFFECTIVELY EXPLAINS historical facts of topic ( briefly / concisely). •ESSENTIALS ONLY - most supportive/ convincing references / ideas. (Remember: full details are reserved for literature review which immediately follows intro in a proposal.) •SEQUENCING Describes general topic then quickly gets to point of your project
The Introduction section will:
•Briefly clarify basic background on the exact problem to be investigated •Explain the importance/significance (gap you will fill) and to whom (audience) •Identify the expected outcomes (i.e., purpose-primary aims) of project
Often OTD student research projects require development of a data collection instrument. All of the following are true of instrument development EXCEPT: A. Non-standardized questionnaires may be needed to study a new population or topic of interest B. Non-standardized questionnaires are used when no instrument exists to meet the research need. C. Students do not need to request permission to use previous research instruments or adaptations of such instruments D. A description of the instrument should be outlined in the Methods section, but the actual instrument should be placed in the appendix, if included
C
Which of the following is NOT an accurate statement regarding the Methods section? A. Detailed and specific instructions are provided in the Methods section. B. The Methods are written so that other researchers can replicate the study. C. Subheadings are not needed in the Methods section for ease of reading. D. The Methods section is often the "heart" of the proposal.
C
Why does an intro matter
- Never get a 2nd chance to make a 1st impression. - Important road map for the remainder of your proposal. - Makes reader WANT to read the remainder of your paper.
Multiple Choice Questions
- Offering several options - ONE correct answer - Each alternative is approximately the same length
Dichotomous Questions
- Only permitted to answer yes / no. - Useful for very factual questions. - May allow for "Don't Know" option.
Tick List
- Providing participants a list of items to choose from regarding topic. - List should be as EXHAUSTIVE as possible. - Wise to include an "other" category. - May wish to LIMIT to a certain number of responses. (choose top three) - Categories should NOT overlap. - Lose some detail and data manipulation ability
Scaled question
- Series of ordered steps used as a standard of measurement. - Provide numerical scores to compare individuals and groups. - Referred to as Likert Scales - Scales usually comprise five points.
selection bias
in an experiment, unintended differences between the participants in different groups
Quanitative samlping
- the inclusion and exclusion data is set before the study begins - unit of analysis is likely the individual with intentions to generalize a population
When developing a new survey
- their is validity and reliabliy issues
multi stage sampling
- using a combination of random sampling methods
major sources of systematic error
- using volunteers those who volunteer are likely to be different than those who refuse - using groups that are available or convenient: likely to share some common characteristic that makes the differ from intended population
convenience sampling
- volunteers easily available - clients available to use as our sample - no evidence of being representative of population were interested in generalizing to - most problematic, wildly used non-probability method - subjects enrolled as they agree to participate until desired number is reached
Questions to ask during data analysis
- what program will be used for data entry? - How will data be analyzed once collected? - may be one or more analysis procedures used
To decide on a collectoin method, select the method that best suites the
-research question/ primary aims - populaton under study - available resources and constraints of study
quasi-experimental design ****
An experiment that does not require random assignment to conditions. convenience sampling
PILOT SURVEY
- Test survey on a few people. - Similar to the "real" sample to take survey. - Eliminate remaining problems that may have been overlooked. - Encourage critique. - Solicit opinions on length, instruction/question clarity, attractiveness, problems, or adverse reactions.
When using a preexisting survey...
- remember to cite sources - get permission to use - adapt an existing survey but must explain how and why to use; NEED PERMISSION TO ADAPT
Researcher is responsible for: (in reguards of ethics)
- the conduct of the consent process - ensuring that effective informed consent is obtained and documented using only the IRB-approved and stamped consent document(s) - ensuring that no human participants are involved in research prior to obtaining their informed consent.
Qualitative sampling
- 2 principles: appropriatness and adequacy - unit of analysis = peopel focussed or structure focused (culture)
The methods section does 3 things
- Accounts for exactly how research will be completes - is clear and detailed enough for another researcher to recreate the research - describes the ethical approval process as well as subsections of info
ROLE OF INTRODUCTION
- Acts as a BRIDGE to transport reader from their own lives into the "place" of your research. - Briefly explains professional value for the topic ... Why this? Why now? What will you accomplish(aims)?
Open Questions
- Allow participants to answer in their own words. - Questionnaires often have a mixture of open and closed q's. - May use open question as a follow up to a closed question
What information should be included in the research design statement?
- An overarching idea of the methods used - The type of study (such as: quantitative, qualitative, mixed-method, crossectional, etc.) - The population being studied
Matrix (grid) questions
- Asking 2 or more questions at once; - Often formatted in a table or box to visually help the reader - Keep It Simple, Stupid (KISS) principle - VERY IMPORTANT
Critical steps to sampling
- Define population of intrest (lit review) - Consider the unit of analysis - identify a performace site/access - deveop a sampling approach - implement sampling procedures
Steps in Building Questionnaire
- Defining and clarifying SURVEY VARIABLES - Formulating the questions - Formatting the questionnaire - Piloting and Revising
SUMMER SEMESTER BIG GOALS
- Explore Research methodologies and data analysis - Complete research proposal (to have a plan!) - Explore decisions related to ethics (IRB approval or IRB Self-Certification)
Key Dimensions of Survey research
- Identify population of interest & how to sample. - Identify research purpose / aims and generate appropriate survey questions. - Develop statistical estimates to generalize to population under study.
Main Advantages of Survey Research
- Large number of respondents; minimal expenditure (What is a respondent?) - Collection of data on numerous variables - Statistical manipulation; multiple uses of the data set
when Designing a recruitment plan you must
- Locate a sample - ensure the sample representativeness - creating links to sample sources - develop recruiting materials - funding recruitment efforts
The Participants Section of the Methods Section should:
- Thoroughly describe the people taking part in the study - identify sampling procedure; access to participants is a key consideration - explain process of recruitment and sample size - identify any inclusion or exclusion criteria
Sampling includes
- WHO: will particpate in the study - HOW: they will best reppresent the larger population of intrest - SAMPLE SIZE: how many participants will be invited to particpate - SAMPLING APPROACH; how participants are selected
How to reduce non-response in mailed survey
- Well presented letter & questionnaire - Send multiple mailings to non-respondents ◦Three mailings - original / two reminders ◦One month apart - Postal: postcard follow-up - reminder
The process of consent has 2 central components
- a well written indomed consent document - the process for obtaining consent
IRB is comprised of a group of diverse individuals with both scientific and nonscientific interests who do 2 things
- are Responsible for reviewing applications, including a study protocol. - Ensure safeguards are in place, including informed consent
stratagies for determining sample size
- census for small populations - published tables - formulars to calculate
threats to construct validity
- confounding variables - expectancy effects - interactoin effects - testing anxiety
Non- Standardized Questionnaires
- created for pre-lim studies about a novel variable - no instrument exists to meet the need - typically limited to descriptive studies - not used in experimental/ outcome studies - no or limited reliability/ validity background - commonly used with student OT projects
Inclusion Criteria
- criteria for including a person of study - clearly defined in an objective manner - provides ability to reproduce inclusion decisions precisely
2 major types of survey research
- cross sectional surveys - longitudinal surveys
purposive sampling
- deliberate selection of individuals by the researcher based on certain SPECIFIC predetermined criteria - sample with a purpose in mind - one of the first things done is verify that respondent does meet criteria for sample
Quota sampling
- different proportions of subject types are needed appropriate representation in the sample - specify a minimum number of participants you want in a non overlapping category ex; 100 participants = 50 males & 50 females
cluster sampling
- divide population into clusters - randomly sample clusters or groups - measure all units within sampled clusters - Individuals are not randomly selected; clusters are
The limitations section does...
- explain factors that might reduce the generalizability of study - discuss potential weak points or criticism of the study
a cover letter
- is A tool for recruitment and informed consent - The participant's first impression - May be a "recruitment email" if e-survey methods The goal is to provide certain critical pieces of information in a relatively short manner. Best if only one page; has brief and engaging style, and establishes interest and trust.
how to prepare for data analysis after collecting the surveys
- know how data will be analyzed to meet the aims of the study (planning stage of survey developement) - identify gaps in potential data in advance - survey data must be able to translate into data that can be analyzed statistivally or qualitativly
If you use a mail or electronic survey the emphasis is on ________________ If. you use a phone survey the emphasis is on ________-
- layout design (visual) - word choise (auditory)
Data Collection approaches
- observations - Interviews - self - report - standardized tests - contextual/environmental assessment - focus groups - biometric measures - records review
sample pool-
- part of defining the sample - refers to those who are identifies as eligible to participate
threats to external validity
- people vested in process/sampling issues - place demographics of location - time, day, season
Research tool where information is gathered about groups of individuals in a systematic way.
- questionnaire Heart of survey process is development of the questionaire
statistical validity
- relevant to research studies that rely on stats to tests hypothesis
A rigorous survey requires careful attention to:
1. Developing the survey 2. Administering the survey 3. Processing the data
systematic error
subjects differing from population
Which of the following is not a part of a survey question? A. Answer key B. Choices or spaces C. Question stem D. Instructions
A. Answer key
Which of the following terms is NOT a key definition on the self-certification form? A. Informed Consent B. Human Subjects C. Research
A. Informed Consent
Which of the following is NOT a factor when making decisions about research collection methods? A. Personal bias B. Research questions/aims C. Available resources D. Access to study the population under study
A. Personal bias
practice effects
Ability to practice makes someone better
Recruitment Materials: Options
Advertisements Flyers Outlook announcements, Telephone scripts Newspaper ads Radio Television Announcements Bulletin Board Tear-Offs Internet Postings Posters
Includes copies of any detailed supportive documentation. Examples include, but are not limited to: lit. matrix, letters of support, survey or assessment, recruitment materials, etc.
Appendices
Which of the following is NOT a consideration for Data Analysis in the Methods section? A. Data analysis should be closely linked to the research design, purpose, and aims. B. A statistician consultation is never needed until data analysis. C. Basic descriptive statistics may include providing the mean, mode, median, or frequencies using SPSS D. Data analysis may utilize one or more analysis procedures
B
Which of the following is NOT a consideration with Participants in your study? A. The accessibility of the participants (and their personal contact information) B. Inclusion and exclusion criteria do not need to be specified C. Recruitment of the participants D. The informed consent process of participants
B
Which of the following is not recommended with forming survey questions? A. Make sure the question applies to the respondent. B. Ask multiple questions at one time for efficiency. C. Use as few words as possible to pose the question. D. Be sure the question specifies the response task.
B. Ask multiple questions at one time for efficiency.
Which of the following was NOT one of the threats to external validity that was mentioned in your notes? A. People B. IRB approval C. Place D. Time
B. IRB approval
Which of the following is not a contributing factor to RESPONSE BIAS: A. Poor Recall B. Lack of response to survey Correct C. Poor choices for respondents D. Incorrect question interpretation
B. Lack of response to survey Correct
Read the following question below. Which level of measurement best describes this survey question? In your facility, how often does OT provide services in ANY adult ICU? ___ At least daily ___ At least weekly ___ At least monthly ___ Other:_______________________________________________ A. Nominal B. Ordinal C. Interval D. Ratio
B. Ordinal
Which of the following is NOT a feature of quantitative sampling. A. The specifications of the subjects are set before the study begins B. The unit of analysis is focused on the culture of the people C. The unit of analysis is likely the individual with intentions to generalize to a population
B. The unit of analysis is focused on the culture of the people
Read the following question below. This survey question is best described as a(n) ____________ question? In what state(s) are you currently practicing? _____________________________________________________________________ A. Closed B. Open C. Partially closed
B. open
Read the following question below. What kind of data would you yield in the following type of question for data analysis? Do you plan on working in a rural setting for the remainder of your career? Yes _____ No _____ Unsure ____ Please elaborate. ___________________________________________ A. Quantitative B. Qualitative C. Both Quantitative and Qualitative
C. Both Quantitative and Qualitative
Which of the following is not a main type of question format for surveys? A. Partially closed question B. Open question C. Electronic question D. Closed question
C. Electronic question
Which of the following is NOT a consideration with designing a recruitment plan? A. Locating the sample B. Ensuring sample representativeness C. Neglecting links/relationships to sample sources D. Developing and Funding recruitment materials
C. Neglecting links/relationships to sample sources
Which of the following is FALSE in regard to recruitment and retention processes? A. Considered part of the informed consent process B. The IRB must review and approve all recruitment procedures and materials BEFORE use. C. Retention efforts and materials are NOT reviewed by IRB prior to use. This is NOT correct. Both recruitment and retention processes and materials must be approved by IRB before use. D. A successful study considers both recruiting and retaining subjects.
C. Retention efforts and materials are NOT reviewed by IRB prior to use.
Which of the following is NOT an example of a type of probability sampling in quantitative research? A. Simple random B. Systematic Random C. Snowball D. Cluster
C. Snowball
Which of the following best describes your role in the process of IRB approval?
Co-investigator
Exclusion Criteria
Criteria for excluding a person from the study - why they do not qualify for it
Which of the following is NOT true of ethical considerations in research? A. Ultimately, the researcher is morally responsible for the study B. The practical application of the principles of integrity and ethics is a complex matter. C. Current researchers can learn from past mistakes in the unethical treatment of subjects. D. A commonsense understanding of moral issues is adequate in understanding ethics in research
D. A commonsense understanding of moral issues is adequate in understanding ethics in research
Which of the following is NOT an example of non probability sampling in quantitative research? A. Convenience B. Purposive C. Snowball or Network D. Cluster E. Quota
D. Cluster
Which of the following does NOT describe a cover letter and/or a recruitment email? A. A tool for recruitment and informed consent B. The participant's first impression C. Serves to provide certain critical pieces of information D. Is best if lengthy and complex, to include all important legal information
D. Is best if lengthy and complex, to include all important legal information
___________ is the section of the methods section that describes the means of collecting data
Data Collection - Includes instrument used and process
32 principles and two subsequent clarifications
Declaration of Helsinki
This is an example of what kind of question: Did the number of participants with multiple sclerosis treated in your department exceed 50 last year? __ Yes __ No __ Don't Know
Dichotomous question
Read the following question below. This survey question can be described as a ____________ question? Have you worked in the ICU to provide adult patient care within the last 3 years?___ Yes___ No IF YES, please identify the state(s) where you provided ICU occupational therapy services. _____________________________________ A. Tick List B. Matrix C. Dichotomous D. Filter E. Both C and D are correct and describe this question
E. Both C and D are correct and describe this question
Which of the following is NOT a consideration when crafting survey questions? A. Primary Aims/Variables of study B. Mode of survey to ask questions C. Visual layout of survey D. Attitudes/opinions are more difficult to measure E. Recall of memories improve over time
E. Recall of memories improve over time
Read the following question below. This survey question is best described as a ____________ question? Does a typical OT order specify early mobilization treatment in the adult ICU? ___ Yes ___ No ___ Sometimes If YES or SOMETIMES to the above question, what is the most common frequency ordered for early mobilization by OT? ___ Once a day ___ Twice a day ___ Three times a day ___ Other:______________________________________ A. Tick List B. Matrix C. Dichotomous D. Filter
Filter
This is an example of what kind of question Did you qualify as an OT before 1980? Yes __ No __ (If your answer to this question is "NO" please proceed to section B.)
Filter
This is an example of what kind of question 1.How long was there between the first signs of illness and the child being given a firm diagnosis? 2.Do you think the time taken between first illness and diagnosis made any difference to how you coped later? 3.Can you say how it made a difference?
Funnel
The Proposal is written in ________________ tense; whereas, the Manuscript is written in ____________ tense.
Future, past
What is the FIRST step to perform before building a survey questionnaire?
Identify/Clarify variables of interest
Briefly explains the context and value of the research. Answers: Why this/why now? Includes your goals/primary aims.
Intro
Required sections of a research proposal
Intro, Lit review, methodology, references, appendices
Scientific Rigor
Investigators carefully follow rules, procedures, and techniques that have been developed and agreed upon by the scientific community.
To write good questions you should avoid
Leading Questions Double Barreled Questions Ambiguous Questions Assuming Questions Irrelevant Questions Questions full of jargon Questions phrased in the negative
Written summary that establishes expertise on the topic to design a study.
Literature Review
When satisfaction data for a survey is gathered over time (e.g., admission, discharge, and 6 months post discharge), this would best describe what type of survey?
Longitudinal
Describes plan for exactly how research will be completed. Clear and detailed enough to repeat it by reading the content.
Methodology
Read the following question below. Which level of measurement best describes this survey question? Which way of writing do you like the best? 1. Print 2. Cursive 3. Keyboarding A. Nominal B. Ordinal C. Interval D. Ratio
Nominal
Convey meaning and sequence or order to respondents
Numbers
written during Nazi Doctors Trials; 10 principles of ethical human subject research
Nuremberg Code
Confidentiality
Only the investigator(s) or individuals of the research team can identify the responses of individual subjects; however, the researchers must make every effort to prevent anyone outside of the project from connecting individual subjects with their responses.
This is the process of figuring out how to accurately measure the factors (i.e., variables) you wish to measure.
Operationalization
Read the following question below. Which level of measurement best describes this survey question? How prepared were you to practice in a rural area upon completion of your OT educational program? Please circle your answer. Very prepared Prepared Neutral Poorly prepared Not prepared A. Nominal B. Ordinal C. Interval D. Ratio
Ordinal
Read the following question below. This survey question is best described as a(n) ____________ question? Do you plan on working in a rural setting for the remainder of your career? Yes _____ No _____ Unsure ____ Please elaborate. _______________________________________ A. Closed B. Open C. Partially closed
Partially Closed
Words used in the question stem, additional instructions, and response options are the ________________ that respondents draw upon when comprehending the meaning of survey questions.
Primary sources of meaning
Respect for persons, beneficence, and justice are all key components of the _________________________________.
Principles of Belmont
_____________________ outlines what will happen in the study & the order in which it will happen
Process/Procedures. (included in data collection of the Methods section) Includes the Timeline the project will happen - IRB/Self Cert. Implications Explains in detail how the data will be collected
Anonymity
Providing anonymity of information collected from research participants means that either the project does not collect identifying information of individual subjects (e.g., name, address, Email address, etc.), or the project cannot link individual responses with participants' identities. A study should not collect identifying information of research participants unless it is essential to the study protocol.
Deliberate selection of individuals by the researcher based on certain specific predetermined criteria is known as _________________________ sampling.
Purposive
For OTD studies, IF you are doing an e-survey, your team MUST use ________ to collect survey data, since this helps with protecting participants' personal information.
REDcap
If your research group decides to conduct an electronic survey (i.e., questionnaire), it must be completed through the ___________________________ software program.
REDcap
_________ is the intro section to your methods section
Research Design - Broad Overarching methodological statement - state choice of particular research strategy as appropriate for answering the research questions
Order the subsections of the Methodology Section from first to last
Research Design, Participants, Data Collection, Data analysis, Limitations
A Written document that organizes/describes a planned process of research to address the research problem or answer a question. (includes lit review)
Research Proposal
The literature review becomes a key element to your _________ which becomes the foundation of your ________
Research Proposal; Manuscript
Refers to the specific procedures and guidelines that a researcher uses to answer a research question and/or test a research hypothesis
Research design
Nonresponse Bias:
Respondents selected for the sample who elect not to respond
non-response bias
Respondents selected for the sample who elect not to respond
A method of inquiry characterized by collecting data using structured questions to elicit self-reported information from a sample of people.
SURVEY RESEARCH
Critical steps in the research process involve identifying a population of research participants from which the researcher draws the ___________ and a __________________ in which to conduct the research.
Sample performance site (where the research takes place)
Funnel Questions
Seek more and detailed information on one particular topic.
A selection of every nth case drawn from a population at fixed intervals is known as ____________________________ sampling.
Systematic Random
This type of sampling error is defined as a widespread flaw in the study design.
Systematic error
A sample pool refers to______________________
Those who are eligible to participate in the study
Read the following question below. This survey question is best describes as a ____________ question? What type of adult ICU experience have you had in the last 3 years? Please check all that apply. ___ Medical ___ Surgical ___ Neurological ___ Trauma ___ Burn ___ Cardiac ___ Respiratory ___ Other: ______ A. Tick List B. Matrix C. Dichotomous D. Filter
Tick list
This is an example of what kind of question Select the three modalities which you believe to be the most effective in relieving pain of frozen shoulder? _ Ice _ Infra-red irradiation _ Ultra-sound _ Short-wave diathermy _ Exercise _ Manipulation
Tick list
All studies have limitations; however, discussing potential limitations up-front in the proposal may allow decisions to be made to minimize these limitations during the planning stages. (T/F)
True
exclusion criteria
Who will not be included in the study, decided on by factors that may confound finsings and those unable to participate in research
Do all studies have limitations??
YES
what is a variable
a means of labeling or giving meaning to a set of characteristics that are expected to vary amounf clients being studies (gender, age, pain level, etc)
randomization
a process of randomly assigning subjects to different treatment groups
Reliability
accuracy may be affected by circumstances of data collection (i.e who collects, instrument, how/when collected) - getting the same results
snowball sampling
aka network sampling method in which initially identified subjects provide names of others who may meet the study criteria
Target population
all of the units to which one desires to generalize results
If IRB- __________, _______________, ________________ must be approved FIRST by IRB in Fall 2021 BEFORE you can recruit your participants.
all recruitment, consent (&assent), and cover letter documents
completed sample
all the units that complete the study
Strata sampling
divide population into non-overlapping himigenous sub-groups - sex, age, ethnicity, work seetting, ed level
attrition
drop out
When you recieve final approval from your advisor on your cover letter you should
email final letter to advisor who will get sandy to print it with the UMMC OT letter head
simple random sample
every member of a population has an equal chance of being included
external validity
extent study findings can be generalized to different persons, settings, times - findings can be generalized to other people - the purpose of getting a representative sample is to increase the generalizability of the study
confounding variables
factors that cause differences between the experimental group and the control group other than the independent variable
Operationalization
figure out how to accurately measure the factors you wish to measure
no treatment control group
for some reason treatment is withheld/withdrawn
Shapes and visual images that can be simple or complex to convey meaning
graphics
Survey questions are made up of multiple parts that must work together in concert to produce _____________________________
high quality data about the topic of interest.
threats to internal validity
history, maturation, practice effects, regression to the mean, selection bias attrition, measurement approach, contaminatoin effects, ethical and social confounds
This principle requires prospective research subjects be given enough information, before they choose to participate in a research study, to make an informed decision as to whether or not they wish to participate This is a PROCESS- not a document; begins with the initial contact and ends at some point after the study is complete.
informed consent
Recruitment and retention is considerred to be part of the
informed consent process and the participatnt selecton process
non experimental research design
lacks variable manipulation, describes associations - descriptive, observational, correlational
sample frame
list from which a sample is to be drawn in order to represent the survey population
threats to statistical validity
low stats power (sample small) data mining - not theory/ evidence driven number reliability considerations measures- setting variations measures sample variations
Response rate is generally lower for
mailed surveys
questionaires might be
mailed, direct administartion, electric/online
A paper that is prepared for submission to a journal or other publication venue detailing project & findings. "an author's text that has not yet been published" Includes Abstract, Intro, methodology, results, discussion, conclusion, references
manuscript
Basic descriptive stats
mean, median, mode, frequencies, - simply describes what is or what the data shows
What is considered the "heart of the proposal"
methods section
critism of survey research
might be poorly designed & administered May result in data that is not very accurate, but is energetically quoted and used to make important decisions
This is an example of what kind of question The profession of OT was founded in which year? a.1910 b.1915 c.1917 d.1920
multiple choice
Qualitative data
narrative, descriptions
usual care control group
no change; standard care is provided
non probability sampling
no random selection may or may not represent the population well no statistical assurance - used when the parameters are not known or when its not feasible to do probability
2 main factors that can influence rigor of survey research
nonresponse bias and response bias
Quantitative data
numbers, counting
general rule about sample size
obtain largest sample possible
Interviews might be
on the phone, face to face
This is an example of what kind of question My preference for the following desserts on sale in the hospital canteen. Give the item you most prefer number 1 and the item you least prefer number 8. Bread Pudding __ Fruit Salad __ Rice Pudding __ Yogurt __ Apple Pie __ Jelly __ Ice-cream __ Steamed Pudding __
ranking
coverage
refers to extend to which elements of the target population are listed on the sampling frame
Recruitment and retention methods-
refers to means by which the authors were able to locate, access, enroll, and retain their sample over time and through the course of the study This concept is linked to the informed consent process.
Consent
refers to the process whereby competent adults give permission
sampling error
represents the difference between the values obtained by the sample and the actual values that exist in the population - may be random or systematic
Data Analysis should be linked directly to
research design, purpose, Primary Aims
the IRB must ____________ all recruitment procedures and materials before use
review and approve - retention efforts must also be approved
all units of population that are drawn for inclusion in the survey
sample
List from which a sample is to be drawn in order to represent the survey population
sample frame
This is an example of what kind of question Please circle the number that best expresses your view: I enjoy my current employment. 1 Strongly Agree 2 Agree 3 Neither agree or nor disagree 4 Disagree 5 Strongly Disagree
scaled (likert)
systematic random sampling
selection of every n'th case drawn from a population at fixed intervals
Examples of probability sampling
simple random systematic randm stratifies random cluster
Visual Design Properties that modify how elements are presented visually and the meaning respondents assign to them.
size, font, brightness/contrast/color, location
Primary Aims should not:
•be vague, too broad in scope •repeat each other (or purpose) in different terms •list things related to your research topic •contradict methods that will be chosen
