Research Methods SLP 6070 Fall
secondary source
•Analyzes and interprets research results •Analyzes and interprets scientific discoveries ex: Publications about the significance of research or experiments •Analysis of a clinical trial •Review of the results of several experiments or trials
3. Justice
"Individuals shall not discriminate in the delivery of professional services or in the conduct of research and scholarly activities on the basis of race, ethnicity, sex, gender identity/gender expression, sexual orientation, age, religion, national origin, disability, culture, language, or dialect." (ASHA, 2016, Principles of Ethics I, C) Everyone needs equal chance of participation
HIPAA
"Privacy Rule" that defines the content of protected health information (PHI)
2. Beneficence
"do no harm" Obligation to protect wellbeing of those who participate in research Sometimes there's direct benefit- treatment might improve after participating in trial More often the research Is for the good of society, ppl in study wont be benefited, but the findings will help Maximize all possible benefits and minimize any possible harm Cant anticipate all the side effects but can see what's going on and then stop it Review board can stop our research even if we don't want to
Evidence-Based Practice Make informed clinical decisions based on:
1. Available evidence identified with a thorough search 2. Professional expertise and knowledge of your patient(s) 3. Patient and family considerations
Systematic Inquiry Key features
1. Formulate a question to answer 2. Define a process for obtaining information 3. Complete predetermined set of procedures a. In a regular, orderly way b. To obtain information to answer your question
Additional Ethical Issues Research Integrity
1. Protection of nonhuman animals Conflicts of interest Care in data acquisition and handling Relationships with mentors/mentees and collaborators Accuracy and honesty in publishing research Peer review Avoiding research misconduct 2.Conflicts of interest Clinician-researcher dual roles Clinician-researcher patient recruitment Researcher-developer dual roles Researcher-instructor dual roles 3. Credit for Intellectual Effort Relates to recognition for your role in a research project Demonstrated when you receive appropriate recognition as an author or contributor 4. Attribution of ideas a. Citations b. Quotations 5. Accuracy in reporting 6. Confidentiality and privacy a. Knowingly misrepresenting data or other facts about your research ex: Unintentional- misrepresenting the data; ex: adding numbers to your study to make you look better 7. Data management a. Data quality b. Data ownership and sharing c. Data storage 8. Confidentiality and privacy a. Handling data and documents securely b. Protect participants' identities & information i. Using of identification codes rather than names ii. Keeping documents in a secure location iii. Obtaining consent if sharing data
Systematic Inquiry
1. Relates to the scientific method a. Identify and further define a problem 2. Develop Hypothesis/ Hypotheses a. Or questions 3. Plan a set of procedures 4. Collect relevant data 5. Analyze the data 6. Make a decision about the hypothesis/hypotheses
Human Subjects: The Belmont Report Three basic principles
1. Respect of persons 2. Beneficence 3. Justice
Roles for Research
1. Satisfy scientific curiosity ex: Pt comes in with certain set of problems and through the research process we learn 2. Answer important clinical questions 3. Engage in evidence-based practice a. Used to be called best practice now its called evidence based practice 4. Engage in evidence-based practice 5. Document the need for program support 6. Influence public policy 7. Evaluate clinical service programs
Key Elements
1. Summary of research: a. Not a "list" of found research but a coherent and articulate account of past and current research findings 2. Sources: articles, books and other documents describing status of research in a given field: a. Exhaustive and current b. Number of articles? c. Search how far back? 3. Should be organized: a. Coherent and organized under themes or topics b. In-depth & current status of research 4. Documents the need for a study: a. Should not simply duplicate current research b. If replicated, should document why
institutional Review Board (IRB)?
A group of university or medical research facility experts who provide oversight and evaluate proposed studies before researchers begin collecting data
directional hypothesis
A hypothesis in which a particular outcome is predicted
Sections of an empirical article
Abstract Introduction Method Results Discussion References
Course Outcomes
Access scholarly information from databases Critically read journal articles and review the literature on a research topic Understand research design and the clinical application of research Write a scholarly research paper Gain an understanding of evidence- based practice in the field of SLP
Quantitative pros and cons
Advantages Credible Economic on time Statistical analysis Disadvantages Artificial Difficult to control for variables Less flexible
Qualitative pros and cons
Advantages Natural settings Descriptive data Focus on perspectives Disadvantages Labor intensive Experience-based learning Different methodological assumptions Researcher bias Not suited to large amounts of data
References
All citations of previous studies must be listed
Research Critique
An analysis of research that focuses on its strengths and limitations
Institutional Review Board: Applications of Beneficence
Assessment of Risks and Benefits Risk refers to the probability of harm; benefit refers to something that promotes health, well-being, or welfare. What are the risks of harm to the participants? Are the risks justified? Can they be minimized? Can the research design be improved to minimize risk and maximize benefit? What are the benefits?
The 2 stylistic APA errors in the below reference: Yiu, Verdolini, & Chow. (2005). Electromyographic Study of Motor Learning for a Voice Production Task. Journal of Speech Language and Hearing Research, 48(6), 1254-1268. doi:10.1044/1092-4388(2005/087a
Authors' initials are missing & Journal title is not italicized
Quantitative research
Collect and analyze data of a numerical nature Frequency counts, measures of physical properties, scores on formal or informal tests Quantitative- numerical, identify test scores Accompanied by statistical measures, analyze data
Qualitative research
Collect and analyze data of a verbal nature Recorded speech, direct quotes, detailed descriptions and so forth ex: Ethnography Phenomenology Case study Grounded theory Conversation Analysis Focus groups Qualitative is more verbal- interview people, make observations of people, describe a culture in detail Don't do statistical measures on this
Empirical research
Collect new information or data Make observations and measurements Theres a question that need to be answered Empirical- collecting the data, first people who have collected it
The "C" in PICO
Comparison
Abstract
Concise summary of the problem, methods used, highlights of the results and a concluding statement of implications
Respect for persons:
Confirmed consent- they told them "bad blood" just testing them Tell them risks and benefits
Nuremberg War Tribunal (1947)
Criminal proceedings against 23 leading German physicians and administrators for their willing participation in war crimes and crimes against humanity. Horrifying procedures were conducted for research purposes on thousands of concentration camp prisoners without their informed consent. ex: Research conducted on holocaust concentration camp prisoners without their consent
Qualitative research
Ethnography is an example of this type of research.
Beneficent- do no harm
Even when cure came about they withheld treatment Going to test on human participants need to do no harm to them
Justice:
Everyone should have equal chance of being in the study In here they targeted poor black illiterate men
research is a process of systematic inquiry
Ex: car broke down need to do something set of processes 1. get car fixed 2. where can I do that
Belmont Report
Federal document that outlines basic ethical principles in research involving human subjects
Purposes of a Search
Find a potential answer to a question Identify prior research on a topic Identify a problem to study Identify methods from other fields of study Generate background information Identify procedures or outcome measures
Special Protections
For those that are most vulnerable Persons in prison Children Women who are pregnant and their fetuses Persons with impaired capacity to consent These individuals might not have free choice to make their decision Prison- confined against their will Children- don't fully understand to make an informed consent Fetus- cant make any choice at all Language level needs to be understandable to these participants, can provide rewards to participate
Nonexperimental Research explained
Group vs Single-Subject research Nonexperimental examples Case-control studies Survey research Case study Field study Correlational research Longitudinal, developmental research
Personal Health Information
Health Insurance Portability and Accountability Act (HIPAA) Referred to as the "Privacy Rule" Defines the content of protected health information (PHI) Specifies how this information should be secured Covers personal health information but impacts research when investigators are using health information or working with an agency that collects health information 18 diff categories of information, SSN, pictures, video, DOB, etc
Introduction
Historical overview of the problem Literature review Research rationale to justify the need for additional investigation
null hypothesis (H0)
Hypothesis based on assumption that results will yield no significant differences
Topic Outline
Information Literacy Purposes of a Literature Search Planning and Conducting a Search Designing a Search Strategy Organizing/Documenting Your Search
Institutional Review Board: Application of Respect for Persons
Informed Consent Process Information Does the consent form provide all the information necessary for the individual to make a reasoned decision? Comprehension Is the consent form crafted in language understandable to the potential participant? Voluntariness Does the consent form and clearly indicate that participation in the research is voluntary? What additional protections can be in place to protect those with limited autonomy? How to determine whether one lacks the autonomy to make a reasoned decision?
Discussion
Interpret the factual information Look for meaningful patterns to see how they fit within the larger framework Recommendations for improving future methodology
basic principles on the Belmont report
Respect of persons- Recognize potential participants' ability to make their own decisions Beneficence-Protect the wellbeing of the persons who participate in research Justice-Make equitable decisions regarding who is invited to participate in research
Features of Peer-Reviewed Articles
Is the article published by a professional scholarly society, professional association, or academic journal? Did you find a citation for it in one of the databases that includes scholarly publications? Did you limit your search to scholarly or peer-reviewed publications? Is there an abstract at the beginning of the article? Is the tone thoughtful, restrained and serious? Does the article have citations of other sources? Does the article have a bibliography at the end? Are the author's credentials listed? Is the topic narrowly focused and explored in depth? Is the article based on original research or authorities in the field? Is the article written for those with subject knowledge? Is the article divided into sections with headings?
Experimental research
Manipulate one or more factors to create different conditions or experiences Includes true experimental research and quasi-experimental research
Quantitative Research Quasi-experimental research
Manipulate one or more factors to create different conditions or experiences Use existing groups of participants without random assignment Johnson, Ladefoged, and Lindau (1993)
Quantitative Research True experimental research
Manipulate one or more factors to create different conditions or experiences Use random assignment of participants to groups Scott & Caird (1983)
Dependent variable
Measured by the experimenter For documenting participants' responses or outcomes What the outcomes of the research are Measured by the experimenter For documenting participants' responses or outcomes Dependent variable: the outcome. Ex: performance on the test
Response to Research Abuses
Nuremburg Code (1948)- international research standards Kefauver Amendment (1962) - all FDA requirements Food, Drug and Cosmetic Act Declaration of Helsinki (1964) Good Clinical Practices National Research Act (1974) - bc of syphilis study, human study research must protect their participants Belmont Report From all these studied we have laws that came out of them
test-retest reliability
One examiner uses the measure to assess the same persons at 2 different times
Types of Research Articles
Original research Review article Clinical case study Clinical trial Book review Perspective, opinion, and commentary
PICO component underlined below: In children with pragmatic language impairments and/or high-level autism, would a social communication intervention (SCI) increase the child's expressive language skills?
Outcome
A well-formed EBP research question takes the form of this acronym
PICO (P)atient/Population (I)ntervention (C)omparison (O)utcome(s)
Tuskegee Syphilis Study
Participants in the Tuskegee Syphilis Study. Department of Health, Education, and Welfare. Public Health Service. Health Services and Mental Health Administration. Center for Disease Control. Venereal Disease Branch (1970 - 1973). Participants would get 1k bonus after death for their autopsy Pulled from actually getting treated and they checked their progression
Scholarly Sources
Peer Reviewed or Refereed Primary and secondary sources A critical mind must always consider the sources where information comes from
National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research
Prepared the Belmont Report in 1979 The Belmont Report is a statement of basic ethical principles and guidelines that provide "an analytical framework to guide the resolution of the ethical problems arising from research with human subjects." 1. Boundary btw practice and research 2. Defines basic ethical principles 3. How you're going to apply them
Primary vs. Secondary
Primary- journal articles secondary- books
Three populations vulnerable to exploitation in research
Prisoners, children, women who are pregnant, or persons with impaired capacity to consent
Ethical Research Practices
Protection of Human Subjects Three basic principles Informed Consent Special Protections Historical Perspective Institutional Review Board (IRB) Additional Ethical Issues
Include the following in your notes or paraphase:
Reference for the information Statement of research question or hypothesis Description of observational procedures Including a description of participants Summary of observations (results) Tentative answer to question or decision
Information Literacy
Refers to the skills needed to: Find prior research efficiently Conduct a literature search Evaluate the quality of prior research Summarize or paraphrase key information Use existing information appropriately
the principle of Beneficence
Researchers' obligation to protect the wellbeing of the persons who participate in studies
National Research Act (1974)
Resulting from the Tuskegee Syphilis Study Created the National Commission for the Protection of Human Subjects of Biomedical and Behavioral Research Identifies basic ethical principles for conducting research involving human participants and develop guidelines to assure research is conducted in accordance with those principles What were required to do for a research study
Human Subjects Researchers should provide these additional protections:
Safeguard the privacy of personal information Maintain confidentiality and security of records
A Systematic Review would be considered this type of source
Secondary Source
Method
Select subjects Instruments and materials Select a research design Procedures
Institutional Review Board: Applications of Justice
Selection of Subjects Is the potential subject pool appropriate? Is it appropriate to involve vulnerable populations? Are the recruitment procedures fair and impartial? Are the inclusion and exclusion criteria fair and appropriate
Scientific method
Series of steps Can apply to life, basic research, clinic- seeing a new pt and need to know whats going on, do diagnostic tests, then plan a therapy for them, etc
5 Steps of a Literature Review Step 1:
Step 1: Identify Key terms or Descriptors Boolean search tools Scan the past 10 years; look for key terms Step 3: Critically Evaluate and Select Literature Peer reviewed journal articles Prioritize your source search Avoid "opinion" pieces Qualitative and quantitative research Decide how each article "fits" your argument
5 Steps of a Literature Review Step 2:
Step 2: Locate Literature Use our academic library! Do not limit search to an electronic articles Use ONLY primary and secondary sources
Results
Straightforward presentation of the relevant data Includes statistical analysis Tables, graphs
Nonexperimental research
Study existing characteristics or differences Pre-experimental research
Willowbrook State School Study
Study on hepatitis 40s-50s common outbreaks among pts Children w down syndrome and mental disabilities were put in mental institutions 1955-70s the study to track hep A, look at effectiveness of different injections Children in study were residents of school w mental retardation and were injected w hep A to see what would happen Need to get consent for a study - even though they did get consent from family, they manipulated them they said if they participated in the study they could get into the institution Didn't receive complete information for the study were told they were going to get a vaccine Is the risk bigger than the benefit Conducted in unsanitary environment Did go before committee review wasn't under the table Class action law suit was filled by the parents in 1972 1975 decree. Was signed to make changes 1982 declared theyd close the study and school 1987 last children left the grounds
Human Subjects Federal Policy for the Protection of Human Subjects: 45 CFR Part 16
Subpart A: the "Common Rule"- basic protects on the Belmont rule Subpart B: additional protections for pregnant women, human fetuses, and neonates Subpart C: additional protections for prisoners Subpart D: additional protections for children Belmont Report Participation needs to be voluntary Keep them from physical and psychological harm Risk and benefits Confidentiality. Privacy in research They can quit at any time if they want
Collates all empirical evidence that fits pre-specified eligibility criteria in order to answer a specific research question
Systematic Review
T/F (Independent variable) causes a change in (Dependent Variable) and it isn't possible that (Dependent Variable) could cause a change in (Independent Variable).
T
T/F (Time Spent Studying) causes a change in (Test Scores) and it isn't possible that (Test Score) could cause a change in (Time Spent Studying).
T
Thalidomide use
Thalidomide used in the 1950s to combat symptoms associated with pregnancy Not usually disclosed that the drug was investigational It was discovered the drug had teratogenic effects, causing severe deformities in the fetus Thalidomide was soon banned worldwide Drug for morning sickness Didn't inform participants that it was an investigational drug Drug caused fetus malformations
Informed Consent process
The development of a research document that provides Information, is Comprehendable to participants, and ensures Voluntariness.
reliability
The extent to which a measure yields consistent or repeatable results
are randomization, manipulation, and control
The three principles of quantitative research design
independent variable
The variable that is being manipulated in a study
primary source
This type of source/article provides firsthand original evidence about an event, object, person, or work of art.
Quantitative Research
Three Principles Randomization Manipulation Control Goals Data reduction Inference Discovery of relationships Exploration of processes
Informed Consent
To make an informed decision, participants need to know: Purpose of the research What will happen during the study What the potential benefit(s) might be What the potential detrimental effects might be They can discontinue participation at any time
Tudor Study
Tudor, Mary. "An experimental study of the effect of evaluative labeling of speech fluency." MA (Master of Arts) thesis, State University of Iowa, 1939. also called the monster study Study completed by a Masters of SLP student Small newspaper in 2001 published this study but it occurred in 1939 Took kids who stuttered even if they didn't and told them they did and put them in groups 2 groups Normal speakers and stuttering groups - stuttering group half actually stuttered Psychological affect of their study and speech problems they had for the rest of their lives, and they were told of the test 60 years later Praised kids did well Those who were told they weren't speaking well, began to get worse, one became mute, and became to stutter even worse and had psychological issues 6 kids who received the negative comments were awarded a million dollars Kids came from the orphanage close to the university When we see something adverse happening we need to stop the investigation they let this study continue when they knew there were issues
Historical Perspective
Tuskegee syphilis study Willowbrook State School study Tudor study at the University of Iowa Laws in place Respect for persons Benefices/ do no harm And justice
Radiation experiments (1940s - 1960s)
U.S. officials studied effects of radiation on hospital patients, pregnant women, mentally disabled children, and military personnel Few gave informed consent Manhattan Project officials authorized these wartime experiments to establish health and safety standards
Nonempirical research
Use existing information or data Nonempirical- data that's already been collected
Meta-Analysis
Uses statistical methods to summarize the results of systematic reviews
Evidence-Based Practice
Using research and scientific evidence to guide medical & educational decisions
Institutional Review Board
Usually referred to as "the IRB" Provide institutional oversight of research Evaluate proposed studies before data collection begins considering the principles of respect for persons, beneficence, and justice Consider risks/benefits of proposed research IRB- Only for research w human studies
Independent variable
What the research wants to study Manipulated by the experimenter For studying cause and effect relationships Designated by the experimenter For studying predictive relationships or group differences Independent variable- the one we are going to study and manipulate, what. I will be doing in my study Ex: relationship btw # of hours studying and performance of test. I could manipulate how many hours of studying you will have
What is a Literature Review?
Written summary of journal articles, books and other documents that describes the past and current state of information, organizes the literature into topics and documents a need for a proposed study. Creswell (2008)
The type of research question given below: Are the CV ratios for 24-month-old children with expressive language delay who participated in an 8-week intervention program significantly greater than those of 24-month-old children with expressive language delay who received no intervention?
Yes/No Research Question
1. Respect of persons
can make their own choices of their own free will, informed consent and voluntary cannot manipulation anyone into the study If a child refuses even thought the parents consented they are allowed to back out
Research that involves the collection of new information through observation and measurement of behavior and/or physical properties
empirical research
Three ways to establish validity
face, content, criterion, concurrent, predictive or construct validity
primary source
•Report of scientific discoveries •Results of experiments •Results of clinical trials •Social and political science research results •Factual, not interpretive ex: Published results of research studies •Published results of scientific experiments •Published results of clinical trials •Proceedings of conferences and meetings