SW-520 Quiz 1

Client satisfaction surveys: -should focus exclusively on the client-practitioner relationship. -will usually find that most clients are dissatisfied -will usually find that most clients are satisfied. -They are mainly associated with quantitative evaluation methods.

will usually find that most clients are satisfied.

A disadvantage of the rates under treatment approach to needs assessment is that it might underestimate normative need. (T/F)

True

An outcome evaluation might have value and be worth doing even if it has some imperfections. (t/f)

True

Concealing the nature of the study from those being observed violates the norm of voluntary participation. (t/f)

True

Focus group interviewers need to use neutral probes when seeking further clarification. (T/F)

True

Group dynamics can influence what participants say about what they need. (T/F)

True

Interview guides allow interviewers to adapt the sequencing and wording of questions to each particular interview. (T/F)

True

It is acceptable for evaluations to mix qualitative and quantitative methods. (T/F)

True

Logic models identify the components and processes that are expected to lead to program outcomes. (T/f)

True

The possible purposes of program evaluation include: -to assess the ultimate success of programs -to assess problems in how programs are being implemented -to obtain information needed in program planning and development -all of the answers

All of the answers

Which of the following statements is true regarding the three criteria for causal inference? -All three are required for the inference of causality to be plausible. -At least two are required for the inference of causality to be plausible. -Any one of them, alone provides some limited evidence supporting the plausibility of causality. -Studies have shown the criteria to be irrelevant regarding causality.

Any one of them, alone provides some limited evidence supporting the plausibility of causality.

Which of the following statements is true about focus group interview questions? -Begin by asking what are the most important needs. -At the end interviewers should summarize the main points and check to see if participants agree with the accuracy of their summary. -Yes/no follow-up probes are best. -The sequencing of the different types of questions does NOT matter.

At the end interviewers should summarize the main points and check to see if participants agree with the accuracy of their summary.

Institutional Review Boards [IRBs]: A) may continue to oversee studies after they are implemented. B) all of the choices. C) emerged in response to unethical research experiments. D) aim to protect the rights and interests of research participants.

B) All of the choices

Which of the following statements is true about non-probability samples? -They should never be used in program evaluation. -They should always be used in program evaluation. -They are the least risky type of sample. -Despite their risks, they can have value.

Despite their risks, they can have value.

Randomized experimental designs are strong designs for determining whether a program is effective. (t/f)

True

Stakeholders can include any individual, group, or organization that might need, use, affect, or be affected by the evaluation's processes or findings. (T/F)

True

The plausibility of program effectiveness can be supported in some outcome evaluations that lack random assignment to treatment and control groups. (t/f)

True

The switching replication design improves the control for a selectivity bias in non-equivalent comparison group designs. (t/f)

True

The validity of randomized experimental designs can be hindered if there is measurement bias. (t/f)

True

The views of people who respond to a survey might be quite unlike the views of the non- respondents. (T/F)

True

Time series designs can have value in determining whether a program is effective. (t/f)

True

Triangulation is a way to handle uncertainty about what outcome objectives to measure. (t/f)

True

Two different ways to define needs are: 1) in terms of humanitarian values regardless of whether clients feel those needs; and 2) in terms of what needs that clients actually say they need. (T/F)

True

John has continued smoking continuously since completing a smoking cessation treatment program 6 months ago. However, he answered "no" every time he was asked whether he has smoked since completing the program. John's answers are: -both reliable and valid. -reliable but not valid. -valid but not reliable. -Neither reliable nor valid.

reliable but not valid.

Writing good outcome objectives involves: -stating the objectives in specific, measurable terms -avoiding specificity so as not to be too narrow. -stating objectives in very ambitious terms. -not specifying when the objectives will be achieved

stating the objectives in specific, measurable terms

Suppose a new intervention program is offered to students with high levels of truancy. If those students placed in the program by their families have significantly less truancy after participating than the students who did not participate in the program, then we can conclude that: -the program effectively reduces truancy. -a selection bias might explain away the difference. -some clients benefited, so the program has value.

a selection bias might explain away the difference

Clients who express the need for a particular service will almost always utilize that service if it is offered. (T/F)

False

Correlation is a sufficient basis for inferring causality. (t/f)

False

Formative evaluations are conducted to evaluate the effectiveness of programs that have been up and running for a long time. (T/F)

False

If your survey mails out questionnaires to 1000 randomly selected individuals, and 200 of them are completed and returned, then you have an unbiased and representative sample. (T/F)

False

In measurement, the terms reliability and validity are synomymous. (t/f)

False

Nonprobability sampling is more scientific and less risky than probability sampling. (T/F)

False

Random assignment to treatment and control groups eliminates the possibility of biases in measurement of outcome. (t/f)

False

The most common and best way to conduct an outcome evaluation is by conducting a process evaluation. (T/F)

False

The most reliable and comprehensive approach to needs assessment relies primarily on public hearings and community forums. (T/F)

False

The one-group posttest only design is the strongest design for determining whether a program is effective. (t/f)

False

There is usually only one way that an outcome objective can be defined operationally. (t/f)

False

Time sequence is a sufficient basis for inferring causality. (t/f)

False

When measuring whether recipients of a substance abuse treatment program have stopped using crack cocaine, it is sufficient to simply ask them because their answers are more likely to be accurate than their urine toxicology results. (t/f)

False

Which of the following statements is true about the social indicators approach to needs assessment? -A disadvantage is that it is expensive. -Key informants always are members of the target population, and never are practitioners. -It is one of the most expensive, time-consuming approaches to needs assessment. -A disadvantage is that the information is not coming directly from the target population.

A disadvantage is that the information is not coming directly from the target population.

Which of the following statements is true regarding correlational evidence about program effects? -A very strong correlation might be sufficient to warrant policy or program recommendations. -The evidence will not be sufficient to warrant policy or program recommendations regardless of the strength of the correlation. -Even a very weak correlation will be sufficient to warrant policy or program recommendations -None of the choices

A very strong correlation might be sufficient to warrant policy or program recommendations.

Which of the following statements is/are true about between-group effect sizes? -They equal the difference between the treatment group's mean outcome score and the control group's mean outcome score divided by the pooled standard deviation of both groups. -They depict the strength of an intervention's impact. -They can be compared across evaluations that use different ways to measure outcome. -All of the choices

All of the choices

Which of the following statements is/are true regarding feasible outcome evaluation designs? -The one-group pretest-posttest design does not permit causal inferences, but it might be the only feasible design in service-oriented agencies. -If the degree of improvement is clinically meaningful in a one-group pretest-posttest design, then the notion that the program or intervention had a causal impact becomes more plausible. -The within-group effect size can be particularly useful in evaluations that assess how well an agency's treatment providers are implementing an intervention known to have strong research supporting its effectiveness. -All of the choices

All of the choices

Which of the following statements is true about within-group effect sizes? -They equal the difference between the treatment group's mean pretest score and its mean outcome score divided by the pooled standard deviation of all of the pretest and posttest scores. -They can show how well treatment providers are implementing an intervention that has strong research support. -They can be compared to within-group effect size benchmarks. -All of the choices.

All of the choices.

Which of the following statements is/are true about IRB procedures or requirements? A) All IRBs use the same amounts of required forms. B) All research must undergo a full review; there are no exemptions for expedited reviews. C) All IRBs are expected to require education on the protection of human research participants for each research assistant in studies involving human subjects. D) All of the statements are true.

C) All IRBs are expected to require education on the protection of human research participants for each research assistant in studies involving human subjects.

When names are removed from questionnaires and are replaced with identification numbers so that only the researcher can later link a response to a name, the researcher should tell the respondent that the information is A) anonymous and confidential. B) harmless. C) confidential. D) anonymous.

C) Confidential

What ethical guidelines is/are violated in the following study? A child therapist thinks the new, untested psychotherapy she recently developed is more effective than physician-prescribed medications for attention deficit hyperactivity disorder. To research the effectiveness of her therapy, she tells parents that the therapy replaces the need for the medications and then provides the therapy to half of her clients, without telling parents about the study or which treatment group their child is in. A) voluntary participation and informed consent. B) deceiving subjects. C) all of the choices D) no harm to the participant.

C) all of the choices

Which of the following statements CORRECTLY describes the social research profession? A) Social researchers can never be totally objective. B) Social researchers attempt to be value-free. C) all of the statements are correct. D) Social researchers are humanly subjective. E) Different scientists can and should arrive at the same results when they employ accepted research techniques and set personal values and views aside.

C) all of the statements are correct.

Which of the following is NOT an operational definition of the quality of a parent-child relationship? -Degree of conflict between parent and child -Number of hours/minutes parent and child participate in recreational activities together. -Whether identified by a therapist as having a good or poor relationship -A score on a self-report scale measuring relationship quality.

Degree of conflict between parent and child

Which of the following statements is/are true about philosophical issues in evaluation? -Contemporary positivism emphasizes objectivity and precision in measurement. -Interpretivism emphasizes the logic of causality. -Contemporary positivism emphasizes using evaluation to empower oppressed people. -all of the answers

Contemporary positivism emphasizes objectivity and precision in measurement

Which of the following statements is/are true about the Tuskegee syphilis study? A) Physicians were NOT involved in it. B) It was stopped shortly after it began. C) Despite the controversy surrounding it, ethicists agreed that its benefits justified its risks. D) A social worker was instrumental in getting it stopped.

D) A social worker was instrumental in getting it stopped.

Which of the following questions should be answered in an informed consent form? A) What are the possible discomforts and risks involved in the study? B) What are the possible benefits of the study? C) What will you be asked to do if you participate in this research study? D) All of the questions should be answered in an informed consent form.

D) All of the questions should be answered in an informed consent form.

If you complete an evaluation that has some important methodological limitations, you should: -Avoid mentioning those limitations in your report so as not to damage your evaluation's credibility -Not let those limitations influence the implications you develop. -Draw attention to those limitations in your report and explain why your conclusions are therefore tentative. -Not disseminate a report of your failed evaluation.

Draw attention to those limitations in your report and explain why your conclusions are therefore tentative.

Which of the following does NOT harm subjects? A) asking them to identify their deviant behavior. B) allowing them to easily identify themselves in the final report. C) asking them to reveal their unpopular attitudes. D) having them face aspects of themselves that they do not normally consider. E) All of the above may harm respondents.

E) All of the above may harm respondents.

The PRIMARY ethical research issue raised by the Milgram study was Your quiz has been submitted successfully. A) the administering of electrical shocks. B) the effects of the methods on the learner. C) the willingness of people to harm others when "following orders" required it. D) the examination of obedience as a topic for study. E) the effects of the methods on the experimental subjects.

E) the effects of the methods on the experimental subjects.

Which of the following statements is NOT true about critical thinking? -Examine whether assertions of fact are based on unstated assumptions. -Be willing to alter your own cherished beliefs and practices if compelling new evidence implies altering them. -Be open-minded and willing to consider new ideas and new evidence that might contradict long-standing traditions. -Be guided by what esteemed authorities or prestigious professional publications say.

Examine whether assertions of fact are based on unstated assumptions.

Which philosophical paradigm is most reflected in an evaluation seeking a deep subjective understanding of how people experience their needs? -Interpretivism -Empowerment -Contemporary positivism -Quantitative methods

Interpretivism

Which of the following statements is true about probability sampling? -It is the best way to try to maximize the representativeness of a sample. -It should never be used in program evaluation. -It is almost always feasible in program evaluation surveys.

It is the best way to try to maximize the representativeness of a sample.

Which of the following statements is true about accreditation as a form of evaluation? -It is the most empirical form of evaluation. -Agency administrators tend NOT to value it. -It relies more on the expertise of site visitors than on empirical assessment. -Its standards do NOT change over time.

It relies more on the expertise of site visitors than on empirical assessment.

Which of the following statements is true about the community forum approach to needs assessment? -It utilizes rigorous survey designs. -Its chief advantages are pragmatic. -Those who attend and speak at the forums have a high probability of being representative of the target population. -It minimizes measurement bias.

Its chief advantages are pragmatic

Which of the following is statements is true about evidence-informed practice? -Practiced decisions should be based almost entirely on research evidence. -Practice decisions should disregard the practitioner's expertise. -Practiced decisions should take into account client characteristics, needs, values, and treatment preferences -Practice decisions should disregard the organizational context

Practiced decisions should take into account client characteristics, needs, values, and treatment preferences

Which of the following statements is/are true about types of evaluation? -Summative evaluations should be carried out very soon after a program begins. -Formative evaluations assess a program's outcome -Process evaluations assess how a program is being implemented -Process evaluations should precede formative evaluations.

Process evaluations asses how a program is being implemented

Which of the following is/are an operational definition of caregiver burden? -Score on a caregiver burden self-report scale. -Degree of depression or anxiety experienced by the caregiver.

Score on a caregiver burden self-report scale.

Which of the following statements is true about a client satisfaction survey with a 50 percent response rate? -The findings will be representative of the client population. -Although the level of satisfaction of respondents might differ from that of the non- respondents, the difference is likely to be trivial. -The level of satisfaction of the respondents might be markedly different than that of the non-respondents. -If the sample of clients to be surveyed was selected randomly, the response rate does not matter.

The level of satisfaction of the respondents might be markedly different than that of the non-respondents.

One year after a dropout prevention program is implemented in a high school the school's dropout rate drops by 50 percent. Therefore: -The program was effective. -The results support the plausibility of the notion that the program is effective. -With no control group, nothing of value is implied by these results.

The results support the plausibility of the notion that the program is effective.

Which of the following statements is NOT true about mission statements? -They are usually worded in vague and perhaps grandiose terms. -They briefly state why an organization exists. -They usually identify specific outcome objectives to measure. -They can identify an organization's intended consumers and geographical target region.

They usually identify specific outcome objectives to measure.

Which of the following statements best depicts the a purpose(s) of a needs assessment? -To learn about a target population's most important needs, only. -To learn about a target population's most important needs and its characteristics, only. -To learn what kinds of needs are most pervasive in what parts of the community, and in what parts are the unmet needs most problematic. -None of the responses

To learn what kinds of needs are most pervasive in what parts of the community, and in what parts are the unmet needs most problematic.

A good time to send follow-up reminders to potential respondents to a survey is: -about 2 to 3 weeks after the first invitation is sent. -about 2 to 3 months after the first invitation is sent. -about 2 to 3 days after the first invitation is sent. -about 3 to 4 months after the first invitation is sent.

about 2 to 3 weeks after the first invitation is sent.

Suppose a case management program is established to reduce rehospitalization rates in a hospital and that those rates drop dramatically once the new program is established. We can conclude that: -research has demonstrated an effective approach to practice. -causality cannot be inferred because time order was not established. -another event occurring during the time of the study might explain away the change.

another event occurring during the time of the study might explain away the change.

As compared to self-administered questionnaires, interview surveys: -are more anonymous. -are harder to make anonymous. -are less time consuming -are less vulnerable to a social desirability bias.

are harder to make anonymous.