Quiz 7 - Program Evaluation

An evaluation that uses a quasi-experimental group design differs from an experimental- group design in what way? A) A quasi experimental design does not use random sampling and an experimental design does B) A quasi experimental design does not have identified variables and an experimental design does. C) A quasi experimental design uses random sampling and an experimental design does not D) A quasi experimental design does not use a control group and an experimental design does

A) A quasi experimental design does not use random sampling and an experimental design does

You are using a single subject research design to test a new behavioral technique with your 8 year-old client. You give the parents a behavioral checklist to complete prior to beginning the treatment, and then ask them to complete the behavioral checklist after 6 weeks of treatment. You then compare your client's behavior before and after the treatment. This is an example of what kind of SSRD? A) A-B B) A-B-A C) A-B-A-B D) A-B-C

A) A-B

When treatment fidelity is not maintained, what is/are the risk(s) for the evaluator? A) All of the answers are correct B) None of the answers are correct C) The data will contain errors D) The treatment likely cannot be replicated in other settings E) Concluding that a program was not effective when truly it was

A) All of the answers are correct

You are working on a research project about adolescent runaways who are homeless and use snowball sampling. Which of the following is an example of snowball sampling? A) Asking an adolescent runaway at a local shelter where you could find other adolescent runway youth to confidentially interview B) All answers are correct C) Asking adolescent runaways who currently use services at a substance abuse treatment center to be part of your study D) Interviewing adolescent runaways sheltered at a local crisis center

A) Asking an adolescent runaway at a local shelter where you could find other adolescent runway youth to confidentially interview

Evaluative research is designed to __________? A) Determine whether the needs of clients are being met B) Uncover the causes of problems C) Determine the objectivity of things D) Describe a concept

A) Determine whether the needs of clients are being met

Qualitative methods are most often used with which type of program assessment? A) Formative B) Summative C) Experimental D) Survey

A) Formative

_________ is a term used to describe a research design's capacity to determine whether an independent variable caused a change in a dependent variable. A) Internal validity B) Construct validity C) Attribution bias D) Confirmation bias

A) Internal validity

The following is a tool used for diagramming theoretically how a program will work to meet its outcomes: A) Logic model B) Evaluation matrix C) Triangulation plan D) Process evaluation

A) Logic model

Which one of the following is carried out at the conceptualization stage of programs or before programs are implemented? A) Needs assessment B) Monitoring C) Formative evaluation D) Client satisfaction surveys

A) Needs assessment

When completing a logic model for a family counseling program, Samira counts the numbers of therapy sessions that were conducted during a 30 day period. This is an example of which of the following? A) Outputs B) Outcomes C) Activities D) Resources

A) Outputs

An organized collection of activities designed to reach certain objectives is referred to a ___________? A) Program B) Organizational Strategy C) Collaborative D) Process

A) Program

What are the three primary purposes of process or formative evaluation? A) Program description, Program monitoring, Quality assurance B) Program accountability, Program monitoring, Quality assurance C) Program description, Program monitoring, Program output D) Program outputs, Program activities, and Program monitoring

A) Program description, Program monitoring, Quality assurance

You are designing an evaluation for a county foster care youth program. You sample youth at three county foster youth facilities within your county. What kind of evaluation is this? A) Purposeful sample B) Snowball sample C) Probability sample D) Quota sample

A) Purposeful sample

You ensure the questionnaire you select consistently measures the constructs you are studying. You are attempting to demonstrate that your questionnaire is: A) Reliable B) Valid C) Psychometrically sound D) Empirical

A) Reliable

Identify the dependent variable in the follow hypothesis: At risk students who participate in the Communities and Schools program will have a lower drop-out rate than students who do not participate in the program. A) School drop out rate B) Communities and Schools program C) At risk students D) None of the above

A) School drop out rate

Treatment fidelity is important to maintain so that program evaluation results can confidently be attributed to _______, and not to other factors or activities. A) The intervention itself B) Researcher competence C) Therapist competence D) Evidence-based practice

A) The intervention itself

A cost-benefit analysis can help an administrator determine if the money spent on a program is related to its outcomes. A) True B) False

A) True

Measuring the efficiency of a program encompasses all of the following except ______? A) Determining if the program outcomes are worth the dollars invested B) Determining if the program is based on empirical research C) Conducting a benefit-cost analysis D) Determining if the program is cost-effective

B) Determining if the program is based on empirical research

Group research designs cannot be used in program evaluation to determine if outcomes have been met. A) True B) False

B) False

Historically speaking, evaluation research has been primarily qualitative in nature. A) True B) False

B) False

In needs assessment an evaluator usually employs a longitudinal design. A) True B) False

B) False

One of the requirements of single system research design is that the results are: A) Presented in narrative format. B) Disseminated to practitioners in similar programs. C) Displayed in graph form to see the measures over time D) Distributed to program stakeholders

C) Displayed in graph form to see the measures over time

Needs assessment employs: A) Explanatory research B) Descriptive research C) Exploratory research D) None of the above

C) Exploratory research

Program evaluation and basic research have some similarities. Which of the following is a difference between the two approaches? A) The use of a research design B) The collection of data C) How the data will be used D) How the data will be analyzed

C) How the data will be used

People who have knowledge of the programs being assessed, through work or educational experience with a program or agency, or within a certain population with which you should consult before conducting your needs assessment are known as _______? A) Change Agents B) Stakeholders C) Key Informants D) Facilitators

C) Key Informants

Aaron wishes to collect data to understand better if his program is being implemented the way it was planned. What kind of evaluation is Aaron likely going to complete? A) Outcome B) Output C) Process D) Goal driven

C) Process

A graph that measures an individual client's changes over time is an example of which of the following? A) Behavioral output B) Client activity C) Single subject design D) Client improvement graph

C) Single subject design

Low response rates on positive client satisfaction surveys are a problem because: A) Staff may assume their interventions are working B) The agency may incorrectly generalize results C) Staff might assume the results are inconclusive D) All responses are correct

D) All responses are correct