Chapter 13

The first step in the evaluation process is implementation.

False

One barrier to effective program evaluation can be the time allotted for evaluation.

True

Propriety standards ensure that an evaluation is ethical.

True

Institutional Review Board approval is not necessary for program evaluation research.

False

Monitoring participants' reactions about program location, time, and speakers is called A) formative evaluation. B) summative evaluation. C) outcome evaluation. D) impact evaluation.

A

The two evaluation categories in which health education specialists engage can be classified as A) formative and summative. B) independent and dependent. C) outside and inside. D) organized and unorganized.

A

Which of the following is NOT considered a critical purpose for program evaluation? A) Adjusting costs B) Assessing quality C) Determining effectiveness D) Improving quality

A

Which of the following is a benefit to having an internal evaluator? A) More objective; fresh outlook B) More familiar with organization & program C) Brings global knowledge D) Typical brings more breath & depth of technical expertise

B

Determining whether or not a program led to changes in health status is an example of A) impact evaluation. B) process evaluation. C) outcome evaluation. D) formative evaluation.

C

One strength of having an external evaluator is A) links with the funding source. B) familiarity with the program. C) objectivity. D) less expense.

C

Utility, feasibility, propriety, and accuracy are A) steps used to engage stakeholders. B) principles of gathering credible evidence. C) standards of evaluation within the framework for program evaluation. D) important only when conclusions cannot be easily justified.

C

Which of the following people is NOT a stakeholder? A) Program planner B) Administrator C) Evaluator D) Representative from the funding source

C

Which of the following types of evaluation assesses behavior change? A) Outcome evaluation B) Formative evaluation C) Impact evaluation D) Process Evaluation

C

The number of people who stopped smoking following a smoking cessation program is a measure of A) formative evaluation. B) outcome evaluation. C) process evaluation. D) impact evaluation.

D

Which of the following evaluations employs pretesting? A) Impact evaluation B) Process evaluation C) Outcome evaluation D) Formative evaluation

D

List three characteristics of a good evaluator.

Experience in the type of evaluation needed Comfortable with quantitative data sources and analysis Able to work with a wide variety of stakeholders, including representatives of target populations Can develop innovative approaches to evaluation while considering the realities affecting a program (e.g., a small budget) Incorporates evaluation into all program activities Understands both the potential benefits and risks of evaluation Educates program personnel in designing and conducting the evaluation Will give the staff full findings (i.e., will not gloss over or fail to report certain findings)

An evaluation consultant should respect senior staff members' wishes for specific findings, and emphasize those findings in the report.

False

Developing the evaluation design is a step within the data collection process.

False

Describe the three advantages for using an internal evaluator and three advantages for using an external evaluator.

Internal — Advantages: More familiar with organization & program; Knows decision making style of organization; Present to remind people of results; Able to communicate results more frequently & clearly External — Advantages: More objective; fresh outlook; Can ensure unbiased evaluation outcome; Brings global knowledge; Typical brings more breath & depth of technical expertise

List and define three types of evaluation.

Process — provides documentation during the program implementation to make adjustments for improvement if necessary Impact — assesses the overall success of a program in producing favorable knowledge, skills, attitudes, etc. in the target population Outcome — determines whether or not the program met the stated long-term goals and objectives

List four events that could hinder a successful evaluation.

The planner failed to build evaluation into program planning Changes in adults come slowly Some changes do not last Adequate procedures cost time and resources

List and describe three reasons for evaluating a program.

To demonstrate worth — an evaluation can help to determine if the program is moving in the right direction and whether or not it has had an impact on the target population and its health concerns To compare different types of programs — different programs can be compared to determine which are the most effective in reaching program goals and objectives To meet requirements of the funding source — many times the funding source requires evaluation to determine whether or not goals have been met.

A reason a stakeholder may want a program evaluated is to inform policy decisions.

True

Data reflecting the initial status or interests of the participants are referred to as baseline data.

True

Evaluation planning should occur early, while program goals and objectives are being developed.

True