Mgt 363 Ch 6
True
A reliable test includes items for which the meaning or interpretation does not change over time.
focused on an operational issue.
ROI analysis is best suited for training programs that are:
pencil-and-paper tests
Typically, _____ are used to assess cognitive outcomes.
True
No evaluation design can ensure that the results of the evaluation are completely due to training.
True
Once the costs and benefits of the training program are determined, ROI is calculated by dividing return or benefits by costs.
False
Outcome measures are perfectly related to each other.
True
Reaction and cognitive outcomes do not help determine how much trainees actually use training content in their jobs.
False
Results belong to the level 1 criteria in Kirkpatrick's framework for categorizing training outcomes.
False
The Hawthorne effect refers to employees in an evaluation study performing at a low level because of the attention they receive.
It combines both pretest/post-test comparison group and post-test-only control group design.
The Solomon four-group design combines the pretest/post-test comparison group and the post-test-only control group design.
True
The Solomon four-group design combines the pretest/post-test comparison group and the post-test-only control group design.
result
The _____ training outcome is collected to determine whether trainees are using training content back on the job.
False
The believability of study results refers to external validity.
time series
A firm that aims at improving readily observable outcomes such as productivity by collecting related data at periodic intervals both before and after training is typically applying the _____ evaluation design.
False
A pencil-and-paper test is ideal for measuring skill-based outcomes.
trainees' performance on the outcome should actually reflect true differences in performance.
Appropriate training outcomes need to be discriminative which implies that:
observations
Behavior or skill-based outcomes are best measured by _____.
a company is only interested in whether trainees have achieved a certain proficiency level.
Evaluation designs without pretest or comparison groups are most appropriate when:
their opinions and feelings about the program
Formative evaluation involves collecting qualitative data about a training program from trainees mainly through:
their opinions and feelings about the program.
Formative evaluation involves collecting qualitative data about a training program from trainees mainly through:
results
If a firm measures its sales volume before and after a training program, it is typically assessing the _____ outcome.
criterion contamination
If a manager believes that a training program is valuable and hence provides higher ratings of job performance to those trainees who attended the training program, then the training outcomes will lack relevance due to _____.
conducting a needs analysis.
If instructional objectives identify business-related outcomes such as increased customer service, then reaction outcomes should be used in the evaluation.
False
In Kirkpatrick's five-level framework for categorizing training outcomes, the levels indicate the importance of the outcomes.
True
It is necessary to limit return on investment analysis only to certain training programs as it can be costly.
Needs Assessment
The evaluation process ideally begins with:
True
The influence of training is largest for organizational performance outcomes and weakest for financial outcomes.
Training group differs from comparison group on individual differences that influence outcomes.
Which of the following is a threat to internal validity?
Customer service orientation.
Which of the following is an affective outcome collected in a training evaluation?
Dollar value of productivity divided by training costs reflects return on investment.
Which of the following is true of return on investment (ROI)?
Formative evaluation focuses on how to make a training program better, whereas summative evaluation helps to determine the extent to which trainees have changed after training.
Which of the following statements best differentiates formative evaluation from summative evaluation?
It combines both pretest/post-test comparison group and post-test-only control group design.
Which of the following statements is true of Solomon four-group evaluation design?
True
Which of the following statements is true of Solomon four-group evaluation design?
Comparison group consists of a group of employees who do not attend the training program
Which of the following statements is true of comparison groups?
Reversal
_____ is a time period in which participants no longer receive training intervention.
Success case
_____ refers to concrete examples of the impact of training that show how learning has led to results that a company finds worthwhile and managers find credible.
Practicality
_____ refers to the ease with which training outcome measures can be collected.