T&D Exam 2 3-6

Which of the following is true of return on investment (ROI)?

Dollar value of productivity divided by training costs reflects return on investment

3 factors in the learning process that must be analyzed before you can logically make any conclusions about the training design

Task, Organization, Person

ROI analysis is best suited for training programs that are:

focused on an operational issue

Formative evaluation involves collecting qualitative data about a training program from trainees mainly through:

their opinions and feelings about the program

T/F A pencil-and-paper test is ideal for measuring skill-based outcomes.

False

Which of the following statements best differentiates formative evaluation from summative evaluation?

Formative evaluation focuses on how to make a training program better, where as summative evaluation helps determine the extent to which trainees have changed after training

_____ is a time period in which participants no longer receive training intervention.

Reversal

T/F The influence of training is largest for organizational performance outcomes and weakest for financial outcomes.

True

Behavior or skill-based outcomes are best measured by _____.

observations

Typically, _____ are used to assess cognitive outcomes.

pencil-and-paper tests

Type of SME interview that involves a face to face meeting with groups of SMEs in which the questions that are asked relate to specific training needs

Focus Groups

Determines the appropriateness of training, given the company's business strategy and resources

Organizational Analysis

Determines whether performance deficiencies result from a lack of knowledge, skill, or ability

Person Analysis

_____ refers to the ease with which training outcome measures can be collected.

Practicality

Which of the following types of training outcomes are collected when trainees are asked to rate their level of satisfaction with the trainer at the end of a training program?

Reaction

Training Evaluation

Refers to the process of collecting the outcomes needed to determine whether training is effective

The _____ training outcome is collected to determine whether trainees are using training content back on the job.

Result

_____ refers to concrete examples of the impact of training that show how learning has led to results that a company finds worthwhile and managers find credible.

Success case

T/F Formative evaluation usually involves collecting quantitative data through tests or objective measures of performance.

False

T/F In Kirkpatrick's five-level framework for categorizing training outcomes, the levels indicate the importance of the outcomes.

False

T/F Results belong to the level 1 criteria in Kirkpatrick's framework for categorizing training outcomes.

False

Process used to determine whether training is necessary

Needs Assessment

Identifies the important tasks and knowledge, skills, and behaviors that need to be emphasized in training for employees to complete their tasks

Task Analysis

t/F Pilot testing refers to the process of previewing the training program with potential trainees and managers or with other customers.

True

The evaluation process ideally begins with

conducting a needs analysis

Traditionalists

1925-1945: patriotic and loyal, great deal of knowledge of history and work life

Baby Boomers

1946-1964: competitive, hardworking, and concerned that all employees be fairly treated

Gen Xers

1965-1980: need feedback and flexibility and dislike close supervision

Using information about other companies' training practices to help determine the appropriate type, level, and frequency of training

Benchmarking

Generation Y

Born after 1980: optimistic, willing to work and learn, and technology-literate

Which of the following statements is true of comparison groups?

Comparison group consists of a group of employees who do not attend the training program

If a manager believes that a training program is valuable and hence provides higher ratings of job performance to those trainees who attended the training program, then the training outcomes will lack relevance due to _____.

Criterion contamination

Asking a large group of employees to help provide information for needs assessment that they are not traditionally asked to do

Crowdsourcing

Which of the following is an affective outcome collected in a training evaluation?

Customer service orientation

1. May be incorrectly used as solution to performance problem 2. Programs may have the wrong content, objectives, or methods 3. Trainees may not have basic skills or confidence to learn

Disadvantages of training

If trainers are interested in the generalizability of a study's results to other groups and situations, then they are said to be interested in the _____ of the study.

External Validity

Situational constraints

Includes lack of proper tools and equipment, materials and supplies, budget, and time

Which of the following statements is true of random assignment

It assigns employees to a training program without considering their individual differences

Which of the following statements is true of Solomon four-group evaluation design?

It combines both pretest/post-test comparison group and post-test-only control design

Employees who are currently performing the job

Job Incumbents

A firm that aims at improving readily observable outcomes such as productivity by collecting related data at periodic intervals both before and after training is typically applying the _____ evaluation design

Time series

Appropriate training outcomes need to be discriminative which implies that:

Trainees' performance on the outcome should actually reflect true differences in performance

Which of the following is a threat to internal validity?

Training group differs from comparison group on individual differences that influence outcomes

Evaluation designs without pretest or comparison groups are most appropriate when:

a company is only interested in whether trainees have achieved a certain proficiency level

According to Kirkpatrick's framework for categorizing training outcomes, _____ outcomes are level 1 criteria that are often called class or instructor evaluations.

Reaction

If a firm measures its sales volume before and after a training program, it is typically assessing the _____ outcome

Results

Experts who are knowledgeable with regard to training issues, knowledge & skills required for task performance, and necessary equipment and conditions under which task has to be performed

Subject-Matter Experts (SME)

T/F A reliable test includes items for which the meaning or interpretation does not change over time.

True