T&D Exam 2 3-6
Which of the following is true of return on investment (ROI)?
Dollar value of productivity divided by training costs reflects return on investment
3 factors in the learning process that must be analyzed before you can logically make any conclusions about the training design
Task, Organization, Person
ROI analysis is best suited for training programs that are:
focused on an operational issue
Formative evaluation involves collecting qualitative data about a training program from trainees mainly through:
their opinions and feelings about the program
T/F A pencil-and-paper test is ideal for measuring skill-based outcomes.
False
Which of the following statements best differentiates formative evaluation from summative evaluation?
Formative evaluation focuses on how to make a training program better, where as summative evaluation helps determine the extent to which trainees have changed after training
_____ is a time period in which participants no longer receive training intervention.
Reversal
T/F The influence of training is largest for organizational performance outcomes and weakest for financial outcomes.
True
Behavior or skill-based outcomes are best measured by _____.
observations
Typically, _____ are used to assess cognitive outcomes.
pencil-and-paper tests
Type of SME interview that involves a face to face meeting with groups of SMEs in which the questions that are asked relate to specific training needs
Focus Groups
Determines the appropriateness of training, given the company's business strategy and resources
Organizational Analysis
Determines whether performance deficiencies result from a lack of knowledge, skill, or ability
Person Analysis
_____ refers to the ease with which training outcome measures can be collected.
Practicality
Which of the following types of training outcomes are collected when trainees are asked to rate their level of satisfaction with the trainer at the end of a training program?
Reaction
Training Evaluation
Refers to the process of collecting the outcomes needed to determine whether training is effective
The _____ training outcome is collected to determine whether trainees are using training content back on the job.
Result
_____ refers to concrete examples of the impact of training that show how learning has led to results that a company finds worthwhile and managers find credible.
Success case
T/F Formative evaluation usually involves collecting quantitative data through tests or objective measures of performance.
False
T/F In Kirkpatrick's five-level framework for categorizing training outcomes, the levels indicate the importance of the outcomes.
False
T/F Results belong to the level 1 criteria in Kirkpatrick's framework for categorizing training outcomes.
False
Process used to determine whether training is necessary
Needs Assessment
Identifies the important tasks and knowledge, skills, and behaviors that need to be emphasized in training for employees to complete their tasks
Task Analysis
t/F Pilot testing refers to the process of previewing the training program with potential trainees and managers or with other customers.
True
The evaluation process ideally begins with
conducting a needs analysis
Traditionalists
1925-1945: patriotic and loyal, great deal of knowledge of history and work life
Baby Boomers
1946-1964: competitive, hardworking, and concerned that all employees be fairly treated
Gen Xers
1965-1980: need feedback and flexibility and dislike close supervision
Using information about other companies' training practices to help determine the appropriate type, level, and frequency of training
Benchmarking
Generation Y
Born after 1980: optimistic, willing to work and learn, and technology-literate
Which of the following statements is true of comparison groups?
Comparison group consists of a group of employees who do not attend the training program
If a manager believes that a training program is valuable and hence provides higher ratings of job performance to those trainees who attended the training program, then the training outcomes will lack relevance due to _____.
Criterion contamination
Asking a large group of employees to help provide information for needs assessment that they are not traditionally asked to do
Crowdsourcing
Which of the following is an affective outcome collected in a training evaluation?
Customer service orientation
1. May be incorrectly used as solution to performance problem 2. Programs may have the wrong content, objectives, or methods 3. Trainees may not have basic skills or confidence to learn
Disadvantages of training
If trainers are interested in the generalizability of a study's results to other groups and situations, then they are said to be interested in the _____ of the study.
External Validity
Situational constraints
Includes lack of proper tools and equipment, materials and supplies, budget, and time
Which of the following statements is true of random assignment
It assigns employees to a training program without considering their individual differences
Which of the following statements is true of Solomon four-group evaluation design?
It combines both pretest/post-test comparison group and post-test-only control design
Employees who are currently performing the job
Job Incumbents
A firm that aims at improving readily observable outcomes such as productivity by collecting related data at periodic intervals both before and after training is typically applying the _____ evaluation design
Time series
Appropriate training outcomes need to be discriminative which implies that:
Trainees' performance on the outcome should actually reflect true differences in performance
Which of the following is a threat to internal validity?
Training group differs from comparison group on individual differences that influence outcomes
Evaluation designs without pretest or comparison groups are most appropriate when:
a company is only interested in whether trainees have achieved a certain proficiency level
According to Kirkpatrick's framework for categorizing training outcomes, _____ outcomes are level 1 criteria that are often called class or instructor evaluations.
Reaction
If a firm measures its sales volume before and after a training program, it is typically assessing the _____ outcome
Results
Experts who are knowledgeable with regard to training issues, knowledge & skills required for task performance, and necessary equipment and conditions under which task has to be performed
Subject-Matter Experts (SME)
T/F A reliable test includes items for which the meaning or interpretation does not change over time.
True