Unit 3 Topic 1.5 Test and Test-Item Analysis

A class comprises 20 learners. A question was successfully answered by three of the test takers. Use the following formula: P = Nc ÷ N and a calculator to perform your computations. What is the difficulty index?

.25

All of the following are types of analysis EXCEPT:

Complexity Index

(TRUE/FALSE) The acceptable range of a difficulty for technical training is .50-.90

True

A Course Supervisor gathers 90 answer sheets from previous convenes. A question was successfully answered by 75 of the test takers. Use a calculator to perform computations. What is the difficulty index?

.83

When a course official conducts analysis using answer sheets, what is the recommended sample size?

100

Which are less formal, follow-up methods for reviewing items?

A peer review is conducted. The CIWT Learning Standards Officer reviews the test items

Which statement is associated with Error of Central Tendency?

Different evaluators rate most of the learners near the middle of a scale.

An essay test is administered. The class leader assigns a number to each learner. The learners annotate the number at the top of the answer sheet instead of their name. After the test is graded, the evaluator is given the list of numbers with names. In this scenario, which grading error is mitigated?

Error of Halo

(TRUE/FALSE) With the 50-percent missed rule, each test item that is missed by 50 percent of the learners is removed from the bank, and those who incorrectly answered are given credit.

False

Which rule of thumb pertains to grading scales and rubrics?

If the majority of the evaluators agree and the evaluators who disagree are only off by 1 point on a scale, the grading scale is reliable. If there is no majority agreement or if evaluators differ by 2 or more points on the scale, a review of the grading instrument is warranted.

Once all the information has been reviewed for a high-missed item, all of the following actions may occur EXCEPT:

The Training Project Plan is revised.

Which statement is associated with Logical Error?

The evaluator gives similar grades on scales that are not necessarily related.

Which statement is associated with Error of Standards?

The requirement is at the discretion of the evaluator