Chapter 11 Evaluation and Testing
Subject- matter expert
A person who is technically competent and who works in the job for which test items are being developed.
Skills evaluation
A test that measures a student's ability to do a task under specified conditions and to a specific level of competence. Also known as a performance test.
Essay Test
A test that requires students to form a structured argument using materials presented in class or from required reading
Systems approach to training (SAT) process
A training process the relies on learning objectives and outcome-based learning
Face Validity
A type of validity achieved when a test item has been derived from an area of technical information by an experienced subject-matter expert who can attest to its technical accuracy.
Job-content/criterion-referenced validity
A type of validity obtained through the use of technical committee of job incumbents who certify the knowledge being measured is required on the job and referenced to known standards.
Technical - Content Validity
A type of validity that occurs when a test item is developed by a subject matter expert and is documented in current, job relevant technical resources and training materials
Which of the following selection-type test items is best suited for measuring higher mental functions? A. Multiple Choice B. Arrangement C. Identification D. Matching
A. Multiple choice PG 247
Which of the following terms is used to describe how well a test item measures what the test-item developer intended it to measure? A. Valid B. Reliable C. Objective D. Measurable
A. Valid pag 242
Qualitative analysis
An in depth research study performed to categorize data into patterns to help determine which test items are acceptable
Which of the following selection-type test items is particularly well-suited to reliably measure the ability to perform an emergency procedure? A. Essay B. Arrangement C. Identification D. True/False
B. Arrangement pg 248
Which of the following selection-type test items has as its advantage the ability of the students to relate words to drawings, pictures, or sketches? A. Arrangement B. Identification C. Matching D. Essay
B. Identification pg 249
Which of the following terms means that a test item measures knowledge in a consistent manner? A. Equivalence B. Reliable C. Valid D. Standardized
B. Reliable pg 245
A placement exam to determine which level of math class appropriate for student is an example of a: A. Selection test B. Formative assessment C. Pre-test D. Criterion test
C. Pre-test pg 241
The use of which of the following selection-type test items should be limited to factual information at the basic level of an entry-level course? A. Matching B. Arrangement C. True/False D. Identification
C. True/False Pg 250
In the hierarchy of words used to develop essay test items, ________ creates the easiest question. A. Evaluate B. Discuss C. Contrast D. Describe
D. Describe pg 251
Which form of the assessment is used during the class to determine the student's level of understanding and the need for additional assistance from the instructor? A. Summative B. Selective C. Prescriptive D. Formative
D. Formative pg 241
________ is often referred to as "the father of the performance/learning objective." A. Cory Bihr B. Mark Fairbanks C. Abraham Maslow D. Robert F. Mager
D. Robert F. Mager pg 244
Validity
The documentation and evidence that supports the test items relationship to a standard of performance in the learning objective and or performance required on the job.
Quantitative analysis
Use of statistics to determine the acceptability of a test item.
Reference blank
Where the current job-relevant source of the test-item content is identified
Valid
is used to describe how well a test item measures what the test-item developer intended it to measure.
Reliability
The characteristic that a test measures what it is intended to measure on a consistent basis
