Topic 5: Short Answer and Completion Items
Short Answer and Completion Items
- Generally short in structure and require a short answer as well - Used almost exclusively to assess lower- level thinking skills such as memorization and basic knowledge - Also called "supply" items○ Test taker must supply a response in either words, numbers or symbols
Essay Items
- Test taker is expected to write a coherent and informative response to a question - Good to use when you want an unrestricted response that will measure higher-order thinking - Relationship between ideas - Pros and cons of an argument -Open-ended or close-ended
How to Score Essay Questions
1. Allow plenty of time to score items. 2. Pace yourself! Score items in batches and take a break after each batch. 3. When creating the question, create a model response to have a basis for comparison. 4.Score the same question across all test takers then score the next question. 5. Grade responses without knowing the test taker's identity
Essay Guideline #1
Allow adequate time to answer the question. • Tell test takers how much time they have to complete the question. • Recommend outlining a response before writing.
Short Answer and Completion Items Guidelines #2
Avoid grammatical clues to the correct answer. - questions should make sense but not inadvertently provide help
Essay Guideline #2
Be sure the question is clear and complete. - Write the question so test takers know what information is wanted in the response.
Close-ended essay items
Defines limits for both the content and the format of the response
Short Answer and Completion Items Guidelines #3
Do not copy items directly from study materials. • It encourages memorization beyond what is needed.
Essay Guideline #4
Have all test takers answer the same questions. - Should be one model answer against which responses should be compared. • Multiple questions require that multiple model answers have to be created - a lot of work!
Short Answer and Completion Items Guidelines #5
When requiring a numerical answer, specify the precision of the answer you want and the units. - being specific ensures that you receive the one correct answer you want
Short Answer and Completion Items Guidelines #1
If you have a choice, create short answer items rather than completion items. - short answer items are more clearer, more straightforward, and less ambigious
Short Answer and Completion Items Guidelines #7
Items should be written so there is only one, brief answer that is correct.
Short Answer and Completion Items Guidelines #6
Make sure blank spaces are equal in size and kept to a minimum.
Open-Ended Essay items
No restrictions placed on the response (i.e., unrestricted)
Essay Guideline #3
Only use essay questions to evaluate higher- order thinking, such as comparisons, evaluations, analyses, and interpretations
Short Answer and Completion Items Guidelines #4
Place the "blank" for completion items at the end of the item. - when a blank is at the end of an item, the test taker is more prepared