Tests & Measurements Midterm (Ch. 1-7), SP17
You will identify (from a list) an observable learning outcome.
*Note: Must also be measurable
According to the textbook, which of these statements best summarizes the reason for using selected-response items to assess knowledge?
A broad range of content can be assessed efficiently
Second-grade students should be able to retell a story. At the beginning of the year, the retelling should include the beginning, middle, and end of the story. By the end of the year, the retelling should also include details about the setting, characters, and plot. The change in student performance from the beginning of the school year to the end is an example of _______.
A learning target
According to the textbook, which of these types of questions is most likely to promote student reasoning rather than simply recall?
A question that has more than one possible correct answer
A technical training school offers courses in photocopier repair. Which of these assessment formats would be best to use to determine if students are ready to repair a machine for a customer?
A series of performance tasks in which students diagnose problems and repair machines
When designing test items, good directions should include all except _____________.
A statement of reliability
Test Blueprint/Table of specifications.
A technique that helps the teacher write test items at different levels
Content validity
All of the pieces have to match.
After a unit of study, a teacher administered a multiple-choice test and a mini project as the assessments. The teacher was disappointed when the students did not perform as well as she had hoped. Which of these actions would most likely be helpful to the teacher?
Analyze the specific targets for the unit and determine if instruction was adequate
According to the textbook, which of these is an accurate statement about assessing deep understanding and reasoning?
Any assessment format can be used; however, constructed response or essay are the best match.
According to the information in Chapter 2, which of these is not a major criteria for evaluating the appropriateness of textbook objectives?
Appropriateness of the assessments recommended to determine student mastery of the objectives
According to the textbook, one way a classroom teacher can avoid introducing bias into a classroom assessment is by _________
Avoiding items based on stereotypes
You will be given several sample True/False test items.
Choose the one that is not poorly written.
A teacher wrote the following learning target: "Students will write a well-developed essay comparing the basic economic principles of communism and capitalism." This learning target is flawed because it does not ________. (Define what students are to know)
Clarify how performance will be judged
According to the textbook, which of these is a teacher's primary reason for being concerned about high-quality classroom assessment?
Consequences: because assessments affect instructional decisions
Which of these is not a key step in defining scoring criteria?
Describe how observations are to be documented
Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Construct a test blueprint."
Desirable to do
Bias in a test is suspected when ___________.
Examinees from different groups perform significantly different on an item, although they have equivalent total scores on the test
Identify a non-measurable, non-observable behavior
Example: understand, know
Bloom's Taxonomy. Identify an objective written at the application level.
Examples: apply, practice, demonstrate, solve, report, use, etc.
Which of the following best describes characteristics of assessment for learning?
Formative, describes the needs for future learning
Benchmark tests are used to
Gage progress toward the annual assessment and identify students at risk of failure on the annual assessment.
When might it be appropriate to delay feedback?
Giving feedback when students are involved
Which of the following concerns would not be considered in planning a summative assessment?
Have most of the students had an opportunity to learn what is being assessed?
Which of the following statements is most true about teaching in a high stakes testing environment?
Higher test scores result from assessments that are implemented on the basis of promoting student learning, rather than showing student performance.
Off-quiz question.
I'm sorry; I didn't get this one written down.
You will be given another sample multiple choice item.
Identify the error.
The statement: "The student reads below grade level." indicates which of the following?
Interpretation
According to the textbook, which of these best describes what a performance standard is?
It describes specific characteristics of a competent performance or quality product.
Which of these is a primary limitation of using oral questions as a way to assess whether students have mastered the material taught?
It is difficult to pose questions that tap into higher-level reasoning.
A teacher is teaching a unit on map skills. The teacher wants to know if students can use the symbols on a road map or atlas to locate places, tell the direction of travel from point A to point B, and estimate distances using the distance scale. Based on the information given, which type of target is being assessed?
Knowledge
In order to overcome measurement error in informal observation, it is best to ________________.
Look for confirming evidence from a variety of assessments
You will be given an example multiple choice item.
Make the best change to make it a better item
A learning target ______.
Makes suggestions for further learning
The statement: "The student correctly answered 85% of the questions." indicates which of the following?
Measurement
Which French political philosopher defended the principle of separation of powers? A) Mahatma Gandhi B) Friedrich Nietzsche C) Alexsandr Solzhenitsyn D) Charles, Baron de Montesquieu The response alternatives should be modified so that they are __________.
More homogenous
Which of the following would be a DOK 1 test item?
Multiple-choice question, requiring recognizing specific facts
Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Determine which declarative and procedural knowledge to test."
Necessary to do
Which of these pairs of words best describes key characteristics of a learning target?
Observable and measurable
A classroom teacher had students create models of the solar system. Students made the model at home and brought it to class. Which of these formats would be best to use as a follow-up assessment to determine if students achieved the specific learning targets?
Oral questioning of student individually about their model
Assessment experts recommend that the specific learning targets, evidence of learning, and the characteristics of a quality performance should be shared with students. What principle of Cognitive Learning Theory does this support?
People perform better when they know the goal, see models, and know how their performance comp
Know what it means to have content validity
Questions on test match objectives
Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Increase the number of items on a test."
Reliability
Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Minimize distractions during testing."
Reliability
Which of these would be least helpful when using information from a nationally-standardized norm-referenced test for planning instruction?
Review the test manual to learn about the characteristics of the norming group and test reliability
Refer to the map scenario in question 7. Assuming that the teacher will use a real map to assess students, which type of assessment method best meets the criteria of reliability and efficiency?
Selected-response test, which may include multiple-choice, true-false, fill-in-the-blank, and short answer
Which of the following types of feedback compares student expectations with previous performance?
Self-referenced
Which of these statements best explains why selecting an appropriate assessment method is an important characteristic of quality classroom assessments?
Some methods are better suited to certain types of targets than others.
In order for feedback to be optimally useful, it should be ______________.
Specific to learning targets
Asks you about the pieces of a multiple choice item.
Stem: the question Distractors: the wrong choices Key: right answer
Which of these statements supports the conclusion that a formal pretest at the beginning of the school year is not very helpful for planning instruction?
Students may change rapidly with respect to the learning targets, and expectations based on a pretest may be obsolete within a very short time.
Which of these is not one of the benefits of specifying the learning targets for a unit of study?
Targets help focus on what may be most important to assess and what assessment formats may be most appropriate.
According to the textbook, which of these statements would be a reasonable conclusion about ready-made tests from textbooks and instructional packages?
Teachers must evaluate the quality of such tests in light of their instructional targets and rules for writing good items.
Which is usually not true regarding summative assessment?
Teaching test-taking skills will skew the detail and results.
Read the following set of test directions: "The purpose of this test is to determine your speed and accuracy in doing mathematical computations. You will have 15 minutes to complete the 20 computations. Write your answer in the space below each problem." Which of these statements best explains whether the directions meet the criteria for writing test directions?
The directions are incomplete because it is not clear how speed and accuracy will be scored.
Which French political philosopher defended the principle of separation of powers? A) Mahatma Gandhi B) Friedrich Nietzsche C) Alexsandr Solzhenitsyn D) Charles, Baron de Montesquieu For the sample item above, how should the item stem be revised so that it follows the rules for writing multiple-choice items?
The item stem should be reworded because it contains clues to the correct response.
Which of these statements best describes the role that the end use of assessment plays in planning for assessment?
The kinds of decisions that will be made influence the kind and quantity of information to collect.
Which of these best explains the purpose of providing students with examples of a quality product or performance before they do their work?
They clarify what students should be aiming for in their work
Know the description of the analysis level of Bloom's Taxonomy.
This is the ability to examine and break information into it's component parts. Examples: compare, debate, inspect, etc.
Know the purpose of the taxonomy of the educational level
To arrange in order of complexity
Which of these is not generally a purpose of formative assessment?
To document learning
According to the information in Chapter 4, which of these statements best summarizes the purpose of collecting assessment information before instruction?
To gather evidence that will help shape instruction
Which of these best describes the purpose of doing assessment prior to instruction?
To plan appropriate instruction
Which of these is not a reason for asking both knowledge and reasoning questions during instruction?
To reveal what will be on the final test
Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Have the same number of items for each learning target."
Unecessary to do
Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Have someone judge whether the item measures the intended target."
Validity
Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Identify appropriate uses of results."
Validity
Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Specify the content to be tested."
Validity
Teachers' editions of textbooks usually include questions for the teacher to ask during instruction and end-of-chapter questions for students to answer. When considering whether to use such questions, which of these is most important for a teacher to do?
Verify that the questions match important learning targets
Which of these phrase pairs best describes the relationship between content standards and performance criteria?
What students should be able to do: how well they should be able to do it
You will be asked about the different types of objective test items.
You will have to select the best one for a particular scenario.
How we measure in the classroom should be determined by...
what we want to measure
