Tests & Measurements Midterm (Ch. 1-7), SP17

You will identify (from a list) an observable learning outcome.

*Note: Must also be measurable

According to the textbook, which of these statements best summarizes the reason for using selected-response items to assess knowledge?

A broad range of content can be assessed efficiently

Second-grade students should be able to retell a story. At the beginning of the year, the retelling should include the beginning, middle, and end of the story. By the end of the year, the retelling should also include details about the setting, characters, and plot. The change in student performance from the beginning of the school year to the end is an example of _______.

A learning target

According to the textbook, which of these types of questions is most likely to promote student reasoning rather than simply recall?

A question that has more than one possible correct answer

A technical training school offers courses in photocopier repair. Which of these assessment formats would be best to use to determine if students are ready to repair a machine for a customer?

A series of performance tasks in which students diagnose problems and repair machines

When designing test items, good directions should include all except _____________.

A statement of reliability

Test Blueprint/Table of specifications.

A technique that helps the teacher write test items at different levels

Content validity

All of the pieces have to match.

After a unit of study, a teacher administered a multiple-choice test and a mini project as the assessments. The teacher was disappointed when the students did not perform as well as she had hoped. Which of these actions would most likely be helpful to the teacher?

Analyze the specific targets for the unit and determine if instruction was adequate

According to the textbook, which of these is an accurate statement about assessing deep understanding and reasoning?

Any assessment format can be used; however, constructed response or essay are the best match.

According to the information in Chapter 2, which of these is not a major criteria for evaluating the appropriateness of textbook objectives?

Appropriateness of the assessments recommended to determine student mastery of the objectives

According to the textbook, one way a classroom teacher can avoid introducing bias into a classroom assessment is by _________

Avoiding items based on stereotypes

You will be given several sample True/False test items.

Choose the one that is not poorly written.

A teacher wrote the following learning target: "Students will write a well-developed essay comparing the basic economic principles of communism and capitalism." This learning target is flawed because it does not ________. (Define what students are to know)

Clarify how performance will be judged

According to the textbook, which of these is a teacher's primary reason for being concerned about high-quality classroom assessment?

Consequences: because assessments affect instructional decisions

Which of these is not a key step in defining scoring criteria?

Describe how observations are to be documented

Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Construct a test blueprint."

Desirable to do

Bias in a test is suspected when ___________.

Examinees from different groups perform significantly different on an item, although they have equivalent total scores on the test

Identify a non-measurable, non-observable behavior

Example: understand, know

Bloom's Taxonomy. Identify an objective written at the application level.

Examples: apply, practice, demonstrate, solve, report, use, etc.

Which of the following best describes characteristics of assessment for learning?

Formative, describes the needs for future learning

Benchmark tests are used to

Gage progress toward the annual assessment and identify students at risk of failure on the annual assessment.

When might it be appropriate to delay feedback?

Giving feedback when students are involved

Which of the following concerns would not be considered in planning a summative assessment?

Have most of the students had an opportunity to learn what is being assessed?

Which of the following statements is most true about teaching in a high stakes testing environment?

Higher test scores result from assessments that are implemented on the basis of promoting student learning, rather than showing student performance.

Off-quiz question.

I'm sorry; I didn't get this one written down.

You will be given another sample multiple choice item.

Identify the error.

The statement: "The student reads below grade level." indicates which of the following?

Interpretation

According to the textbook, which of these best describes what a performance standard is?

It describes specific characteristics of a competent performance or quality product.

Which of these is a primary limitation of using oral questions as a way to assess whether students have mastered the material taught?

It is difficult to pose questions that tap into higher-level reasoning.

A teacher is teaching a unit on map skills. The teacher wants to know if students can use the symbols on a road map or atlas to locate places, tell the direction of travel from point A to point B, and estimate distances using the distance scale. Based on the information given, which type of target is being assessed?

Knowledge

In order to overcome measurement error in informal observation, it is best to ________________.

Look for confirming evidence from a variety of assessments

You will be given an example multiple choice item.

Make the best change to make it a better item

A learning target ______.

Makes suggestions for further learning

The statement: "The student correctly answered 85% of the questions." indicates which of the following?

Measurement

Which French political philosopher defended the principle of separation of powers? A) Mahatma Gandhi B) Friedrich Nietzsche C) Alexsandr Solzhenitsyn D) Charles, Baron de Montesquieu The response alternatives should be modified so that they are __________.

More homogenous

Which of the following would be a DOK 1 test item?

Multiple-choice question, requiring recognizing specific facts

Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Determine which declarative and procedural knowledge to test."

Necessary to do

Which of these pairs of words best describes key characteristics of a learning target?

Observable and measurable

A classroom teacher had students create models of the solar system. Students made the model at home and brought it to class. Which of these formats would be best to use as a follow-up assessment to determine if students achieved the specific learning targets?

Oral questioning of student individually about their model

Assessment experts recommend that the specific learning targets, evidence of learning, and the characteristics of a quality performance should be shared with students. What principle of Cognitive Learning Theory does this support?

People perform better when they know the goal, see models, and know how their performance comp

Know what it means to have content validity

Questions on test match objectives

Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Increase the number of items on a test."

Reliability

Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Minimize distractions during testing."

Reliability

Which of these would be least helpful when using information from a nationally-standardized norm-referenced test for planning instruction?

Review the test manual to learn about the characteristics of the norming group and test reliability

Refer to the map scenario in question 7. Assuming that the teacher will use a real map to assess students, which type of assessment method best meets the criteria of reliability and efficiency?

Selected-response test, which may include multiple-choice, true-false, fill-in-the-blank, and short answer

Which of the following types of feedback compares student expectations with previous performance?

Self-referenced

Which of these statements best explains why selecting an appropriate assessment method is an important characteristic of quality classroom assessments?

Some methods are better suited to certain types of targets than others.

In order for feedback to be optimally useful, it should be ______________.

Specific to learning targets

Asks you about the pieces of a multiple choice item.

Stem: the question Distractors: the wrong choices Key: right answer

Which of these statements supports the conclusion that a formal pretest at the beginning of the school year is not very helpful for planning instruction?

Students may change rapidly with respect to the learning targets, and expectations based on a pretest may be obsolete within a very short time.

Which of these is not one of the benefits of specifying the learning targets for a unit of study?

Targets help focus on what may be most important to assess and what assessment formats may be most appropriate.

According to the textbook, which of these statements would be a reasonable conclusion about ready-made tests from textbooks and instructional packages?

Teachers must evaluate the quality of such tests in light of their instructional targets and rules for writing good items.

Which is usually not true regarding summative assessment?

Teaching test-taking skills will skew the detail and results.

Read the following set of test directions: "The purpose of this test is to determine your speed and accuracy in doing mathematical computations. You will have 15 minutes to complete the 20 computations. Write your answer in the space below each problem." Which of these statements best explains whether the directions meet the criteria for writing test directions?

The directions are incomplete because it is not clear how speed and accuracy will be scored.

Which French political philosopher defended the principle of separation of powers? A) Mahatma Gandhi B) Friedrich Nietzsche C) Alexsandr Solzhenitsyn D) Charles, Baron de Montesquieu For the sample item above, how should the item stem be revised so that it follows the rules for writing multiple-choice items?

The item stem should be reworded because it contains clues to the correct response.

Which of these statements best describes the role that the end use of assessment plays in planning for assessment?

The kinds of decisions that will be made influence the kind and quantity of information to collect.

Which of these best explains the purpose of providing students with examples of a quality product or performance before they do their work?

They clarify what students should be aiming for in their work

Know the description of the analysis level of Bloom's Taxonomy.

This is the ability to examine and break information into it's component parts. Examples: compare, debate, inspect, etc.

Know the purpose of the taxonomy of the educational level

To arrange in order of complexity

Which of these is not generally a purpose of formative assessment?

To document learning

According to the information in Chapter 4, which of these statements best summarizes the purpose of collecting assessment information before instruction?

To gather evidence that will help shape instruction

Which of these best describes the purpose of doing assessment prior to instruction?

To plan appropriate instruction

Which of these is not a reason for asking both knowledge and reasoning questions during instruction?

To reveal what will be on the final test

Indicate whether the following statement is something that is necessary, desirable, or unnecessary for a classroom teacher to do when constructing a unit test: "Have the same number of items for each learning target."

Unecessary to do

Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Have someone judge whether the item measures the intended target."

Validity

Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Identify appropriate uses of results."

Validity

Identify whether the statement affects the reliability of a test or if the statement contributes to enhancing validity: "Specify the content to be tested."

Validity

Teachers' editions of textbooks usually include questions for the teacher to ask during instruction and end-of-chapter questions for students to answer. When considering whether to use such questions, which of these is most important for a teacher to do?

Verify that the questions match important learning targets

Which of these phrase pairs best describes the relationship between content standards and performance criteria?

What students should be able to do: how well they should be able to do it

You will be asked about the different types of objective test items.

You will have to select the best one for a particular scenario.

How we measure in the classroom should be determined by...

what we want to measure