EDGC 661 Measurement Principles and Techniques exam questions

Objectivity is increased when students _______________. A "Discuss...." B "Evaluate..." C "List...." D "Compare and contrast..."

"Compare and contrast..."

.In a normal curve, the area from one standard deviation below the mean to a point two standard deviations below the mean will include approximately ______ percent of the scores in the distribution. 14 50 68 82

14

The variance of a distribution of test scores is a measure of _________. Dispersion or spread Central tendency Relationship Location

Dispersion or spread

The highest cognitive level on Bloom's hierarchy is ______________. A Synthesis B Evaluation C Knowledge D Application E Emancipation

Evaluation

What characteristic distinguishes evaluation from measurement? A Evaluation requires quantification B Measurement includes testing; evaluation does not C Evaluation involves a value judgment D Evaluation includes assessment; measurement does not.

Evaluation involves a value judgment

Which of the following is NOT a good test constructing practice? A Writing more test items than needed. B Including some clues on items to aid slow learners C Asking a colleague to review the items. D Using a test blueprint in test preparation

Including some clues on items to aid slow learners

Which of the following is an advantage of true-false tests? A They encourage rote memorization of material. B They presume a dichotomous world that is composed of truth or falsity. C They are most likely to contain unambiguous items. D They enable teachers to examine students on a lot of material in a short testing time.

They enable teachers to examine students on a lot of material in a short testing time.

. Which one of the following correlation coefficients indicates the strongest relationship? .-0.03 -0.78 0.56 0.70

-0.78

A correlation coefficient (r) ranges in value from ________. .0 to +1.00 -1.00 to 0 .-1.00 to +1.00 -100 to +100

.-1.00 to +1.00

Richard's z score in science was 2.7. What was his T score? 27 .270 .77 88

.77

A five-year-old is found to have a mental age of seven on Binet's original IQ test. What is the estimate of the child's intelligent quotient? A 115 B 130 C 140 D 170

140

Five students received scores of 10, 12, 14, 16, and 28. The mean of these scores is __________. 12 14 16 18

16

Mr. Stevens gave his 15 students a test the first day of school. Here are students' raw scores (number correct) from a test with 32 items: 17,23,14,20,29,26,26,2718,20,15,22,26,19,17 What is the mode for these scores? 17 22 26 18

26

On a test with a standard deviation of 8 and a mean of 80, an individual with a raw score of 76 will have a T-score (mean=50, SD=10) of ____________________. 35 40 45 55

45

What is the median of the following scores: 2, 4, 6, 24, 68? .6 16 20 24

6

On a 100-item true-false examination, Jessie responded correctly to 80 items although all were attempted. If Jessie s sore were corrected for guessing, what would this corrected score be? A 20 B 60 C 80 D -60

60

A student obtains a score of 75 on a test taken by 86 students for which the mean is 70 and the standard deviation is 10. Assuming a normal distribution of scores, her percentile rank is approximately __________________. 19 31 50 68

68

A correlation of 1.25 is computed between Form A and Form B of an intelligence test. How should this coefficient be interpreted? A mistake in computation must have been made. There is no major source of measurement error in the test. The test is unusually reliable and valid. The test has too much measurement error.

A mistake in computation must have been made.

A new nationally standardized reading achievement test for junior high school students has been created, but the test's developers want to make sure that the three forms of the new test are performing in essentially the same way. What sort of reliability evidence should they gather? A Test-retest reliability evidence. B Alternate-forms reliability. C Internal consistency reliability. D Logical analysis reliability

Alternate-forms reliability.

On a medical aptitude test, Barry Um scored at the 85th percentile. What does this mean? A Barry has an 85% chance of being successful if he is admitted. B Barry has high aptitude for medical work but not necessarily as a doctor. C Barry's predicted score is 85% reliable. D Barry would fall somewhere above the upper quartile in medical school.

Barry has high aptitude for medical work but not necessarily as a doctor.

The purpose of a code of ethics is to protect the ____________. A client B profession C public D school

Client

Most teachers' classroom assessments will deal with the _______ domain. A Psychomotor B Objective C Affective D Cognitive

Cognitive

The overuse of masculine or feminine nouns and pronouns in test items is an example of ______. A Success bias. B Social consequences bias. C Content bias. D Construct bias.

Content bias

Formative evaluation is to summative evaluation as ___________________. A Continuous feedback is to overall effectiveness B Cost is to benefit. C Subjective decision making is to objective decision making. D Test is to measurement.

Continuous feedback is to overall effectiveness

++++++For which of the following groups is an aptitude test likely to be most valid? A Group A, in which the standard deviations of the aptitude test and the criterion are both 10.0 B Group B, in which the standard deviation of the aptitude test is 10 but the criterion is 5. C Group C, in which the standard deviation of the aptitude test is 5 but the criterion is 10. D Group D, in which the standard deviations of the criterion and the aptitude test are both 5.

Group A, in which the standard deviations of the aptitude test and the criterion are both 10.0

Directions for taking the test should include all of the following EXCEPT _____________. A time limits, if any for each section of the test. B seating arrangements. C minimum light, temperature, and ventilation requirements. D Holidays on which the test cannot be given.

Holidays on which the test cannot be given

An example of a nominal scale of measurement is _____________. A Dollars earned per year. B Legibility of handwriting C Identification data D Time taken for students to complete a lesson.

Identification data

The probability of answering a multiple-choice item correctly by merely guessing is _________________. A A 25% chance B A 20% chance C It depends on the number of answers D It depends on the number of alternatives (options)

It depends on the number of alternatives (options)

The lowest level on Bloom's hierarchy is _____________. A Synthesis B Evaluation C Knowledge D Application E Emancipation

Knowledge

Jack and Jane are fraternal twins in the 7th grade. With their class, they took a paper-and-pencil intelligence test. The test results were reported in terms of deviation scores (DIQ) with a mean of 100 and a standard deviation of 15. The standard error of measurement for the test was plus or minus 3. Jack's DIQ score was 128. Jane's DIQ score was 132. Is there evidence that Jane is more intelligent than Jack? A Yes, because Jack's DIQ score was higher than Jane's DIQ score. B Yes, because Jack's DIQ score was lower than Jane's DIQ score. C No, because the Standard Error of Measurement (SEM) was + or - 15 and an error band must be constructed around Jack and Jane's DIQ scores. D No, because the Standard Error of Measurement (SEM) was + or - 3 and an error band must be constructed around Jack and Jane's DIQ scores. Meaning that Jack's true DIQ Since these bands of scores overlap, there is NO difference in Jack and Jane's DIQ scores.

No, because the Standard Error of Measurement (SEM) was + or - 3 and an error band must be constructed around Jack and Jane's DIQ scores. Meaning that Jack's true DIQ Since these bands of scores overlap, there is NO difference in Jack and Jane's DIQ scores.

The interpretation of a test that is based on an individual's performance relative to some group can best be called _____________ referenced. A Norm B Criterion C Selective D Non-Selective

Norm

The incorrect responses are needed to compute _____________. D (the discrimination index) P (the difficulty level of the item) the chance score. the optimum level of difficulty.

P (the difficulty level of the item)

Which of the following is NOT a recommended practice in scoring essay test questions? A Decreasing the possibility of the "halo effect" B Keeping students' scores on each item on a separate sheet. C Looking at students' names only after all papers have been corrected. D Reading all items written by one student before reading items from another student.

Reading all items written by one student before reading items from another student.

An absolute interpretation is to criterion-referenced testing as _________ interpretation is to norm-referenced testing. A Relative B Constant C Criterion D Ratio

Relative

How could you best improve upon the following true-false items? Item: No school system is supported entirely by local funds. A Include the word anywhere after the word system. B Leave off the last two words in the statement and convert the item into a completion format C Omit the word entirely. D Replace the word No with Few and adjust the grammar accordingly

Replace the word No with Few and adjust the grammar accordingly

Which of the following activities is SPECIFICALLY prohibited (not by implication), under the provisions of the 1974 Buckley Amendment? A Choosing members of a team for a spelling bee. B Using letters of recommendation. C Posting of grades. D Requiring students to evaluate family members on tests.

Requiring students to evaluate family members on tests.

On a seventh-grade mathematics test, Sam achieved a score of 80, which converted to the 92nd percentile. This means that _____________. Sam did as well or better than 92% of students taking the test. Ninety-two percent of the students taking the test scored higher than Sam. Sam is an average student. Sam is a below average student.

Sam did as well or better than 92% of students taking the test.

Tests are referred to as being objective if _____________________. A Scorers consistently apply scoring rules and get the same scores B Students and teachers agree that the test is measuring important objectives. C The items measure math and science objectives. D They consist of true-false and multiple-choice items.

Scorers consistently apply scoring rules and get the same scores

A test that places a larger proportion of minority students than is justified by their population into programs for the mentally retarded is considered to be biased because of its ______. A Average-score bias. B Content bias. C Social consequences bias. D Success bias.

Social consequences bias.

(Test-Retest Reliability) Assume that test A is re-administered over one week; test B is re- administered over one month; test C is re-administered over two months; and test D is re- administered over four months. The stability coefficient for tests A, B, C, and D is .81. Assuming all other conditions are equal, which test would you recommend? A Test A B Test B C Test C D Test D

Test D

One of the best predictors of art scores on the DAT is arithmetic reasoning. Why might this be so? A Arithmetic reasoning is one of the most reliable subtests. B Art teachers tend to reward girls with good grades, and most girls do better on nonverbal skills than boys. C The arithmetic reasoning subtest is invalid. D The arithmetic reasoning subtest measures some of the same skills as those required by art teachers.

The arithmetic reasoning subtest measures some of the same skills as those required by art teachers.

Which of the following will NOT be affected if an item has been miskeyed? .D (the discrimination index) P (the difficulty level of the item The number of students in the upper 25% The number of students responding "correctly" in the middle 50%.

The number of students in the upper 25%

Under which of the following conditions is the use of the essay examination most defensible? A The number of examinees is large. B The objectives specify synthesis. C The teacher has less time for scoring htan for test construction. D The test will be reused.

The objectives specify synthesis.

The test manual for an ability test must report ________________. A the criterion being predicted by the test. B the validity coefficient. C the amount of time elapsing between the test administration and the collection of the criterion data. D all of the above.

all of the above

The most important function for providing the general directions and exact words the administrator is to say when distributing, administering, and collecting all materials help to __________________. A make students comfortable. B cut the time limits. C assure standardized testing conditions. D assure the validity of the test.

assure standardized testing conditions

The term reliability is closest in meaning to ________________. A consistency. B objectivity. C practicality. D validity.

consistency

The type of validity that is of concern for a personality test is ______. A content validity. B construct validity. C criterion validity--predictive. D criterion validity--concurrent.

construct validity.

Test questions are samples from a domain of knowledge or behavior that we wish to examine. We work to make the test questions representative samples of the domain because we are concerned with _________. A generalizability. B content validity. C reliability. D standardization.

content validity

Reliability can be best determined by _______________. A analyzing the test blueprint. B correlating test scores. C comparing test scores to a criterion. D counting the errors examinees make.

correlating test scores.

Which of the following is NOT a technical consideration in selecting a standardized test? A cost B directions for administering C norms and scales D validity

cost

In a negative correlation, as one variable increases, the other ________________. stays constant. increases. decreases. varies randomly.

decreases

What is the first step in designing classroom tests and assessment? A assembling the assessment. B determining the purpose of measurement. C designing the test blueprint. D selecting appropriate items.

determining the purpose of measurement.

A correlation coefficient indicates the ________________. .direction but not the strength of a relationship. .direction and strength of a relationship. strength and direction of a treatment effect. strength but not the direction of a relationship.

direction and strength of a relationship.

When students who respond correctly to an item have the highest total scores on the test, and when students who respond incorrectly to the same item have the lowest total scores on the test, the item is said to be ____________. criterion-referenced. discriminating. easy. heterogeneous.

discriminating.

2. .When using a typewriter to count student responses, it is necessary to __________. first separate answer sheets into upper and lower groups. use separate answer sheets. type each student's answer to item 1 before typing responses to subsequent items. sort answer sheets by the P value of each item.

first separate answer sheets into upper and lower groups.

Discrimination indices of zero are acceptable when the test is designed __________. for criterion-referenced purposes (mastery learning). for formative evaluation. for marking purposes. to discriminate only at one end of a distribution.

for criterion-referenced purposes (mastery learning).

Mrs. Scott gave the same physics test to each of his three junior classes. Analysis of the data revealed the following descriptive statistics: Class M SD One 59 7.5 Two 68 6.2 Three 62 6.9 Compared to the other two classes, Mrs. Scott can infer that students in Class One exhibit_________. a more narrow distribution of scores. greater variability in scores. a higher measure of central tendency. lower variability in scores.

greater variability in scores.

Open-book exams are most useful in courses where objectives emphasize ______________________. A much memorization of material. B knowledge-level learning C higher-level thinking. D recall of material.

higher-level thinking.

A deviation IQ score indicates _________________. A how a person compares with others in his/her age group. B how close mental age is to chronological age. C the degree of how well mental age is related to a particular cognitive level.a D the difference between scores on group and individual IQ tests.

how a person compares with others in his/her age group.

What is the best procedure for improving the reliability of a classroom test? A increasing the number of test items. B making the items easier. C making the items more difficult. D using more supply-type items.

increasing the number of test items.

When IQ tests correlate in the .90s with achievement tests, this means that ______________. A achievement test scores are responsible for students' IQs B intelligence increases at the same rate as achievement. C intelligence is responsible for and determines the amount of student achievement. D intelligence tests and achievement tests do not measure exactly the same factors.

intelligence tests and achievement tests do not measure exactly the same factors.

A very young child tries to measure time with a bathroom scale. This is an example of ____________ measurement. A unreliable. B reliable. C invalid. D valid.

invalid

To determine the Range, we simply subtract the ________ score from the _______ score. highest, lowest lowest, highest highest, median lowest, mean

lowest, highest

Consider the following data. Without calculations, using your knowledge of item analysis, your evaluation of the data indicates that the item ______________. (N=100, *=correct option) Hi Lo A 17 12 B* 1 3 C 1 1 D 1 1 . is too difficult for the low group. is too difficult for the high group. has a very high "D" index. miskeyed

miskeyed

Composite method is to compensatory as cutoff method is to ________. A correlation. B multiple decisions. C rationalization. D validation.

multiple decisions

Pat has an IQ of 80, receives mostly D and failing grades in school, but holds a job in a flower nursery. Pat should probably be diagnosed as being ________________. A educable mentally retarded. B mentally incompetent. C of low average intelligence. D none of the above.

none of the above

The text states that research on the advantage of essay tests over multiple-choice tests indicates that they help students to ____________. A express their ideas in written form. B organize their thoughts on paper. C study properly. D none of the above.

none of the above.

The calculation of the "D" index and the "P" index assume that the test is ____________. .criterion referenced. norm referenced. easy. difficult.

norm referenced.

If the mean, median, and mode of a distribution are identical, the distribution must be ______. normal rectangular (i.e., an equal number of persons received the same sore value). skewed. more calculations are needed

normal

The purpose of a regression equation is to _______. A determine the mean amount of regression. B develop a compensatory selection strategy. C estimate the correlation between a predictor and a criterion. D predict criterion values.

predict criterion values

The most appropriate form of validity for aptitude tests is ________. A concurrent B construct C content D predictive

predictive

The probability of invading the privacy of students is highest when testing and measurement is designed to _____________. A assign grades B help students evaluate their own learning C place students in appropriate classrooms D provide data for a research study

provide data for a research study

+++++The difference between aptitude and intelligence tests concerns their ____________. A purpose and method of validation. B purpose and types of items. C types of items and theoretical constructs. Dvalidity and objectivity

purpose and method of validation

Which one does NOT belong with the other three? Mean Median Range Mode

range

Norms given in a test manual must _____________. A refer to defined populations. B refer to clearly described populations. C report whether scores differ for various ethnic groups. D report all of the above.

report all of the above

+++++The development of intelligence tests grew out of the need to measure __________. A affective differences in ability. B innate (inborn) differences in ability. C school selection and placement. D simple reaction time and association skills.

school selection and placement

With a normal distribution of scores having a mean of 35 and a standard deviation of 8, which of the following statements is true? .A score of 31 is one standard deviation below the mean. A score of 45 would exceed 98% of the scores. A score of 27 would be higher than 16% of the scores. A score of 40 would exceed about 85% of the scores.

score of 27 would be higher than 16% of the scores.

In the case of Larry P. et al. v. Wilson Riles et al., the court held that ___________. A African American psychologists must be employed to administer individual IQ tests to African American students. B minority students could not be placed in classes for the retarded solely on the basis of test scores. C parents must be allowed to help make the judgment of special class placement. D special class placement of minorities by means of IQ scores is illegal if racial imbalance occurs.

special class placement of minorities by means of IQ scores is illegal if racial imbalance occurs.

The "teachable moment" is most closely related to the concept of _______. A heredity B readiness C subjective individual demand schedules. D the subconscious.

subjective individual demand schedules.

To obtain content-related evidence of validity, you would examine the _____________. A expectancy table. B size of the correlation coefficient. C type of criterion used. D table of specifications

table of specifications

A specific determiner is an unintentional clue to ______________________. A the answer to the question. B the total number of items that the student will get correct. C the chance of getting the item correct. D the chance of getting the item wrong.

the answer to the question.

A correlation of +.80 between short-term memory span and vocabulary indicates that _________. the greater the short-term memory span, the greater the vocabulary. short-term memory span and vocabulary are weakly associated. there is a low correlation between short-term memory span and vocabulary. short-term memory span and vocabulary are not related.

the greater the short-term memory span, the greater the vocabulary.

Consider the following data from a test item. (same data as in question 4, but different question) (N=100, *=correct option) Hi Lo A 0 0 B* 37 35 C 2 4 D 1 1 Without calculations, an educated evaluation of the item would be _______________. the item had a "P" value .2 or less the item had a "P" value .8 or greater. the item had a high "D" value. the item was too ambiguous.

the item had a "P" value .8 or greater.

Consider the following data from a test item: (N=100, *=correct option) Hi Lo A 0 0 B* 37 35 C 2 4 D 1 1 Without calculations, an educated evaluation of the item would be ___________. Answer the item was too difficult. the item was miskeyed. the item had a high "D" value. the item was too easy.

the item was too easy

When reviewing information on the Normative data provided in a test manual it is important to remember _____________. A the reliability of the subtests must be reported. B the validity of the subtests and total test must be reported. C the reliability of the subtests and total test must be reported. D the validity and reliability of the subtests and total test must be reported.

the validity and reliability of the subtests and total test must be reported.

Which of the following is NOT a practical consideration in selecting a standardized test? A cost B time limits C ease of administration D title of the test

title of the test

If children only have the ability to care for their own minimal needs, can get along in their families and neighborhoods, and can work in sheltered workshops, they are categorized as being ________________. A educable mentally retarded. B from lower SES groups. C mentally incompetent. D trainable mentally retarded.

trainable mentally retarded

The standard deviation is considered the most important measure of the ________ of a distribution of scores. reliability variability validity average

variability