Chapter 11

If a thermometer measured the temperature in an oven as 400 degree five days in a row when the temperature was actually 377 degree, this measuring instrument would be considered:

Reliable but not valid

In an item analysis, 14 of the 20 high-ability students answered an item correctly, whereas only 8 of the 20 low-ability students did. What is the discrimination index for this item?

.30

The use of intraclass correlation to estimate reliability in motor performance instead of Pearson r has the advantage(s) of:

Allowing analysis of trial-to-trial change and estimating reliability for more than two trials.

A physical education teacher develops a skill test in volleyball. After administering the test to 50 students, she asks the volleyball coach to rate the students on volleyball skills. She then correlates the students' test scores with the coach's rating. This is an example of what type of validity evidence?

Criterion Validity

Reliability of a measure may be established by:

Giving the test to the sample people on two different occasions and correlating the two sets of scores & correlating scores from alternate forms of the same test

A teacher wishes to determine the reliability of three trials on a performance test. She uses ANOVA to obtain the reliability coefficient. What is this technique called?

Intraclass correlation

For a test to have good content validity evidence, the following statement(s) must be true:

The test is adequately samples what was covered in the course and the percentage of points for each topic area reflects the amount of emphasis given that topic.

Evidence of validity is often provided by finding the correlation between scores on:

A test and some independent criterion

Which of the following is a technique for providing information about the reliability of an instrument?

Coefficient Alpha

Which technique is used to estimate the reliability of a test that is changed in length?

Spearman-Brown prophecy formula