Intro to Eval Final

The type of scoring error that occurs when the evaluator's general impression of the test taker affects the accurate rating of performance is

Halo effect

What materials are required for the Purdue Pegboard Test?

Instruction manual, a test board, pins, collars, washers, stopwatch, a score sheet or scoring application

This type of reliability is concerned with the degree of agreement between items on an assessment that measure similar concepts or skills

Internal consistency

Which of the following is a characteristic of non-standardized tests?

Likely to take place in a naturalistic setting

Researchers were using a polygraph machine to screen for dishonest responses on a questionnaire. After many administrations of the polygraph test, they begin to worry that the machine is actually measuring anxiety and NOT dishonest responses. If this is true, it would be an example of:

Low construct validity

What theoretical framework is the COSA based on?

MOHO

What are correct types of SPM forms?

Main classroom form, home form, & school environments form

Which of the following is a measure of central tendency?

Mean

This measure of central tendency evenly divides the population in half, with 50% above and 50% below

Median

Which of the following is provided by a standardized test?

Objectivity, quantification, and communication

Likert scale and semantic differential scales result in which type of data?

Ordinal

Research that examines the effectiveness of treatment as it is provided under real-life circumstances is referred to as:

Outcomes research

What is the target population of PEGS?

Pediatrics, ages 5-9

The target audience for the Reading-Free Vocational Interest Inventory?

People aged 12-61 with limited reading ability

Which of the following is not a score generated from the SPM?

Proprioception

Monitoring the success of interventions, providing risk management assessments and monitoring the cost-effectiveness of services are all ways that this stakeholder group uses evaluation data.

Providers

What is the main form of documentation, that is detachable from the booklet, for the examiner to complete for the R-FVII:2?

Record of Interest and Cluster scores

According to the OTPF-III outcomes measures should be:

Selected early in the intervention process, valid and reliable, and congruent with client goals

Which of the following types of studies are quite feasible within clinical settings and can help clinicians accumulate data to make informed decisions? (indicate all that are appropriate)

Single subject designs and case studies

The ability of a test to Identify or detect those who do not have a condition is

Specificity

An occupational therapist is working with a client with low endurance and she is concerned that he may not be able to complete the long version of an assessment. A short version of the test is available. Which type of reliability information would be most important to validate the decision of the therapist to administer the shorter version?

Split-half reliability

Which of the following is a measure of reliability of an obtained test score and estimates the possible deviation of a test taker's observed score from his true score?

Standard error of measurement

The purpose of the R-FVII:2 is to assess

vocational interest areas

Who is the Beery VMI targeted towards? (years)

0-6

In scoring a client's standardized test, you calculate his Z-score as -1.4. This tells you that his score falls...

1.4 standard deviations below the mean

How many geometric shapes are copied in the Test of Visual-Motor Skills booklet

23

When administering the COSA, how many different formats are available?

3

Given a normal distribution, the percentage of scores between -1 and +1 SD is

68%

The KELS assessment is most applicable when the patients stay is:

<1 month

In using an outcomes-oriented approach the use of standardized measurement instruments to gather evaluation data optional and not really necessary.

False

When reporting scores on a standardized assessment, it is better to report the age or grade equivalent over a percentile or rank measure

False

For the Beery VMI, when in doubt...

Give credit

Which of the following is not an indicator of a test's validity?

Agreement of results over multiple test administrations

A measurement scale that has a standard unit of measure that allows for estimating the magnitude of difference between responses is...

An interval scale

Select the best answer about the QNST-3's reliability and validity

Caution should be used when interpreting the internal consistency results in individuals 20-59 years old

Who is included in the assessment portion of PEGS?

Child, parent/caregiver, educator

Evidence-based practice in health care is a process that guides the practitioner in choosing appropriate interventions by...

Combining the best available published evidence with practitioner expertise and client preferences

How does a norm-referenced test differ from a criterion-referenced test?

Comparison of scores with a population or representative sample

_____ refers to the extent to which there is agreement between two measures of the same behavior or trait

Criterion-related validity

Which types of studies are generally classified as non-experimental

Descriptive studies, case studies, and correlation research

The Purdue Pegboard assesses client's...

Dominant hand, non-dominant hand, and both hands working together

How is the Visual-Motor Skills assessment scored?

Each error is given a score of 0 and each non-error is given a score of 1

This type of validity refers to the degree to which the assessment relates to or represents real world conditions

Ecological

Who is the target population of SPM?

Elementary school-aged children in kindergarten through 6th grade (age 5-12)

Public health programs, private insurance companies and state and federal regulatory bodies use evaluation data to...

Establish reimbursement guidelines and policies, determine reimbursable services, develop policies and professional standards

What statement is true about the COSA's reliability and validity?

The COSA is reliable and valid

The raw scores for the QNST-3 are calculated using what?

The number of mistakes made during each task

What statement is true about the purpose of the QNST-3?

The purpose of the QNST-3R is to quantify sensory processing, motor processing, and motor control difficulties; & may be used to screen for neurological soft signs

Peer reviewed journals require that manuscripts undergo a process of evaluation by experts in the discipline

True

When documenting the results of an assessment, the occupational therapist should use past tense to describe actions of the client

True

When neither quantitative nor qualitative research evidence is available to support practice, the therapist should...

Use individual practice data as support for subsequent decisions

Which of the following areas of the OTPF is NOT addressed during the Purdue Pegboard assessment?

Values

What does the Beery VMI test?

Visual perception and motor coordination

What does the Test of Visual-Motor Skills assess?

Visual, motor, and written skills

What area of the OTPF is NOT addressed in PEGS?

Work

The Purdue Pegboard test is...

a rectangular board with 2 sets of 25 holes running vertically and 4 concave cups at the top

A positive correlation between two measures suggests that

if the client scores well on one test, he is likely to score well on the other

There are a few target populations the KELS work best for. Which of the following is one of them?

people with acquired brain injury

All of the following are areas assessed by the KELS except:

play participation