Intro to Eval Final
The type of scoring error that occurs when the evaluator's general impression of the test taker affects the accurate rating of performance is
Halo effect
What materials are required for the Purdue Pegboard Test?
Instruction manual, a test board, pins, collars, washers, stopwatch, a score sheet or scoring application
This type of reliability is concerned with the degree of agreement between items on an assessment that measure similar concepts or skills
Internal consistency
Which of the following is a characteristic of non-standardized tests?
Likely to take place in a naturalistic setting
Researchers were using a polygraph machine to screen for dishonest responses on a questionnaire. After many administrations of the polygraph test, they begin to worry that the machine is actually measuring anxiety and NOT dishonest responses. If this is true, it would be an example of:
Low construct validity
What theoretical framework is the COSA based on?
MOHO
What are correct types of SPM forms?
Main classroom form, home form, & school environments form
Which of the following is a measure of central tendency?
Mean
This measure of central tendency evenly divides the population in half, with 50% above and 50% below
Median
Which of the following is provided by a standardized test?
Objectivity, quantification, and communication
Likert scale and semantic differential scales result in which type of data?
Ordinal
Research that examines the effectiveness of treatment as it is provided under real-life circumstances is referred to as:
Outcomes research
What is the target population of PEGS?
Pediatrics, ages 5-9
The target audience for the Reading-Free Vocational Interest Inventory?
People aged 12-61 with limited reading ability
Which of the following is not a score generated from the SPM?
Proprioception
Monitoring the success of interventions, providing risk management assessments and monitoring the cost-effectiveness of services are all ways that this stakeholder group uses evaluation data.
Providers
What is the main form of documentation, that is detachable from the booklet, for the examiner to complete for the R-FVII:2?
Record of Interest and Cluster scores
According to the OTPF-III outcomes measures should be:
Selected early in the intervention process, valid and reliable, and congruent with client goals
Which of the following types of studies are quite feasible within clinical settings and can help clinicians accumulate data to make informed decisions? (indicate all that are appropriate)
Single subject designs and case studies
The ability of a test to Identify or detect those who do not have a condition is
Specificity
An occupational therapist is working with a client with low endurance and she is concerned that he may not be able to complete the long version of an assessment. A short version of the test is available. Which type of reliability information would be most important to validate the decision of the therapist to administer the shorter version?
Split-half reliability
Which of the following is a measure of reliability of an obtained test score and estimates the possible deviation of a test taker's observed score from his true score?
Standard error of measurement
The purpose of the R-FVII:2 is to assess
vocational interest areas
Who is the Beery VMI targeted towards? (years)
0-6
In scoring a client's standardized test, you calculate his Z-score as -1.4. This tells you that his score falls...
1.4 standard deviations below the mean
How many geometric shapes are copied in the Test of Visual-Motor Skills booklet
23
When administering the COSA, how many different formats are available?
3
Given a normal distribution, the percentage of scores between -1 and +1 SD is
68%
The KELS assessment is most applicable when the patients stay is:
<1 month
In using an outcomes-oriented approach the use of standardized measurement instruments to gather evaluation data optional and not really necessary.
False
When reporting scores on a standardized assessment, it is better to report the age or grade equivalent over a percentile or rank measure
False
For the Beery VMI, when in doubt...
Give credit
Which of the following is not an indicator of a test's validity?
Agreement of results over multiple test administrations
A measurement scale that has a standard unit of measure that allows for estimating the magnitude of difference between responses is...
An interval scale
Select the best answer about the QNST-3's reliability and validity
Caution should be used when interpreting the internal consistency results in individuals 20-59 years old
Who is included in the assessment portion of PEGS?
Child, parent/caregiver, educator
Evidence-based practice in health care is a process that guides the practitioner in choosing appropriate interventions by...
Combining the best available published evidence with practitioner expertise and client preferences
How does a norm-referenced test differ from a criterion-referenced test?
Comparison of scores with a population or representative sample
_____ refers to the extent to which there is agreement between two measures of the same behavior or trait
Criterion-related validity
Which types of studies are generally classified as non-experimental
Descriptive studies, case studies, and correlation research
The Purdue Pegboard assesses client's...
Dominant hand, non-dominant hand, and both hands working together
How is the Visual-Motor Skills assessment scored?
Each error is given a score of 0 and each non-error is given a score of 1
This type of validity refers to the degree to which the assessment relates to or represents real world conditions
Ecological
Who is the target population of SPM?
Elementary school-aged children in kindergarten through 6th grade (age 5-12)
Public health programs, private insurance companies and state and federal regulatory bodies use evaluation data to...
Establish reimbursement guidelines and policies, determine reimbursable services, develop policies and professional standards
What statement is true about the COSA's reliability and validity?
The COSA is reliable and valid
The raw scores for the QNST-3 are calculated using what?
The number of mistakes made during each task
What statement is true about the purpose of the QNST-3?
The purpose of the QNST-3R is to quantify sensory processing, motor processing, and motor control difficulties; & may be used to screen for neurological soft signs
Peer reviewed journals require that manuscripts undergo a process of evaluation by experts in the discipline
True
When documenting the results of an assessment, the occupational therapist should use past tense to describe actions of the client
True
When neither quantitative nor qualitative research evidence is available to support practice, the therapist should...
Use individual practice data as support for subsequent decisions
Which of the following areas of the OTPF is NOT addressed during the Purdue Pegboard assessment?
Values
What does the Beery VMI test?
Visual perception and motor coordination
What does the Test of Visual-Motor Skills assess?
Visual, motor, and written skills
What area of the OTPF is NOT addressed in PEGS?
Work
The Purdue Pegboard test is...
a rectangular board with 2 sets of 25 holes running vertically and 4 concave cups at the top
A positive correlation between two measures suggests that
if the client scores well on one test, he is likely to score well on the other
There are a few target populations the KELS work best for. Which of the following is one of them?
people with acquired brain injury
All of the following are areas assessed by the KELS except:
play participation