Validity

Decision validity or accuracy

Accuracy of a test in classifying people as proficient or nonproficient

Validity Situation:Activity assessment (exercise mode). What's evaluated? What's decided?

Appropriate for bone health, muscle strength, flexibility. Prescription? Intervention?

Criterion Referenced validity coefficient

C=(A+D)/(A+B+C+D)

Validity Situation: Fitness test (job-specific). What's evaluated? What's decided?

Can you perform your job? Hiring, promotion

Validity Situation: Fitness test (function). What's evaluated? What's decided?

Capable of independence. Institutionalization

A 8 RM strength test for quads was developed. To assess the validity, you compare the results of 8 RM test to a 1 RM test. What type of validity is this?

Criterion Referenced

Statistical CRT validity

Decision validity or accuracy

Two approaches to CRT validity

Logical and Statistical

Decision Validity

Must be able to classify people are either true masters or true nonmasters (contingency table is used)

Expert Ratings are

Subjective scores by one or more judges, either by point or group ratings

Content validity evidence is what kind of approach?

The logical approach

The validity coefficient for determining if someone is a master of something is 085. Does the test accurately classify them?

Yes, C= >0.80 is a master

Evidence of content validity is the extent to which...

a test measures the most important components of skill necessary to perform a motor task adequately

Tournament standings

assumes tournament standing is a good indicator of overall ability in the tested skill.

Concurrent validity evidence criterion is measured

at about the same point in time

Criterion related validity is demonstrated

by correlating the test of the construct with a criterion measure of that construct

Example of decision validity or accuracy

cardiovascular fitness

Evidence of content validity is a

concept of content validity that was developed for physical tests in the field of exercise science.

Two types of criterion related evidence

concurrent and predictive

Predetermined Criteria is the

criterion measure recognized as the "gold standard." correlations and regression equations are often used to establish evidence of concurrent validity

Define Validity

degree to which the inferences (conclusions/evaluations) we make from specific measures are appropriate

Values of C= >0.80 are

desirable

Content validity evidence is used to...

determine a person's knowledge of the construct.

Logical CRT validity

domain referenced validity

Criterion measurements typically come from....

expert judges, tournament standings, known valid tests

Tournament standings are often used with....

individual or dual activity (tennis, badminton, etc.)

What gets validated ?

inferences

Sum up Content Validity-

logical, will the items measure the construct of interest?

Sum up Construct Validity-

measures abstract constructs (ex: attitudes, beliefs, self-efficacy)

Validity Situation: Fitness test (body comp). What's evaluated? What's decided?

obese or not. diet/exercise or intervention required.

Validation is the process of...

obtaining evidence to demonstrate that inferences made from test scores are appropriate and meaningful.

predetermined criterion measures are.....

scores from an accepted instrument.

Validity is ___________ specific

situation

Expert ratings are commonly used with....

skill set tests, where the scores from the tests are correlated with scores from the judges

Predictive validity evidence criterion is measured

some time in the future

Criterion Referenced Test (CRT) Validity

test with a predetermined standard used to classify people as proficient or nonproficient

Validity means that ...

that the inferences or conclusions from a test are correct

Domain referenced validity

the behavior the test is designed to measure. test is logically validated by showing the tasks adequately represents the domain

Construct

the characteristic we want to measure (aerobic fitness, upper body strength, PA, body comp, self-efficacy)

Evidence of validity is judged based on....

the intended use of the data. should come from various sources, gives us confidence in choice of measurement

Construct validity is based on...

the scientific method. judge extent to theoretical and statistical info supports the constructs

Known valid tests are usually used...

to develop a quicker/easier test than criterion measure.

Sum up Criterion Referenced Validity-

validity used to substitute one test for another (ex: 3 min step test vs VO2 max)

When Concurrent validity evidence used?

when a test is proposed as a substitute for the criterion measure. selection of criterion is a crucial step.

Predictive validity evidence is used when?

when you want to predict the criterion measure some time in the future.

The term "content validity" is used with...

written knowledge tests

When C=0.50 then validity is

zero