Quantitative research REC 359 final

What is a pilot test?

A pilot study is a standard scientific tool for 'soft' research, allowing scientists to conduct a preliminary analysis before committing to a full-blown study or experiment.

How does a researcher establish validity?

As a process, validation involves collecting and analyzing data to assess the accuracy of an instrument. There are numerous statistical tests and measures to assess the validity of quantitative instruments, which generally involves pilot testing

Know how to establish face and content validity

Face validity is the extent to which a test is subjectively viewed as covering the concept it purports to measure. It refers to the transparency or relevance of a test as it appears to test participants. Content validity refers to the appropriateness of the content of an instrument. In other words, do the measures (questions, observation logs, etc.) accurately assess what you want to know?

What are some difficulties with validity? Be able to cite examples

It is rare, if nearly impossible, that an instrument be 100% valid, so validity is generally measured in degrees

Be able to define and explain: judgmental validity, empirical validity, face validity, content validity, construct validity, predictors, constructs

Judgmental validity is based upon professional judgment on the appropriateness of a measurement or instrument. There are two principle forms of judgmental validity: face validity and content validity. Empirical validity (or criterion related validity) is the use of data, evidence, to see if a measure (operational definition) yields scores that agree with a direct measure of performance. Construct validity is "the degree to which a test measures what it claims, or purports, to be measuring." In the classical model of validity, construct validity is one of three main types of validity evidence, alongside content validity and criterion validity.

What does it mean for an instrument to be "reliable" in quantitative research?

Reliability can be thought of as consistency. Does the instrument consistently measure what it is intended to measure?

What does it mean for an instrument to be "valid" in quantitative research?

Validity is the extent to which an instrument measures what it is supposed to measure and performs as it is designed to perform

What is more important reliability or validity? Why?

validity is more important than reliability.

instrument

"A device used to determine the present value of quantity under measurement".