Exam 1- Education
What type of education opportunities are available?
- Educ. courses: PACE, ASCP - College course - Teleconferences - Advanced BOC certification - Research - On site inspector - Authorizing book
Errors with rating scales
- Leniency - Central tendency - Halo effect - Contrast error - Proximity error
When to use Multiple choice questions?
- application - synthesis - analysis - evaluation
What are Short answer questions good for?
- application, synthesis, analysis & evaluation levels
Advantages of True/False
- can test large amounts of content - can answer 3-4 question per min -easy to grade
Disadvantages of Multiple choice
- difficult to construct - difficult to come up with plausible distractors - tendency to test using lower level questions
Disadvantages of True/False
- difficult to construct - encourages guessing - tests at lower cognitive levels
Advantages of Short answers
- easy to contruct - good for testing higher cognitive levels - minimizes guessing - encourages more intensive study
What are Matching questions good for?
- knowledge level - some comprehension level
What are True/False questions good for?
- knowledge level content - evaluating student understanding of popular misconceptions - concepts with 2 logical responses
Advantages of Matching
- max coverage at knowledge level in a minimum amount of space - valuable in content areas that have a lot of facts
Disadvantages of Short answers
- may overemphasize memorization of facts - lack of objectivity in grading - time consuming to grade
What is the certification maintenance plan (CMP)?
- must be completed every 3 years - earn 36 points (CREs) 2 in each domin 1 in Saftey
Rating scales should contain
- objective - explanation of rating - non-applicable column - comments - instructor signature - student signature
Disadvantages of Matching
- time consuming - encourages memorization - test at lower cognitive level
Advantages of Multiple choice
- very effective - versatile at all levels - guessing reduced - covers broad range of content
What is the ideal discrimination index?
.4
Alternatives
A choice limited to one of two possibilities, as of things, propositions, or coursed of action.
Discrimination index
A statistic that compares the performance of those who made very high test scores with the performance of those who made very low test scores on each item.
Objectives should have what 4 things?
A- audience B- behavior (verbs) C- condition D- degree
What agencies provide certifications?
ACSP & ASCLS
Affective Level 1 verbs
Accept, attend, comply, cooperate, examine
Affective Level 3 verbs
Advocate, alter, choose, defend, influence, verify
What is the taxonomic level and domain of the following, "Adhere to the hospitals polices on dress code, attendance and processional conduct."
Affective level 1
What is the taxonomic level and domain of the following, "Suggest an effective approach to deal with a situation in which a fellow laboratory employee is observes using the laboratory information system for unauthorized access to patient data."
Affective level 3
Psychomotor Level 3 verbs
Alter, arrange, change, combine, compose, design, create, reorganize
Cognitive Level 3 verbs
Analyze, assess, choose, contrast, compare, create, differentiate
Psychomotor Level 1 verbs
Assemble, prepare, proceed, respond, select, start
Affective Level 2 verbs
Assist, demonstrate, defend, support, share
Identify what component is missing (A,B,C,D), "Using the 2-headed scope, the students will achieve 100% accuracy."
B
Identify what component is missing (A,B,C,D), " The students are to calculate the amount of gases in the specimen with 100% accuracy."
C
Cognitive Level 2 verbs
Calculate, convert, discuss, explain, use
Psychomotor Level 2 verbs
Calibrate, manipulate, measure, operate, perform, practice
What states require licensures?
California, FL, Georgia,HI, LA, NY, TN PR
How is a Certification different from a Licensure?
Certification: recognized by a non-governmental organization/agency Licensure: gov. agency grants individual who has met certain req. for the right to work in a particular occupation
What is the taxonomic level and domain of the following, "State the reference ranges for the routine chemistry and hematology tests."
Cognitive level 1
What is the taxonomic level and domain of the following, "Given the results of an antibody identification panel, identify the antibody that is present."
Cognitive level 2
What is the taxonomic level and domain of the following, "Explain the clinical significance of cholesterol and triglyceride test results in terms that would be understood by the general public."
Cognitive level 3
What is the accreditation for Laboratories?
College of American Pathologist (CAP)
Identify what component is missing (A,B,C,D), "After incubating the specimen, the students will centrifuge the tubes to determine the presence of or degree of hemolysis."
D
Identify what component is missing (A,B,C,D), "Following the staining of the blood smears the students will perform differentials."
D
Identify what component is missing (A,B,C,D), "The student will perform the new procedure."
D
Cognitive Level 1 verbs
Define, describe, identify, label, name, state
Discrimination index ranks
Good: .3-.39 Marginal: .2-.29 Bad: less than .19
criterion-referenced test
Individual's performance is measured against mastery of curriculum criteria rather than other students (asses mastery by achieving predetermined minimal competencies)
What is the accreditation for hospitals?
Joint Commission on Accreditation of Healthcare Organizations (JCAHO)
Affective(values/attitude)
Level 1: Receiving/ Responding(awareness) Level 2: Valuing Level3: Organization/characterization(Commitment)
Cognitive (intellectual learning)
Level 1: knowledge/ comprehension/recall Level 2:Application Level 3: analysis(prob. solving)/ synthesis/ evaluation
Psychomotor (neuromuscular coordination)
Level 1: perception/set(Readiness) Level 2: guided response/mechanism/Complex overt response (Proficiency) Level 3: Adaptation/ origination
what is the accreditation of CLS/MLS programs?
National Accrediting Agency for Clinical Laboratories Science (NAACLS)
what are overt verbs?
Performance that is directly observable through vision or audition ex. explain, describe, judge, advocate
What is the taxonomic level and domain of the following, "Given a patient's serum sample, prepare a 1:2 dilution."
Psychomotor level 2
What are the parts to a multiple choice question?
Stem & Options
What does the D (degree) in objectives mean?
a criterion by which the performance is evaluated
Stem
asks a questions, gives an incomplete statement, states an issue, or describes a situation
What is a good difficulty index?
b/w 60-80% *over 80 to easy * less than 60 to hard
Options
best answer(only one), distractors, should be reasonable to the student who has partial, incomplete, or inappropriate knowledge
Norm-referenced tests
compares the individual students achievements to that achieved by the member in his/her class
What does a 0 discrimination index mean?
correct response was chosen equally between high and low achievers
Error of central tendency
evaluator hesitates to give high or low rating therefore give an average rating
Proximity error
evaluator may tend to rate traits that are placed next to one another on the rating scale form in a similar fashion
leniency error
evaluator's rating is higher than it should be
Contrast error
evaluators contrast the trait in themselves and in the student
Halo effect
evaluators influences others on their judgement
What is a Checklist?
list of statements describing the behaviors that comprise a particular task or procedure *no judgement on performance just state whether action occurred or not
What is Rating scales?
list of traits along with a scale that allowed the evaluator to indicate the degree to which the student or practitioner has demonstrated that trait *use to assess traits
What is accreditation?
measures quality of healthcare organizations & approves them to operate
what are covert verbs?
not openly shown, engaged in such as thinking, reasoning, dreaming, retrieving memories Ex. know, consider, understand, appreciate
What is American Society of Clinical Pathologist (ASCP)?
organization concerned with the education and training of students
What is American Society of Clinical Laboratory Scientists (ASCLS)?
organization that focuses on educational issues and those of a political nature affecting both quality of education and laboratory performance
What verbs are usually used in objectives?
overt verbs
Difficulty index
percent of test takers selecting the correct answer on a particular item
What does C (condition) in objectives mean?
state the condition you will impose when the learners are demonstrating mastery of objectives
What does a negative discrimination index mean?
the question should be revised or discarded *low achievers are getting right and high achievers get wrong
What is Anecdotal records?
written description of an individual's behavior over a brief period of time
Distractors
wrong answers offered as choices in a multiple choice item *sounds reasonable
