FOI SU: 6

To evaluate a learner's ability to use critical thinking skills in performing real-world tasks, which assessment method is most appropriate? A. Authentic. B. Supply-type. C. Learner-centered.

Authentic.

Which of the following assessment types focuses on real-world tasks? A. Traditional. B. Formal. C. Authentic.

Authentic.

When conducting an oral assessment, which of the following is an example of a type of question to avoid? A. What is the first step in conducting a preflight? B. What do you do before beginning a flight? c. How do you check for correct tire pressure?

What do you do before beginning a flight?

Which is the main disadvantage of supply-type test items? A. They cannot be graded with uniformity. B. They are readily answered by guessing. C. They are easily adapted to statistical analysis

They cannot be graded with uniformity.

What is true of traditional assessments? A. They require the learner to demonstrate meaningful application of skills. B. They evaluate a learner's progress at a rote level of learning. C. There are multiple correct responses in traditional assessments.

They evaluate a learner's progress at a rote level of learning.

What is true of irrelevant questions? A. They are too broad in scope and could have multiple correct responses. B. They change the learner's focus from the message to the messenger. C. They introduce unrelated facts and slow learner progress.

They introduce unrelated facts and slow learner progress.

The most important consideration in test evaluation is what? A. Usability. B. Validity. C. Comprehensiveness.

Validity.

Which type test is desirable for evaluating training that involves an operation, procedure, or process? A. Oral. B. Performance. C. Proficiency.

Performance.

Which is a valid reason for the use of proper oral quizzing during a lesson? A. Promotes active learner participation. B. Identifies points that need less emphasis. C. Help the instructor determine the general intelligence level of the learners.

Promotes active learner participation.

What step in the learner-centered assessment process helps the learner relate the lessons learned to other experiences? A. Redirect. B. Replay. C. Reconstruct.

Redirect.

What are the four steps in the learner-centered assessment process? A. Replay, reconstruct, redesign, redirect. B. Replay, reconstruct, reflect, redirect. C. Replay, repeat, reflect, redirect.

Replay, reconstruct, reflect, redirect.

The primary advantage of supply-type testing is that A. it can be graded quickly. B. the learner is required to organize knowledge. C. it can be graded with an answer key.

the learner is required to organize knowledge.

The process of gathering measurable information to meet evaluation needs of a learner is known as what? A. Critique. B. Assessment. C. Appraisal.

Assessment.

Which statement is true about instructors' assessment? A. Instructors should rely on their personality to make an assessment more acceptable B. A comprehensive assessment should emphasize positive aspects of learner performance C Before learners willingly accept their instructor's assessment they must first accept the instructor.

Before learners willingly accept their instructor's assessment they must first accept the instructor.

Which statement is true regarding an assessment that is constructive? A. An instructor's manner and attitude make an assessment constructive. B. Constructive assessments can inspire a learner to improve in areas of lesser accomplishment. C. A constructive assessment should express ideas with authority in terms that cannot be misunderstood.

Constructive assessments can inspire a learner to improve in areas of lesser accomplishment.

Which statement is true regarding learner evaluation? A. The learner's own evaluations can only be objective. B. Evaluation of the learner's learning should be an integral part of each lesson. C. If deficiencies or faults not associated with the present lesson are revealed, they should be corrected immediately.

Evaluation of the learner's learning should be an integral part of each lesson.

Instructors must be aware of the fact that A. FAA Practical Test Standards (PTS) books are testing documents only. B. FAA Practical Test Standards (PTS) books · should be introduced early in training and used as a measuring stick for learner performance and progress. C. FAA Practical Test Standards (PTS) books should be introduced 6 hours prior to the practical test.

FAA Practical Test Standards (PTS) books are testing documents only.

During oral quizzing, which type of questions should an instructor expect a learner to answer based on memory or recall? A. Trick questions. B. Fact questions. C. HOTS (higher order thinking skills) questions.

Fact questions.

Which of the following statements is true? A. Instructor critiques should focus on only positive areas of the learner's performance. B. Instructor critiques should only focus on areas where the learner needs to improve. C. For an instructor's critique to be effective, the learner must first accept the instructor.

For an instructor's critique to be effective, the learner must first accept the instructor.

With regards to oral quizzing, which type of question requires the learner to combine knowledge with the ability to analyze, solve problems, and arrive at conclusions? A. Fact questions. B. HOTS questions. C. Provocative questions.

HOTS questions.

Proper oral quizzing by the instructor during a lesson can have which result? A. Alerts the instructor to the level of learner motivation B. Identifies points which need more emphasis C. Can serve as a lead-in to introduce new material.

Identifies points which need more emphasis

Which of the following is not a type of critique? A. Written critique. B. Instructor-absence critique. C. Individual learner critique by another learner.

Instructor-absence critique.

Which is one of the major difficulties encountered in the construction of multiple-choice test items? A. Adapting the items to statistical item analysis. B. Keeping all responses approximately equal in length. C. Inventing distractors which will be attractive to learners lacking knowledge or understanding.

Inventing distractors which will be attractive to learners lacking knowledge or understanding.

What is a characteristic of a learner-centered assessment? A. It is conducted jointly between the learner and the instructor. B. The learner is not directly involved in the assessment until reaching a specific level. C. The instructor provides the assessment directly to the learner.

It is conducted jointly between the learner and the instructor.

Which is true about an instructor's assessment of a learner's performance? A. Praise for praise's sake is of value. B. It should be constructive and objective. C. It should treat every aspect of the performance in detail.

It should be constructive and objective.

Which statement is true relative to effective multiple choice test items? A. Negative words or phrases need not be emphasized B. Items should call for abstract background knowledge C. Keep all alternatives of approximately equal length

Keep all alternatives of approximately equal length

What grading dimension or level has a learner reached when they correctly gather information, identify proper courses of action, evaluate risk, and make an appropriate decision without instructor input? A. Explain. B. Practice. C. Manage-Decide.

Manage-Decide.

In a written test, which type of selection-type test items reduces the probability of guessing correct responses? A. Essay. B. Matching. C. Multiple-choice.

Matching.

When taking a written test, what selection-type test items reduce the probability of guessing correct responses? A. Multiple choice. B. Matching. C. True-false.

Matching.

Which statement is true about multiple-choice test items that are intended to measure achievement at a higher level of learning? A. It is unethical to mislead learners into selecting an incorrect alternative. B. Some or all of the alternatives should be acceptable, but only one should be clearly better than the others. C. The use of common errors as distracting alternatives to divert the learner from the correct response is ineffective and invalid

Some or all of the alternatives should be acceptable, but only one should be clearly better than the others.

How should an instructor critique a learner? A. The critique should be conducted in public to promote peer feedback and a group learning experience. B. The critique should vary in content as necessary to accommodate the performance being evaluated. C. The critique should be delivered verbally with a focus on exemplary performance.

The critique should vary in content as necessary to accommodate the performance being evaluated.

What must an instructor do to ensure an assessment is thoughtful? A. The instructor must not minimize the importance and dignity of the individual. B. The instructor must give positive guidance when identifying a learner's mistakes. C. The instructor must limit negative comments that discourage.

The instructor must not minimize the importance and dignity of the individual.

What is a benefit of a written critique? A. The learner will have a permanent record of suggestions. B. Learners get to work together, thus sharing ideas. C. The written critique is always positive.

The learner will have a permanent record of suggestions.

What is a characteristic of supply-type test items? A. They are easily adapted to testing knowledge of facts and details. B. Test results would be graded the same regardless of the learner or the grader. C. The same test graded by different instructors would probably be given different scores.

The same test graded by different instructors would probably be given different scores.

Which part of a multiple-choice test includes the question, statement, or problem? A. The response. B. The root. C. The stem.

The stem.

Which type of assessment is more beneficial during the early stages of training? A. Learner-centered assessments. B. Traditional assessments. C. Authentic assessments.

Traditional assessments.

Using double negatives is an example of which type of question that should be avoided? A. Irrelevant questions. B. Oversize questions. C. Trick questions.

Trick questions.

Which type of test item creates the greatest probability of guessing? A. True/false. B. Supply-type. C. Multiple-choice.

True/false.

An instructor's critique of a learner's performance should be A. as varied in content as the performance being evaluated. B. an opportunity for an instructor to be critical of a learner's performance. C. always conducted in private.

as varied in content as the performance being evaluated.

During oral quizzing in a given lesson, effective questions should A. be brief and concise. B. provide answers that can be expressed in a variety of ways. C. divert the learner's thoughts to subjects covered in previous lessons.

be brief and concise.

To be effective, an assessment should A. not contain negative remarks. B. treat every aspect of the performance in detail. c. be flexible enough to satisfy the requirements of the moment.

be flexible enough to satisfy the requirements of the moment.

For oral quizzing to be effective during a lesson a question should A. be limited to who, what, when, where why or how, not a combination. B. include a combination of where, how, and why. C. be easy for the learner at that particular stage of training.

be limited to who, what, when, where why or how, not a combination.

To be effective in oral quizzing during the conduct of a lesson, a question should A. be of suitable difficulty for that stage of training. B. include a combination of where, how, and why. C. divert the learner's thoughts to subjects covered in other lessons.

be of suitable difficulty for that stage of training.

In all quizzing as a portion of the Instruction process, the questions should A. include catch questions to develop the learner's perceptive power. B. call for specific answers and be readily evaluated by the instructor. c. include questions with more than one central idea to evaluate how completely a learner understands the subject.

call for specific answers and be readily evaluated by the instructor.

To answer a learner's question, it is most important that the instructor A. clearly understand the question. B. have complete knowledge of the subject. C. introduce more complicated information to partially answer the question, if necessary.

clearly understand the question.

When an instructor critiques a learner It should always be A. done in private. B. subjective rather than objective. C. conducted immediately after the learner's performance.

conducted immediately after the learner's performance.

The FAA Practical Test Standards A. should be used as a primary training tool. B. contain tasks in addition to those presented in 14 CFR Part 61. C. contain testing standards only.

contain tasks in addition to those presented in 14 CFR Part 61.

A pretest constructed to measure knowledge and skills necessary to begin a course is referred to as a A. virtual-reality test. B. evaluation-referenced. C. criterion-referenced test.

criterion-referenced test.

Performance-based objectives are a distinguishable characteristic of A. formative assessments. B. subjective grading. c. criterion-referenced testing.

criterion-referenced testing.

FAA practical Test Standards are A. criterion-referenced. B. diagnostic-assessed. c. formative-assessed.

criterion-referenced.

Practical tests for pilot certification are A. evaluation-referenced. B. selection type tests. C. criterion-referenced.

criterion-referenced.

A written test that is objective A. distinguishes the differences between learners. B. measures what is supposed to be measured. C. describes the singleness of scoring a test.

describes the singleness of scoring a test.

The characteristic of a written test, which measures small differences in achievement between learners, is its A. validity. B. reliability. C. discrimination.

discrimination.

A written test having the characteristic of discrimination will A. be easy to give and be easily graded. B. distinguish between learners both low and high in achievement. C. include a representative and comprehensive sampling of the course objectives.

distinguish between learners both low and high in achievement.

The Practical Test Standards should be used in A. flight training and testing. B. flight training only. c. testing only.

flight training and testing.

Comprehensiveness is the degree to which a test A. measures the overall objectives. B. consists of an appropriate mix of easy, medium, and difficult questions. C. includes multiple-choice, essay and true/false questions.

measures the overall objectives.

A written test has validity when it A. yields consistent results. B. samples liberally whatever is being measured. C. measures what it is supposed to measure.

measures what it is supposed to measure.

Evaluation of learner performance and accomplishment during a lesson should be based on A. objectives and goals established in the lesson plan. B. performance of each learner compared to an objective standard. C. each learner's ability to make an objective evaluation of their own progress.

objectives and goals established in the lesson plan.

Criterion-based assessment items would most likely be part of A. performance-based tests. B. multiple choice tests. c. oral quizzing.

performance-based tests.

An instructor's assessment of a learner's performance should A. treat every aspect of the performance in detail. B. be conducted in private so that the learner is not embarrassed. C. provide direction and guidance to improve performance.

provide direction and guidance to improve performance.

The purpose of a critique is to A. identify only the learner's faults and weaknesses. B. give a delayed evaluation of the learner's performance. C. provide direction and guidance to raise the level of the learner's performance.

provide direction and guidance to raise the level of the learner's performance.

One desirable result of proper oral quizzing by the instructor is to A. reveal the effectiveness of the instructor's training procedures. B. fulfill the requirements set forth in the overall objectives of the course. C. reveal the essential information from which the learner can determine progress.

reveal the effectiveness of the instructor's training procedures.

The objective of the Airman Certification Standards (ACS) is to ensure the certification of pilots at a high level of performance and proficiency, consistent with A. the time available. B. safety. C. their abilities.

safety.

A written test is said to be comprehensive when it A. includes all levels of difficulty. B. samples liberally whatever is being measured. C. measures knowledge of the same topic in many different ways.

samples liberally whatever is being measured.

When a learner performs a maneuver correctly but the instructor suspects the learner does not fully understand the principles and objectives involved the instructor should A. defer on the matter to avoid lowering learner confidence. B. point out the suspected flaw to the learner. C. vary the performance of the maneuver slightly.

vary the performance of the maneuver slightly.

One of the main advantages of selection-type test items over supply-type test items is that the selection-type A. decreases discrimination between responses. B. would be graded objectively regardless of the learner or the grader. C. precludes comparison of learners under one instructor with those under another instructor.

would be graded objectively regardless of the learner or the grader.

A written test that has reliability A. yields consistent results. B. measures small differences in the achievement of learners. C. actually measures what it is supposed to measure and nothing else.

yields consistent results.