Fire Instructor III Chapters 15-17
Which of the following determine how well a program is meeting its current objectives? (page 396) A. Goal-based evaluations B. Course-based evaluations C. Process-based evaluations D. Outcome-based evaluations
A. Goal-based evaluations
What is the primary purpose of analyzing test results? A. Make test questions more/less difficult B. Ensure new content is covered correctly C. Improve the teaching/learning process D. Determine if learning objectives are being met
C. Improve the teaching/learning process
Which of the following are based on a numeric or statistical analysis? A. Process-based evaluations B. Outcome-based evaluations C. Qualitative evaluations D. Quantitative evaluations
D. Quantitative evaluations
Which of the following can gather evidence during individual classes during a course? A. Performance evaluations B. Instructors' observations C. Student learning surveys D. Retrospective evaluations
B. Instructors' observations
The result of a ______ identifies items that may need altering or restructuring to make them more easily understood. A. needs analysis B. test analysis C. distractor analysis D. task analysis
B. test analysis
Which of the following defines the needs of the organization and allows manufacturers to decide whether they can meet purchasing specifications? A. Needs analysis B. Incident action plan (IAP) C. Request for proposals (RFP) D. Budgetary approval
C. Request for proposals
When selecting instructional staff, a Level III Instructor should determine the instructor's roles in the organization and the: A. acceptable level of student success B. facility scheduling C. qualifications they need to teach D. courses taught
C. qualifications they need to teach
Which of the following are a more complete and honest critique of the material presented to the student? A. Course surveys B. Instructor surveys C. Supervisor surveys D. Student learning surveys
D. Student learning surveys
What is the difference between course and curriculum goals? A. Course goals contain students performance and conditions B. Curriculum goals apply to a number of courses C. Curse goals only involve learning objectives D. Curriculum goals contain student performances
B. Curriculum goals apply to a number of courses
What is the first step a Level III Instructor should do after reviewing the evaluations? A. Determine areas for improvement B. Identify actions to correct deficiencies C. Evaluate the students again D. Document and report results as appropriate
A. Determine areas for improvement
Which evaluation assess the achievements or outcomes of the program? A. instructional designs B. organizational C. course D. retrospective
D. retrospective
Which of the following is analyzed by an instructor to determine needs in the areas of knowledge, skills, and attitudes? A. Peer review feedback B. Student feedback C. Grant proposal D. Training record
D. Training record
Which of the following is a function of a needs analysis? A. Defining new levels of knowledge and skill B. Identifying a method to achieve desired levels of knowledge C. Identifying special needs students D. Experimenting to fix problem areas
B. Identifying a method to achieve desired levels of knowledge
The cost of creating a curriculum should be compared to" A. Purchasing an existing curriculum B. Salary and experience of the developer C. Contributions of content experts D. Time it took to prepare the curriculum
A. Purchasing an existing curriculum
Which of the following occur when the intent of the evaluation is to assess the achievement or outcomes of the program? A. Retrospective evaluations B. Instructional design evaluations C. Organizational evaluations D. Supervisor evaluations
A. Retrospective evaluations
Which of the following provides the opportunity for personnel to ask questions and gain clarification regarding a new policy, procedure or guideline? A. Online advertising B. Job description C. Face-to-face meeting D. Student interviews
C. Face-to-face meetings
Which of the following is a simple proportion of how many students in a class or training group selected the correct answer? A. Difficulty index B. Distracter analysis C. Discrimination index D. Development level
A. Difficulty index
Which of the following are records that can be released without authorization? A. Instructional materials B. Medical documents C. Student test record D. Personnel records
A. Instructional materials
Which of the following is a method of qualitative evaluation? A. Instructor observations B. Student evaluations C. Close-ended questions D. Skill performances
A. Instructor observations
Who identifies and addresses agency needs projected for the future? A. Level III Instructor B. State training manager C. Company officer D. Level II Instructor
A. Level III Instructor
Who should schedule meetings at an appropriate interval to allow those attending the meetings the time needed to perform their duties? A. Level III Instructor B. Administrative assistant C. State training manager D. Program manager
A. Level III Instructor
Which of the following are intended to compare a mission statement with its output? A. Organizational evaluations B. Instructional design evaluations C. Retrospective evaluations D Supervisor evaluations
A. Organizational evaluatons
Scheduling and announcing the course or curriculum should be done before: A. Selecting students B. Scheduling facilities and equipment C. Selecting an instructor D. Assembling training aids
A. Selecting students
Instructors should establish both the skills/knowledge that are prerequisite for the students to take a course and that: A. students must master during a course B. instructors must perform during the course C. instructors must master during the course D. students must perform during the course
A. Students must master during the course
Qualitative evaluation is a (an)_______form of evaluation. A. Subjective B. goal-based C. results-based D. objective
A. Subjective
Which of the following is a detailed review of each job that is performed as part of a certain skill or set of job functions? A. Task analysis B. Needs analysis C. Test result analysis D. Distractor analysis
A. Task analysis
Adopting a standard gives it formal authority in the organization and allows the training manager to: A. enforce the requirements set forth in the standard B. adopt rules to the needs of an incident C. revise existing policies pertaining to training D. make employment decisions for the organization
A. enforce the requirements set forth in the standard
Validity refers to the measurement of mastery or nonmastery by a student as compared against the: A. established learning objectives B. standard operating procedures C. new requirements D. previous overall results
A. established learning objectives
Which of the following collectively contribute to achieving the course goal? A. Learning objectives B. Performance evaluations C. Conditions and standards D. Student performances
A. learning objectives
Distracters that are not selected by any test takers: A. need revision B. can be left alone C. indicate that students are learning information D. indicate that instructors are not doing a good job
A. need revision
Forms should have ______that are consistent with other training forms used by the organization. A. Names B. Lengths C. Fields D. Answers
C. Fields
When change is required, an organization must perform a needs analysis to determine: A. service level and capability differences in the new requirement B. student competency adjustments for the new conditions C. changes in textbook material and assignments D. instructor knowledge of all available instructors
A. service level and capability differences in the new requirement
Which of the following can be goal-based, process-based, or outcome-based? A. Company policy B. Evaluation model C. Capital purchasing process D. Budgetary document
B. Evaluation model
Which of the following determine how well a program is meeting its correct goals or objectives? A. Course-based evaluations B. Goal-based evaluations C. Process-based evaluations D. Outcome-based evaluations
B. Goal-based evaluations
Which of the following ensures that lesson plans can be developed around topic areas to meet the course goals? A. Using the lesson outline B. Grouping similar learning objectives C. Following textbook sections D. Teaching parts in given order
B. Grouping similar learning objectives
Which of the following identifies a general philosophy? A. Policy B. Guideline C. Procedure D. Goal
B. Guideline
During which step of the four-step development model does an instructor perform a needs analysis? A. Design a course or curriculum B. Identify training needs C. Implement the course or curriculum D. Evaluate the course or curriculum
B. Identify training needs
Who should have input into the assessment of teaching and learning materials? A. Instructors and their teaching assistants B. Instructors and students C. Local jurisdiction and supervisors D. Only supervisors and Level II instructors
B. Instructors and students
With what should a Level III Instructor maintain familiarity in regards to laws that apply to the supeonaing of documents for use in legal cases? A. International diplomacy B. Local and state/provincial laws C. National trends D. Regional developments
B. Local and state/provincial laws
Which of the following is an example of performance measurement? A. Cost per unit hour for training B. Number of training injuries per year C. Customer approval ratings while talking to students D. Percentage of students that do not complete recruit academies
B. Number of training injuries per year (401)
What should an instructor use to create a course or curriculum? A. Task analysis B. Planning model C. Evaluation form D. Standard operating procedures
B. Planning model
When may a needs analysis identify other agencies that can provide training facilities, mutual aid, and equipment? A. When determining what standards to use B. When funding does not exist to acquire resources C. When justifying agency actions D. When hiring new instructors for training
B. When funding does not exist to acquire resources
A needs analysis should determine how the current service level and capability: A. differ from neighboring jurisdictions B. differ from new requirements C. can be justified as meeting requirements D. differ from past service levels
B. differ from new requirements
The primary purpose of evaluation is to: A. determine the need for new instructors B. improve the teaching and learning process C. collect student outcome knowledge D. keep results and records of courses
B. improve the teaching and learning process
A request for proposal may also include: A. employment assistance program benefits B. language about evaluating equipment to be purchased C. personnel decisions about salary and hiring D. scheduling organizational dates for specific training
B. language about evaluating equipment to be purchased
If _____ indicate that the new requirements do not provide the necessary changes, it should be evaluated. A. new instructors B. observations C. opinions D. national trends
B. observations
Forms should have fields that are consistent with: A. national training standards B. other training forms used by the organization c. other emergency services D. local and state mandates
B. other training forms used by the organization
Before implementation of a course or curriculum, instructors: A. perform a spot summative evaluation B. perform a detailed formative evaluation C. ask other jurisdictions to test the program D. hire a committee to critique the program
B. perform a detailed formative evaluation
Which of the following is the last step to identify need? A. Establish a revision process B. Recommend the policy C. Conduct the evaluation D. Select alternative responses
B. recommend the policy
Customer approval ratings (CARs) taken from course evaluations are an example of: A. Instructor designed evaluations B. Performance measurements C. Student learning surveys D. Observations of instructors
B.Performance measurements
Curriculum goals are similar to course goals EXCEPT that they: A. Do NOT contain student performance or conditions B. Only affect the instructor teaching the course C. Apply to a number of courses collectively D. Only relate to standard operating procedures
C. Apply to a number of courses collectively
What should an instructor do after obtaining final course approval when implementing a course? (page 385) A. Select qualified instructors B. Schedule facilities and equipment C. Assemble training aids and materials D. Establish appropriate training records systems
C. Assemble training aids and materials
Which of the following things should require password protected computer security to limit access to authorized personnel? A. Computer file B. Dual-record C. Automated D. Manual
C. Automated
Which of the following begins with performing research about the capital resource in question? A. Purchasing specification B. Review of industry trend C. Bid process D. Product comparison
C. Bid process
Where must Level III Instructors advertise the position to prospective candidates? A. Only within the jurisdiction B. Only within the organization C. Both inside and outside the organization D. Only outside the organization
C. Both inside and outside the organization
Which of the following is used MOST for test-result analysis? A. Digital slide presentation B. Graph C. Computer software D. Chart
C. Computer software
Which of the following should an instructor do first when planning a revision? A. Determine the use of available equipment B. Determine if the revision meets local standards C. Determine if the revision is mission appropriate D. Determine if retraining is necessary
C. Determine if the revision is mission appropriate
The result of instructor evaluations may show the need for: A. Retraining in a particular area B. Teaching assistants for the course C. Enhanced instructor development D. Test item analysis
C. Enhanced instructor develpment
Which of the following may determine the need for revision of a course? A. Test and distractor analysis B. Student feedback on instructor C. Evaluation of training course D. Test results of students
C. Evaluation of training course
What is the first step of the personnel evaluation process? A. Developing a form B. Consulting student evaluation form records C. Meeting between Level III Instructor and the new staff D. Announcing to all personnel
C. Meeting between Level III Instructor and the new staff
What type of evidence do instructors gather during individual classes? (399) A. Performance B. Retrospective C. Observational D. Organizational
C. Observational
Which of the following evaluations may be completed by a third party, such as state boards of Emergency Medical Services or state agencies for public health? A. Retrospective B. Course C. Organizational D. Instructional design
C. Organizational
Which of the following identifies the steps that must be taken to fulfill the intent of a policy and is written to support a policy? A. Proposal B. Guideline C. Procedure D. Goal
C. Procedure
Which of the following is an element in a record keeping system? A. Grades B. Internet C. Procedures D. Students
C. Procedures
Which of the following determine how a process works in practice and highlights its strengths and weaknesses? (396) A. Goal-based evaluations B. Course-based evaluations C. Process-based evaluations D. Outcome-based evaluations
C. Process-based evaluations
Which of the following is one of Kirkpatrick's model? A. Preknowledge B. Assessment C. Reaction of students D. Comparison
C. Reaction of students
Which of the following encompasses a wide range of information organizing skills and results in the proper documentation of the policies and transactions of the organization? A. Organizaton of procedures B. Book keeping C. Record keeping D. Organization of policies
C. Record keeping
Which of the following are used to formulate training policies, mandate safe practices, or change procedures? A. Data collections forms B. Office organization systems C. Record keeping systems D. Committee quorums
C. Record keeping systems
Which of the following encompasses the overall effectiveness of the program? (398) A. Supervisor survey B. Student learning survey C. Retrospective evaluation D. Organizational evaluation
C. Retrospective evaluation
Which of the following is a key management function? A. Developing training schedules B. Scoring tests C. Selecting competent instructional staff D. Confirming the validity of standard operating procedures
C. Selecting competent instructional staff
Which of the following is constructed to assess how a student applies knowledge, skills or habits while on duty? A. Course survey B. Instructor survey C. Supervisor survey D. Student learning survey
C. Supervisor survey
Outcome based evaluations measure benefits that are created as a result of: A. The need for new instructors B. Students needing to take the course C. The program's existence D. Changes made in jurisdictional requirements
C. The program's existence
For policies to be effective, they must be: A. supported by state training directors B. approved by old and new instructors C. Supported by the organization's administration and training manager d. approved by the students in training
C. supported by the organization's administration and training manager
Learning objectives are based upon information gathered during: A. the needs analysis B. personnel evaluations C. the task analysis D. feedback evaluations
C. the task analysis
Personnel should be educated about new policies to: A. consider budget funding B. never question authority C. comply to changes D. follow orders as a given
C. comply to changes
After an Instructor III determines areas for improvement based on student outcomes, they should next: A. make decisions on money invested B. document and report results C. identify actions to correct deficiencies D. evaluate the student's again
C. identify actions to correct deficiencies
Which of the following is the first step after reviewing the evaluations? (402) A. Evaluate the students again B. Make decisions on money invested C. Identify actions to correct deficiencies D. Determine areas for improvement based on student outcomes
D. Determine areas for improvement based on student outcomes
A _____ signals to organizational personnel that the policy, procedure, or guideline has official sanction. A. Directive B. Mandate C. Accredidation D. Endorsement
D. Endorsement
What is the last step to submit a draft for review? A. Provide a comment period for the draft document B. Submit the draft document to organization's legal counsel\ C. Provide personnel an opportunity to respond with feedback D. Evaluate comments and amend the draft document
D. Evaluate comments and amend the draft document
Which of the following steps determines the effectiveness of the course or curriculum in meeting the requirements? A. Design a course of curriculum B. Identify training needs C. Implement the course or curriculum D. Evaluate the course of curriculum
D. Evaluate the course or curriculum
Which of the following contains the step-by-step process used by a jurisdiction? (397) A. Personnel survey B. Yearly budget C. Grant proposal D. Evaluation plan
D. Evaluation plan
Presentations regarding the needs analysis should be concise and informed by: A. Current events B. Public opinion polls C. Student evaluation forms D. Evidence from research
D. Evidence from research
The first step in the four-step development model is to: A. Evaluate the course or curriculum B. Implement the course or curriculum C Design a course or curriculum D. Identify training needs
D. Identify training needs
Which of the following are used when instructors need to eliminate instruction that is no longer needed? A. Retrospective evaluations B. Supervisor evaluations C. Organizational evaluations D. Instructional design evaluations
D. Instructional design evaluations
Who should determine the instructors role in the organization? A. State training manager B. Hiring committee C. The instructors themselves D. Level III instructor
D. Level III Instructor
Which of the following statements about low scores is MOST accurate? A. Low scores are indicative that students did not learn B. Low scores should be graded on a curve C. Low scores indicate that the test was too difficult D. Low scores could indicate that the test was not valid
D. Low scores could indicate that the test was not valid
Which of the following is a standard used to influence training? A. U.S. Fire Administration B. National Institute for Occupational Safety & Health (NIOSH) C. NFIRS D. NFPA
D. NFPA
What is the first step in implementing a course or curriculum? A. Selecting an instructor B. Assembling training materials C. Scheduling facilities and equipment D. Obtaining final course approval
D. Obtaining final course approval
Which of the following is often based on nonnumeric analysis? A. Qualitative evaluation B. Quantitative evaluation C. Process-based evaluation D. Outcome-based evaluation
D. Outcome-based evaluation
Which of the following focus on actual, measurable benefits that are created as a result of the program's existence? A. Goal-based evaluations B. Course-based evaluations C. Process-based evaluations D. Outcome-based evaluations
D. Outcome-based evaluations
Which of the following can be used to justify existing budgets and support the efficiency of the training division? A. Student learning surveys B. Instructors' observations C. Retrospective evaluations D. Performance measurements
D. Performance measurements
Which of the following should be used to create a course or curriculum? A. Standard Operating Procedure B. Evaluation form C. Task analysis D. Planning model
D. Planning model
What is the last step in implementing a course or curriculum? A. Select students B. Schedule facilities C. Announce course or curriculum D. Present a pilot version of course
D. Present a pilot version of course
Which of the following is the most often used model to understand what skills need to be included and taught in the course? A. Model-based B. Cause and effect C. Cognitive D. Sequential task-analysis
D. Sequential task-analysis
Which of the following are a method used to determine individual training needs? (page 376) A. Post tests B. Test score averages C. Personnel evaluations D. Skill level requirements
D. Skill level requirements
Periodic evaluations of all courses and curricula should be scheduled to determine: A. If instructors need additional training B. If the student material is still current C. Whether test and distractor analysis is necessary D. Whether they still meet the original needs of the organization
D. Whether they still meet the original needs of the organization
Documents must contain information that is: A. peer reviewed B. correct and appropriate C. direct and concise D. based on national standards
D. based on national standards
Instructors and students can perform a summative evaluation at the end of each course to determine whether the course met the: A. testing standard of other courses B. results from the feedback evaluations C. chages to the new requirements D. educational goals of the organization
D. educational goals of the organization
The standard containing each duty and its JPR's defines and describes the job, giving instructors and planners a (an): A. description of course objectives B. course goal for their curriculum C. basic outline for the lesson plan D. end point to design and teach curriculum
D. end point to design and teach curriculum
An instructor should be _______ by more experienced instructors with subject matter expertise. A. trained B. retrained C. replaced D. evaluated
D. evaluated
