D293 Pre-Assessment

Which statement is an example of an unethical practice that might occur when analyzing data about student pass/fail rates?

All researchers have access to personal information collected, even though it is not needed to reach conclusions.

How can learning analytics be used to encourage student success?

By developing student awareness to support self-reflection

Diagnostic Analytics

Analyzes past information to find out why something happened

Bloom's Taxonomy identifies three domains of learning. Which domain includes knowing?

Cognitive

Based on Live Data, tells what's happening in real time, accurate & handy, easy to visualize

Descriptive Analytics

A teacher assigns an essay during the first week of school to assess students' writing abilities. The teacher provides the following prompt: "Share what you did during summer vacation by describing one of the following: (1) a long-distance trip you took, (2) a fancy restaurant you visited, or (3) a major league sporting event you attended." How is this assessment biased?

It does not consider socioeconomic differences among the students.

Students in a hybrid class are given a link to an animated video that is composed of text on the screen and background music, so closed captions are not available. Students must watch the video and then write a short summary about the video's main points. Why is this assessment not equitable to all students?

Learners who cannot see will not be able to access the content.

A university learning experience designer wants to encourage students to take ownership of learning. What are two ways the designer can use learning analytics to achieve this goal?

Let students see how often and long classmates are accessing each learning resource in the course & provide students access to a program that tracks personal course progress.

On an online test, students are given a picture of a partially completed chart of the periodic table and asked to "fill in all of the missing element names." The blank spaces are numbered, and students are asked to type the name of the element next to the corresponding number on the chart. Students who cannot use the mouse are able to use keyboard controls to complete the test. Which POUR principle needs to be addressed in the above assessment scenario?

Perceivable

Bryan leads an HVAC company and wants to select a learning analytics type that will maximize the company's goals. What are two actions that Bryan must incorporate from the company's training practices to ensure the correct learning analytics type is chosen?

Pick a strategy and invest in resources and instruments & create a program that analyzes data solicited from trainees who completed the training program

A student on an academic scholarship that only covers a certain number of credit hours has signed up for a course not required for a degree. Scholarship students taking unnecessary courses is a repeated issue for the university, as it impacts students' ability to graduate on time and costs extra money. The university wants to eliminate the problem of students signing up for unneeded courses. The university can implement _________ analytics to correct this issue, so students can focus more time and effort on courses needed for graduation.

Predictive

Defines future actions, based on current data analytics, predefined future plans, goals, and objectives, recommends the best course of action

Prescriptive

A program director gathered data on how frequently instructors engaged with students on discussion boards. Which learning analytics technique should be used to analyze this data?

Quantitative analysis

In a web design class, students are assigned to visit a specific website provided by the instructor and write a paper analyzing the website's design. Some students are having trouble accessing the website because it does not open in a commonly used web browser. If the described assessment was evaluated using the POUR principles, which principle would be flagged?

Robust

It is the last week of the semester and students only have a multiple-choice final exam left. Juan just received feedback on a midterm paper, featuring a few paragraph-long notes. Why is this not quality feedback?

The feedback is no longer relevant to the student's work this semester.

A teacher completed a lesson on the scientific method to prepare students for their science fair projects. Students then took a formative assessment that asked them to make a hypothesis based on supplied preliminary research. After the assessment, students received feedback. How does the feedback the students receive from this assessment support their learning?

The feedback will let students know if they understand how to write a hypothesis before learning the next step of the scientific method. The feedback will let the students know if they need to study more and practice writing a hypothesis. The feedback will let the students know if they are ready to learn the next step in the scientific lesson.

A general education chemistry course is taught by a professor who has a reputation of failing most students every semester. The professor has been asked to conduct a review to identify areas in which students struggled so student performance can be improved. What type of learning analytics data could this professor use for the purpose of identifying areas that need improvement for students to be more successful?

The mean score for each assessment in the course

A student did not meet the following learning objective: "Write an introduction that clearly states the recommendation." Which feedback statement should the student receive?

The recommendation is not clearly stated in the introduction.

Which statement is an example of a performance measure?

The number of correct answers students had on the unit test

An instructor has provided the following feedback for a student's essay: "You did a much better job than the rest of the class. Your topic sentences are strong. You have a lot of run-on sentences. The paper should be single-spaced, not double-spaced." Which of the sentences is representative of mastery-oriented feedback?

The paper should be single-spaced, not double-spaced.

What is a sign that an assessment includes barriers to fairness?

The scores of a certain ethnic or cultural group are lower.

An instructor for a course populated by multiple Hard of Hearing/Deaf learners is providing assignment feedback. What should the instructor avoid under these circumstances when delivering in-depth feedback?

The use of any audio

What is one of the goals of giving feedback to learners?

To acknowledge learners' strengths and weaknesses

What are strategies to minimize bias when grading assessments?

Use an objective rubric Hide students' names

Predictive Analytics

Use data from the past to predict what might happen in the future

Which strategies reduce irrelevant knowledge in assessments?

Use grade-level appropriate language Avoid terms that most people might not know

Descriptive Analytics

Used to inform; based on data from gathered information

POUR Principle - Operable

User interface components and navigation must be operable. Make all functionality available from a keyboard. Provide ways to help users navigate find content, and determine where they are.

In a course that teaches academic literacy skills to adult learners without a high school diploma, the instructor wants to assess students' ability to accurately summarize an assigned reading. Which assessment aligns to this learning objective?

Write a paragraph that addresses the reading's key points.

The following prompts are designed for students in an online writing course. Which assessment prompt is biased?

Write about your favorite experience in the snow.

A learning goal for a middle school music class unit is "Students will create music using computer-based composition tools." After the class spends several weeks practicing using the composition tools, an instructor for the course assigns a project in which students must compose an original song that is one minute long, incorporates at least two instruments, and includes a repeating chorus. How would this competency-based assessment strategy determine whether students met the learning goal?

By providing an opportunity for students to demonstrate their computer-based composition skills

How should this committee proceed to avoid confirmation bias?

By redacting students' names from the essays before the review

How could the teacher modify this assessment to minimize bias?

By revising the character descriptions so they do not include generalizations

How could this assessment be redeveloped to reduce the barrier to fairness?

By using language that is suited to broad interests and experiences

Following a teacher's presentation of a science lesson, students access an online module that reviews the content presented and captures their responses to related questions. After reviewing the students' responses, the teacher determines that most students have not correctly answered questions associated with the lesson's learning objective. How could the teacher use prescriptive learning analytics for the purpose of creating a modified version of this lesson that will have a greater impact on this same group of students?

By using the identified weaknesses of the students' collective performance to adapt the original lesson presented

A special education school administrator is concerned that students with special needs are not making adequate progress in developing literacy skills. The administrator sets a goal that the literacy scores of students with disabilities will increase by 12% by the end of the following school year. Which type of learning analytics should this special education administrator use when reviewing performance levels during the year?

Descriptive

An instructor wants to develop an authentic assessment where students demonstrate the Create level of Bloom's revised taxonomy. Which assessment aligns to this cognitive level?

Design a new traffic plan for a downtown shopping district that is about to undergo major street repairs.

An instructor is planning to teach a third-grade science unit on the states of matter. The learning goal is "Students will be able to identify examples of liquids, solids, and gases." Which type of assessment should this instructor use to determine what students already know about the states of matter prior to receiving instruction?

Diagnostic

In a course for a human resources staff, the instructor wants to determine if learners can evaluate employees and colleagues based on affective domain skills and abilities. Which assessment is based on the affective domain?

Differentiate the behaviors and attitudes of employees to see who is likely to participate in a volunteer community outreach effort for a local charity.

The parents of an elementary school student are concerned that their child is being bullied and decide to contact the principal for more information. They ask to review the discipline records of the two students in their child's class to determine if the students have histories of bullying behavior. Which ethical consideration should lead the principal to deny this request?

Discipline records are confidential and private.

A site-based decision-making team for an urban school works with a principal to establish a campus improvement plan that will target academic areas that need improvement based on academic performance data. Which ethical obligation should this team consider in the allocation of the funds?

Ensuring a portion of the funds are used to address achievement gaps

Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level. In a culinary arts course, the learner will be able to determine whether a dish was properly prepared by tasting and rating the dish.

Evaluate

Students in a business writing course complete a series of writing practice quizzes using a self-paced approach. Quizzes are automatically scored in a learning management system (LMS), but no grade is entered into the grade book until an instructor reviews and releases the score. The instructor commits to releasing the score and providing effective feedback within 24 hours after the LMS scores a quiz. The following feedback is provided to the first student who completes a quiz: "Awesome work! You missed only 2 of the 35 questions." How should this feedback be modified in order to be more effective for students?

It should describe in some detail how the student's performance can be improved.

The undergraduate students in a developmental psychology course are learning about genetics. The objective of a lesson in the course is "Students will be able to identify whether traits are genetic or not genetic." Before class is dismissed, an instructor for the course distributes a list of 10 traits and asks students to circle the traits that are genetic and cross out the traits that are not. Why would this direct assessment be effective in determining whether students met the learning objective?

It would allow students to demonstrate their ability to differentiate traits.

A trainer has been hired to facilitate a digital image editing skills workshop. The learning objective is "Identify the basics of image file formats." Participants use software and images provided by the workshop sponsors. Which direct assessment method would determine whether participants met this objective?

Matching common image file formats to their purpose

A high school history teacher administered a summative exam that required students to answer short-response items focused on the causes of the Revolutionary War. The responses were graded with a rubric on the following categories: accuracy, rationale, and length. One student received the following written feedback from the teacher: "The information you provided for each question minimally met the standards. However, you had some spelling errors. For example, the following words were misspelled: revolutionary, adequate, colonies, and applicable. Please revise and resubmit." Is this feedback effective?

No, because spelling was not a category in the rubric

Students in a healthcare capstone course prepare for a required postgraduation licensing exam by completing a nationally validated competency exam that serves as practice. The students' practice exam performance results are available within 10 days of the exam date to the program chair but not to the capstone instructor. The program chair briefly reviews the exam scores and tells the capstone instructor that the results are around the expected average for healthcare students. Was the program chair's decision to provide a summary interpretation of the practice exam scores ethical?

No, because the interpretation does not provide enough information for the instructor to share specific performance insights with each student

Marketing administrative staff are required to participate in a self-paced software training course. There are two components to the final assessment. One is an objective, multiple-choice test that assesses knowledge of vocabulary and resources. The other is a hands-on practical application of software skills. At the end of the course, a trainer must provide all performance results to a marketing manager. The trainer notices that course participants earned high scores on the multiple-choice test but low scores on the practical application, suggesting participants may be unable to apply the software skills effectively in their work environment. To highlight the strengths of course participants, the software trainer reports only the multiple-choice scores to the marketing manager. Was this trainer's decision to limit the reported results ethical?

No, because the trainer has an obligation to provide complete assessment information

A history curriculum department for a K-12 school district has created a history fair project: Sixth-grade students will present a historically significant character as part of a living museum. To determine how prepared students are for this project, teachers in the district have asked students to demonstrate their speeches before the fair. The teachers use a rubric to assess each student's presentation as meets expectations or below expectations in four categories: accuracy, presentation, scope, and bias. The scores are entered into a learning management system (LMS) for review by a history department coordinator to determine which schools need additional support. Which type of learning analytics does this process represent?

Prescriptive

A third-grade reading teacher is developing a reading assessment to predict student preparedness for the state standardized test in making inferences. To ensure that the assessment is aligned with state standards, the teacher selects items from past state assessments. The teacher plans to provide the English learners (ELs) with a bilingual dictionary to use during the assessment. Which action does this teacher take to address the accessibility of this test?

Providing EL students with bilingual dictionaries

A high school yearbook teacher teaches six classes with a total student count of 130 students. Students are required to submit monthly proposals for yearbook articles. The proposals represent students' monthly grade. Students' proposals must be accepted to receive a passing grade for each assignment. Which monthly process would provide meaningful formative guidance for the students?

Two weeks before the proposal due date, the teacher plans a peer-review session for students to score and discuss the proposals.

Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level. In a medical course, the learner will be able to explain the clinical signs of obesity to a patient in a treatment context by playing the role of a clinician in a scenario-based discussion post.

Understand

A goal of a second-grade science unit is "Students will be able to categorize a variety of objects according to observable characteristics." After demonstrating how certain objects placed in an aquarium float and how others sink, a teacher decides to assess the students' conceptual knowledge. Before placing the next item into the aquarium, the teacher asks students to stand if they predict it will float and to remain seated if they think it will sink. Which cognitive levels of the revised Bloom's taxonomy do this learning goal and direct assessment align with?

Understand and Apply

A learning experience designer is asked to help an instructor design a summative assessment for a lesson. The course design calls for the summative assessment to be at higher cognitive level based on the Revised Bloom's Taxonomy and to employ either conceptual or procedural knowledge dimension. Which assessment activity is both at higher cognitive level and is also aligned to one of the required knowledge dimensions?

Write a pedagogical analysis of a lesson plan and its steps by applying two of the five learning theories learned in a unit.

Which design process is an example of backward design?

Write learning goals based on what students need to learn, decide how that learning will be measured, then choose activities to prepare students for success in those measurements.

College applicants who score below acceptable limits on the math portion of the ACT are required to take a computerized math basic skills assessment to avoid remedial math courses. To pass the assessment, students must answer 70% of the questions correctly. Students have three opportunities to pass the test, and they receive feedback electronically after the first and second attempts. One student received the following feedback with attached models and practice problems in deficient areas (i.e., areas below 70%): Testing AreasPercentage of Questions Answered Correctly in Each AreaNumber and Quantity75%Algebra64%Functions86%Geometry44%Statistics and Probability44% Is this quality feedback?

Yes, because students are provided with specific and timely information regarding their performance and practice problems

Students in a business course are required to calculate an organization's break-even analysis. The students are given a formula, via a learning management system (LMS), and they use the formula throughout the course. Several weeks after the formula is introduced, an instructor notices a student who continues to submit assignments with incorrect calculations. Consequently, the instructor recommends that student support services and the student meet to review the student's inability to calculate correctly. Was the instructor's decision to contact support services ethical?

Yes, because the instructor is obligated to recommend support services for students who demonstrate a lack of understanding

A physical education teacher challenges remote learners to improve their speeds when completing a one-mile run. Students wear fitness trackers that automatically record their times in an online database where the students can review their progress. At the end of each week, the teacher sends an email to each student. One email reads, "You have been committed to the process of improving your speed. This week's data show that you have improved your speed by 28 seconds—wow! For next week, try to maintain a steady pace until the last two-tenths of a mile. Then try sprinting to the finish line." Is this feedback specific and actionable?

Yes, it mentions the learning goal, the progress made, and a plan for moving forward.

Each week in a clinical training course, a dental assistant student is selected to record a simulated dental assistant-patient interaction. The class instructor and other students view the recorded simulation and offer verbal feedback. During one simulation, a dental assistant student teaches a patient about oral hygiene and plaque-control techniques but does not provide an opportunity for the patient to ask questions. The instructor offers the following feedback to the student: "You gave a model demonstration for providing oral care information to a patient using easy-to-understand language, and you enhanced your verbal description with a simulation of techniques. Patients are more likely to apply techniques when they fully understand them. They must be invited to ask questions at the time the information is presented. How might you ask patients whether they understood the presented technique?" Is this feedback specific and actionable? Why, or why not?

Yes, the instructor identified the student's progress toward the learning goal and an opportunity for improvement.

A state board of education requires that all schools in the state determine the languages spoken in student homes to identify their language needs. In one elementary school, data from a "Home Language Survey" indicate that 11% of students speak a language other than English in their homes. The school's principal asks an English language teaching specialist to administer an English language proficiency (ELP) assessment to determine whether these students are eligible for language support services in school. Did the principal fulfill the ethical obligation to act on the knowledge about students that was gained through the initial survey?

Yes, the principal attempted to gather additional information to understand the students' specific needs.

Tells what's likely to happen? Based on historical data, and assumes a static model, helps make decisions for a larger group

Predictive Analytics

Students in a virtual reading group are asked to read four sentences aloud. One student's read-aloud sounded choppy, with several pauses. The teacher responded, "You seem distracted. Is there something bothering you?" Which modified feedback statement would be more effective for this learner?

"If you are feeling distracted during your read-aloud, it is OK to stop, ask for a brief pause, regain your composure, and start fresh."

Students are learning how to crop an image in half using a provided step-by-step instructional document. One student submits an uncropped, rotated image. The initial feedback from the teacher is, "It does not appear that you understand the definition of crop. Instead, you have rotated the image." Which modified feedback statement would be more effective for this student?

"It appears you have rotated this image rather than cropped it. For this exercise, follow the provided steps on the board, and then resubmit your task."

Students are instructed to predict what will happen if they attempt to grow bean seeds without direct sunlight for a specified growth period. One student group hypothesizes that their bean seeds will not grow without sunlight. Which instructor feedback statement would be meaningful?

"List the steps you can take to test your hypothesis."

Students in an online humanities course are assigned to listen to and compare samples of three types of music: opera, classical, and jazz. What should be provided to students with hearing loss to increase the accessibility of this assignment?

A description of each sample

Middle school students watch a video with embedded quizzes for a social studies assignment. How could the students' teacher use descriptive learning analytics with the purpose of determining individual student progress with the presented content?

By examining student engagement with the video and quiz question responses

An instructor wants to share feedback with online students during class in a multimodal format. The instructor wants to offer both audio and video components in real time. Which option would fit best?

Screen sharing

An instructor is working with a student with a documented disability who requested personal assessment feedback be delivered as a recording. Which method(s) of feedback would fit best for this student?

Screen sharing Audio

An instructor wants to develop an authentic assessment where students demonstrate the Understand level of Bloom's revised taxonomy. Which two assessments align to this cognitive level? Choose 2 answers.

Summarize the benefits of the company's insurance policy & Clarify the insurance premium and payout options for a potential client.

An American Sign Language instructor designs an assessment activity where pairs of students meet on a video conferencing platform to participate in a friendly conversation using basic signs. The instructor will use a checklist to assess students' use of basic signs. Which feedback meets the goal of motivating learners?

"Your skillful use of facial expressions will continue to serve you well in expressing the meaning of the signs."

When grading an assessment about the use of commas, an instructor notices that many students are placing commas instead of periods and creating run-on sentences. What is the instructor's next step after providing students feedback on their assignments?

To teach more about commas and run-on sentences

A supervisor wants to know if the new training program designed to increase production is successful or needs to be revised. How should the supervisor apply learning analytics to measure the effectiveness of the training?

Track employees' performance during training.

How can predictive analytics be used to improve the effectiveness of training in a workforce development setting?

Tracking data through training so that learning programs are aligned with employee performance

The following is a question on a middle school American history test: Who won the American Civil War? A. The Union (The North) B. The Confederacy (The South) C. Americans D. No one won About a third of the students chose "C" as the answer and got upset when told their answer was incorrect. Why did students choose "C" instead of the right answer?

Option "C" is too close to the right answer.

What questions can a learning experience designer ask to evaluate barriers to fairness in assessments?

Does the assessment contain uncommon language? Is the assessment free of controversial references? Is the assessment accessible to learners with disabilities?

Which goals align with prescriptive analytics?

Plan how to achieve an 80% passing rate on chapter tests, determine how to increase the number of students who will graduate next year, propose a solution to increase sales

A learner receives the following feedback on a short answer test: "The answer to question 3 asks for a comparison of the weaponry from the Civil War and the Revolutionary War. Instead of a comparison, only facts about weapons from the Civil War are discussed." Which learning objective for the test would be aligned with this feedback?

Identify how Civil War weapons are similar to and different from Revolutionary War weapons.

Which scenario presents a barrier to fairness due to cognitive load?

An assessment requires students to visit a website with multiple pop-up ads.

Students in a web design course are assigned to develop a custom logo for their website. One student uses an offensive image as the basis for the logo. Which instructor feedback would help motivate this learner to recognize the importance of inclusivity in design?

"The purpose of your website is to promote your business. Reconsider the basis of your logo so that you do not offend potential customers."

Which situation is an example of ethically interpreting data?

A CEO of a Fortune 500 company is reviewing the sales data of the past three months to determine which salesperson will win the quarterly sales contest.

What is an example of indirect assessment?

A course survey

An instructor in a digital art course is seeking a summative assessment that aligns to a course learning goal: "Learners will demonstrate the skills of visual design, applying color theory, fonts and layouts, and information to successfully communicate with a variety of digital media contexts." The instructor consults with a learning experience designer and decides to require students to create a personal website e-portfolio of original designs created in the course. Each design will include a student annotation about the design's origin, how it meets the requirements of the learning goal, peer reviews of other students' work. In a review with the department chair, the instructor is asked to explain the reasons for this assessment task. Which reasons justify the instructor's assessment strategies based on the learning goal?

A portfolio website requires students to apply the skills the learning goal measures

A fifth-grade health teacher forgets to make paper copies of the midsemester multiple-choice assessment. The teacher is required to administer the test by the end of the day; consequently, the teacher decides to project the assessment using the class smart board and have the students write their answers on notebook paper. What is a test administration concern for this assessment?

Accessibility

Which assessment prompt for high school students includes irrelevant knowledge?

Acquaint yourself with Hamlet and create an exposition of the themes present.

A learning experience designer at a local community college is asked to design a course that will generate learning analytics to measure whether a new collaborative learning activity contributes to student success in a summative performance assignment. The course is offered in partnership with a local business as an employee training course. Employees eligible for the course vary in age, the number of years at the company, whether English is their first language, prior educational achievement, and cultural backgrounds. Stakeholders include the employees taking the course, the employer funding the course, the course faculty, and the associate dean. Data collected includes personal demographic information on each student, data on employment, grades on collaborative assignment tasks, which combinations of employees made up individual teams, and grade data on the performance assessments for each learner. Which solution would allow the data to be collected in an ethical way while also providing the stakeholders with the necessary data to make curricular decisions?

Anonymized data relevant to determining patterns of success is shared with the stakeholders.

A learning experience designer meets with a school principal who seeks data for improvement. The principal wants to know if a proposed new e-reading curriculum for the fourth grade will improve reading comprehension measures.

Arrange for each fourth-grade classroom to complete one lesson from the proposed curriculum and compare the scores to student scores on the same lesson from the current curriculum.

How do learners with disabilities benefit from assessments designed using Universal Design for Learning (UDL) guidelines?

Assessments can be flexible Multiple formative assessments are offered Barriers are reduced but not completely removed

A principal is concerned that 14% of students in a high school are absent five or more school days per month. The principal sets a goal to decrease the overall absenteeism rates by 10% between the third and final term. Which type of learning analytics should this principal consider when trying to determine why some students have been chronically absent?

Diagnostic

An instructor set up a multiple-choice test to mark answers as correct or incorrect immediately after submitting the question. This is an example of ________ feedback.

timely

At the end of a grammar unit for second-grade students, a teacher administers an assessment to determine the students' ability to write complete sentences. Learning analytics show that 25% of all students do not demonstrate competency. How could this instructor use prescriptive learning analytics in order to customize instruction and address this problem?

By determining individual skills that need reteaching by categorizing common errors

A trainer is responsible for teaching the features and capabilities of a proprietary software system to large groups of new employees with widely varying technology skill levels. How can this trainer use prescriptive learning analytics to enhance individual employees' learning experiences?

By developing personalized learning at scale

A trainer wrote the following assessment question for serving staff in a restaurant: A customer complains about the lack of speedy service. What should you do to address the customer's concerns? A. Get the manager B. Say "It's Christmas, be nice!" C. Refund the cost of the meal D. Ignore the customer's complaint What kind of barrier to fairness is present in the assessment?

Barrier related to irrelevant knowledge

Students in a second-grade class are learning how to tell time. The learning objective of a lesson is "Students will be able to identify the correct time on an analog clock." At the end of the lesson, a teacher distributes a scaled survey to the students so they can self-assess their confidence in reading an analog clock. Why does this indirect assessment method align with the learning objective?

Because it allows the teacher to gather information on the students' perceptions about their own learning

Why is this instructor's evaluative feedback biased?

Because it implies there is a correct answer, when morals are personally determined

Which math question includes a barrier to fairness?

Becky drank a Frappuccino for breakfast, which cost $6. For lunch, she ate a burger that cost her $12. For dinner, she ordered foie gras for $45. How much did Becky spend on meals?

How could this assignment be modified to decrease bias?

By allowing students to select from a broader scope of interviewees and focus their inquiry on how different moments in American history affected them

Students in an introduction to marketing course took an online assessment requiring them to discuss the marketing techniques demonstrated in a set of statements. The assessment had to be completed within a specific period of time and without access to resources. More than half of the students inaccurately discussed the technique associated with the following statement: "You must rely on the esoteric interests of a group to place your product." How could this assessment be modified to reduce bias?

By using language suited to the students' level of knowledge and experience

A trainer in a large organization teaches evidence-based selling techniques to sales agents after they have completed their first year of employment. Following the first unit of training, participants access an online module that reviews the content presented and captures participant responses to related questions. After reviewing the participants' responses, the trainer determines that most participants have not correctly answered the questions associated with the unit's learning objective. The trainer is required to show that 80% of the participants correctly respond to 80% of each unit's questions. How could the trainer use prescriptive learning analytics with the purpose of presenting a modified version of the unit that will have a greater impact on this same group of participants?

By using the identified weaknesses in the participants' collective performance to adapt the first unit of training

The learning goal of a seventh-grade geometry unit is "Students will be able to calculate the surface area of given geometric figures." The students' teacher is planning an assessment that aligns with the Apply cognitive level and the Procedural knowledge dimension. Which assessment would align with this learning goal, the Apply cognitive level, and the Procedural knowledge dimension?

Calculating the surface area of several shapes

An assessment question for an introduction to communications class requires learners to watch a video of a speech and critique the speaker's tone, eye contact, and use of idioms. The video has closed captions, and students have time in the class computer lab to complete the assessment. Why would this assessment pose a barrier for some students?

Closed captions do not provide information about speakers' eye contact. Tone is not conveyed in closed captions. Idioms are challenging for English learners to identify.

A graduate student is conducting research for a professor who wants to write an article about the positive impact of mentorship on scholarship recipients. The professor has advised the graduate student to only collect and record data that shows a positive relationship. The graduate student is worried that the research is not ethical and approaches the professor to explain that there is an issue with ___________.

Confirmation bias

Grades are due at the end of the week, and a teacher realizes that the students in their class still need to take an end-of-chapter quiz, a unit test, and a midterm exam. The teacher explains to the students that they should study hard each night because they will be taking these three assessments over the next three days. How could this assessment plan be modified to improve the students' experience?

Consolidate the content to lessen the cognitive load and alleviate student stress

POUR Principle - Robust

Content must be robust enough that it can be interpreted reliably by a wide variety of user agents, including assistive technologies. Maximize compatibility with current and future user agents, including assistive technologies.

An instructor has asked students to engage with three different sources that discuss an environmental issue. The students have read the sources, and the instructor wants to assess students' ability to synthesize the information. Which assessments would demonstrate the students' ability to synthesize?

Create a presentation highlighting ideas where the sources are in agreement & Write a blog post explaining a new perspective based on the three sources.

The learning goal for a sixth-grade language arts unit is "Students will be able to compose various types of poetry." Which competency-based assessment strategy would determine whether students met the competency requirements for this learning goal?

Creating a portfolio of poems the students have written

One of the learning objectives of a ninth-grade anatomy unit about the systems of the body is "Students will be able to describe the functions of the respiratory system." Which project-based assessment would determine whether students have met this objective?

Creating a song with lyrics about the role of the respiratory system

How can prescriptive learning analytics data from course evaluations in higher education be used for the purpose of making improvements to a course?

Critical comments can be analyzed to determine areas in the course that may need revision.

A learning experience designer working in a university setting has collected new data for a study on camera usage in synchronous online courses and is at the point of analysis and interpretation of the data. What ethical practice must the learning experience designer adhere to during the analysis and interpretation phase?

Cultural values

Students are consistently dropping an introduction to psychology course after the third unit. The university wants to discover why this keeps happening. Which type of analytics should the university use?

Diagnostic

Which type of learning analytics would help an instructor determine why student dropout rates are rising?

Diagnostic

Automated RCA - root cause analysis, explains "why" things are happening, helps troubleshoot issues

Diagnostic Analytics

A learning experience designer has changed the learning resource for this semester's Chapter 2 test, but the test remains the same. The learning experience designer wants to know if students scored better on this semester's test than previous semesters to determine if the new learning resource should be kept. What data strategy is being implemented?

Data for improvement

An instructor wants to gather data about a class to better understand how to increase student engagement. Which type of data measurement should help the instructor reach this goal?

Data for improvement

Which strategy would help to ensure that students effectively interpret feedback?

Demonstrate how students should apply feedback.

A principal wants teachers to compare this year's midterm grades to last year's midterm grades. Which type of learning analytics should be used?

Descriptive

The teacher has gathered the learning data of a fifth-grade world history class throughout an entire school year. The school seeks a 10 percent improvement in student learning and wants to use the data from this year as a benchmark for comparison to students who take history next year. The school principal has asked the teacher to use the data to establish learning growth benchmarks based on the current year's data. To establish the desired benchmark, _____________ analytics should be used.

Descriptive

Which type of learning analytics should a learning experience designer begin with as a first step toward optimizing learning in K-12, higher education, and workforce development?

Descriptive

An instructor presents business ownership concepts to a group of business students, including the different types of business ownership. The learning objective is "Compare the major forms of business ownership." Which direct assessment method aligns with this learning objective?

Developing a presentation about business ownership

A company has concerns about employee turnover. The learning and development team decides to analyze employee morale information from the past to find out why employees are leaving the company at such a rapid rate. Which type of learning analytics should the learning and development team use?

Diagnostic

Which strategy could create a barrier to fairness in assessments due to cognitive load?

Discouraging group work

What could this teacher do to decrease the predictive-validity bias of the created assessments?

Ensure students take the assessments under the same conditions that the state assessment is administered

Administrative support staff in an organization are learning how to prepare digital presentations through an online course. The course is mostly self-paced; content is delivered by a learning management system (LMS) but facilitated by a trainer. New to the training curriculum is an enhanced coaching component. Coaching consists of regularly scheduled one-on-one sessions where course participants meet with the trainer for an hour each week. While the enhanced coaching experience increases the course length, the trainer notes the productive working relationship between coaches and course participants and believes it may positively influence participants' application of digital presentation skills after the training. Two months after the course ends, the organization's human resources (HR) department asks participants to describe how their participation has enhanced their ability to prepare digital presentations. What should the trainer do to determine whether the longer training period and enhanced coaching are valuable to employees and the organization?

Examine total course hours per participant and associated participant feedback collected by HR

Which action is an example of using the qualitative analysis technique to extract insights about learners?

Examining the transcript of a discussion about students' feelings on remote learning.

Which scenario is an example of how prescriptive analytics can be used in a K-12 setting?

For the past five years, the number of students reading at grade level has declined. The school would like to know what actions should be taken to break the five-year decline in the number of students reading at grade level.

An eighth-grade teacher notices that students are struggling to submit the homework. The teacher wants to use direct data collection methods to determine whether students are still retaining the content even though assignments are not being turned in. What could the teacher do to get the necessary data?

Give the students a pop quiz that covers the objectives of the test.

A corporate office is providing sales training to its employees. The two-hour long training features a guest speaker. The office has two employees who are Deaf, so a transcript of the speaker's speech was provided. After the training, each employee will be asked to participate in a mock sales call to demonstrate the new knowledge. What can be changed to make the training accessible?

Have an American Sign Language interpreter at the training.

A learning experience designer wants to collect data about how often learners sign into the learning management system. The data will be collected through the learning management system's analytics. What is one way for the designer to ensure that learners' privacy is respected when collecting this data?

Have learners review and sign a consent form prior to data collection.

A middle school science teacher evaluates the online lab reports of students and provides feedback consisting of only numerical scores and letter grades. However, the teacher wants to modify the feedback to improve its effectiveness. What should this teacher provide in addition to the scores and letter grades?

Information about the students' progress toward the learning goal

POUR Principle - Understandable

Information and the operation of user interface must be understandable. Make text content readable and understandable. Make web pages appear and operate in predictable ways.

POUR Principle - Perceivable

Information and user interface components must be presentable to users in ways they can perceive. Provide text alternatives for any non-text content. Make it easier for users to see and hear content including separating foreground from background.

An instructor designed the following assessment question for college freshmen: A server waited on five tables during lunch rush. The first table tipped 15% on their $25 bill. The couple in the corner at table 2 tipped 20% on their $38 bill. The third table was a small order of $10 and tipped 20%. The fourth table was two teenagers who split their bill two ways. One tipped 30% on their $15 bill and the other tipped 10% on their $7 bill. The final table was a bunch of politicians who tipped 10% on their $120 bill. How much money did the server receive in tips? The question was evaluated using TAMI and found to be inaccessible. Why is this question inaccessible?

It includes content that may be controversial.

A student submits a history paper without any in-text citations, but references are included. One of the assignment's learning objectives is to accurately cite sources according to APA formatting style. Which feedback statement would help the student improve performance on the next assignment?

It is important to properly cite sources using APA. In-text citations are missing in your assignment. Citations are important for the reader to know what words and ideas are from sources. Reference the library website for information about how to format in-text citations.

The following feedback was given one day after a student completed the assignment: "The lab report was not complete. An abstract is missing." What is wrong with this feedback?

It is not actionable.

Which statement displays actionable feedback?

Kelsey, you had strong topic sentences and the theme was consistent throughout the paper. There are some issues with your citation formatting. Next time, reference the citation guide from the library website.

In a nursing course, students examine body systems, including the nervous system. The learning objective is "Interpret terms related to the nervous system." An instructor for the course wants to determine students' ability to interpret these terms accurately. Which skill demonstration aligns with this learning objective?

Matching nervous system elements on an image of the human body

What are three essential metrics for gauging the effectiveness of training evaluation in a workforce development setting?

Metrics that measure participants' reactions, metrics that measure how much employees are learning, metrics that measure changes in behavior

A teacher uses a rubric to assess students' political cartoon assignments in three areas: message, content, and visual presentation. One student scored four points for the message, four points for the content, and three points for the visual presentation. In addition to providing a score of 11 out of 12 points, the teacher included the following feedback for the student in a comment box: "Please review your classmates' political cartoons." Is this an example of quality feedback?

No, the feedback does not include specific, actionable statements relative to the learning goal.

After reading books about different animals and viewing paintings of animals in an online art class, second grade students are asked to paint a picture of another animal for a homework assignment. Why is this assessment inaccessible?

Not all students will have access to painting supplies.

College freshmen received the following assessment prompt: Write and deliver a speech to the class about the importance of suicide prevention. What changes can be made to the prompt to make it fairer to learners?

Offer multiple topic choices Allow an alternative delivery method

Students are assigned to write a paper or create a presentation on their family's history. How can barriers to fairness be mitigated in this assessment?

Offer students the option to research another family's history

Prescriptive Analytics

Offers recommendations based on possible outcomes and helps identify the best options

Employees in an organization are not completing a training course on their first attempt, resulting in additional costs for the organization. A training manager wants to anticipate the likelihood of participants' failure while participants are engaged in the course and recommend customized remediation that is embedded throughout participants' first attempt at the course and is based on each participant's needs. Which type of learning analytics should this trainer use to suggest various actions to participants to help them complete the course successfully on their first attempt?

Prescriptive

How can professors use diagnostic learning analytics in the classroom to understand why learners struggle with the learning resources in a particular unit?

Professors can compare the time students spend on learning resources to individual test results to see if a lack of reading is causing low scores.

An instructor discovered an online student is having trouble identifying the locations of the regions of the brain. What is one way that the instructor can provide feedback for this learner considering the nature of the content?

Provide feedback that includes pictures and video examples

An instructor wants to determine whether to continue using a new textbook in a course or return to last year's textbook. What kind of assessment data should the instructor use to inform this decision?

Test performance compared to last year

Each week in an organizational management course, students are required to view recorded simulations of conflict resolution scenarios and evaluate the manager's performance in each scenario. The recorded simulations offer transcripts of the dialogue. Which modification would improve accessibility?

Providing audio descriptions that present the visual-only content in the videos

When using learning analytics to assess student learning in online courses, which learning analytics technique is often used with descriptive analytics to conduct item analysis of multiple-choice formative assessments?

Quantitative analysis

A learning experience designer wants to collect data to develop a plan for hiring better-qualified candidates. What are three types of data that could be collected from current employees to help develop the plan?

Questionnaire Face-to-face interview Trained observers watching the abilities of new hires during the first few days of employment

A learner received the following feedback on a memo writing assignment: "Memos need to be single-spaced, with headings that separate the main ideas. You do not write the person's name at the start of a memo because there is already a 'To' field at the top of the page." How can the feedback be improved?

Remove "You do not" from the second sentence and replace it with "It is not appropriate to."

A teacher designed the following assessment question for a fifth-grade math test: It takes David 25 minutes to travel to work. David left for work at 7:05 AM. An obstructed crossing caused a 7-minute delay. Michael, David's colleague, departed for work at 6:50 AM. It normally takes Michael 35 minutes to get to work, but setup for a Halloween parade postponed traffic for 9 extra minutes. Who arrived at work first? By how many minutes? How could the assessment question be changed so diverse learners are considered in the design of the question?

Remove the reference to Halloween Use simpler language Shorten the word problem

A teacher notices that a former straight-A student has started to fail tests. The teacher wants to personalize the lesson to help the student succeed. What assessment data should the teacher use?

Review and compare cumulative test scores.

Which high-level principle of functional accessibility is missing in this course site?

Robust

Beth created a short answer test for the students and the directions stated that all questions must be answered in complete sentences. As Beth is grading the test, it is discovered that a student answered with only one- or two-word answers. What is the appropriate actionable feedback Beth should provide to the student?

Short answer questions need to be answered using complete sentences.

What is a content-validity bias issue in this assessment?

Some students may not have access to proper supplies.

Which modification to this assessment would eliminate bias?

Square is to four sides as triangle is to ____ (three sides).

In what ways can an instructor successfully address learner variability when providing feedback?

Stimulate perseverance Highlight effort and improvement rather than relative performance Give substantive feedback rather than comparing the learner to other students

What is one benefit of aligning feedback with assessment results?

Students can understand which specific areas need improvement.

How do students benefit when Universal Design for Learning (UDL) guidelines are applied to assessment design?

Students face fewer barriers.

Why is it helpful to reference learning objectives while giving students written or verbal feedback?

Students will know what they need to accomplish. It helps the feedback remain objective.

A university has been awarded a grant after a groundbreaking course in bioscience. The money from the grant will go to similar course development. Soon after the grant is awarded, the learning experience designer finds that certain information was not surveyed correctly, thus skewing the results. Ethically, what should the learning experience designer do?

The designer should notify a superior at the university.

A marketing firm is training its employees how to use new bookkeeping software. The goal of the training is for employees to be able to properly input an invoice in the software. During an in-person training, employees get to practice using the software and input sample invoices into the software. Which verbal feedback should the trainer supply when an employee forgets to enter the date the invoice is due?

The due date field also needs to be filled out.

A manager notices that a new employee is not using the correct company email signature. When should the manager tell the employee about this mistake?

The employee should be told as soon as possible by replying to the email or by speaking in person.

A learning experience designer has collected data that examines how much assessment feedback student athletes receive compared to non-athlete classmates. The results revealed that, on average, student athletes received 20% less feedback than non-athletes. What do the results of this study indicate?

The results raise awareness of disparity. The results present information that the university is obligated to act upon.

A high school history teacher has taught the same group of students all year. The teacher is familiar with the work habits of each student and, at times, has been able to guess the score that each student will receive on an assignment based on its level of difficulty. For their final project, students are required to submit a research paper that highlights a historical event or figure. Students have two weeks to submit the paper. Which scoring bias issue may be a concern in this situation?

The teacher may score the assignment based on prior knowledge of the students.

An instructor wants to improve learners' performance by offering specific feedback. Which feedback options would help the instructor reach this goal?

This paragraph is very good, but you need a stronger topic sentence. Good job at picking such a profound subject. Please provide more background on the historic event. Your pacing of events is very good. Expand more on what brought you to your conclusion.

When does formative assessment support students to learn and practice?

Throughout the course

Why is it important to design assessments with diverse learners in mind?

To ensure the assessment is measuring the appropriate skills

The supervisor of an accounting team wants to collect data on junior accountants' errors to reduce errors and increase quality. Why should this data be collected?

To identify employees who need additional training

A learning experience designer is analyzing data from a study about the effectiveness of server training in a 24-hour restaurant that focuses on upselling desserts. Servers attended training and consented to have their sales data analyzed. The data being analyzed will include the average number of dessert items sold per customer. The study is not taking the time of the order into consideration. Which ethical issue is present in the study?

Validity and reliability of data

When creating a new course for a healthcare system, a learning experience designer realizes that data results did not include all the necessary information, including race and gender, to make a fair interpretation. Collecting the missing data would delay a new course that needs to be completed by the end of the business day. What is the ethical issue that the learning experience designer is faced with?

Validity and reliability of data

Amy is grading a formative assessment and writing feedback. Amy wants to provide feedback that encourages the learners to examine their process. What is a good question that Amy can ask as part of the feedback that will help the learners examine their process to improve learning?

What is the explanation for the correct answer?

What is an example of construct-validity bias?

When a test measures something other than what is supposed to be measured

Which two questions can be answered by using indirect assessment methods?

Which unit do students think is the most challenging? What is the biggest challenge for first generation college students at this university?

Students are required to work together in groups to find a solution to a problem. The teacher observed one group and provided the following feedback to the group: "I observed that for the majority of the time, you listened to one another. I heard you encourage each other and ask each other for help. We will work in groups again on Friday. On Friday, all of you should work together to ensure everyone agrees on a solution." Is this quality feedback?

Yes, because it includes details about the observation and provides the next steps

In a business management course, students must research and write a paper analyzing the founders of modern management principles. To ensure students approach the assignment as intended, the course instructor requires students to submit an outline of their papers. The instructor reviews each outline and provides feedback to help students develop a complete, clear analysis. Which feedback provides students with formative guidance?

Written comments in each student's outline identifying the student's progress and opportunities for enhancement

A student received the following feedback: "Work needs to be shown when solving the problems on chapter tests. For example, when you solved for the area of the triangle in question 2, the formula '½ base times height' should be filled in with the numbers from the question. You are so smart, but you need to show your work! Let me know if you have any questions." Which sentence should be removed to improve this feedback?

You are so smart, but you need to show your work!

Tom teaches a student who is good at auto mechanics but who also often forgets basic required steps. Throughout the class, Tom shared feedback with the student that stated and enforced the student's natural abilities and intelligence; however, the student is not doing better. Which feedback option is actionable and could motivate the student to improve in the future?

You tried hard in class today. Next time, make sure you check the oil levels first.

A student received the following feedback: "Overall, you did a good job. However, your thesis needs some work. Your topic sentences were direct and well written. Please let me know if you have any questions." Which sentence demonstrates specific feedback?

Your topic sentences were direct and well written.

Showing students how to review and apply feedback helps them know what to do when they receive it. Using _______ lets students know what is expected, where expectations are or are not met, and can guide teachers' responses.

a rubric

Christian is providing feedback to an online learner and has identified a specific situation where the learner underperformed. The next step would be for Christian to _________, which would motivate the learner to stay attuned to goals of the feedback.

offer advice on next steps

In an introduction to programming course, students analyze the structure and components of a program. The learning objective is "Create a simple program." Which direct assessment method would determine whether students have met this objective?

Developing program code

Students in a management principles course develop a presentation related to the application of four principles. The course instructor reviews each student's presentation draft to ensure it adheres to the presentation requirements. Then the instructor enters feedback in the form of a letter grade in each student's grade book. The instructor wants to make the feedback more effective by adding a descriptive comment. What should the comment in this modified feedback describe?

The student's progress toward the learning goal and how the presentation might be improved

An online music class teacher directs students to play a specific song in unison using their recorders. Informal observation data indicate that several students are not keeping the beat while playing. Which teacher feedback meets the goal of providing formative guidance?

"I noticed that several students were effectively keeping the beat by nodding their heads to the beat. I would like everyone to try nodding their heads as they play next time."

Students in a math class submit a homework assignment about adding decimal numbers on an online learning platform. While reviewing their work, the students' teacher noticed they did not line up the numbers and decimal points in the assignment correctly. The online learning platform automatically marks the incorrect answers with an X. The teacher follows up with these students by emailing a comment: "Your numbers and decimal points were not aligned." Which statement should be added to this feedback to improve its effectiveness?

"Please use the graph paper technique when completing the next problem set to ensure the numbers and decimal points are aligned."

As part of an introductory icebreaker activity on an online discussion board, students must write a complete sentence about their morning. The sentence must use correct spelling, grammar, and punctuation. One student writes, "i ate breakfast B4 school". Initially, the teacher provides this feedback: "The requirements state that you must use correct spelling, grammar, and punctuation." Which additional statement would make this feedback more effective?

"Rewrite your response with the first letter of the sentence capitalized, proper spelling, and a period at the end."

Which characteristics describe effective formative assessment practices?

Aligns to a specific learning objective, informs instruction, helps students learn during a course

A course survey will provide information about factors that affect student learning, but it does not measure student knowledge or skills. An English Literature instructor has just finished a lesson on Romeo & Juliet, which has this learning objective: Students will demonstrate the ability to apply a literary theory explored in the course in a critical analysis of Romeo & Juliet. Which direct assessment would allow the learner to show an ability to meet this learning objective?

An essay analyzing the play

Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level. In a guidance counseling course, the learner will be able to provide advice based on the learner's own experience to high school seniors about choosing whether to attend college.

Apply

A music composition teacher has completed a lesson where the learning objective is "Students will learn the cadence variations of four-four time by composing a single two-minute piece that can be played at both a waltz and polka tempo." Which assessment method aligns with this learning objective?

Ask the students to compose a single piece and to perform it.

A learning goal for a group of kindergarten students is "Students will be able to differentiate how objects are alike and different." A teacher provides each student with a sorting mat and a bag filled with tiles in a variety of colors. The teacher asks students to sort the tiles by color on their mats. Why does this performance-based assessment align with the learning goal and the Analyze level of the revised Bloom's taxonomy?"

Because students demonstrate their ability to distinguish attributes of tiles

How could the instructor improve the functional accessibility of this assessment?

By changing the format of the questions to allow for a single keyboard click to select answer choices

A teacher of a first-year German class is interested in determining the impact of using online learning games on vocabulary knowledge. How could this teacher use learning analytics with the purpose of determining the efficacy of the learning games?

By comparing assessment scores from students who did and did not use the online learning games

In a graduate business course, one of the learning objectives is, "Students will be able to facilitate a meeting using presentation software." How should an indirect assessment method be used to support students in meeting this objective?

By having students critique each other's recorded meetings and offer suggestions

To meet the learning goal of starting an IV, nursing students must understand the different functions of two types of blood vessels: veins and arteries. Which assessment aligns with the Understand taxonomy of this learning objective?

Classifying vein and artery characteristics

In a certificate program for adults pursuing a career in business, learners must demonstrate the ability to write an employee self-evaluation using a self-assessment rubric as well as to submit a reflection describing the extent to which a potential raise or promotion provides motivation for writing an honest self-evaluation. Which two learning domains are being used in this authentic assessment?

Cognitive & affective

In a college chemistry course, students construct a model of a benzene ring. The learning objective is "Investigate the properties of a benzene ring." Which cognitive level of the revised Bloom's taxonomy does the students' construction of the model reflect?

Create

Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level. In a woodworking course, the learner will be able to demonstrate the ability to use three of ten possible types of joints by building a bookcase, table, or storage chest.

Create

A fourth-grade teacher is piloting an enrichment unit on fractions with like and unlike denominators for remote learners. The modules are accessed through a learning management system (LMS) and are arranged in a specific instructional sequence. The teacher is uncertain whether the modules are effectively sequenced. Which data measure should be used to determine if the learning modules are effectively sequenced?

Current scores from end-of-module quizzes

A data analyst for a school district is asked to provide information to the district's superintendent on how each school in the district performed on the math portion of a state standardized test. Specifically, the superintendent wants to know which schools had fifth-grade students solve two-step math word problems with at least 70% accuracy on the test. The data analyst plans to summarize the schools' performance data using graphs. Which type of learning analytics does this assignment represent?

Descriptive

An individual has been hired to train an organization's administrative staff to use a new automated scheduling system. The training runs for three days. The individual wants to know the progress of each participant at the end of the first day and use that information to plan the second day's instruction.

Formative

An instructor has asked learners to keep a journal based on personal learning goals for the course including the learners' progress toward meeting those goals. Which assessment strategy does this activity use?

Ipsative

Which high-level principle of functional accessibility is a concern in this assessment?

Operable

Fifth-grade students are learning about the three branches of government during a social studies class. At the end of a lesson, a teacher asks students to complete a 3-2-1 writing assignment in which they list the three branches of government, two facts about each branch, and one question. With which learning objective would this direct assessment method align?

"Students will be able to recall the features of the three branches of the United States government."

Students in an introduction to philosophy class are struggling to understand the complex information provided in the course readings. The students' instructor asks teaching assistants to facilitate tutoring sessions so students can receive support while completing their reading assignments. How can this instructor use learning analytics for the purpose of determining the impact of the tutoring sessions on the students' comprehension of course readings?

By comparing the students' grades from before and after the tutoring sessions

A trainer identifies several participants in an advanced, self-paced Excel course who have not completed a complex table activity at the end of the first unit. The trainer examines the performance dashboard in the learning management system (LMS) and determines that these participants attempted the complex activity but quit after several unsuccessful attempts. How should the trainer use data measures to foster successful learning for all participants?

By identifying participants who should participate in an adaptive learning experience in the LMS that includes customized instruction

An instructor identifies several students in a college math course who have not completed their weekly assignments at the end of the first three weeks. The instructor determines that these students begin the weekly activities but stop at the point where they must apply the presented math concept. The instructor would like to help foster successful learning for these students. How should this instructor use data measures to do this?

By identifying students who should participate in an adaptive learning experience in the LMS that includes additional practice

In an online college speech course, an instructor encourages students to work with their peers to develop speech topics and to rehearse their speeches. How could this instructor use diagnostic learning analytics to determine whether students are participating in group work?

By identifying the number and type of student interactions

In a senior internship course, one of the learning objectives requires students to be able to evaluate their growth throughout the semester. Which weekly assessment method would align with this objective?

Composing a reflection essay

A curriculum specialist is developing an online assessment that checks students' preparedness for a state math assessment. Which feedback provides the most meaningful information?

For each incorrect answer, students are provided with a video that demonstrates the correct way to answer the question.

Seventh-grade students in a French class complete a unit focused on colors with the learning goal of "Students will be able to identify the colors of the rainbow using French vocabulary words." How should the instructor assess whether students met this learning goal using a traditional assessment strategy?

Have students complete a matching worksheet that includes the colors in both English and French

The learning goal for a fifth-grade language arts unit is "Students will be able to use context clues to identify the meanings of unfamiliar words." Using a traditional assessment strategy, how should an instructor determine if students met this learning goal?

Have students complete a multiple-choice vocabulary quiz at the end of each chapter

An instructor is teaching an eight-week clinical health course to college students. At the beginning of the course, each student performs a complex clinical procedure while being recorded. At the end of the course, students perform the same procedure while being recorded. The students compare these performances and reflect on how their ability to perform the complex procedure has progressed.

Ipsative

What is a construct-validity bias issue with this plan?

It has not been determined that the created assessments measure the students' knowledge of the objectives.

Students in an online creative writing class must develop an original story about a superhero. A teacher for the class reviews the drafts and finds that one student did not include all of the required information. The teacher inserts a comment into the student's live, shared document that says, "You successfully named your superhero and explained how she discovered her powers. To earn full credit, please add two more details about your superhero's appearance and give an example of how she uses her powers for good." Why would this comment be considered quality feedback?

It provides specific information about revisions that are needed

The learning goal for a research foundations course is "Apply a variety of approaches to identify and solve problems." The summative assessment for the course involves applying these approaches to a case study. Why would this authentic assessment strategy be effective in measuring students' achievement of the learning goal?

It requires students to apply acquired knowledge to realistic situations.

A lesson objective for a ninth-grade history class is "Students will be able to explain how the preamble serves as an introduction to the United States Constitution." Which assessment would align with this objective and the Understand level of the revised Bloom's taxonomy?

Paraphrasing the preamble to the United States Constitution

Match the learning objective with embedded assessment task to the aligned Revised Bloom's Taxonomy level. In an auto-mechanics certification course, the learner will be able to state which EPA laws apply to exhaust system repairs.

Remember

In which stage of backward design does the instructor consider what will be acceptable and accurate evidence of students meeting learning goals and objectives asking "how will I know" students have met these goals and objectives?

Stage 2

The objective of a high school art unit is, "Students will be able to make artwork using mixed media." How could a project-based assessment method be used to determine whether students have met this learning objective?

Students could create a portfolio with samples of their artwork.

Second-grade students are learning about common and proper nouns in their English language arts class. At the end of a lesson, a teacher distributes electronic clickers to the students, lists one noun at a time on a whiteboard, and asks students to select whether the noun is a common or proper noun. Which learning objective aligns with this assessment and the Analyze cognitive level of the revised Bloom's taxonomy?

Students will be able to differentiate between common and proper nouns in sentences.

Maria conducts a three-day training to train an organization's administrative staff on a new automated scheduling system. After the training, the organization's training director requests the scores participants earned on the final training activity, which is a complex simulation. Which type of assessment does the final training activity represent?

Summative

What type of assessment should an instructor administer to collect evidence of learners' knowledge, skill, or proficiency?

Summative

What is the bias issue in this item?

The content relies on language suited to specific interests and experiences.

An online college course uses a digital textbook and online practice quizzes that students can take at any time to determine their competency. The responses are available to both the students and their instructor. What can be determined from the learning analytics data measures from these practice quizzes to help the instructor decide how to help students meet the competency goals of the course?

The content that students have mastered

Learning analytics from an online course indicate that some students are successfully completing discussion board assignments and exams without first reading the course materials in the modules. How can the learning analytics data be interpreted for the purpose of adjusting this course?

The data indicate that the course materials should be better aligned with the assignments and assessment activities.

During the first week of a 12-week semester, students in an online accounting course complete an orientation. The orientation includes a knowledge check of the students' ability to locate specific course information and access navigation menu items. However, three weeks into the course, students are asking the instructor how to access assignment information. The instructor would like to provide further direction to these students. Which data measure should the instructor review to determine how to help these students?

The frequency of students access to course activity content

The learning goal of a fifth-grade math unit is "Students will be able to correctly identify place values from one to ten million." A teacher for the course conducts informal checks for understanding by asking students to complete exit tickets, submit self-reflections, and share their responses using individual whiteboards. What is the teacher's purpose in collecting this formative assessment data?

To monitor student learning to guide instruction

A learning experience designer is asked to design a fill-in-the-blank vocabulary test for nursing students who are studying for a licensing exam. Each item has one right answer, and students receive a final score based on the number of correct answers. Which assessment strategy is being used?

Traditional