HCI-2
The System Usability Scale (SUS) is a widely used, _______-item questionnaire designed to assess the usability of a system or interface, providing a simple and reliable measure of user satisfaction.
Answer: 10 Explanation: The System Usability Scale (SUS) consists of 10 items, which are designed to assess the usability of a system or interface. This questionnaire provides a simple and reliable measure of user satisfaction, making it a popular choice for usability evaluations in various domains.
The System Usability Scale (SUS) is a popular _______-item questionnaire used to measure the perceived usability of an interface, providing a reliable and quick assessment of user satisfaction.
Answer: 10 Explanation: The System Usability Scale (SUS) is a widely used questionnaire consisting of 10 items that measure users' perceptions of an interface's usability. With its straightforward format and proven reliability, the SUS is a valuable tool for quickly assessing user satisfaction and identifying areas for improvement.
When designing a questionnaire for HCI evaluation, it is essential to ensure that questions are _______ and easy to understand, minimizing potential confusion or misinterpretation by participants.
Answer: clear Explanation: Clear and easy-to-understand questions are crucial when designing a questionnaire for HCI evaluation. By minimizing ambiguity and potential confusion, researchers can increase the reliability of the responses and ensure that the data collected accurately reflects users' experiences and opinions.
To calculate the SUS score, researchers first need to sum the converted scores for each item, with positive statements having their scale position value minus 1, and negative statements having 5 minus their scale position value. Then, the sum is multiplied by _______ to obtain the final SUS score.
Answer: 2.5 Explanation: To calculate the SUS score, researchers first sum the converted scores for each item. For positive statements, the scale position value is subtracted by 1, and for negative statements, 5 is subtracted from the scale position value. After obtaining the sum of the converted scores, it is then multiplied by 2.5 to produce the final SUS score, which ranges from 0 to 100.
The NASA-TLX utilizes a two-step process, where participants first rate each of the six dimensions on a _______ scale, followed by a pairwise comparison of the dimensions to determine their relative importance.
Answer: 20-point Explanation: The NASA-TLX assessment process involves two steps. First, participants rate each of the six dimensions on a 20-point scale, with higher scores indicating greater perceived workload. Next, participants complete a pairwise comparison of the dimensions to determine the relative importance of each dimension, which is then used to calculate a weighted overall workload score.
The SUS contains both positive and negative statements, with participants rating their agreement on a _______-point Likert scale, ranging from "strongly disagree" to "strongly agree."
Answer: 5 Explanation: The SUS uses a 5-point Likert scale for each item, with participants indicating their level of agreement with the statements, ranging from "strongly disagree" (1) to "strongly agree" (5). The mix of positive and negative statements helps to reduce response bias and encourages participants to consider their experiences more carefully.
The NASA-TLX assesses users' perceived workload across six dimensions, including Mental Demand, Physical Demand, Temporal Demand, Performance, Effort, and _______.
Answer: Frustration Explanation: The six dimensions of the NASA-TLX are Mental Demand, Physical Demand, Temporal Demand, Performance, Effort, and Frustration. These dimensions capture different aspects of the workload experienced by users while interacting with a system or interface, providing a comprehensive understanding of the overall task demands.
If the normality assumption is not met or if the sample sizes are small, researchers might use a non-parametric test, such as the _______ U test, to compare SUS scores between two groups.
Answer: Mann-Whitney Explanation: If the normality assumption is not met or if the sample sizes are small, researchers can use a non-parametric test like the Mann-Whitney U test to compare SUS scores between two groups. The Mann-Whitney U test does not require the normality assumption and is more robust to small sample sizes than the t-test.
When examining the relationship between SUS scores and other continuous variables, researchers can use the _______ correlation coefficient to quantify the strength and direction of the association between the two variables.
Answer: Pearson Explanation: The Pearson correlation coefficient is used to quantify the strength and direction of the association between SUS scores and other continuous variables. This can help researchers understand how usability (as measured by the SUS) is related to other factors, such as user demographics, task performance metrics, or other usability measures.
One of the advantages of using questionnaires in HCI evaluation is that they can be easily _______ to suit the specific needs and goals of a particular study or evaluation.
Answer: adapted Explanation: Questionnaires are a flexible method for HCI evaluation, as they can be easily adapted to address specific research questions, goals, or contexts. By tailoring the questions and response options, researchers can obtain more relevant and targeted data to inform their evaluation and design decisions.
In addition to the original NASA-TLX, there are several _______ versions of the instrument that have been developed to accommodate specific contexts or user populations, such as the NASA-TLX for children or for use in virtual environments.
Answer: adapted Explanation: These adaptations, such as the NASA-TLX for children or for use in virtual environments, maintain the core principles of the original instrument while making necessary adjustments to ensure its suitability and validity for the specific context or user population. By using these adapted versions, researchers can obtain accurate and relevant workload data that is tailored to their unique study requirements and participant groups.
When using the NASA-TLX in HCI evaluations, it is essential to consider the _______ of the instrument by ensuring that the questions are relevant and meaningful for the specific user population and study context.
Answer: appropriateness Explanation: Ensuring the appropriateness of the NASA-TLX in a specific HCI evaluation involves verifying that the questions are relevant and meaningful for the user population and the study context. The instrument should accurately capture the aspects of workload that are most pertinent to the users and the task at hand, in order to provide valuable insights into the design and performance of the interface.
When using the SUS, it is essential to consider the _______ of the instrument by ensuring that the questions are relevant and meaningful for the specific user population and study context.
Answer: appropriateness Explanation: Ensuring the appropriateness of the SUS in a specific HCI evaluation involves verifying that the questions are relevant and meaningful for the user population and the study context. The instrument should accurately capture the aspects of usability that are most pertinent to the users and the task at hand to provide valuable insights into the design and performance of the interface.
A limitation of the SUS is that it provides an overall measure of usability but does not differentiate between specific _______ of usability, such as learnability, efficiency, or error prevention.
Answer: aspects Explanation: While the SUS provides a useful overall measure of usability, it does not differentiate between specific aspects of usability, such as learnability, efficiency, or error prevention. To obtain more detailed insights into these specific aspects, researchers may need to employ additional evaluation methods or targeted usability questionnaires.
To minimize potential biases in users' responses to the NASA-TLX, researchers can consider using a _______ administration, which can help reduce the impact of factors such as social desirability bias or experimenter expectations.
Answer: blinded Explanation: A blinded administration of the NASA-TLX involves concealing the purpose of the assessment or the specific hypotheses being tested from participants. This approach can help minimize potential biases in users' responses, such as social desirability bias or the influence of experimenter expectations, leading to more accurate and reliable workload data.
The NASA-TLX can be used as a _______ tool for evaluating the impact of design changes or interventions on users' perceived workload, allowing researchers to compare workload scores before and after the implementation of modifications.
Answer: comparative Explanation: The NASA-TLX serves as an effective comparative tool for evaluating the impact of design changes or interventions on users' perceived workload. By administering the NASA-TLX before and after the implementation of design modifications, researchers can compare workload scores and assess the effectiveness of the changes in reducing workload and improving the user experience.
The NASA-TLX is particularly useful for assessing workload in _______ tasks or situations where users must manage multiple sources of information, cognitive demands, or physical challenges.
Answer: complex Explanation: The NASA-TLX is well-suited for assessing workload in complex tasks or situations, where users are required to manage multiple sources of information, cognitive demands, or physical challenges. By capturing users' perceptions of workload across six dimensions, the NASA-TLX provides valuable insights into the various factors contributing to workload and highlights areas where interface design or task structure can be improved to reduce workload and enhance user performance.
The NASA-TLX is often used in conjunction with other HCI evaluation methods, such as usability testing, think-aloud protocols, or heuristic evaluations, to provide a more _______ assessment of the user experience and the impact of interface design on workload.
Answer: comprehensive Explanation: Combining the NASA-TLX with other HCI evaluation methods, such as usability testing, think-aloud protocols, or heuristic evaluations, allows researchers to obtain a more comprehensive assessment of the user experience and the impact of interface design on workload. This multi-method approach can help identify areas for improvement and provide more targeted design recommendations to enhance the overall user experience.
The SUS is often used in conjunction with other HCI evaluation methods to provide a more _______ assessment of the user experience and the impact of interface design on usability.
Answer: comprehensive Explanation: Combining the SUS with other HCI evaluation methods, such as heuristic evaluations, think-aloud protocols, or task-based usability testing, allows researchers to obtain a more comprehensive assessment of the user experience and the impact of interface design on usability. This multi-method approach can help identify areas for improvement and provide more targeted design recommendations to enhance the overall user experience.
The NASA-TLX can be administered either _______ or post-task, depending on the specific goals of the HCI evaluation and the potential impact of the assessment on users' performance and experiences during the task.
Answer: concurrently Explanation: The NASA-TLX can be administered concurrently (during the task) or post-task (after task completion), depending on the specific goals of the HCI evaluation and the potential impact of the assessment on users' performance and experiences. Concurrent administration may provide more immediate insights into users' workload experiences, while post-task administration can help minimize potential distractions or interruptions during the task. Researchers should consider the trade-offs and implications of each approach when planning their HCI evaluation.
Although the NASA-TLX is a widely used and well-validated instrument, it is essential for researchers to consider its potential limitations and the unique characteristics of their specific study context when interpreting the results and making _______ recommendations.
Answer: design Explanation: While the NASA-TLX is a valuable tool for assessing workload in HCI evaluations, researchers should be mindful of its potential limitations and consider the unique characteristics of their study context when interpreting the results and making design recommendations. By considering the strengths and weaknesses of the NASA-TLX, as well as the specific goals and requirements of their evaluation, researchers can make more informed and targeted design decisions to enhance the user experience.
While the SUS is a valuable tool for assessing usability, it is essential for researchers to consider its potential limitations and the unique characteristics of their specific study context when interpreting the results and making _______ recommendations.
Answer: design Explanation: While the SUS is a valuable tool for assessing usability, researchers should be mindful of its potential limitations and consider the unique characteristics of their study context when interpreting the results and making design recommendations. By considering the strengths and weaknesses of the SUS, as well as the specific goals and requirements of their evaluation, researchers can make more informed and targeted design decisions to enhance the user experience.
While the SUS is a valuable tool for obtaining quick usability feedback, it may not be suitable for capturing the nuances of _______ interactions or experiences, as it focuses primarily on users' overall perceptions of system usability.
Answer: emotional Explanation: The SUS is primarily focused on users' overall perceptions of system usability and may not be suitable for capturing the nuances of emotional interactions or experiences. To explore these aspects in more detail, researchers might need to use additional evaluation methods or questionnaires designed specifically to assess users' emotional experiences with a system or interface.
The ease of administering and interpreting the SUS makes it an attractive choice for _______ evaluations or for researchers who are new to usability assessment, as it provides a straightforward approach to measuring user satisfaction.
Answer: formative Explanation: The SUS is an attractive choice for formative evaluations or for researchers who are new to usability assessment, as it offers a straightforward approach to measuring user satisfaction. The ease of administration and interpretation helps researchers quickly and efficiently gather usability feedback, which can inform design decisions and improvements.
A potential disadvantage of the SUS is that it is a(n) _______ questionnaire, which means that it may not capture the unique features or challenges of specific systems or interfaces, limiting the specificity of the feedback obtained.
Answer: generic Explanation: The SUS is a generic questionnaire, which means it may not capture the unique features or challenges of specific systems or interfaces. As a result, the specificity of the feedback obtained might be limited. To obtain more detailed insights into the unique aspects of a system or interface, researchers may need to use additional, tailored evaluation methods or develop custom questionnaires.
The overall SUS score ranges from 0 to 100, with higher scores indicating _______ usability and user satisfaction with the system or interface.
Answer: greater Explanation: The overall SUS score ranges from 0 to 100, where higher scores represent greater usability and user satisfaction with the system or interface. This score provides a simple and easily interpretable metric that can be used to compare different systems or track usability improvements over time.
The NASA-TLX is often used in the evaluation of HCI designs to assess the impact of different interface elements or task designs on users' perceived workload, helping to identify areas for _______ and optimization.
Answer: improvement Explanation: The NASA-TLX is commonly used in HCI evaluations to assess how different interface elements or task designs affect users' perceived workload. By identifying aspects of the interface or task that contribute to high workload, researchers and designers can make targeted improvements and optimizations to enhance the overall user experience.
A common statistical test used to compare SUS scores between two groups (e.g., two different interface designs) is the _______ t-test, which assesses whether there is a significant difference in the means of the two groups.
Answer: independent Explanation: The independent t-test is a commonly used statistical test to compare SUS scores between two groups, such as users of two different interface designs. This test assesses whether there is a significant difference in the means of the two groups, providing evidence for or against the hypothesis that the designs have differing levels of usability.
A SUS score of 68 is often considered to be the _______ average, meaning that a system with a score below this value might be perceived as having below-average usability, while a system with a score above this value might be perceived as having above-average usability.
Answer: industry Explanation: A SUS score of 68 is often considered the industry average, serving as a benchmark to compare the usability of different systems. A system with a SUS score below 68 might be perceived as having below-average usability, while a system with a score above 68 might be perceived as having above-average usability. However, it is important to consider the specific context and user population when interpreting SUS scores.
The SUS has been translated into several _______ to accommodate diverse user populations, making it a versatile tool for assessing usability in international and multicultural contexts.
Answer: languages Explanation: The SUS has been translated into several languages to accommodate diverse user populations, making it a versatile tool for assessing usability in international and multicultural contexts. Researchers should select the most appropriate language version for their specific user population to ensure accurate and meaningful usability data.
The SUS is often used as a(n) _______ measure to track changes in usability over time or between different iterations of a system or interface, providing valuable feedback for designers and developers to make improvements.
Answer: longitudinal Explanation: The SUS is often employed as a longitudinal measure, allowing researchers to track changes in usability over time or between different iterations of a system or interface. This provides valuable feedback for designers and developers, guiding them in making improvements and ensuring that changes to the system result in enhanced usability.
To determine whether the SUS scores have a normal distribution, which is an assumption for some statistical tests like the t-test, researchers can perform a(n) _______ test.
Answer: normality Explanation: A normality test is used to determine whether SUS scores have a normal distribution, which is an assumption for some statistical tests, like the t-test. If the normality assumption is violated, researchers may need to employ alternative statistical methods, such as non-parametric tests, to compare SUS scores between groups.
The NASA-TLX can be used in conjunction with _______ measures of workload, such as physiological indicators or performance metrics, to provide a more comprehensive understanding of users' experiences and the impact of interface design on workload.
Answer: objective Explanation: Combining the subjective data provided by the NASA-TLX with objective measures of workload, such as physiological indicators (e.g., heart rate variability) or performance metrics (e.g., task completion time), can provide a more comprehensive understanding of users' experiences and the impact of interface design on workload. This multi-method approach helps researchers and designers obtain a more complete picture of the factors contributing to workload and identify targeted improvements to enhance the user experience.
The use of _______ questions in HCI questionnaires allows participants to provide more detailed and nuanced responses about their experiences and opinions, complementing the data collected through closed-ended questions.
Answer: open-ended Explanation: Open-ended questions in HCI questionnaires provide participants with the opportunity to express their thoughts and opinions in their own words, offering richer and more nuanced insights into their experiences. These questions can complement closed-ended questions by providing additional context and a deeper understanding of users' perspectives.
The NASA-TLX can be administered in a _______ format or as an electronic questionnaire, allowing researchers to choose the most appropriate method for their specific study context and participant population.
Answer: paper-and-pencil Explanation: The NASA-TLX can be administered either as a paper-and-pencil questionnaire or in an electronic format, providing researchers with the flexibility to select the most suitable method for their specific study context and participant population. Both formats allow for the collection of reliable and valid workload data.
The SUS can be administered either in a _______ format or electronically, depending on the preferences of the researchers and the context of the evaluation.
Answer: paper-and-pencil Explanation: The SUS can be administered in a paper-and-pencil format or electronically, giving researchers the flexibility to choose the most appropriate method for their specific study context and participant population. Both formats enable the collection of reliable and valid usability data.
While the SUS provides a useful overall measure of usability, it does not provide detailed information on specific _______ or issues that may be impacting user satisfaction, requiring additional evaluation methods to identify these areas for improvement.
Answer: problems Explanation: The SUS offers a valuable overall measure of usability, but it does not provide detailed insights into specific problems or issues affecting user satisfaction. To identify these areas for improvement, additional evaluation methods, such as heuristic evaluations, think-aloud protocols, or task-based usability testing, may be required.
One potential limitation of the NASA-TLX is that it relies on users' _______ reports of workload, which may not always accurately reflect the true cognitive, physical, or emotional demands experienced during a task.
Answer: self Explanation: The NASA-TLX relies on users' self-reports of their perceived workload, which may not always provide an accurate representation of the actual demands experienced during a task. Users may have difficulty accurately recalling or estimating their workload, or their reports may be influenced by factors such as fatigue or social desirability bias. Despite this limitation, the NASA-TLX remains a valuable tool for assessing workload in HCI evaluations.
In addition to the original NASA-TLX, the Raw NASA-TLX (RTLX) is a _______ version of the instrument that eliminates the pairwise comparison step and uses only the raw ratings of the six dimensions, simplifying the administration and analysis process.
Answer: simplified Explanation: The Raw NASA-TLX (RTLX) is a simplified version of the original NASA-TLX that eliminates the pairwise comparison step, requiring participants to provide raw ratings for each of the six dimensions only. This streamlined approach simplifies the administration and analysis process while still providing valuable workload data, although it may not be as sensitive to subtle differences in workload as the weighted scoring method used in the original NASA-TLX.
When analyzing questionnaire data in HCI evaluation, it is essential to consider the potential impact of _______ bias, as users may provide responses that they perceive to be more socially acceptable or favorable.
Answer: social desirability Explanation: Social desirability bias is a common concern when analyzing questionnaire data, as participants may be inclined to provide responses that they believe are more socially acceptable or favorable. To mitigate this potential bias, researchers should design their questions carefully, use anonymity when appropriate, and consider the context in which the questionnaire is administered.
The _______ Questionnaire for User Interaction Satisfaction (QUIS) is a widely used tool for assessing users' satisfaction with a specific interface or system, focusing on various aspects of the user experience, such as system capabilities, interface design, and user support.
Answer: standardized Explanation: The standardized Questionnaire for User Interaction Satisfaction (QUIS) is a popular tool for assessing users' satisfaction with an interface or system. The questionnaire covers multiple aspects of the user experience and provides a comprehensive assessment of user satisfaction, helping researchers identify areas for improvement and inform design decisions.
When comparing SUS scores between different systems or interface designs, researchers often employ _______ tests to determine if the observed differences are statistically significant and not merely due to chance.
Answer: statistical Explanation: Statistical tests are used to determine if observed differences in SUS scores between systems or interface designs are statistically significant, meaning that the differences are not merely due to chance. These tests help researchers draw more reliable conclusions from their usability data and make informed design decisions.
Questionnaires are a widely used method for collecting _______ data from users in HCI evaluation, allowing researchers to gather information about users' attitudes, preferences, and experiences.
Answer: subjective Explanation: Subjective data refers to information that is based on users' personal opinions, feelings, and perceptions. Questionnaires are a popular method for collecting this type of data in HCI evaluation, as they enable researchers to efficiently gather feedback from a large number of users.
The SUS is considered to be a(n) _______ measure, as it captures users' perceptions of usability rather than objective performance metrics, such as task completion time or error rates.
Answer: subjective Explanation: The SUS is a subjective measure of usability because it captures users' perceptions of the system or interface's usability rather than relying on objective performance metrics, such as task completion time or error rates. While subjective measures are valuable for understanding users' experiences, it is often helpful to combine them with objective measures to obtain a more comprehensive understanding of the system's usability.
Although the SUS was originally developed for evaluating the usability of software systems, it has since been adapted and used for evaluating a wide range of _______ systems and interfaces, such as websites, mobile apps, and hardware devices.
Answer: technology Explanation: The SUS, originally developed for software systems, has been adapted and used for evaluating a wide range of technology systems and interfaces, including websites, mobile apps, and hardware devices. Its versatility and simplicity make it a popular choice for usability evaluations across various domains.
The SUS is particularly useful for providing a quick and efficient measure of usability in _______ situations, where time and resources for more extensive usability evaluations may be limited.
Answer: time-sensitive Explanation: The SUS is well-suited for time-sensitive situations, as it offers a quick and efficient way to assess usability when time and resources for more extensive usability evaluations are limited. The simplicity and brevity of the questionnaire make it an attractive option for obtaining usability feedback in various contexts.
The SUS is considered a _______ and reliable instrument for assessing usability, with good psychometric properties and the ability to detect differences in usability across various systems and interfaces.
Answer: valid Explanation: The SUS is a valid and reliable instrument for assessing usability, as it has demonstrated good psychometric properties in numerous studies. It has the ability to detect differences in usability across various systems and interfaces, making it a suitable choice for a wide range of usability evaluations.
To ensure the _______ of a questionnaire in HCI evaluation, it is essential to pilot test the instrument with a small sample of participants, refining the questions and response options based on the feedback received.
Answer: validity Explanation: Ensuring the validity of a questionnaire in HCI evaluation involves pilot testing the instrument with a small sample of participants. This process allows researchers to identify any potential issues or ambiguities in the questions and response options. Based on the feedback received, they can refine the questionnaire to improve its clarity, relevance, and overall validity before administering it to a larger group of participants.
One advantage of the NASA-TLX as a workload assessment tool is its _______ across various domains and contexts, making it suitable for evaluating workload in a wide range of settings, from aviation to healthcare.
Answer: versatility Explanation: The NASA-TLX is a versatile workload assessment tool that has been successfully applied across various domains and contexts, including aviation, healthcare, and other industries. This adaptability makes it a valuable instrument for HCI researchers and practitioners seeking to evaluate the impact of interface design and task structure on users' perceived workload.
The NASA Task Load Index (NASA-TLX) is a widely used subjective, multidimensional assessment tool that measures users' perceived _______ across six dimensions while interacting with a system or interface.
Answer: workload Explanation: The NASA Task Load Index (NASA-TLX) measures users' perceived workload while interacting with a system or interface, taking into account six distinct dimensions of workload. This assessment tool helps researchers understand the cognitive, physical, and emotional demands placed on users and identify potential areas for improvement in the interface.