COMP Exam 2
Many techniques, the most popular is ____________ ___________ ___________
Hierarchical Task Analysis (HTA)
Qualitative
Open-ended survey questions on satisfaction questionnaire Observations Interviews
user satisfaction questionnaire
completed after the user test
What is the correct sequence of the three stages for heuristic evaluation?
Briefing session Evaluation period Debriefing session
Which of the following focuses on representing user-system interactions? A. UML diagrams B. usability tests C. use cases D. Volere shells
C. use cases
What is one of the "practical issues" discussed in the textbook that should be considered when planning an evaluation study?
Choosing appropriate participants to be involved in the study and considering what those participants will be asked to do.
Which of the following is an evaluation technique that does NOT involve potential users. A. usability testing B. in the wild studies C. cognitive walkthroughs D. None of these evaluation techniques involve potential users.
D. None of these evaluation techniques involve potential users.
Which of the following is a data collection technique described in the textbook for gathering data for requirements? A. focus groups B. direct observations C. studying documentation D. These are all described in the textbook as techniques for gathering data for requirements.
D. These are all described in the textbook as techniques for gathering data for requirements.
Which of the following types of evaluations studies are discussed in Chapter 14 of the textbook? A. usability testing B. experiments C. field studies D. These are all discussed in Chapter 14 of the textbook.
D. These are all discussed in Chapter 14 of the textbook.
Which of the following is a method for creating low-fidelity prototypes that is discussed in the textbook? A. storyboarding B. sketching C. use of index cards D. These are all methods for creating low-fidelity prototypes that are discussed in the textbook.
D. These are all methods for creating low-fidelity prototypes that are discussed in the textbook.
Which of the following is a reason that an evaluation method might be used that does not involve users? A. Potential users might not be easily accessible. B. Involving potential users might be too expensive. C. Involving potential users may take too long. D. These are all reasons evaluation methods might be used that do not involve users.
D. These are all reasons evaluation methods might be used that do not involve users.
Sketching
Sketching is important to low-fidelity prototyping Don't be inhibited about drawing ability. Practice simple symbols
Experiments
Something is manipulated to explore cause-and-effect Random assignment
confounding variable(s)
Something the researcher is not studying, but may not be able to control
What is "used mainly to investigate an existing situation, not to envision new products"?
Task analysis
______________ is used mainly to investigate an existing situation
Task analysis
_____________ are often used to envision new systems or devices
Task descriptions
What is a predictive model that attempts to determine a numerical prediction of user performance?
The Keystroke Level Model
Use cases
assume interaction with a system assume detailed understanding of the interaction
An experimental design for which subjects are randomly assigned to only one of the experimental conditions is known as a(n) _____________.
between-subjects design
In the context of an evaluation study, the term reliability refers to how well the method
can produce the same results on different occasions when performed under the same circumstances.
The first "E" in the DECIDE framework is about
clearly articulating the questions to be answered by the evaluation study.
Research
"a systematic process of collecting, analyzing, and interpreting information (data) in order to increase our understanding of the phenomenon about which we are interested or concerned"
Which of the following is a technique discussed in the textbook for expressing task descriptions? A. requirements analysis documents B. scenarios C. Volere shells D. These are all mentioned in the textbook as ways to express task descriptions.
B. scenarios
How many evaluators (usability experts) does Nielsen recommend for a heuristic evaluation?
Between 3 and 5
Scenarios
an informal narrative story, simple, 'natural', personal, not generalizable
Evaluation
"Systematic investigation of the worth or merit of an object"
Between ___ to ___ subjects should participate in a usability study.
5 and 12
Quasi
Something is manipulated to explore cause-and-effect NO random assignment
The textbook mentions a quote from Boehm and Basili about how expensive it is to fix a software problem after product delivery. According to this quote, how much more expensive is it to fix a software problem after delivery than it is to find and fix it "during the requirements and design phase"?
100 times
_____ to ______ subjects should be adequate
5 to 12
Wizard of Oz
A human operator simulates the correct software response
Prototype
A limited representation of a product's design with which potential users can interact.
What is the difference between a design and a prototype?
A prototype is an interactive version of a design
What is likely to be found on an informed consent form?
A statement informing subjects that they can stop participating in the study at any time.
Which of the following is one of the three principles of a user-centered approach to development described in the textbook? A. Empirical measurement B. requirements analysis C. software testing D. These are all principles of the user-centered approach described in the textbook.
A. Empirical measurement
Which of the following best describes the process of establishing requirements? A. It is an iterative activity. B. It is a static activity. C. It is a random activity. D. It is a straightforward activity.
A. It is an iterative activity.
Methods for evaluating user traffic through a system are known as
Analytics
Stakeholder
Anyone who has a direct or indirect influence as to the requirements of a project.
Which of the following is a philosophy underlying good interaction design? A. Requiring the project team to strictly adhere to the waterfall model of software development. B. Involving users in the design and evaluation process. C. Performing evaluation only after the project has been completed. D. Allowing the programmers to make all interface design decisions.
B. Involving users in the design and evaluation process.
A limited representation of a product's design that can demonstrate how interaction with a product will work is known as a(n): A. requirement. B. model. C. prototype. D. alternative.
B. model.
Which of the following is a type of requirement discussed in the textbook? A. functional B. data C. environmental D. These are all types of requirements discussed in the textbook.
D. These are all types of requirements discussed in the textbook.
Which of the following should be considered when determining the requirements for an interactive product? A. users and their capabilities B. current user tasks and goals C. conditions under which a product might be used D. These should all be considered when determining the requirements of an interactive product.
D. These should all be considered when determining the requirements of an interactive product.
The process of determining the usability and/or acceptability of a product is known as A. establishing requirements. B. designing alternatives. C. prototyping D. evaluating
D. evaluating
Low-fidelity prototype
Does not look very much like the intended final product.
The process of determining what kind of support (or features) that an interactive product should provide for users is known as: A. establishing requirements. B. designing alternatives. C. prototyping. D. evaluating.
Establishing requirements.
Prediction Research
Examines the extent to which differences in one characteristic or variable are related to differences in one or more other characteristics or variables
Vertical prototyping is when a high-fidelity prototype supports
Few features, but with great detail
What can be used to predict the time it takes a user to select a target using a pointing device?
Fitt's Law
What is a usability inspection method that involves an expert applying a set of usability principles to a product to determine whether or not the interface conforms to the principles? Experts applies usability principles to determine if interface conforms to principles
Heuristic Evaluation
Evaluation enables designers to ensure that their design is appropriate for
Intended users.
Hierarchical Task Analysis
Involves breaking a task down into subtasks, then sub-sub-tasks and so on. These are grouped as plans which specify how the tasks might be performed in practice
Usability Testing
Involves testing whether a product is usable in a controlled environment
High-fidelity prototype
Looks similar to the intended final product.
Horizontal prototyping is when a high-fidelity prototype supports
Many features with little detail
Storyboards
Often used with scenarios, bringing more detail, and a chance to role play It is a series of sketches showing how a user might progress through a task using the device Used early in design
Case Study 11.3 in the textbook describes prototyping the design of cell phones using what medium?
Paper
An important difference between "cognitive walkthroughs" and "pluralistic walkthoughs" is that
Pluralistic walkthoughs involve users.
What is a challenge of using predictive models?
Predictive models can only make predictions about predictable user behavior.
Ex Post Facto Research
Researchers might want to study cause-and-effect but for ethical or logistical reasons are not able to manipulate anything
Personas
Rich descriptions of hypothetical users of the product under development who might be representative of typical users.
In the context of evaluation studies, what best describes the purpose of an IRB?
To ensure that the rights of study participants are protected, and to make sure that the participants are not put in physical or emotional danger.
What is most likely to be a goal of usability testing?
To evaluate whether or not a product is usable for accomplishing tasks for which the product was designed.
What is the best reason to conduct an experiment?
To test specific hypotheses.
Remember the key components of usability testing
User test and user satisfaction questionnaire
What is one of Nielsen's usability heuristics described in Chapter 15 of the textbook?
Visibility of system status
What is a usability inspection method that involves a designer and expert(s) working through user tasks and noting problematic usability issues?
Walkthroughs
Data Requirements
What kinds of data need to be stored? How will they be stored (e.g. database)?
Functional Requirements
What the system should do Historically the main focus of requirements activities
A study that is conducted to test a hypothesis, and for which (to the extent possible) all aspects of the study are controlled except for the variable(s) under investigation is known as a(n)
controlled experiment.
In a within subjects design, having half of the subjects experience conditions in one order and the other half experience conditions in the opposite order is known as
counterbalancing.
Getting requirements right is
crucial
When following the process of interaction design discussed in the textbook, a product's design emerges iteratively through repeated _______________ cycles.
design-evaluation-redesign
Bias occurs in evaluation studies when results are _________.
distorted
If we wanted to determine how a product was being used in real world settings, what evaluation methods would be most appropriate?
field study
To evaluate a user's experience with a product in natural settings a(n) ___________ would most likely be conducted.
field study
Evaluation performed during the design of a product to make sure that it is meeting user's needs is known as ___________ evaluation.
formative
Subject data
gender, age,
In an experiment, an independent variable is what the researcher
manipulates
In an experiment, a dependent variable is what the researcher
measures
In the context of an evaluation study, the term validity refers to whether or not the method
measures what it is supposed to be measuring.
Non-functional Requirements
memory size, response time...
While usability testing is often performed in controlled environments, field studies take place in
natural settings.
Which of the following is a common metric in usability testing?
number of errors made
Data is collected for field studies primarily through
observation and interviews.
environment requirements
physical: dusty? noisy? vibration? light? heat? humidity? .... (e.g. OMS insects, ATM) social: sharing of files, of displays, in paper, across great distances, work individually, privacy for clients organisational: hierarchy, IT department's attitude and remit, user support, communications structure and infrastructure, availability of training
What is most likely to be completed by subjects at the conclusion of a usability testing session?
satisfaction questionnaire
Determining the goals for your evaluation help you to determine the evaluation's __________.
scope
Evaluation performed to assess the quality of a finished product is known as __________ evaluation.
summative
Task analysis: It is important not to focus on ________ ________
superficial activities
An inferential statistics technique that can be performed to see if there is a significant difference between two group means is known as a
t-test.
As part of Contextual Inquiry, the context principle emphasizes the importance of
the designer going to the workplace to see what takes place there.
A key difference between the evaluation methods discussed in Chapter 14 of the textbook (usability testing, experiments, and field studies) and the evaluation methods discussed in Chapter 15 of the textbook is that
the methods discussed in Chapter 15 do not require users for the evaluation.
In the context of an evaluation study, the phrase ecological validity refers to the extent to which
the results of the evaluation are influenced by the environment where the evaluation takes place.
In general, the null hypothesis states that
there is no difference between conditions.
To understand what is going through users' heads as they use a product, subjects are often asked to __________ as they perform tasks in usability testing.
think aloud
The two most common performance measures in usability testing are
time to complete a task and number of errors made.
Performance Metrics
time-on-task, errors, task success,
Evaluation can focus on both the ____________ of a system and on the _____________ when interacting with a system.
usability, user experience
User test
what you have the subjects do