COMP Exam 2

Many techniques, the most popular is ____________ ___________ ___________

Hierarchical Task Analysis (HTA)

Qualitative

Open-ended survey questions on satisfaction questionnaire Observations Interviews

user satisfaction questionnaire

completed after the user test

What is the correct sequence of the three stages for heuristic evaluation?

Briefing session Evaluation period Debriefing session

Which of the following focuses on representing user-system interactions? A. UML diagrams B. usability tests C. use cases D. Volere shells

C. use cases

What is one of the "practical issues" discussed in the textbook that should be considered when planning an evaluation study?

Choosing appropriate participants to be involved in the study and considering what those participants will be asked to do.

Which of the following is an evaluation technique that does NOT involve potential users. A. usability testing B. in the wild studies C. cognitive walkthroughs D. None of these evaluation techniques involve potential users.

D. None of these evaluation techniques involve potential users.

Which of the following is a data collection technique described in the textbook for gathering data for requirements? A. focus groups B. direct observations C. studying documentation D. These are all described in the textbook as techniques for gathering data for requirements.

D. These are all described in the textbook as techniques for gathering data for requirements.

Which of the following types of evaluations studies are discussed in Chapter 14 of the textbook? A. usability testing B. experiments C. field studies D. These are all discussed in Chapter 14 of the textbook.

D. These are all discussed in Chapter 14 of the textbook.

Which of the following is a method for creating low-fidelity prototypes that is discussed in the textbook? A. storyboarding B. sketching C. use of index cards D. These are all methods for creating low-fidelity prototypes that are discussed in the textbook.

D. These are all methods for creating low-fidelity prototypes that are discussed in the textbook.

Which of the following is a reason that an evaluation method might be used that does not involve users? A. Potential users might not be easily accessible. B. Involving potential users might be too expensive. C. Involving potential users may take too long. D. These are all reasons evaluation methods might be used that do not involve users.

D. These are all reasons evaluation methods might be used that do not involve users.

Sketching

Sketching is important to low-fidelity prototyping Don't be inhibited about drawing ability. Practice simple symbols

Experiments

Something is manipulated to explore cause-and-effect Random assignment

confounding variable(s)

Something the researcher is not studying, but may not be able to control

What is "used mainly to investigate an existing situation, not to envision new products"?

Task analysis

______________ is used mainly to investigate an existing situation

Task analysis

_____________ are often used to envision new systems or devices

Task descriptions

What is a predictive model that attempts to determine a numerical prediction of user performance?

The Keystroke Level Model

Use cases

assume interaction with a system assume detailed understanding of the interaction

An experimental design for which subjects are randomly assigned to only one of the experimental conditions is known as a(n) _____________.

between-subjects design

In the context of an evaluation study, the term reliability refers to how well the method

can produce the same results on different occasions when performed under the same circumstances.

The first "E" in the DECIDE framework is about

clearly articulating the questions to be answered by the evaluation study.

Research

"a systematic process of collecting, analyzing, and interpreting information (data) in order to increase our understanding of the phenomenon about which we are interested or concerned"

Which of the following is a technique discussed in the textbook for expressing task descriptions? A. requirements analysis documents B. scenarios C. Volere shells D. These are all mentioned in the textbook as ways to express task descriptions.

B. scenarios

How many evaluators (usability experts) does Nielsen recommend for a heuristic evaluation?

Between 3 and 5

Scenarios

an informal narrative story, simple, 'natural', personal, not generalizable

Evaluation

"Systematic investigation of the worth or merit of an object"

Between ___ to ___ subjects should participate in a usability study.

5 and 12

Quasi

Something is manipulated to explore cause-and-effect NO random assignment

The textbook mentions a quote from Boehm and Basili about how expensive it is to fix a software problem after product delivery. According to this quote, how much more expensive is it to fix a software problem after delivery than it is to find and fix it "during the requirements and design phase"?

100 times

_____ to ______ subjects should be adequate

5 to 12

Wizard of Oz

A human operator simulates the correct software response

Prototype

A limited representation of a product's design with which potential users can interact.

What is the difference between a design and a prototype?

A prototype is an interactive version of a design

What is likely to be found on an informed consent form?

A statement informing subjects that they can stop participating in the study at any time.

Which of the following is one of the three principles of a user-centered approach to development described in the textbook? A. Empirical measurement B. requirements analysis C. software testing D. These are all principles of the user-centered approach described in the textbook.

A. Empirical measurement

Which of the following best describes the process of establishing requirements? A. It is an iterative activity. B. It is a static activity. C. It is a random activity. D. It is a straightforward activity.

A. It is an iterative activity.

Methods for evaluating user traffic through a system are known as

Analytics

Stakeholder

Anyone who has a direct or indirect influence as to the requirements of a project.

Which of the following is a philosophy underlying good interaction design? A. Requiring the project team to strictly adhere to the waterfall model of software development. B. Involving users in the design and evaluation process. C. Performing evaluation only after the project has been completed. D. Allowing the programmers to make all interface design decisions.

B. Involving users in the design and evaluation process.

A limited representation of a product's design that can demonstrate how interaction with a product will work is known as a(n): A. requirement. B. model. C. prototype. D. alternative.

B. model.

Which of the following is a type of requirement discussed in the textbook? A. functional B. data C. environmental D. These are all types of requirements discussed in the textbook.

D. These are all types of requirements discussed in the textbook.

Which of the following should be considered when determining the requirements for an interactive product? A. users and their capabilities B. current user tasks and goals C. conditions under which a product might be used D. These should all be considered when determining the requirements of an interactive product.

D. These should all be considered when determining the requirements of an interactive product.

The process of determining the usability and/or acceptability of a product is known as A. establishing requirements. B. designing alternatives. C. prototyping D. evaluating

D. evaluating

Low-fidelity prototype

Does not look very much like the intended final product.

The process of determining what kind of support (or features) that an interactive product should provide for users is known as: A. establishing requirements. B. designing alternatives. C. prototyping. D. evaluating.

Establishing requirements.

Prediction Research

Examines the extent to which differences in one characteristic or variable are related to differences in one or more other characteristics or variables

Vertical prototyping is when a high-fidelity prototype supports

Few features, but with great detail

What can be used to predict the time it takes a user to select a target using a pointing device?

Fitt's Law

What is a usability inspection method that involves an expert applying a set of usability principles to a product to determine whether or not the interface conforms to the principles? Experts applies usability principles to determine if interface conforms to principles

Heuristic Evaluation

Evaluation enables designers to ensure that their design is appropriate for

Intended users.

Hierarchical Task Analysis

Involves breaking a task down into subtasks, then sub-sub-tasks and so on. These are grouped as plans which specify how the tasks might be performed in practice

Usability Testing

Involves testing whether a product is usable in a controlled environment

High-fidelity prototype

Looks similar to the intended final product.

Horizontal prototyping is when a high-fidelity prototype supports

Many features with little detail

Storyboards

Often used with scenarios, bringing more detail, and a chance to role play It is a series of sketches showing how a user might progress through a task using the device Used early in design

Case Study 11.3 in the textbook describes prototyping the design of cell phones using what medium?

Paper

An important difference between "cognitive walkthroughs" and "pluralistic walkthoughs" is that

Pluralistic walkthoughs involve users.

What is a challenge of using predictive models?

Predictive models can only make predictions about predictable user behavior.

Ex Post Facto Research

Researchers might want to study cause-and-effect but for ethical or logistical reasons are not able to manipulate anything

Personas

Rich descriptions of hypothetical users of the product under development who might be representative of typical users.

In the context of evaluation studies, what best describes the purpose of an IRB?

To ensure that the rights of study participants are protected, and to make sure that the participants are not put in physical or emotional danger.

What is most likely to be a goal of usability testing?

To evaluate whether or not a product is usable for accomplishing tasks for which the product was designed.

What is the best reason to conduct an experiment?

To test specific hypotheses.

Remember the key components of usability testing

User test and user satisfaction questionnaire

What is one of Nielsen's usability heuristics described in Chapter 15 of the textbook?

Visibility of system status

What is a usability inspection method that involves a designer and expert(s) working through user tasks and noting problematic usability issues?

Walkthroughs

Data Requirements

What kinds of data need to be stored? How will they be stored (e.g. database)?

Functional Requirements

What the system should do Historically the main focus of requirements activities

A study that is conducted to test a hypothesis, and for which (to the extent possible) all aspects of the study are controlled except for the variable(s) under investigation is known as a(n)

controlled experiment.

In a within subjects design, having half of the subjects experience conditions in one order and the other half experience conditions in the opposite order is known as

counterbalancing.

Getting requirements right is

crucial

When following the process of interaction design discussed in the textbook, a product's design emerges iteratively through repeated _______________ cycles.

design-evaluation-redesign

Bias occurs in evaluation studies when results are _________.

distorted

If we wanted to determine how a product was being used in real world settings, what evaluation methods would be most appropriate?

field study

To evaluate a user's experience with a product in natural settings a(n) ___________ would most likely be conducted.

field study

Evaluation performed during the design of a product to make sure that it is meeting user's needs is known as ___________ evaluation.

formative

Subject data

gender, age,

In an experiment, an independent variable is what the researcher

manipulates

In an experiment, a dependent variable is what the researcher

measures

In the context of an evaluation study, the term validity refers to whether or not the method

measures what it is supposed to be measuring.

Non-functional Requirements

memory size, response time...

While usability testing is often performed in controlled environments, field studies take place in

natural settings.

Which of the following is a common metric in usability testing?

number of errors made

Data is collected for field studies primarily through

observation and interviews.

environment requirements

physical: dusty? noisy? vibration? light? heat? humidity? .... (e.g. OMS insects, ATM) social: sharing of files, of displays, in paper, across great distances, work individually, privacy for clients organisational: hierarchy, IT department's attitude and remit, user support, communications structure and infrastructure, availability of training

What is most likely to be completed by subjects at the conclusion of a usability testing session?

satisfaction questionnaire

Determining the goals for your evaluation help you to determine the evaluation's __________.

scope

Evaluation performed to assess the quality of a finished product is known as __________ evaluation.

summative

Task analysis: It is important not to focus on ________ ________

superficial activities

An inferential statistics technique that can be performed to see if there is a significant difference between two group means is known as a

t-test.

As part of Contextual Inquiry, the context principle emphasizes the importance of

the designer going to the workplace to see what takes place there.

A key difference between the evaluation methods discussed in Chapter 14 of the textbook (usability testing, experiments, and field studies) and the evaluation methods discussed in Chapter 15 of the textbook is that

the methods discussed in Chapter 15 do not require users for the evaluation.

In the context of an evaluation study, the phrase ecological validity refers to the extent to which

the results of the evaluation are influenced by the environment where the evaluation takes place.

In general, the null hypothesis states that

there is no difference between conditions.

To understand what is going through users' heads as they use a product, subjects are often asked to __________ as they perform tasks in usability testing.

think aloud

The two most common performance measures in usability testing are

time to complete a task and number of errors made.

Performance Metrics

time-on-task, errors, task success,

Evaluation can focus on both the ____________ of a system and on the _____________ when interacting with a system.

usability, user experience

User test

what you have the subjects do