Chapter 4

We are planning to conduct usability testing. Find the one that does not necessary to be determined in planning the evaluation study?

recruiting experts

For large implementation projects, the customer or manager usually sets objective and measurable goals for hardware and software performance. If the completed product fails to meet defined acceptance criteria, the system must be reworked until success is demonstrated. What do we call this test?

Acceptance Test

Describe the meaning of Institutional Review Boards (IRB)?

An institutional review board (IRB), also known as an independent ethics committee or ethical review board, is a committee that has been formally designated to approve, monitor, and review biomedical and behavioral research involving humans.

____ is a reasonably comprehensive expert analysis, focused on the psychological aspects of the interface. Specifically, it focuses on understanding how well the interface supports "exploratory learning" i.e., first-time use without formal training. It involves one or a group of evaluators inspecting a user interface by going through a set of tasks and evaluators inspecting a user interface by going through a set of tasks and evaluate it's understandably and ease of learning.

Cognitive walkthrough

_______ is a more formal analysis based on code walk-throughs. Specifically, it evaluates a user interface in terms of identifying graphics, text, and interaction discrepancy.

Consistency Inspection

_____ is more formal analysis, based on code breakthroughs. In this evaluation method, expert(s) are asked to inspect consistency within an application. Evaluating and improving a user's interface is performed both within a screen and between screens, in graphics (color, typography, layout, icons), text (tone, style, spelling), interaction (consistency of tasks steps and command names).

Consistency inspection

_________ is usually considered as a theoretic framework. But, it is broadly applied to scientific experiments because it can produce more fundamental results and support perceptual, cognitive, and motoric theories. Utilizing the experiments is often considered in user interface design because it can lead to a deeper understanding of the fundamental principles of human interaction with computers. It also can help fine tuning the human-computer interface of actively used systems.

Controlled Psychological-oriented Experiment

If you have a tight budget, what usability testing should be considered?

Discount usability testing

Find the one that does not have correct description about expert reviews?

Formal usability inspection combines individual and group inspections in a six-step procedure with freely defined roles to with elements of both heuristic evaluation and a simplified form of cognitive walkthroughs.

The evaluation process requires that a small set of testers (or "evaluators") examine the interface, and judge its compliance with recognized usability principles (the "heuristics"). A major advantage for this evaluation process is that it provides some quick and relatively inexpensive feedback to designers. But, it requires a certain level of knowledge and experience to apply the heuristics effectively. What do we call this evaluation process?

Heuristic Evaluation

______ is a usability inspection methods for computer software that helps to identify usability problems in the user interface (UI) design.

Heuristic evaluation

When we are performing an evaluation to identify "user friendly" for user interface, it is important to establish measurable criteria for the user interface. Find the one that does not belong to the measurable criteria for the user interface.

Human understanding over time

Describe the difference between Within-subjects evaluation an Between-Subjects evaluation?

In a between-subjects design, the various experimental treatments are given to different groups of subjects perform at all levels of the independent variable.

While informal demos to colleagues or customers can provide some useful feedback, more formal expert reviews have proven to be effective. Find the one that has incorrect description about expert reviews?

Inviting one or two expert reviewers would be sufficient enough for initiating expert reviews.

Identify the one that has an autocorrect explanation about heuristic evaluation.

It is performed by having more than one evaluator inspect the interface alone.

Describe how User Testing is far more accurate than Heuristic Evaluation.

It takes into account actual users tasks. He may miss problems & find "false positives"

Controlled usability experiment(s) can be performed online as well. ________ is a crowdsourcing Internet marketplace that enables computer programmers (known as Requesters) to coordinate the use of human intelligence to perform tasks that computer are currently unable to do.

Mechanical Turk (MTurk)

______ is an evaluation that experts consider metaphors fro five aspects of human thinking. It appears better than cognitive walkthrough and heuristic evaluation.

Metaphors of human thinking

Find the one that does not have correct description about Usability Testing?

Participants should not be chosen to represent the intended user communities.

Various forms of usability testing have been formed and tested b y researchers. Find the one that is not an example of usability testing?

Repetitive usability testing

Although formal expert reviews have proven to be effective for evaluating interface designs, there might be some limitations in expert reviews. Explain the limitations?

The dangers with expert reviews are that the experts may not have an adequate understanding of the task domain or user communities. Even experienced expert reviewers have great difficulty knowing how typical users, especially first-time users will really behave.

When evaluating user-interfaces, we should be careful of following certain procedures. Find the one that is an incorrect description about the procedures that we need to follow?

The design team needs not to be involved with research on the current system design drawbacks.

In usability testing, think aloud protocol is often used to understand what participants are doing as they are performing the task. Explain the think aloud protocol?

Think-aloud (thinking aloud) protocol (also talk-aloud protocol) is a protocol used to gather data in usability testing. Think-aloud protocols involve participants thinking aloud as they are performing a set of specified tasks. Participants are asked to say whatever comes into their mind as they complete the task. This might include hat they are looking at, thinking, doing, and feeling.

One of expert reviews (metaphors of human thinking) focuses on considering metaphors for five aspects of human thinking. Find one that does not belong to these five aspects of human thinking.

Understanding

Often informal demos can provide some useful feedback. However, formal expert reviews have proven to be effective than informal demos. Find the one that does not belong to expert reviews?

Understanding human ability

If you focus on testing the design of products and environments to be usable by all people, to the greatest extent possible, without the need for adaptation or specialized design, what usability testing should be utilized?

Universal usability testing

For large implementation projects, the customer or manager usually sets objective and measurable goals for hardware and software performance to conduct acceptance testing has been successfully completed, there may be a period of _______ before national or international distribution.

field testing

Guidelines review is similar to a heuristic evaluation, but uses a set of user interface ______ instead of a set of heuristics.

guidelines

Heuristic evaluation was developed Jacob Nielsen in the early 1990s. It mainly perform an evaluation based on _____ distilled from an empirical analysis of 249 usability problems. These ____ have been revised for current technology. Often, design guidelines form a basis for developing _______.

heuristics