Quiz 4 - Usability Testing 1

What are the three questions to consider during the "evaluation" phase of the user-centered design cycle?

1) How do we know if we have made a "good" interface? 2) How do we know if it makes people's lives better? 3) How can we be certain our assumptions are "correct"?

Steps for conducting a usability test (one of the four evaluation approaches)

1) bring in real users 2) have them complete tasks with your design, while you watch with your entire team 3) have the user say what they are thinking 4) measure task completion, task time, and satisfaction 5) identify problems & provide suggestions to team 6) iterate on the design and repeat

Details of the analytical evaluation (one of the four evaluation approaches)

1) does not involve end users 2) does involve either: a) inspection: experts assess the system using structured techniques for uncovering usability flaws or b) performance modelling: using theoretical models to predict user performance, e.g. Fitts Law

Details of "quick-and-dirty" evaluation (one of the four evaluation approaches)

1) get feedback from a consultant or a small number of users 2) can be done at any time in the design process 3) goal is to get input quickly without having to carefully document findings

Things you care about in a usability test (aspects of usability)

1) learnability/discoverability [how easy for first-time users?] 2) efficiency 3) memorability [how easy to use after time away?] 4) how many errors the user makes 5) user satisfaction - is it pleasant to use?

What are the different approaches to evaluation?

1) quick-and-dirty 2) analytical evaluation 3) usability testing & experiments 4) field studies

To consider when writing usability tasks:

1) test something specific [does a task flow work] or something broad [does your language match the user's mental model?] 2) consider the context of use: a) what would someone want to do with the tool? b) what circumstances would they be in?

Details of field study (one of the four evaluation approaches)

1) users use the system in its natural setting 2) data is gathered through observation and interviews 3) systems can be "instrumented" to collect usage data

Where is usability testing in the user-centered design cycle?

During the "evaluation" phase?

What is a usability test?

It's a "formal" method for evaluating whether a design is learnable, efficient, memorable, can reduce errors, and meets users' expectations

What is the subject of evaluation in a usability test?

The design - not the users!