Blogs

Usability tests are conducted on samples of users taken from a larger user population. In usability testing it is hard enough to recruit and test users let alone select them randomly from the larger user population. Samples in usability studies are almost always convenience samples. That is, we rely on volunteers to participate in our test (a convenience to us). Volunteers, even paid volunteers, are

Read More

A user-interface problem is anything in the code or design that inhibits a user from completing an intended action. Usability testing is best done in the formative stages of development to find these UI problems and generate quantifiably better designs. Usability testing also has a summative role at the end of development as validation when bugs and functional gaps have been addressed.  Most UI problems

Read More

While it might seem like having users think aloud while they complete a task will increase the time on task—the literature is actually mixed. Some studies report no difference, some show longer task times for thinking aloud and others report faster task times for thinking aloud. It has been hypothesized that the reason users can perform faster while they think aloud is because this vocalization

Read More

While testing with five users might reveal 85% of problems that impact 31% of users (given a set of tasks and user-type), it doesn't mean you're finding 85% of the critical problems.  Are severe usability problems likely to occur more frequently, less frequently or is problem severity independent of frequency? The data on this is mixed. The paper from Bob Virzi in 1992 showed there

Read More

I'm always gathering and looking at data. One consequence of this is having to reconcile conflicting data-points—say data from users who express different perspectives on an issue. For example, one of my articles was recently tweeted with the note:  "any website with the name usability in it should let you know you're clicking on a PDF." Few things slow the web-browsing experience down more than

Read More

Was a task difficult or easy to complete? Performance metrics are important to collect when improving usability but perception matters just as much. Asking a user to respond to a questionnaire immediately after attempting a task provides a simple and reliable way of measuring task-performance satisfaction. Questionnaires administered at the end of a test such as SUS, measure perception satisfaction. There are numerous questionnaires to

Read More