feature image with microphone and pointing at laptop

Does Thinking Aloud Reduce the Evaluator Effect?

In Think Aloud (TA) testing, participants speak their thoughts while attempting tasks. The process is meant to help researchers identify usability problems and potential fixes. Indeed, in an earlier analysis, we found an increase in problem discovery. Our evaluation of 153 videos, split between TA and non-TA, revealed that evaluators uncovered 36–50% more problems with

Read More »
Feature Image of a microphone and computer screen

Does Thinking Aloud Uncover More Usability Issues?

One of the most popular UX research methods is Think Aloud (TA) usability testing. In TA testing, participants speak their thoughts while attempting tasks. The process helps researchers identify usability problems and potential fixes. But is the process of thinking aloud necessary to uncover problems and insights? Earlier, we investigated the effects of TA on

Read More »

Is What You See What You Get?
Examining the Evaluator Effect in Unmoderated Usability Testing

If different researchers conduct a study, will they identify different problems? While it was originally controversial, the evaluator effect is now well-established in the field of UX research. The evaluator effect is the finding that, in general, different teams or individuals conducting a usability study will identify and report different problems (Hertzum & Jacobsen, 2003).

Read More »

The Methods UX Professionals Use (2022)

The wide range of UX methods is one of the things that makes UX such an interesting field. Some methods, like usability testing, have been around for decades. Others are more recent additions, and some seem to be just slight variations on other existing methods. We’ve been tracking and analyzing the methods UX professionals reported

Read More »

Improving the Prediction of the Number of Usability Problems

Paraphrasing the statistician George Box, all models are wrong, some are useful, and some can be improved. In a recent article, we reviewed the most common way of modeling problem discovery, which is based on a straightforward application of the cumulative binomial probability formula: P(x≥1) = 1 – (1-p)n. Well, it’s straightforward if you like

Read More »

Three Goals of Usability Testing

The fundamental goal of usability testing is to produce highly usable products and services. That’s an uncontroversial statement. Where things can get a bit confusing is how different approaches to usability testing have different ways of achieving that goal. In earlier articles we have described the different types of usability tests but many types still

Read More »

How Much Does a Usability Test Cost?

Usability testing is expensive. At least that has been the perception. But the idea that usability is a nice-to-have ideal that only big companies such as IBM or Microsoft can afford has fortunately evolved. While technology has improved and gotten cheaper, it’s the technique that’s become more accessible and accepted. The discount-usability movement helped emphasize the effectiveness

Read More »

What You Need to Conduct a Moderated Usability Test

Usability tests don’t have to be expensive or require a lot of technology. The real value is not in the equipment or technology but in the technique. Usability testing is not a focus group. Nor is usability testing a product demo. You shouldn’t lead participants through a product as if it were a demo and

Read More »
0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top