Are Face Emoji Ratings Better than Numbered Scales?

Somewhat agree, very satisfied, extremely likely. The labels used on the points of rating scales can affect responses in often unpredictable ways. What’s more, certain terms can get lost in translation when writing surveys for international usage. Some terms may have subtly different meanings, possibly making cross-cultural comparisons problematic. While numbers are universally understood and

Read More »

The Evolution of the Mean Opinion Scale: From MOS-R to MOS-X2

The Mean Opinion Scale (MOS) is a standardized questionnaire used to assess synthetic speech. The quality of synthetic speech strongly affects the user experience of working with conversational systems, with listeners making rapid and unconscious judgments of the speaker’s personality, so it’s important to have standardized methods for its assessment. In an earlier article, we

Read More »

What Is the Mean Opinion Scale (MOS)?

The quality of the electronic transmission of the human voice has come a long way since Bell summoned Watson. But even with all the advancement in technology, “Can you hear me now?” is still part of our modern lexicon. Voice—both human and digital—plays an increasingly important role in interactions with our devices. But before you

Read More »

Rating Scales: Myth vs. Evidence

There’s a lot of conventional wisdom floating around the Internet about rating scales. What you should and shouldn’t do. Best practices for points, labels, and formats. It can be hard to differentiate between science-backed conclusions and just practitioner preferences. In this article, we’ll answer some of the more common questions that come up about rating

Read More »

What’s the Difference Between Pragmatic and Hedonic Usability?

Is a usable experience sufficient for a good experience? Assuming a product, website, or app does what it intends to do and is usable, is there anything more? Usability testing tends to focus on the objective task-oriented performance quality of an experience. What about aspects such as innovativeness, originality, or beauty? Do these matter? If

Read More »

Cultural Effects on Rating Scales

Numbers are universally understood across cultures, geography, and languages. But when those numbers are applied to sentiments (for example, satisfaction, agreement, or intention), do people respond universally or does a 4 on a five-point scale elicit different reactions based on culture or geography? Many international organizations use similar sets of measures (such as satisfaction or

Read More »

Should All Scale Points Be Labeled?

To have a reliable and valid response scale, people need to understand what they’re responding to. A poorly worded question, an unclear response item, or an inadequate response scale can create additional error in measurement. Worse yet, the error may be systematic rather than random, so it would result in unmodeled bias rather than just

Read More »

10 Things to Know About the Post Study System Usability Questionnaire

We’ve written extensively about the System Usability Scale (SUS). It’s the most widely used and cited questionnaire for measuring the perception of the user experience. But likely the second most widely used and cited questionnaire, with over 2,000 citations, is the Post Study System Usability Questionnaire (PSSUQ). It also goes by the name of Computer

Read More »

10 Things to Know about the NASA TLX

The NASA TLX is a multi-item questionnaire developed in 1980 by Sandra Hart. NASA is, of course, the US-based space agency famous for the one giant leap for mankind. The TLX stands for Task Load Index and is a measure of perceived workload. If you conduct mostly digital UX research for consumers (websites and software), you

Read More »

How to Assess the Quality of a Measure

It seems like each year introduces a new measure or questionnaire. Like a late-night infomercial, some are even touted as the next BIG thing, like the NPS was. New questionnaires and measures are a natural part of the evolution of measurement (especially measuring difficult things such as human attitudes). It’s a good thing. I’ll often

Read More »
0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top