There are many ways to format rating scales. Recently we have explored Labeling neutral points Labeling all or some response options Altering the number of response options Comparing agreement vs. item-specific endpoint labels Each of these formatting decisions has a variety of opinions and research, both pro and con, in the scientific literature at large.
Human: Computer, can you recognize speech? Computer: I think you said, can you wreck a nice beach? Both the quality of synthesized speech and the capability of communicating with a computer using your voice have come a long way since the debut of this technology in the 1970s. One of the most famous synthetic voices
There’s no shortage of opinions about the Net Promoter Score. There’s nothing wrong with an opinion. It’s just better when there’s data backing it. Unfortunately, when it comes to opinions about the Net Promoter Score, especially how the underlying question is displayed, the opinions are often based on anecdotes and out-of-context “best practices.” At MeasuringU,
Who, as a person, doesn’t want to be desirable? And if you’re in the business of developing products or services, who doesn’t want those to be desirable? There is a deep satisfaction beyond the monetary rewards of providing something that people want (and of course, the money’s nice, too). While we’ve found wide interest in
We write extensively about standardized UX metrics such as the SUS, PSSUQ, and SUPR-Q. The main benefits of standardization include improved reliability, validity, sensitivity, objectivity, quantification, economy, communication, and norms. Even when standardized UX questionnaires are developed independently, they are influenced by earlier work, just like how UX itself is a new field built upon earlier
Small changes can have big impacts on rating scales. But to really know what the effects are, you need to test. Labels, number of points, colors, and item wording differences can often have unexpected effects on survey responses. In an earlier analysis, we compared the effects of using a three-point recommend item compared to an
Survey response options come in all sorts of shapes, sizes, and now, colors. The number of points, the addition of labels, the use of numbers, and the use of positive or negative tone are all factors that can be manipulated. These changes can also affect responses, sometimes modestly, sometimes a lot. There is some concern
We love writing about measures at MeasuringU. We write about measures we’ve created (SUPR-Q®), industry standards (SUS, NPS, and TAM), emerging industry standards (UMUX-Lite), and lesser-known ones (lostness). Jim Lewis and I also have a chapter dedicated to questionnaires in Quantifying the User Experience. We’ll often encounter a new measure when working with clients, as
What gets measured gets managed. It’s more than a truism for business executives. It’s also essential for the user experience professional. In business, and UX research in particular, you don’t want to bring focus to the wrong or flawed measure. It can lead to wrong decisions and a misalignment of effort. In an earlier article,
UX research pulls many terms, methods, and conventions from other fields. Selecting a method is an important first choice in measuring the user experience. But an important next step is understanding the variables you’ll have to deal with when designing a study or drawing conclusions. Variables are things that change. Variables can be controlled and measured.
