MeasuringU

48 UX Metrics, Methods, & Measurement Articles from 2020

By Jim Lewis, PhD and Jeff Sauro, PhD . December 29, 2020 . Tags: UMUX-lite, Rating Scale, Sample Size, Survey

Happy New Year from all of us at MeasuringU! 2020 was a crazy year, but we still managed to post 48 new articles and continued improving MUIQ, our UX testing platform. We hosted our seventh UX Measurement Bootcamp, this time virtually. The change of format was a challenge, but it was fantastic to work with attendees from all over the world. The topics we wrote

From Functionality to Features: Making the UMUX-Lite Even Simpler

By Jim Lewis, PhD and Jeff Sauro, PhD . December 15, 2020 . Tags: UMUX-lite, Research, Rating Scale

Like pictures and pixels on a screen, words are a type of user interface. Complex language, like complex software, can lead to misunderstanding, so words should communicate effectively while being easy to understand. The solution, to paraphrase William Zinsser, is to use words that are simple and concise—a guideline that also applies to UX questionnaires. This brings us to the UMUX-Lite, an increasingly popular UX

From Soared to Plummeted: Can We Quantify Change Verbs?

By Jeff Sauro, PhD and Jim Lewis, PhD . December 1, 2020 . Tags: sliders, UMUX-lite, Questionnaires, Rating Scale, Sample Size

Cases spike, home prices surge, and stock prices tank: we read headlines like these daily. But what is a spike and how much is a surge? When does something crater versus tank or just fall? Headlines are meant to grab our attention. They often communicate the dramatic story the author wants to tell rather than what the data say. It isn’t easy to write headlines.

Rating Scale Best Practices: 8 Topics Examined

By Jeff Sauro, PhD and Jim Lewis, PhD . November 17, 2020 . Tags: Sensitivity, Emoji scale, Star Scale, sliders, LTR, UMUX-lite, Sample Size

Rating scales have been around for close to a century. It’s no wonder there are many questions about best practices and pitfalls to avoid. And like any topic that’s been around for that long, there are urban legends, partial truths, context-dependent findings, and just plain misconceptions about the “right” and “wrong” way to use and interpret rating scales. We’ve been researching and conducting our own

Simplifying the UMUX-Lite

By Jim Lewis, PhD and Jeff Sauro, PhD . September 29, 2020 . Tags: Measure, UMUX-lite, Measurement

It seems like every few years a new standardized UX measure comes along. Standardization of UX measurement is a good thing for researchers and practitioners. Having common methods and definitions helps with objectivity, generalization, economy, and professional communication. At MeasuringU, we pay a lot of attention to the continuing evolution of standardized UX measurement. The UMUX-Lite is a relatively recent measure that has been attracting

Should You Use Negative Numbers in Rating Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . September 15, 2020 . Tags: negative scale, UMUX-lite

There are a lot of opinions about the best formats for agreement scales. Sometimes those opinions are strongly held and can lead to lengthy, heated discussions within research teams. When format differences affect measurement properties, those discussions may be time well spent, but when the formats don’t matter (or matter very little), the time is wasted. That’s why we have an ongoing research goal to

Are Face Emoji Ratings Better than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . September 8, 2020 . Tags: graphic scale, Emoji scale, UMUX-lite

Somewhat agree, very satisfied, extremely likely. The labels used on the points of rating scales can affect responses in often unpredictable ways. What’s more, certain terms can get lost in translation when writing surveys for international usage. Some terms may have subtly different meanings, possibly making cross-cultural comparisons problematic. While numbers are universally understood and don’t need translation, does "5" on a seven-point scale properly

Are Star Ratings Better Than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . July 21, 2020 . Tags: Linear Numeric Scale, Star Scale, UMUX-lite, Satisfaction

Five-star reviews. Whether you're rating a product on Amazon, a dining experience on Yelp, or a mobile app in the App or Play Store, you can see that the five-star rating system is quite ubiquitous. Does the familiarity of stars offer a better rating system than traditional numbered scales? We recently reported a comparison between standard five-point linear numeric scales with 0–100-point slider scales made with UMUX-Lite

Are Sliders Better Than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . July 14, 2020 . Tags: slider, Visual Analog Scale, sliders, UMUX-lite

There are many ways to format rating scales. Recently we have explored Labeling neutral points Labeling all or some response options Altering the number of response options Comparing agreement vs. item-specific endpoint labels Each of these formatting decisions has a variety of opinions and research, both pro and con, in the scientific literature at large. Our controlled studies on these topics in the context of

Consumer Software UX & NPS Benchmarks 2020

By Jeff Sauro, PhD and Jim Lewis, PhD . May 12, 2020 . Tags: consumer software, Desirability, UMUX-lite, Net Promoter Score, NPS

Software dominates our professional and personal lives. A product's usability, in addition to its features and capabilities, is an important influence on how likely users are to adopt new technology and recommend the software. Between 30 and 60% of the variation in Net Promoter Scores is determined by a product's usability. Customers tend to recommend products they have positive experiences with. Similarly, bad experiences lead customers

UMUX-lite

by Jim Lewis, PhD and Jeff Sauro, PhD | December 29, 2020

Browse Content by Topic

48 UX Metrics, Methods, & Measurement Articles from 2020

By Jim Lewis, PhD and Jeff Sauro, PhD . December 29, 2020 . Tags: UMUX-lite, Rating Scale, Sample Size, Survey

From Functionality to Features: Making the UMUX-Lite Even Simpler

By Jim Lewis, PhD and Jeff Sauro, PhD . December 15, 2020 . Tags: UMUX-lite, Research, Rating Scale

From Soared to Plummeted: Can We Quantify Change Verbs?

By Jeff Sauro, PhD and Jim Lewis, PhD . December 1, 2020 . Tags: sliders, UMUX-lite, Questionnaires, Rating Scale, Sample Size

Rating Scale Best Practices: 8 Topics Examined

By Jeff Sauro, PhD and Jim Lewis, PhD . November 17, 2020 . Tags: Sensitivity, Emoji scale, Star Scale, sliders, LTR, UMUX-lite, Sample Size

Simplifying the UMUX-Lite

By Jim Lewis, PhD and Jeff Sauro, PhD . September 29, 2020 . Tags: Measure, UMUX-lite, Measurement

Should You Use Negative Numbers in Rating Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . September 15, 2020 . Tags: negative scale, UMUX-lite

Are Face Emoji Ratings Better than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . September 8, 2020 . Tags: graphic scale, Emoji scale, UMUX-lite

Are Star Ratings Better Than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . July 21, 2020 . Tags: Linear Numeric Scale, Star Scale, UMUX-lite, Satisfaction

Are Sliders Better Than Numbered Scales?

By Jim Lewis, PhD and Jeff Sauro, PhD . July 14, 2020 . Tags: slider, Visual Analog Scale, sliders, UMUX-lite

Consumer Software UX & NPS Benchmarks 2020

By Jeff Sauro, PhD and Jim Lewis, PhD . May 12, 2020 . Tags: consumer software, Desirability, UMUX-lite, Net Promoter Score, NPS