Featured image with rating scale and formula

Sample Sizes for Comparing Rating Scales to a Benchmark

Is product satisfaction above average? Is it best in class? Do customers have a favorable or unfavorable opinion of the current product? When UX researchers want to measure attitudes and intentions, they often ask respondents to complete multipoint items like the one shown in Figure 1. It’s also common to set a target benchmark for

Read More »
Featured image

Sample Sizes for Rating Scale Confidence Intervals

Sample size computations can seem like an art. Some assumptions are involved when computing sample sizes, but it should be more math than magic. A key ingredient needed to cook up a sample size estimate is the standard deviation. You need yeast to make bread, and you need a measure of variability to make an

Read More »

How to Use the Finite Population Correction

What is the impact if you sample a lot of your population in a survey? Many statistical calculations—for example, confidence intervals, statistical comparisons (e.g., the two-sample t-test), and their sample size estimates—assume that your sample is a tiny fraction of your population. But what if you have a relatively modest population size (e.g., IT decision-makers

Read More »

Sample Sizes for Comparing SUS Scores

Microsoft Word is a widely used word processing program, part of the Microsoft Office suite of programs. While its dominance has been challenged recently by Google Docs, Word still leads on the features list, providing many features that Google’s offering lacks. But adding features can also add to bloat, making common tasks harder as users

Read More »

A New Statistical Approach for Predicting Usability Problems

In an earlier article, we described the most common methods for modeling the total number of unique usability problems uncovered in a usability test: the average problem occurrence (p), adjusted problem occurrence (adj-p), beta-binomial, and specific problem probabilities. While these methods provide reasonably accurate predictions of the total number of unique problems, there is still

Read More »

Sample Sizes for Comparing SUS to a Benchmark

The System Usability Scale (SUS) has been used in industrial user experience research since the mid-1980s. Despite its age, the SUS is still a popular measure, widely used in benchmark tests of software products to measure perceived usability. One reason for its popularity is the extent to which its measurement properties have been comprehensively studied

Read More »

Sample Sizes for a SUS Score

Despite its age and the availability of other UX measures such as the UX-Lite™ and SUPR-Q®, the ten-item System Usability Scale (SUS) is still a very popular measure. It’s used widely in benchmark tests of software products to generate an overall score of perceived usability. We regularly collect SUS scores for dozens of consumer and

Read More »

49 UX Metrics, Methods, and Measurement Articles from 2021

Happy New Year from all of us at MeasuringU®! In 2021 we posted 49 articles and welcomed several new clients to our UX testing platform MUIQ®, where we continue to add new features to reduce the friction in developing studies. We hosted our eighth UX Measurement Bootcamp, again as a virtual event. Going virtual still

Read More »

How to Statistically Analyze Net Promoter Scores

In a famous Harvard Business Review article published in 2003, Fred Reichheld introduced the Net Promoter Score (NPS). The NPS uses a single likelihood-to-recommend (LTR) question (“How likely is it that you would recommend our company to a friend or colleague?”) with 11 scale steps from 0 (Not at all likely) to 10 (Extremely likely).

Read More »

UX and Net Promoter Benchmarks of Mass Merchant Websites

With the COVID-19 pandemic’s effect on consumer shopping behavior (e.g., increased online shopping for delivery or contactless pickup), mass merchant revenues rose dramatically in 2020 and the first part of 2021. For example, Target reported a $15B sales growth in 2020, higher than its total sales growth over the past 11 years. For another example,

Read More »
0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top