Topics
Topics
UX and NPS Benchmarks of Office Supply Websites (2023)
When people need office supplies, they’re unlikely to use Dunder Mifflin; instead, they’ll search online. But like the fictional paper supply company, many well-known office-supply brands (some with physical stores) have struggled to compete with Amazon and haven’t recovered from the impacts of COVID policies on in-person work. In 2019, Office Depot closed 50 stores,
Sample Sizes for Rating Scale Confidence Intervals
Sample size computations can seem like an art. Some assumptions are involved when computing sample sizes, but it should be more math than magic. A key ingredient needed to cook up a sample size estimate is the standard deviation. You need yeast to make bread, and you need a measure of variability to make an
Initial Validation of Tech-Savvy Measures
How do you measure tech savviness? For several years (since 2015), we’ve been on a mission to develop a valid and practical measure. In our earlier articles, we have Reviewed the literature. We reviewed the literature on tech-savvy measures and found three key approaches to measuring tech-savviness by assessing (1) what a person knows, (2)
How to Estimate the Standard Deviation for Rating Scales
The standard deviation is the most common measure of variability. It’s less intuitive than measures of central tendency such as the mean, but it plays an essential role in analysis and sample size planning. The standard deviation is a key ingredient when building a confidence interval and can be easily computed from a sample of
What Do People Say When They Think Aloud?
Think Aloud (TA) usability testing is a popular UX research method. Having participants speak their thoughts as they attempt tasks helps researchers understand sources of misunderstandings, potentially aiding them in identifying and fixing usability problems. It’s such a common technique in usability testing that we suspect few researchers think about the impacts and consequences (positive
UX and NPS Benchmarks of Electronics Websites (2023)
What do people buy online? Behind clothing, consumer electronics are at the top of the list. Beyond smartphones, people purchase computers, TVs, tablets, gaming consoles, and a myriad of smartphone accessories. Before purchasing, roughly half of US consumers research details about consumer products online, including features, reviews, and prices. To understand the electronics researching and
13 Tips for Running a Successful Rolling Research Program
While the term Lean UX has faded in popularity, many of the lean concepts remain, and they are even incorporated into other frameworks such as Agile. One of the core tenets of Lean UX is to focus on decisions and not deliverables. In project-based UX research, decisions often take a back seat to deliverables. Research
Refining a Tech-Savvy Measure for UX Research
In an earlier article, we described a pilot study from 2015 in which we investigated how to measure tech savviness. Building on the published literature, we generated candidate items that measured three aspects of tech savviness: what people know, what people do, and what people feel. In that pilot study, we assessed knowledge using a
Do Click Tests Predict Live Site Clicks?
How important and predictive is the first click on a website? Some earlier research by Bob Bailey and Cari Wolfson, conducted between 2006 and 2009 across a dozen studies, found an interesting result. If a user’s first click on a website was down one of the optimal paths for the intended task, 87% of those
The Variability and Reliability of Standardized UX Scales
In an earlier article, we examined a large dataset of rating scale data. After analyzing over 100,000 individual responses from 4,048 multipoint items across 25 studies, we reported the typical standard deviations for five-, seven-, and eleven-point items. We found that the average standard deviation tended to be around 25% of the maximum range of
Do Images Change Card Sort Results?
Card sorting is a popular activity that researchers use to understand how people group and associate items such as products or information. Using a research platform like MUIQ®, card sorting is typically done electronically and often without an attending moderator. One advantage of digital over physical card sorting is that it’s easier to add images
Does Thinking Aloud Affect Study Metrics?
One of the most popular UX research methods is Think Aloud (TA) usability testing. Having participants speak their thoughts while working on tasks helps researchers identify usability problems and potential fixes. After a TA session, many UX research teams also collect study-level metrics. Study-level metrics are typically asked only once in a study (unlike task-level