Blogs

Small differences in design changes can have large consequences on website purchases. But detecting these small differences (e.g. 2%–10% changes) through behaviors and attitudes has generally not been feasible from traditional lab-based testing due to the time and costs of recruiting and facilitator costs/time. With unmoderated testing, organizations can now collect data from hundreds to thousands of participants quickly and from around the world to

Read More

In Benchmarking the User Experience, I write about the importance of a regular plan for quantifying the user experience of your websites, apps, or devices. This involves collecting metrics, usually at both task and study levels. But the point of benchmarking isn’t just to collect metrics to put on a dashboard, it’s to ultimately improve them. A common question we receive when conducting benchmark studies

Read More

What does 4.1 on a 5-point scale mean? Or 5.6 on a 7-point scale? Interpreting rating scale data can be difficult in the absence of an external benchmark or historical norms. A popular technique used often by marketers to interpret rating scale data is the so-called “top box” and “top-two box” scoring approach. For example, on a 5-point scale, such as the one shown in Figure

Read More

Your car doesn’t start on some mornings. Your computer crashes at the worst times. Your friend doesn’t show up to your dinner party. If something or someone isn’t reliable, it’s not only a pain but it makes your life less effective and less efficient. And what is true for people and products is true for measurement. The wording of items and the response options we

Read More

Where do you get your news? Do you think it’s objective? Do you trust it? Fewer people are relying on print (newspapers and magazines) and even TV for their news. Print subscriptions continue to decline and almost half of Americans report getting their news online, nearly the same as TV news. Despite the evolution of the news “interface” from print and TV to digital, many of

Read More

A lot of UX methods exist along with recommendations on when to use them. Some activities tend to cross methods: from operationalizing research questions, making data collection more efficient, and making the most of both what users say and what they do. Here are five techniques we’ve found that make our UX research more effective (and often more efficient). 1. Use a Research Matrix To ensure a

Read More

UX metrics are a mix of attitude (what people think) and actions (what people do). To fully measure the user experience, you need to measure both. UX metrics are influenced by more than an interface. Users have preconceived notions about companies and this affects both how they think and what they do when they interact with a brand—either in a store or online. Brand attitudes

Read More

Uncovering usability problems is at the heart of usability testing. Problems and insights can be uncovered from observing participants live in a usability lab, using heuristic evaluations, or watching videos of participants. But if you change the person looking for the problems (the evaluator), do you get a different set of problems? The Evaluator Effect It’s been 20 years since two influential papers (Jacobsen, Hertzum,

Read More