When working with UX metrics (e.g., rating scale data) you need to consider both the average and the variability of the responses. People have different experiences with interfaces, and sometimes they interpret items in rating scales differently. This variability is typically measured with the standard deviation. The standard deviation is a key ingredient in computing
For quantifying the user experience of a product, app, or experience, we recommend using a mix of study-level and task-based UX metrics. In an earlier article, we provided a comprehensive guide to task-based metrics. Tasks can be included as part of usability tests or UX benchmark studies. They involve having a representative set of users
When quantifying the user experience of a product, app, or experience, we recommend using a mix of study-level and task-based UX metrics. While it’s not always feasible to assess a task experience (because of challenges with budgets, timelines, or access to products and users), observing participants attempt tasks can help uncover usability problems, informing designers
Statistically significant. p-value. Hypothesis. These terms are not only commonly used in statistics but also have made their way into the vernacular. Making sense of most scientific publications, which can have practical, significant effects on public policy and your life, means understanding a core framework with which we derive much knowledge. That framework is called
Driving down the road while only looking in the rearview mirror … that gives you a good idea of where you’ve been, but unless the road behind you is exactly like the one in front of you, you may run into some obstacles, to put it mildly. Safe and effective driving means looking forward and
Unmoderated testing platforms allow for quick data collection from large sample sizes. This has enabled researchers to answer questions that were previously difficult or cost prohibitive to answer with traditional lab-based testing. But is the data collected in unmoderated studies, both behavioral and attitudinal, comparable to what you get from a more traditional lab setup? Comparing
Task completion is one of the fundamental usability metrics. It’s the most common way to quantify the effectiveness of an interface. If users can’t do what they intend to accomplish, not much else matters. While that may seem like a straightforward concept, actually determining whether users are completing a task often isn’t as easy. The
Evaluate product designs and concepts early and often. Don’t wait till you’ve built the entire app, website, or product before having people actually use it. Build a prototype and test it. These principles are fundamental to user-centered-design, as well as other popular concepts such as the lean startup and minimum viable products featured in the
Positive word of mouth is a critical driver of future growth for consumer software products. Along with features and capabilities, user experience is a key determinant of how likely users adopt new technology and recommend software. We’ve found that usability accounts for between 30% and 60% of the variation in Net Promoter Scores. A positive
It was another busy year on MeasuringU.com with 50 new articles, the release of the 2nd editions of two books, UX Bootcamps in Denver and Rome and talks in London and Chicago. In 2016, our articles were served up to over a million visitors. Thank You! We covered topics including: usability testing, measurement and research
