Search
Exact matches only
Search in title
Search in content
Search in comments
Search in excerpt
Filter by Custom Post Type

Measurement

by Jim Lewis, PhD and Jeff Sauro, PhD | September 29, 2020

Browse Content by Topic

UX ( 73 )
 Methods ( 62 )
 Usability Testing ( 55 )
 Statistics ( 52 )
 Survey ( 39 )
 NPS ( 36 )
 Usability ( 32 )
 Benchmarking ( 32 )
 Customer Experience ( 31 )
 User Research ( 29 )
 Sample Size ( 29 )
 Rating Scale ( 29 )
 SUS ( 28 )
 Net Promoter Score ( 24 )
 Usability Problems ( 18 )
 Metrics ( 17 )
 Questionnaires ( 17 )
 Measurement ( 16 )
 UMUX-lite ( 15 )
 Rating Scales ( 15 )
 Satisfaction ( 14 )
 Validity ( 14 )
 User Experience ( 14 )
 Surveys ( 13 )
 Usability Metrics ( 13 )
 SUPRQ ( 12 )
 Market Research ( 12 )
 SUPR-Q ( 11 )
 Qualitative ( 11 )
 Reliability ( 11 )
 Navigation ( 10 )
 UX Metrics ( 8 )
 SEQ ( 8 )
 Heuristic Evaluation ( 8 )
 Task Time ( 8 )
 Task Completion ( 7 )
 Questionnaire ( 7 )
 Research ( 7 )
 Mobile ( 6 )
 Analytics ( 6 )
 Mobile Usability Testing ( 6 )
 Confidence ( 5 )
 Usability Problem ( 5 )
 Visualizing Data ( 5 )
 Unmoderated Research ( 5 )
 Confidence Intervals ( 5 )
 Six Sigma ( 5 )
 Task Times ( 4 )
 UX Maturity ( 4 )
 Credibility ( 4 )
 Quantitative ( 4 )
 Expert Review ( 4 )
 Loyalty ( 4 )
 sliders ( 4 )
 UX Methods ( 4 )
 Moderation ( 4 )
 Summative ( 3 )
 Lean UX ( 3 )
 Card Sorting ( 3 )
 Usability Lab ( 3 )
 TAM ( 3 )
 Customer Segmentation ( 3 )
 Task Metrics ( 3 )
 Key Driver ( 3 )
 Voice Interaction ( 3 )
 ROI ( 3 )
 Desirability ( 3 )
 Data ( 3 )
 PURE ( 3 )
 Findability ( 2 )
 Personas ( 2 )
 SUM ( 2 )
 Salary Survey ( 2 )
 A/B Testing ( 2 )
 Errors ( 2 )
 Excel ( 2 )
 IA ( 2 )
 Tasks ( 2 )
 Correlation ( 2 )
 Branding ( 2 )
 PhD ( 2 )
 Tree Testing ( 2 )
 Remote Usability Testing ( 2 )
 UX Salary Survey ( 2 )
 Focus Groups ( 2 )
 Marketing ( 2 )
 Emoji scale ( 2 )
 Sample Sizes ( 2 )
 Prototype ( 2 )
 Eye-Tracking ( 2 )
 Variables ( 2 )
 LTR ( 2 )
 slider ( 2 )
 Sensitivity ( 2 )
 Cognitive Walkthrough ( 2 )
 Star Scale ( 2 )
 KLM ( 2 )
 Formative ( 2 )
 Desktop ( 1 )
 Visual Analog Scale ( 1 )
 Linear Numeric Scale ( 1 )
 Within-subjects ( 1 )
 consumer software ( 1 )
 Margin of Error ( 1 )
 History of usability ( 1 )
 ISO ( 1 )
 Task Randomization ( 1 )
 Test Metrics ( 1 )
 Cumulative Graphs ( 1 )
 Meeting software ( 1 )
 User-Centred Design ( 1 )
 Likert ( 1 )
 Carryover ( 1 )
 b2b software ( 1 )
 Design Thinking ( 1 )
 MOS ( 1 )
 Research design ( 1 )
 Bias ( 1 )
 Probability ( 1 )
 Information Architecture ( 1 )
 Greco-Latin Squares ( 1 )
 Site Analytics ( 1 )
 R ( 1 )
 t-test ( 1 )
 Randomization ( 1 )
 Latin Squares ( 1 )
 Measure ( 1 )
 Contextual Inquiry ( 1 )
 Quality ( 1 )
 Problem Severity ( 1 )
 MOS-R ( 1 )
 Anchoring ( 1 )
 Mean Opinion Scale ( 1 )
 graphic scale ( 1 )
 coding ( 1 )
 negative scale ( 1 )
 Mobile Usability ( 1 )
 Polarization ( 1 )
 Hedonic usability ( 1 )
 Unmoderated ( 1 )
 Design ( 1 )
 Task Completin ( 1 )
 Top Task Analysis ( 1 )
 Certification ( 1 )
 Effect Size ( 1 )
 Segmentation ( 1 )
 Facilitation ( 1 )
 Persona ( 1 )
 User Testing ( 1 )
 True Intent ( 1 )
 Visual Appeal ( 1 )
 Single Ease Question ( 1 )
 Crowdsourcing ( 1 )
 Random ( 1 )
 Think Aloud ( 1 )
 Sample ( 1 )
 Five ( 1 )
 Affinity ( 1 )
 Z-Score ( 1 )
 Performance ( 1 )
 Perceptions ( 1 )
 protoype ( 1 )
 Metric ( 1 )
 Expectations ( 1 )
 UEQ ( 1 )
 Conjoint Analysis ( 1 )
 Regression Analysis ( 1 )
 AttrakDiff2 ( 1 )
 Competitive ( 1 )
 RITE ( 1 )
 Formative testing ( 1 )
 CUE ( 1 )
 Trust ( 1 )
 meCUE2.0 ( 1 )
 Microsoft Desirability Toolkit ( 1 )
 NSAT ( 1 )
 moderated ( 1 )
 Moderating ( 1 )
 Software ( 1 )
 Customer effort ( 1 )
 Ordinal ( 1 )
 PSSUQ ( 1 )
 CSUQ ( 1 )
 Delight ( 1 )
 MUSiC ( 1 )

Simplifying the UMUX-Lite

By Jim Lewis, PhD and Jeff Sauro, PhD . September 29, 2020 . Tags: , ,
It seems like every few years a new standardized UX measure comes along. Standardization of UX measurement is a good thing for researchers and practitioners. Having common methods and definitions helps with objectivity, generalization, economy, and professional communication. At MeasuringU, we pay a lot of attention to the continuing evolution of standardized UX measurement. The UMUX-Lite is a relatively recent measure that has been attracting

Read More

Picking the Right Dependent Variables for UX Research

By Jeff Sauro, PhD . July 30, 2019 . Tags: ,
What gets measured gets managed. It’s more than a truism for business executives. It’s also essential for the user experience professional. In business, and UX research in particular, you don’t want to bring focus to the wrong or flawed measure. It can lead to wrong decisions and a misalignment of effort. In an earlier article, I discussed the differences between the most common variables in

Read More

How Accurate Is Self-Reported Purchase Data?

By Jeff Sauro, PhD . April 23, 2019 . Tags: ,
How much did you spend on Amazon last week? If you had to provide receipts or proof of purchases, how accurate do you think your estimate would be? In an earlier article we reported on the first wave of findings for a UX longitudinal study. We found that attitudes toward the website user experience tended to predict future purchasing behavior. In general, customers of websites

Read More

What Is the Purpose of UX Measurement?

By Jeff Sauro, PhD . February 26, 2019 . Tags: ,
We talk a lot about measurement at MeasuringU (hence our name). But what’s the point in collecting UX metrics? What do you do with study metrics such as the SUS, NPS, or SUPR-Q? Or task-level metrics such as completion rates and time? To understand the purpose of UX measurement we need to understand fundamentally the purpose of measurement. But settling on a definition of measurement

Read More

What Is the CE11 (And Is It Better than the NPS)?

By Jeff Sauro, PhD . February 5, 2019 . Tags: ,
For measuring the user experience, I recommend using a mix of task-based and study-level measures that capture both attitudes (e.g. SUS, SUPR-Q, SEQ, and NPS) and actions (e.g. completion rates and times). The NPS is commonly collected by organizations and therefore UX organizations (often because they are told to). Its popularity inevitably has brought skepticism. And rightfully so. After all, the NPS was touted as

Read More

How to Assess the Quality of a Measure

By Jeff Sauro, PhD . January 29, 2019 . Tags: ,
It seems like each year introduces a new measure or questionnaire. Like a late-night infomercial, some are even touted as the next BIG thing, like the NPS was. New questionnaires and measures are a natural part of the evolution of measurement (especially measuring difficult things such as human attitudes). It’s a good thing. I’ll often help peer review new questionnaires published in journals and conference

Read More

10 Things to Know About the SUPR-Q

By Jeff Sauro, PhD . June 12, 2018 . Tags: ,
The SUPR-Q (Standardized User Experience Percentile Rank Questionnaire) is a standardized questionnaire that measures the quality of the website user experience. It’s an 8-item instrument that’s gone through multiple rounds of psychometric validation and is used by hundreds of organizations around the world. Here’s a list of 10 essential things to know about the SUPR-Q. 1. It’s derived from research and refined across studies. Instead

Read More

Measuring the Reliability of the Net Promoter Score

By Jeff Sauro, PhD . April 24, 2018 . Tags: , ,
Your car doesn’t start on some mornings. Your computer crashes at the worst times. Your friend doesn’t show up to your dinner party. If something or someone isn’t reliable, it’s not only a pain but it makes your life less effective and less efficient. And what is true for people and products is true for measurement. The wording of items and the response options we

Read More

Outsourcing a UX Benchmark vs. Doing it Yourself

By Jeff Sauro, PhD . January 16, 2018 . Tags: ,
Benchmarking is an essential part of a plan to systematically improve the user experience. A regular benchmark study is a great way to show how design improvements may or may not be improving the user experience of websites and products. After you’ve decided you’re ready to conduct a benchmark, you’ll need to consider whether to conduct it internally within your company or outsource all or

Read More

Changing the Net Promoter Scale: How Much Does It Matter?

By Jeff Sauro, PhD . November 28, 2017 . Tags: ,
The Net Promoter Score (NPS) is a popular metric for measuring customer loyalty. For many companies, it’s THE only metric that matters. With such wide usage across different industries, departments, and companies of various sizes, it’s no surprise many questions and controversies arise. Some are systemic—should the NPS be used as a key metric?—and some are trivial—should the NPS be treated as a percentage? In

Read More