Search
Exact matches only
Search in title
Search in content
Search in comments
Search in excerpt
Filter by Custom Post Type

Validity

by Jim Lewis, PhD and Jeff Sauro, PhD | March 24, 2020

Browse Content by Topic

UX ( 73 )
 Methods ( 62 )
 Usability Testing ( 53 )
 Statistics ( 51 )
 Survey ( 36 )
 Usability ( 32 )
 Benchmarking ( 32 )
 Customer Experience ( 30 )
 NPS ( 28 )
 User Research ( 28 )
 SUS ( 23 )
 Rating Scale ( 20 )
 Net Promoter Score ( 20 )
 Sample Size ( 19 )
 Usability Problems ( 17 )
 Metrics ( 16 )
 Measurement ( 15 )
 User Experience ( 14 )
 Usability Metrics ( 13 )
 Questionnaires ( 13 )
 Satisfaction ( 13 )
 Validity ( 13 )
 SUPRQ ( 12 )
 Surveys ( 11 )
 Qualitative ( 11 )
 Navigation ( 10 )
 Rating Scales ( 10 )
 Market Research ( 9 )
 SUPR-Q ( 9 )
 UX Metrics ( 8 )
 Heuristic Evaluation ( 8 )
 Reliability ( 8 )
 Task Time ( 8 )
 Task Completion ( 7 )
 Questionnaire ( 7 )
 Analytics ( 6 )
 Mobile Usability Testing ( 6 )
 Mobile ( 6 )
 Usability Problem ( 5 )
 Visualizing Data ( 5 )
 Six Sigma ( 5 )
 Research ( 5 )
 Moderation ( 4 )
 UX Methods ( 4 )
 Quantitative ( 4 )
 UX Maturity ( 4 )
 Unmoderated Research ( 4 )
 Loyalty ( 4 )
 Expert Review ( 4 )
 Credibility ( 4 )
 Confidence ( 4 )
 SEQ ( 4 )
 Confidence Intervals ( 4 )
 Task Times ( 4 )
 ROI ( 3 )
 Card Sorting ( 3 )
 Lean UX ( 3 )
 Customer Segmentation ( 3 )
 Usability Lab ( 3 )
 PURE ( 3 )
 UMUX-lite ( 3 )
 Task Metrics ( 3 )
 Key Driver ( 2 )
 IA ( 2 )
 Branding ( 2 )
 UX Salary Survey ( 2 )
 Eye-Tracking ( 2 )
 Data ( 2 )
 Salary Survey ( 2 )
 Marketing ( 2 )
 Summative ( 2 )
 Excel ( 2 )
 PhD ( 2 )
 Findability ( 2 )
 Remote Usability Testing ( 2 )
 A/B Testing ( 2 )
 Tree Testing ( 2 )
 Focus Groups ( 2 )
 Personas ( 2 )
 Tasks ( 2 )
 Cognitive Walkthrough ( 2 )
 KLM ( 2 )
 SUM ( 2 )
 Correlation ( 2 )
 Information Architecture ( 1 )
 Site Analytics ( 1 )
 Contextual Inquiry ( 1 )
 Mobile Usability ( 1 )
 Desktop ( 1 )
 Margin of Error ( 1 )
 Task Randomization ( 1 )
 Test Metrics ( 1 )
 Quality ( 1 )
 Problem Severity ( 1 )
 Persona ( 1 )
 moderated ( 1 )
 Moderating ( 1 )
 NSAT ( 1 )
 Customer effort ( 1 )
 Delight ( 1 )
 Metric ( 1 )
 protoype ( 1 )
 Task Completin ( 1 )
 Prototype ( 1 )
 Certification ( 1 )
 Facilitation ( 1 )
 CSUQ ( 1 )
 PSSUQ ( 1 )
 AttrakDiff2 ( 1 )
 UEQ ( 1 )
 Hedonic usability ( 1 )
 CUE ( 1 )
 Formative testing ( 1 )
 meCUE2.0 ( 1 )
 Voice Interaction ( 1 )
 TAM ( 1 )
 LTR ( 1 )
 Microsoft Desirability Toolkit ( 1 )
 Desirability ( 1 )
 Affinity ( 1 )
 Z-Score ( 1 )
 User Testing ( 1 )
 RITE ( 1 )
 Effect Size ( 1 )
 Unmoderated ( 1 )
 Design ( 1 )
 Segmentation ( 1 )
 Software ( 1 )
 Expectations ( 1 )
 Conjoint Analysis ( 1 )
 Regression Analysis ( 1 )
 Ordinal ( 1 )
 Top Task Analysis ( 1 )
 True Intent ( 1 )
 Sample ( 1 )
 Crowdsourcing ( 1 )
 Five ( 1 )
 Perceptions ( 1 )
 Performance ( 1 )
 Random ( 1 )
 Think Aloud ( 1 )
 Visual Appeal ( 1 )
 Errors ( 1 )
 Trust ( 1 )
 Formative ( 1 )
 Competitive ( 1 )

Is Usability Testing Effective?

By Jim Lewis, PhD and Jeff Sauro, PhD . March 24, 2020 . Tags: , ,
Questioning the effectiveness of usability testing may sound like a relic from the past. In the early years of industrial usability engineering, there was a constant need to justify the activity of (and your job in) usability testing. The book Cost-Justifying Usability (Bias & Mayhew, 2005) speaks to this. Usability testing has since gained significant adoption in organizations. But that doesn’t mean some of the

Read More

10 Things to Know about the Microsoft Desirability Toolkit

By Jim Lewis, PhD and Jeff Sauro, PhD . February 18, 2020 . Tags: , ,
Who, as a person, doesn’t want to be desirable? And if you’re in the business of developing products or services, who doesn’t want those to be desirable? There is a deep satisfaction beyond the monetary rewards of providing something that people want (and of course, the money’s nice, too). While we’ve found wide interest in wanting to conduct “desirability testing,” there is much less agreement

Read More

What Is a Strong Correlation?

By Jeff Sauro, PhD . June 18, 2019 . Tags: ,
Smoking causes cancer. Warnings on cigarette labels and from health organizations all make the clear statement that smoking causes cancer. But how do we know? Smoking precedes cancer (mostly lung cancer). People who smoke cigarettes tend to get lung and other cancers more than those who don’t smoke. We say that smoking is correlated with cancer. Carefully rule out other causes and you have the ingredients

Read More

Do Attitudes Predict Behavior?

By Jeff Sauro, PhD . June 11, 2019 . Tags:
Should you ask what people think? Are thoughts and feelings reliable indicators of future behavior? Asking about people’s attitudes—especially about their intentions (likelihood to use, recommend, or purchase)—gets a bad rap in UX research. There’s a sort of folk wisdom in User Experience research: People are poor predictors of their future behavior. And this distrust in what people think is rooted in some well-cited articles.

Read More

The Importance of Replicating Research Findings

By Jeff Sauro, PhD . June 4, 2019 . Tags: ,
You’ve probably heard of the infamous Stanford Prison Experiment by Philip Zimbardo (especially if you took an intro psych class). The shocking results had similar implications to the notorious Milgram experiment and suggested our roles may be a major cause for past atrocities and injustices. You might have also heard about research from Cornell University that found, across multiple studies, that simply having larger serving plates make

Read More

Do Promoters Actually Recommend More? A Longitudinal Analysis

By Jeff Sauro, PhD . May 28, 2019 . Tags: ,
The Net Promoter Score introduced a new language of loyalty. At center stage are the promoters and detractors. These designations are given to respondents who answer the How Likely Are You to Recommend (LTR) question as shown below. But what is the justification for the designations? Were they just arbitrarily created? Do they just sound good for executives? How much faith should we put in

Read More

Validating a Lostness Measure

By Jeff Sauro, PhD . May 14, 2019 . Tags: , ,
No one likes getting lost. In real life or digitally. One can get lost searching for a product to purchase, finding medical information, or clicking through a mobile app to post a social media status. Each link, button, and menu leads to decisions. And each decision can result in a mistake, leading to wasted time, frustration, and often the inability to accomplish tasks. But how

Read More

Linking UX Attitudes to Future Website Purchases

By Jeff Sauro, PhD . March 25, 2019 . Tags: , ,
Users' attitudes about an experience affect their future behavior. People who think a website is less usable or less attractive will probably visit less, purchase less, and recommend the website less. Understanding users’ attitudes now (easier to measure) can help predict users’ behavior in the future (harder to measure). At least that’s the idea behind using standardized questionnaires such as the SUPR-Q. But there’s actually not

Read More

Using Task Ease (SEQ) to Predict Completion Rates and Times

By Jeff Sauro, PhD . October 30, 2018 . Tags: , ,
Our attitudes both reflect and affect our actions. What we think affects what we do and what we do affects what we think. It’s not a perfect relationship of course. What people say or think doesn’t always directly correspond to actions in easily predictable ways. Understanding and measuring user attitudes early and often can provide a good indication of likely future behaviors. Attitudes can be

Read More

Is a Single Item Enough to Measure a Construct?

By Jeff Sauro, PhD . March 13, 2018 . Tags: , ,
How satisfied are you with your life? How happy are you with your job or your marriage? Are you extroverted or introverted? It’s hard to capture the fickle nature of attitudes and constructs in any measure. It can be particularly hard to do that with just one question or item. Consequently, psychology, education, marketing, and user experience have a long history of recommending multiple items

Read More