Search
Exact matches only
Search in title
Search in content
Search in comments
Search in excerpt
Filter by Custom Post Type

Validity

by Jeff Sauro, PhD | June 18, 2019

Browse Content by Topic

UX ( 69 )
 Methods ( 61 )
 Usability Testing ( 52 )
 Statistics ( 51 )
 Survey ( 34 )
 Usability ( 32 )
 Benchmarking ( 28 )
 Customer Experience ( 27 )
 User Research ( 27 )
 NPS ( 25 )
 SUS ( 21 )
 Sample Size ( 19 )
 Net Promoter Score ( 18 )
 Usability Problems ( 17 )
 Rating Scale ( 16 )
 Metrics ( 15 )
 Measurement ( 15 )
 User Experience ( 14 )
 Usability Metrics ( 13 )
 SUPRQ ( 12 )
 Validity ( 11 )
 Qualitative ( 11 )
 Navigation ( 10 )
 Satisfaction ( 9 )
 Questionnaires ( 8 )
 Heuristic Evaluation ( 8 )
 Market Research ( 8 )
 Task Time ( 8 )
 Surveys ( 8 )
 Reliability ( 7 )
 UX Metrics ( 7 )
 Task Completion ( 7 )
 Rating Scales ( 7 )
 SUPR-Q ( 6 )
 Questionnaire ( 6 )
 Mobile Usability Testing ( 6 )
 Mobile ( 6 )
 Usability Problem ( 5 )
 Visualizing Data ( 5 )
 Research ( 5 )
 Analytics ( 5 )
 Six Sigma ( 5 )
 UX Maturity ( 4 )
 Confidence ( 4 )
 Expert Review ( 4 )
 Confidence Intervals ( 4 )
 Task Times ( 4 )
 Quantitative ( 4 )
 Credibility ( 4 )
 Loyalty ( 4 )
 Moderation ( 4 )
 UX Methods ( 4 )
 Task Metrics ( 3 )
 SEQ ( 3 )
 ROI ( 3 )
 Customer Segmentation ( 3 )
 Lean UX ( 3 )
 Unmoderated Research ( 3 )
 Usability Lab ( 3 )
 Card Sorting ( 3 )
 UMUX-lite ( 3 )
 PURE ( 3 )
 Data ( 2 )
 Eye-Tracking ( 2 )
 PhD ( 2 )
 Branding ( 2 )
 Excel ( 2 )
 Cognitive Walkthrough ( 2 )
 KLM ( 2 )
 Marketing ( 2 )
 Summative ( 2 )
 Personas ( 2 )
 A/B Testing ( 2 )
 Salary Survey ( 2 )
 IA ( 2 )
 Key Driver ( 2 )
 Tasks ( 2 )
 Findability ( 2 )
 UX Salary Survey ( 2 )
 SUM ( 2 )
 Tree Testing ( 2 )
 Remote Usability Testing ( 2 )
 Correlation ( 2 )
 Focus Groups ( 2 )
 Perceptions ( 1 )
 Performance ( 1 )
 Mobile Usability ( 1 )
 Moderating ( 1 )
 Information Architecture ( 1 )
 Certification ( 1 )
 Facilitation ( 1 )
 Site Analytics ( 1 )
 protoype ( 1 )
 Prototype ( 1 )
 Contextual Inquiry ( 1 )
 Affinity ( 1 )
 Z-Score ( 1 )
 Task Completin ( 1 )
 Metric ( 1 )
 Five ( 1 )
 moderated ( 1 )
 Problem Severity ( 1 )
 Test Metrics ( 1 )
 Segmentation ( 1 )
 Persona ( 1 )
 Software ( 1 )
 NSAT ( 1 )
 Ordinal ( 1 )
 User Testing ( 1 )
 Effect Size ( 1 )
 True Intent ( 1 )
 Visual Appeal ( 1 )
 Top Task Analysis ( 1 )
 Design ( 1 )
 Unmoderated ( 1 )
 Errors ( 1 )
 Regression Analysis ( 1 )
 Think Aloud ( 1 )
 Margin of Error ( 1 )
 Random ( 1 )
 Crowdsourcing ( 1 )
 Sample ( 1 )
 Task Randomization ( 1 )
 Quality ( 1 )
 Trust ( 1 )
 Conjoint Analysis ( 1 )
 Expectations ( 1 )
 Competitive ( 1 )
 Formative ( 1 )
 Desktop ( 1 )

What Is a Strong Correlation?

By Jeff Sauro, PhD . June 18, 2019 . Tags: ,
Smoking causes cancer. Warnings on cigarette labels and from health organizations all make the clear statement that smoking causes cancer. But how do we know? Smoking precedes cancer (mostly lung cancer). People who smoke cigarettes tend to get lung and other cancers more than those who don’t smoke. We say that smoking is correlated with cancer. Carefully rule out other causes and you have the ingredients

Read More

Do Attitudes Predict Behavior?

By Jeff Sauro, PhD . June 11, 2019 . Tags:
Should you ask what people think? Are thoughts and feelings reliable indicators of future behavior? Asking about people’s attitudes—especially about their intentions (likelihood to use, recommend, or purchase)—gets a bad rap in UX research. There’s a sort of folk wisdom in User Experience research: People are poor predictors of their future behavior. And this distrust in what people think is rooted in some well-cited articles.

Read More

The Importance of Replicating Research Findings

By Jeff Sauro, PhD . June 4, 2019 . Tags: ,
You’ve probably heard of the infamous Stanford Prison Experiment by Philip Zimbardo (especially if you took an intro psych class). The shocking results had similar implications to the notorious Milgram experiment and suggested our roles may be a major cause for past atrocities and injustices. You might have also heard about research from Cornell University that found, across multiple studies, that simply having larger serving plates make

Read More

Do Promoters Actually Recommend More? A Longitudinal Analysis

By Jeff Sauro, PhD . May 28, 2019 . Tags: ,
The Net Promoter Score introduced a new language of loyalty. At center stage are the promoters and detractors. These designations are given to respondents who answer the How Likely Are You to Recommend (LTR) question as shown below. But what is the justification for the designations? Were they just arbitrarily created? Do they just sound good for executives? How much faith should we put in

Read More

Validating a Lostness Measure

By Jeff Sauro, PhD . May 14, 2019 . Tags: , ,
No one likes getting lost. In real life or digitally. One can get lost searching for a product to purchase, finding medical information, or clicking through a mobile app to post a social media status. Each link, button, and menu leads to decisions. And each decision can result in a mistake, leading to wasted time, frustration, and often the inability to accomplish tasks. But how

Read More

Linking UX Attitudes to Future Website Purchases

By Jeff Sauro, PhD . March 25, 2019 . Tags: , ,
Users' attitudes about an experience affect their future behavior. People who think a website is less usable or less attractive will probably visit less, purchase less, and recommend the website less. Understanding users’ attitudes now (easier to measure) can help predict users’ behavior in the future (harder to measure). At least that’s the idea behind using standardized questionnaires such as the SUPR-Q. But there’s actually not

Read More

Using Task Ease (SEQ) to Predict Completion Rates and Times

By Jeff Sauro, PhD . October 30, 2018 . Tags: , ,
Our attitudes both reflect and affect our actions. What we think affects what we do and what we do affects what we think. It’s not a perfect relationship of course. What people say or think doesn’t always directly correspond to actions in easily predictable ways. Understanding and measuring user attitudes early and often can provide a good indication of likely future behaviors. Attitudes can be

Read More

Is a Single Item Enough to Measure a Construct?

By Jeff Sauro, PhD . March 13, 2018 . Tags: , ,
How satisfied are you with your life? How happy are you with your job or your marriage? Are you extroverted or introverted? It’s hard to capture the fickle nature of attitudes and constructs in any measure. It can be particularly hard to do that with just one question or item. Consequently, psychology, education, marketing, and user experience have a long history of recommending multiple items

Read More

Does the Net Promoter Score Predict Company Growth?

By Jeff Sauro, PhD . January 30, 2018 . Tags: ,
It’s the only number a company needs to grow. Or at least that’s what was proclaimed in the title of the now famous HBR article that helped popularize the Net Promoter Score (NPS). Lately it's been taking on more criticism. The NPS is compelling to executives because of its simplicity and for what it purports to do: be the one number a company should track

Read More

5 Concepts to Master When Conducting Quantitative Research

By Jeff Sauro, PhD . April 14, 2015 . Tags: , ,
You don't need to be a data scientist, database admin, or statistical maven to conduct quantitative research. You must, however, have a good grounding in some fundamental concepts to make the most of the efforts. While there are a number of skills, techniques, and concepts you'll want to be familiar with, I think it's essential to master these five: reliability, validity, statistical significance, experimental validity,

Read More