Search
Exact matches only
Search in title
Search in content
Search in comments
Search in excerpt
Filter by Custom Post Type

Validity

by Jeff Sauro, PhD | June 11, 2019

Browse Content by Topic

UX ( 66 )
 Methods ( 56 )
 Usability Testing ( 52 )
 Statistics ( 51 )
 Survey ( 34 )
 Usability ( 32 )
 Benchmarking ( 28 )
 Customer Experience ( 27 )
 User Research ( 27 )
 NPS ( 22 )
 SUS ( 21 )
 Sample Size ( 18 )
 Net Promoter Score ( 17 )
 Usability Problems ( 17 )
 Measurement ( 14 )
 Metrics ( 14 )
 Rating Scale ( 14 )
 User Experience ( 13 )
 Usability Metrics ( 13 )
 SUPRQ ( 12 )
 Qualitative ( 11 )
 Navigation ( 10 )
 Validity ( 10 )
 Surveys ( 8 )
 Task Time ( 8 )
 Market Research ( 8 )
 UX Metrics ( 7 )
 Questionnaires ( 7 )
 Task Completion ( 7 )
 Heuristic Evaluation ( 7 )
 Questionnaire ( 6 )
 Mobile ( 6 )
 Reliability ( 6 )
 Rating Scales ( 6 )
 Mobile Usability Testing ( 6 )
 SUPR-Q ( 6 )
 Satisfaction ( 5 )
 Usability Problem ( 5 )
 Visualizing Data ( 5 )
 Six Sigma ( 5 )
 Analytics ( 5 )
 Loyalty ( 4 )
 Confidence Intervals ( 4 )
 Quantitative ( 4 )
 Credibility ( 4 )
 Research ( 4 )
 Confidence ( 4 )
 Task Times ( 4 )
 UX Maturity ( 4 )
 Moderation ( 4 )
 ROI ( 3 )
 Task Metrics ( 3 )
 Unmoderated Research ( 3 )
 UMUX-lite ( 3 )
 Usability Lab ( 3 )
 Customer Segmentation ( 3 )
 SEQ ( 3 )
 Expert Review ( 3 )
 Lean UX ( 3 )
 Card Sorting ( 3 )
 Key Driver ( 2 )
 Tree Testing ( 2 )
 Remote Usability Testing ( 2 )
 PhD ( 2 )
 Summative ( 2 )
 Salary Survey ( 2 )
 Personas ( 2 )
 Data ( 2 )
 A/B Testing ( 2 )
 Findability ( 2 )
 Focus Groups ( 2 )
 Eye-Tracking ( 2 )
 Excel ( 2 )
 Tasks ( 2 )
 IA ( 2 )
 Marketing ( 2 )
 UX Methods ( 2 )
 Branding ( 2 )
 PURE ( 2 )
 UX Salary Survey ( 2 )
 KLM ( 2 )
 Cognitive Walkthrough ( 2 )
 Correlation ( 2 )
 SUM ( 2 )
 Persona ( 1 )
 Mobile Usability ( 1 )
 Task Completin ( 1 )
 Z-Score ( 1 )
 Ordinal ( 1 )
 Performance ( 1 )
 Problem Severity ( 1 )
 Affinity ( 1 )
 Prototype ( 1 )
 Metric ( 1 )
 Software ( 1 )
 Segmentation ( 1 )
 Moderating ( 1 )
 moderated ( 1 )
 Site Analytics ( 1 )
 protoype ( 1 )
 User Testing ( 1 )
 Information Architecture ( 1 )
 Certification ( 1 )
 Facilitation ( 1 )
 Contextual Inquiry ( 1 )
 Trust ( 1 )
 Task Randomization ( 1 )
 Conjoint Analysis ( 1 )
 Margin of Error ( 1 )
 Design ( 1 )
 Test Metrics ( 1 )
 Quality ( 1 )
 Expectations ( 1 )
 Formative ( 1 )
 Unmoderated ( 1 )
 Think Aloud ( 1 )
 Random ( 1 )
 Crowdsourcing ( 1 )
 Desktop ( 1 )
 Visual Appeal ( 1 )
 Effect Size ( 1 )
 Competitive ( 1 )
 Five ( 1 )
 True Intent ( 1 )
 Regression Analysis ( 1 )
 Errors ( 1 )
 Top Task Analysis ( 1 )
 Sample ( 1 )
 Perceptions ( 1 )

Do Attitudes Predict Behavior?

By Jeff Sauro, PhD . June 11, 2019 . Tags:
Should you ask what people think? Are thoughts and feelings reliable indicators of future behavior? Asking about people’s attitudes—especially about their intentions (likelihood to use, recommend, or purchase)—gets a bad rap in UX research. There’s a sort of folk wisdom in User Experience research: People are poor predictors of their future behavior. And this distrust in what people think is rooted in some well-cited articles.

Read More

The Importance of Replicating Research Findings

By Jeff Sauro, PhD . June 4, 2019 . Tags: ,
You’ve probably heard of the infamous Stanford Prison Experiment by Philip Zimbardo (especially if you took an intro psych class). The shocking results had similar implications to the notorious Milgram experiment and suggested our roles may be a major cause for past atrocities and injustices. You might have also heard about research from Cornell University that found, across multiple studies, that simply having larger serving plates make

Read More

Do Promoters Actually Recommend More? A Longitudinal Analysis

By Jeff Sauro, PhD . May 28, 2019 . Tags: ,
The Net Promoter Score introduced a new language of loyalty. At center stage are the promoters and detractors. These designations are given to respondents who answer the How Likely Are You to Recommend (LTR) question as shown below. But what is the justification for the designations? Were they just arbitrarily created? Do they just sound good for executives? How much faith should we put in

Read More

Validating a Lostness Measure

By Jeff Sauro, PhD . May 14, 2019 . Tags: , ,
No one likes getting lost. In real life or digitally. One can get lost searching for a product to purchase, finding medical information, or clicking through a mobile app to post a social media status. Each link, button, and menu leads to decisions. And each decision can result in a mistake, leading to wasted time, frustration, and often the inability to accomplish tasks. But how

Read More

Linking UX Attitudes to Future Website Purchases

By Jeff Sauro, PhD . March 25, 2019 . Tags: , ,
Users' attitudes about an experience affect their future behavior. People who think a website is less usable or less attractive will probably visit less, purchase less, and recommend the website less. Understanding users’ attitudes now (easier to measure) can help predict users’ behavior in the future (harder to measure). At least that’s the idea behind using standardized questionnaires such as the SUPR-Q. But there’s actually not

Read More

Using Task Ease (SEQ) to Predict Completion Rates and Times

By Jeff Sauro, PhD . October 30, 2018 . Tags: , ,
Our attitudes both reflect and affect our actions. What we think affects what we do and what we do affects what we think. It’s not a perfect relationship of course. What people say or think doesn’t always directly correspond to actions in easily predictable ways. Understanding and measuring user attitudes early and often can provide a good indication of likely future behaviors. Attitudes can be

Read More

Is a Single Item Enough to Measure a Construct?

By Jeff Sauro, PhD . March 13, 2018 . Tags: , ,
How satisfied are you with your life? How happy are you with your job or your marriage? Are you extroverted or introverted? It’s hard to capture the fickle nature of attitudes and constructs in any measure. It can be particularly hard to do that with just one question or item. Consequently, psychology, education, marketing, and user experience have a long history of recommending multiple items

Read More

Does the Net Promoter Score Predict Company Growth?

By Jeff Sauro, PhD . January 30, 2018 . Tags: ,
It’s the only number a company needs to grow. Or at least that’s what was proclaimed in the title of the now famous HBR article that helped popularize the Net Promoter Score (NPS). Lately it's been taking on more criticism. The NPS is compelling to executives because of its simplicity and for what it purports to do: be the one number a company should track

Read More

5 Concepts to Master When Conducting Quantitative Research

By Jeff Sauro, PhD . April 14, 2015 . Tags: , ,
You don't need to be a data scientist, database admin, or statistical maven to conduct quantitative research. You must, however, have a good grounding in some fundamental concepts to make the most of the efforts. While there are a number of skills, techniques, and concepts you'll want to be familiar with, I think it's essential to master these five: reliability, validity, statistical significance, experimental validity,

Read More

Assessing the Validity of Your Research

By Jeff Sauro, PhD . November 4, 2014 . Tags: ,
You often hear that research results are not "valid" or "reliable." Like many scientific terms that have made it into our vernacular, these terms are often used interchangeably. In fact, validity and reliability have different meanings with different implications for researchers. Validity refers to how well the results of a study measure what they are intended to measure. Contrast that with reliability, which means consistent

Read More