Comparison of UX Metrics in Moderated vs. Unmoderated Studies

Unmoderated Research

by Jeff Sauro, PhD | May 29, 2018

Browse Content by Topic

UX ( 66 )
Methods ( 58 )
Usability Testing ( 52 )
Statistics ( 51 )
Survey ( 34 )
Usability ( 32 )
Benchmarking ( 28 )
Customer Experience ( 27 )
User Research ( 27 )
NPS ( 22 )
SUS ( 21 )
Sample Size ( 18 )
Net Promoter Score ( 17 )
Usability Problems ( 17 )
Metrics ( 15 )
Measurement ( 14 )
User Experience ( 14 )
Rating Scale ( 14 )
Usability Metrics ( 13 )
SUPRQ ( 12 )
Qualitative ( 11 )
Validity ( 11 )
Navigation ( 10 )
Task Time ( 8 )
Heuristic Evaluation ( 8 )
Surveys ( 8 )
Market Research ( 8 )
UX Metrics ( 7 )
Questionnaires ( 7 )
Task Completion ( 7 )
Reliability ( 7 )
Questionnaire ( 6 )
Rating Scales ( 6 )
Mobile ( 6 )
Mobile Usability Testing ( 6 )
SUPR-Q ( 6 )
Usability Problem ( 5 )
Visualizing Data ( 5 )
Six Sigma ( 5 )
Satisfaction ( 5 )
Analytics ( 5 )
Confidence Intervals ( 4 )
Quantitative ( 4 )
Loyalty ( 4 )
Credibility ( 4 )
Moderation ( 4 )
Confidence ( 4 )
Research ( 4 )
Task Times ( 4 )
UX Maturity ( 4 )
ROI ( 3 )
PURE ( 3 )
Customer Segmentation ( 3 )
Unmoderated Research ( 3 )
UMUX-lite ( 3 )
Usability Lab ( 3 )
Task Metrics ( 3 )
SEQ ( 3 )
Expert Review ( 3 )
Card Sorting ( 3 )
Lean UX ( 3 )
UX Methods ( 3 )
UX Salary Survey ( 2 )
Excel ( 2 )
Eye-Tracking ( 2 )
Salary Survey ( 2 )
Summative ( 2 )
PhD ( 2 )
Remote Usability Testing ( 2 )
Key Driver ( 2 )
Tree Testing ( 2 )
Marketing ( 2 )
Data ( 2 )
IA ( 2 )
Tasks ( 2 )
Personas ( 2 )
KLM ( 2 )
Branding ( 2 )
A/B Testing ( 2 )
Findability ( 2 )
Focus Groups ( 2 )
Correlation ( 2 )
Cognitive Walkthrough ( 2 )
SUM ( 2 )
Z-Score ( 1 )
Metric ( 1 )
moderated ( 1 )
Perceptions ( 1 )
Performance ( 1 )
Problem Severity ( 1 )
Moderating ( 1 )
Task Completin ( 1 )
protoype ( 1 )
Information Architecture ( 1 )
Certification ( 1 )
Facilitation ( 1 )
Prototype ( 1 )
Contextual Inquiry ( 1 )
Mobile Usability ( 1 )
Site Analytics ( 1 )
Software ( 1 )
Affinity ( 1 )
Sample ( 1 )
Competitive ( 1 )
Expectations ( 1 )
Formative ( 1 )
Unmoderated ( 1 )
Think Aloud ( 1 )
Conjoint Analysis ( 1 )
Regression Analysis ( 1 )
Ordinal ( 1 )
Persona ( 1 )
User Testing ( 1 )
Trust ( 1 )
Effect Size ( 1 )
Quality ( 1 )
Test Metrics ( 1 )
Segmentation ( 1 )
Top Task Analysis ( 1 )
True Intent ( 1 )
Five ( 1 )
Desktop ( 1 )
Errors ( 1 )
Crowdsourcing ( 1 )
Task Randomization ( 1 )
Margin of Error ( 1 )
Design ( 1 )
Random ( 1 )
Visual Appeal ( 1 )

How Similar Are UX Metrics in Moderated vs. Unmoderated Studies?

By Jeff Sauro, PhD . May 29, 2018 . Tags: Moderating, Unmoderated Research, UX Metrics, Metrics, Usability Metrics, UX

Unmoderated testing platforms allow for quick data collection from large sample sizes. This has enabled researchers to answer questions that were previously difficult or cost prohibitive to answer with traditional lab-based testing. But is the data collected in unmoderated studies, both behavioral and attitudinal, comparable to what you get from a more traditional lab setup? Comparing Metrics There are several ways to compare the agreement or

Choosing the Right UX Testing Platform

By Jeff Sauro, PhD . May 15, 2018 . Tags: Unmoderated Research, UX

Small differences in design changes can have large consequences on website purchases. But detecting these small differences (e.g. 2%–10% changes) through behaviors and attitudes has generally not been feasible from traditional lab-based testing due to the time and costs of recruiting and facilitator costs/time. With unmoderated testing, organizations can now collect data from hundreds to thousands of participants quickly and from around the world to

5 Metrics to Diagnose Website Problems in Online Studies

By Jeff Sauro, PhD . December 13, 2017 . Tags: Unmoderated Research

To understand problems on a website, nothing quite beats watching users. The process provides a wealth of information both about what users can or can’t do and what might be causing problems in an interface. The major drawback to watching users live or recordings of sessions is that it takes a lot of focused time. 5 to 20 participants—the typical sample size in moderated studies—isn’t