Comparison of UX Metrics in Moderated vs. Unmoderated Studies

UX Metrics

Browse Content by Topic

Statistics ( 51 )
UX ( 50 )
Usability Testing ( 50 )
Methods ( 50 )
Survey ( 30 )
User Research ( 27 )
Usability ( 27 )
Customer Experience ( 26 )
Benchmarking ( 21 )
Sample Size ( 18 )
NPS ( 17 )
Usability Problems ( 17 )
SUS ( 17 )
Usability Metrics ( 13 )
SUPRQ ( 12 )
Rating Scale ( 12 )
Qualitative ( 11 )
Net Promoter Score ( 10 )
Metrics ( 10 )
Navigation ( 10 )
Measurement ( 10 )
User Experience ( 8 )
Task Time ( 8 )
Market Research ( 8 )
Surveys ( 7 )
Task Completion ( 7 )
Heuristic Evaluation ( 7 )
Questionnaires ( 6 )
Questionnaire ( 5 )
Usability Problem ( 5 )
Mobile ( 5 )
Six Sigma ( 5 )
Visualizing Data ( 5 )
Reliability ( 5 )
Mobile Usability Testing ( 5 )
Confidence Intervals ( 4 )
Research ( 4 )
Analytics ( 4 )
Confidence ( 4 )
Credibility ( 4 )
UX Maturity ( 4 )
Moderation ( 4 )
Satisfaction ( 4 )
Task Times ( 4 )
Loyalty ( 4 )
Validity ( 4 )
Quantitative ( 4 )
UX Metrics ( 4 )
Rating Scales ( 3 )
Expert Review ( 3 )
ROI ( 3 )
Task Metrics ( 3 )
Customer Segmentation ( 3 )
Card Sorting ( 3 )
Usability Lab ( 3 )
Unmoderated Research ( 3 )
Lean UX ( 3 )
SUPR-Q ( 2 )
Eye-Tracking ( 2 )
Certification ( 2 )
UMUX-lite ( 2 )
KLM ( 2 )
Excel ( 2 )
Marketing ( 2 )
PhD ( 2 )
Remote Usability Testing ( 2 )
Salary Survey ( 2 )
Summative ( 2 )
SEQ ( 2 )
Key Driver ( 2 )
Data ( 2 )
Findability ( 2 )
Cognitive Walkthrough ( 2 )
Tasks ( 2 )
SUM ( 2 )
Tree Testing ( 2 )
Personas ( 2 )
UX Salary Survey ( 2 )
IA ( 2 )
Correlation ( 2 )
A/B Testing ( 2 )
UX Methods ( 2 )
Focus Groups ( 2 )
Branding ( 2 )
Affinity ( 1 )
Z-Score ( 1 )
Performance ( 1 )
Perceptions ( 1 )
Design ( 1 )
Problem Severity ( 1 )
Top Task Analysis ( 1 )
Information Architecture ( 1 )
Facilitation ( 1 )
Site Analytics ( 1 )
protoype ( 1 )
Metric ( 1 )
Prototype ( 1 )
Visual Appeal ( 1 )
Contextual Inquiry ( 1 )
True Intent ( 1 )
Five ( 1 )
Task Completin ( 1 )
Crowdsourcing ( 1 )
Test Metrics ( 1 )
Task Randomization ( 1 )
Moderating ( 1 )
Margin of Error ( 1 )
Quality ( 1 )
Ordinal ( 1 )
Conjoint Analysis ( 1 )
Competitive ( 1 )
Trust ( 1 )
Regression Analysis ( 1 )
Software ( 1 )
Formative ( 1 )
Desktop ( 1 )
Effect Size ( 1 )
Expectations ( 1 )
Unmoderated ( 1 )
Random ( 1 )
User Testing ( 1 )
Errors ( 1 )
Segmentation ( 1 )
Persona ( 1 )
Think Aloud ( 1 )
Sample ( 1 )
Unmoderated testing platforms allow for quick data collection from large sample sizes. This has enabled researchers to answer questions that were previously difficult or cost prohibitive to answer with traditional lab-based testing. But is the data collected in unmoderated studies, both behavioral and attitudinal, comparable to what you get from a more traditional lab setup? Comparing Metrics There are several ways to compare the agreement or

Read More

Evaluate product designs and concepts early and often. Don’t wait till you’ve built the entire app, website, or product before having people actually use it. Build a prototype and test it. These principles are fundamental to user-centered-design, as well as other popular concepts such as the lean startup and minimum viable products featured in the popular book Sprint. But building even modest functionality and aesthetics

Read More

Online panels are a major source of participants for both market research and UX research studies. In an earlier article I summarized some of the research on the accuracy and variability of estimates from online panels. The types of estimates from those studies tended to center around general demographic or psychographic questions (e.g., smoking, newspaper readership). To understand whether similar findings would hold for UX-related

Read More

There isn't a usability thermometer to tell you how usable your software or website is. Instead we rely on the impact of good and bad usability to assess the quality of the user experience. Here are 10 metrics you should be familiar with and ready to use in any usability evaluation. 1. Completion Rates: Often called the fundamental usability metric, or the gateway metric, completion

Read More