Comparison of UX Metrics in Moderated vs. Unmoderated Studies

UX Metrics

Browse Content by Topic

UX ( 53 )
Usability Testing ( 52 )
Statistics ( 51 )
Methods ( 50 )
Usability ( 31 )
Survey ( 30 )
User Research ( 27 )
Customer Experience ( 26 )
Benchmarking ( 23 )
Sample Size ( 18 )
SUS ( 18 )
Usability Problems ( 17 )
NPS ( 17 )
Rating Scale ( 13 )
Usability Metrics ( 13 )
SUPRQ ( 12 )
Metrics ( 11 )
Qualitative ( 11 )
Net Promoter Score ( 10 )
Measurement ( 10 )
Navigation ( 10 )
User Experience ( 9 )
Task Time ( 8 )
Surveys ( 8 )
Market Research ( 8 )
Task Completion ( 7 )
Heuristic Evaluation ( 7 )
Questionnaires ( 6 )
Mobile ( 6 )
Mobile Usability Testing ( 6 )
Reliability ( 5 )
Usability Problem ( 5 )
Questionnaire ( 5 )
Six Sigma ( 5 )
Visualizing Data ( 5 )
Analytics ( 4 )
Research ( 4 )
Confidence ( 4 )
Task Times ( 4 )
Credibility ( 4 )
Quantitative ( 4 )
Validity ( 4 )
Satisfaction ( 4 )
UX Metrics ( 4 )
Rating Scales ( 4 )
Loyalty ( 4 )
Confidence Intervals ( 4 )
UX Maturity ( 4 )
Moderation ( 4 )
Card Sorting ( 3 )
Expert Review ( 3 )
Unmoderated Research ( 3 )
Customer Segmentation ( 3 )
SUPR-Q ( 3 )
Usability Lab ( 3 )
Lean UX ( 3 )
Task Metrics ( 3 )
ROI ( 3 )
Findability ( 2 )
Summative ( 2 )
Excel ( 2 )
Focus Groups ( 2 )
SEQ ( 2 )
PhD ( 2 )
Remote Usability Testing ( 2 )
Salary Survey ( 2 )
Marketing ( 2 )
Data ( 2 )
SUM ( 2 )
Eye-Tracking ( 2 )
Personas ( 2 )
A/B Testing ( 2 )
UX Methods ( 2 )
Key Driver ( 2 )
Certification ( 2 )
KLM ( 2 )
UX Salary Survey ( 2 )
Cognitive Walkthrough ( 2 )
Correlation ( 2 )
Tree Testing ( 2 )
UMUX-lite ( 2 )
Tasks ( 2 )
IA ( 2 )
Branding ( 2 )
Information Architecture ( 1 )
Moderating ( 1 )
Facilitation ( 1 )
Perceptions ( 1 )
Metric ( 1 )
Contextual Inquiry ( 1 )
Affinity ( 1 )
Task Completin ( 1 )
Site Analytics ( 1 )
Z-Score ( 1 )
Problem Severity ( 1 )
Prototype ( 1 )
Mobile Usability ( 1 )
Performance ( 1 )
protoype ( 1 )
Formative ( 1 )
User Testing ( 1 )
Effect Size ( 1 )
Persona ( 1 )
Segmentation ( 1 )
moderated ( 1 )
Software ( 1 )
Unmoderated ( 1 )
Design ( 1 )
Errors ( 1 )
Trust ( 1 )
Visual Appeal ( 1 )
True Intent ( 1 )
Top Task Analysis ( 1 )
Ordinal ( 1 )
Regression Analysis ( 1 )
Random ( 1 )
Margin of Error ( 1 )
Crowdsourcing ( 1 )
Sample ( 1 )
Five ( 1 )
Task Randomization ( 1 )
Test Metrics ( 1 )
Expectations ( 1 )
Conjoint Analysis ( 1 )
Competitive ( 1 )
Think Aloud ( 1 )
Quality ( 1 )
Desktop ( 1 )
Unmoderated testing platforms allow for quick data collection from large sample sizes. This has enabled researchers to answer questions that were previously difficult or cost prohibitive to answer with traditional lab-based testing. But is the data collected in unmoderated studies, both behavioral and attitudinal, comparable to what you get from a more traditional lab setup? Comparing Metrics There are several ways to compare the agreement or

Read More

Evaluate product designs and concepts early and often. Don’t wait till you’ve built the entire app, website, or product before having people actually use it. Build a prototype and test it. These principles are fundamental to user-centered-design, as well as other popular concepts such as the lean startup and minimum viable products featured in the popular book Sprint. But building even modest functionality and aesthetics

Read More

Online panels are a major source of participants for both market research and UX research studies. In an earlier article I summarized some of the research on the accuracy and variability of estimates from online panels. The types of estimates from those studies tended to center around general demographic or psychographic questions (e.g., smoking, newspaper readership). To understand whether similar findings would hold for UX-related

Read More

There isn't a usability thermometer to tell you how usable your software or website is. Instead we rely on the impact of good and bad usability to assess the quality of the user experience. Here are 10 metrics you should be familiar with and ready to use in any usability evaluation. 1. Completion Rates: Often called the fundamental usability metric, or the gateway metric, completion

Read More