Sample Sizes

Browse Content by Topic

UX ( 73 )
Methods ( 62 )
Usability Testing ( 53 )
Statistics ( 51 )
Survey ( 37 )
NPS ( 34 )
Benchmarking ( 32 )
Usability ( 32 )
Customer Experience ( 31 )
User Research ( 29 )
SUS ( 28 )
Rating Scale ( 25 )
Net Promoter Score ( 21 )
Sample Size ( 21 )
Metrics ( 17 )
Usability Problems ( 17 )
Measurement ( 15 )
User Experience ( 14 )
Questionnaires ( 14 )
Satisfaction ( 14 )
Validity ( 14 )
Surveys ( 13 )
Usability Metrics ( 13 )
Rating Scales ( 12 )
Market Research ( 12 )
SUPRQ ( 12 )
Qualitative ( 11 )
Navigation ( 10 )
Reliability ( 10 )
SUPR-Q ( 10 )
UMUX-lite ( 10 )
UX Metrics ( 8 )
Heuristic Evaluation ( 8 )
Task Time ( 8 )
Questionnaire ( 7 )
Task Completion ( 7 )
SEQ ( 7 )
Analytics ( 6 )
Mobile Usability Testing ( 6 )
Research ( 6 )
Mobile ( 6 )
Visualizing Data ( 5 )
Usability Problem ( 5 )
Unmoderated Research ( 5 )
Six Sigma ( 5 )
Task Times ( 4 )
Moderation ( 4 )
UX Methods ( 4 )
Confidence ( 4 )
Credibility ( 4 )
UX Maturity ( 4 )
Loyalty ( 4 )
Quantitative ( 4 )
Confidence Intervals ( 4 )
Expert Review ( 4 )
Summative ( 3 )
Data ( 3 )
Usability Lab ( 3 )
Desirability ( 3 )
Lean UX ( 3 )
Card Sorting ( 3 )
Customer Segmentation ( 3 )
Key Driver ( 3 )
Task Metrics ( 3 )
Voice Interaction ( 3 )
PURE ( 3 )
ROI ( 3 )
Findability ( 2 )
Focus Groups ( 2 )
A/B Testing ( 2 )
Excel ( 2 )
Remote Usability Testing ( 2 )
Tasks ( 2 )
Correlation ( 2 )
Salary Survey ( 2 )
Branding ( 2 )
PhD ( 2 )
Personas ( 2 )
UX Salary Survey ( 2 )
Tree Testing ( 2 )
IA ( 2 )
Prototype ( 2 )
Eye-Tracking ( 2 )
SUM ( 2 )
Variables ( 2 )
Sample Sizes ( 2 )
Marketing ( 2 )
TAM ( 2 )
Cognitive Walkthrough ( 2 )
KLM ( 2 )
Formative ( 2 )
Errors ( 2 )
Meeting software ( 1 )
Cumulative Graphs ( 1 )
History of usability ( 1 )
Desktop ( 1 )
b2b software ( 1 )
consumer software ( 1 )
Design Thinking ( 1 )
User-Centred Design ( 1 )
Likert ( 1 )
ISO ( 1 )
MUSiC ( 1 )
AttrakDiff2 ( 1 )
UEQ ( 1 )
meCUE2.0 ( 1 )
Hedonic usability ( 1 )
negative scale ( 1 )
RITE ( 1 )
Formative testing ( 1 )
CUE ( 1 )
Trust ( 1 )
graphic scale ( 1 )
Carryover ( 1 )
Information Architecture ( 1 )
Within-subjects ( 1 )
Polarization ( 1 )
Anchoring ( 1 )
MOS ( 1 )
Site Analytics ( 1 )
MOS-R ( 1 )
Contextual Inquiry ( 1 )
Linear Numeric Scale ( 1 )
sliders ( 1 )
Microsoft Desirability Toolkit ( 1 )
Problem Severity ( 1 )
Visual Analog Scale ( 1 )
slider ( 1 )
Emoji scale ( 1 )
Star Scale ( 1 )
Mobile Usability ( 1 )
Mean Opinion Scale ( 1 )
Task Randomization ( 1 )
Segmentation ( 1 )
Perceptions ( 1 )
Persona ( 1 )
User Testing ( 1 )
Performance ( 1 )
Software ( 1 )
Task Completin ( 1 )
Affinity ( 1 )
Z-Score ( 1 )
Effect Size ( 1 )
Five ( 1 )
Top Task Analysis ( 1 )
True Intent ( 1 )
Visual Appeal ( 1 )
Random ( 1 )
Crowdsourcing ( 1 )
Unmoderated ( 1 )
Sample ( 1 )
Design ( 1 )
coding ( 1 )
Ordinal ( 1 )
CSUQ ( 1 )
Delight ( 1 )
Customer effort ( 1 )
Competitive ( 1 )
PSSUQ ( 1 )
Quality ( 1 )
LTR ( 1 )
Think Aloud ( 1 )
Test Metrics ( 1 )
NSAT ( 1 )
Expectations ( 1 )
protoype ( 1 )
Facilitation ( 1 )
Certification ( 1 )
Metric ( 1 )
Moderating ( 1 )
moderated ( 1 )
Conjoint Analysis ( 1 )
Regression Analysis ( 1 )
Margin of Error ( 1 )
We typically recommend small sample sizes (5–10) for conducting iterative usability testing meant to find and fix problems (formative evaluations). For benchmark or comparative studies, where the focus is on detecting differences or estimating population parameters (summative evaluations), we recommend using larger sample sizes (20–100+). Usability testing can be used to uncover problems and assess the experience. Many usability tests will play both roles simultaneously, formative

Read More

One of the primary goals of measuring the user experience is to see whether design efforts actually make a quantifiable difference over time. A regular benchmark study is a great way to institutionalize the idea of quantifiable differences. Benchmarks are most effective when done at regular intervals (e.g., quarterly or yearly) or after significant design or feature changes. A UX benchmark is something akin to

Read More