Are Within-Subjects Designs Invalid?
One of the best ways to make UX metrics more meaningful is to have a comparison. For example, when conducting a UX benchmark study we often recommend adding at least one competing product (especially if it’s the first benchmark). Comparable interfaces help stakeholders easily interpret context-sensitive task metrics, such as completion rates and task time.