There is plenty of debate about the best way to quantify attitudes and experiences with rating scales. And among those debates, perhaps the most popular question is the “right” number of response options to use for rating scales. For example, is an eleven-point scale too difficult for people to understand? Is a three-point scale insufficient
UX research and UX measurement can be seen as an extension of experimental design. At the heart of experimental design lie variables. Earlier we wrote about different kinds of variables. In short, dependent variables are what you get (outcomes), independent variables are what you set, and extraneous variables are what you can’t forget (to account
To have a reliable and valid response scale, people need to understand what they’re responding to. A poorly worded question, an unclear response item, or an inadequate response scale can create additional error in measurement. Worse yet, the error may be systematic rather than random, so it would result in unmodeled bias rather than just
In an earlier article, we reviewed five competing models of delight. The models differed in their details, but most shared the general idea that delight is composed of an unexpected positive experience. Or, for the most part, delight is a pleasant surprise. However, there is disagreement on whether you actually need surprise to be delighted.
Small changes can have big impacts on rating scales. But to really know what the effects are, you need to test. Labels, number of points, colors, and item wording differences can often have unexpected effects on survey responses. In an earlier analysis, we compared the effects of using a three-point recommend item compared to an
It seems like there are endless ways to ask questions of participants in surveys. Variety in question types can be both a blessing and a curse. Having many ways to ask questions provides better options to the researcher to assess the opinion of the respondent. But the wrong type of question can fail to capture
We all are bombarded with surveys asking us to provide feedback on everything from our experience on a website to our time at the grocery store. Many of us also create surveys. They’re an indispensable method for collecting data quickly. Done well, they can be one of the most cost effective ways to: Understand the
Surveys are a relatively quick and effective way to measure customers’ attitudes and experiences along their journey. Not all customer experience surveys are created equal. Depending on the goals, the type of questions and length will vary. While customer experience surveys can take on any form, it can be helpful to think of them as
The best way to measure the user experience is by observing real users attempting realistic tasks. This is best done through a usability test or direct observation of users. You may not always be able to do so though because of limitations in time, costs, availability of products, or difficulty in finding qualified users. Many large
Which design do you prefer? Which product would you pick? Which website do you find more usable? A cornerstone of customer research is asking preferences. A common scenario is to show participants a set of designs or two or more websites, and then ask customers which design or site they prefer. While customer preferences often
