Blog

Topics

Do Too Many Response Options Confuse People?

Advice on rating scale construction is ubiquitous on the internet and in the halls of organizations worldwide. The problem is that much of the advice is based not on solid data but rather on conventional wisdom and what’s merely thought to work. Even published papers and books on survey design can present a perspective that

Read More »

Four Types of Potential Survey Errors

When we conduct a survey, we want the truth, even if we can’t handle it. But standing in the way of our dreams of efficiently collected data revealing the unvarnished truth about customers, prospects, and users are the four horsemen of survey errors. Even a well-thought-out survey will have to deal with the inevitable challenge

Read More »

How Does Statistical Hypothesis Testing Work?

Statistically significant. p-value. Hypothesis. These terms are not only commonly used in statistics but also have made their way into the vernacular. Making sense of most scientific publications, which can have practical, significant effects on public policy and your life, means understanding a core framework with which we derive much knowledge. That framework is called

Read More »

Quant or Qual Research? 27 Words to Help You Decide

When approaching a UX research project, one of the first things to consider is the method. And UX research has many methods. Methods can be categorized as quantitatively focused (e.g., A/B tests) or qualitatively focused (e.g., interviews). Most UX research methods can collect both qualitative and quantitative data. For example, surveys often collect both closed-ended

Read More »

Seven Reasons Survey Questions Are Answered Incorrectly

Surveys are an essential method for collecting data. But like all research methods, surveys have their limitations. Unless the survey is administered by a facilitator, a respondent has only the survey’s instructions, questions, and response options for guidance. Earlier we wrote about ways to improve the clarity of your questions and certain words to watch

Read More »

UX and Net Promoter Benchmarks of Food Delivery Services

The food delivery market has been growing significantly over the past five years. That growth exploded in the United States from $17 billion in 2018 to $26 billion in 2020 (partly due to COVID-19). This market is highly competitive and has ultra-thin profit margins. Technologies such as route optimization enable faster and cheaper delivery, but

Read More »

Seven Reasons People Misinterpret Survey Questions

Like in all research methods, many things can go wrong in surveys, from problems with sampling to mistakes in analysis. To draw valid conclusions from your survey, you need accurate responses. But participants may provide inaccurate information. They could forget the answers to questions or just answer questions incorrectly. One common reason respondents answer survey

Read More »

Exploring Another Alternate Form for the UMUX-Lite Usefulness Item

When thinking about user experiences with websites or software, what is the difference between capabilities and functions? Is there any difference at all? In software engineering, a function is code that takes inputs, processes them, and produces outputs (such as a math function). The word capability doesn’t have a formal definition, but it most often

Read More »

Four Reasons Why Research Participants Forget

Post-mortems and retrospective accounts are valuable for understanding what went well and what went poorly. This applies not only to investigations of critical events, such as crimes and plane accidents, but also to experiences with products and services. But the usefulness of people’s recollections of events and experiences rests on the accuracy of their memories.

Read More »

Sample Size Estimation for NPS Confidence Intervals

Sample size estimation is a critical step in research planning. It can also seem like a mysterious and at times controversial process. But sample size estimation, when done correctly, is based mostly on math, not magic. The challenge is that the math can get complex, so it becomes easier to defer to simple rules or

Read More »

Nine Words to Watch for When Writing Survey Questions

In UX research, both studies and surveys contain a lot of questions. Getting those questions right can go a long way in improving the clarity and quality of the findings. For example, we’ve recently written about how to make survey questions clearer. And while there are many stories of how the change of a single

Read More »

Evaluating NPS Significance Tests with Real-World Data

The Net Promoter Score (NPS) is widely used by organizations. It’s often used to make high-stakes decisions on whether a brand, product, or service has improved or declined. Net Promoter Scores are often tracked on dashboards, and any changes (for better or worse) can have significant consequences: adding or removing features, redirecting budgets, even impacting

Read More »
0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top