feature image with opt in button

Are Opt-In Online Panels Too Inaccurate?

It’s hard to conduct user research without users. And current and prospective users are often people who sign up to an online panel to get paid for taking studies. But who are these people who spend time taking surveys, unmoderated usability studies, and product concept evaluations? Can we trust them? We’ve written before about the

Read More »

Revisiting the Evidence for the Left-Side Bias in Rating Scales

Are people more likely to select response options that are on the left side of a rating scale? About ten years ago, we provided a brief literature review of the published evidence, which suggested that this so-called left-side bias not only existed but also was detected almost 100 years ago in some of the earliest

Read More »

Are Within-Subjects Designs Invalid?

One of the best ways to make UX metrics more meaningful is to have a comparison. For example, when conducting a UX benchmark study we often recommend adding at least one competing product (especially if it’s the first benchmark). Comparable interfaces help stakeholders easily interpret context-sensitive task metrics, such as completion rates and task time.

Read More »

8 Things to Consider When Using Online Panels

Online panels are the go-to method for collecting data quickly for market and UX research studies. Despite their wide usage, surprisingly little is known about these panels, such as the characteristics of the panel members or the reliability and accuracy of the data collected from them. While there isn’t much published data on the inner

Read More »

A Better Way To Segment Your Customers

Market segmentation is a valuable technique to understand the commonalities between customers. Knowing current and prospective customers’ similarities and differences allows an organization to introduce new products or modify existing ones, and more effectively communicate and sell to the customers most interested in those products. We’ve conducted a number of market segmentations for clients and

Read More »

How Long Is the Typical Online Study?

User and customer research fundamentally rely on collecting data from users and customers. But it can be a constant challenge to find the right number and type of qualified participants . Even when you find the right participants, there’s a limit to how much time they’re willing to spend filling out a survey. A common

Read More »

How Accurate Are UX Metrics From Online Panels?

Online panels are a major source of participants for both market research and UX research studies. In an earlier article I summarized some of the research on the accuracy and variability of estimates from online panels. The types of estimates from those studies tended to center around general demographic or psychographic questions (e.g., smoking, newspaper

Read More »

How Accurate Are Estimates From Online Panels?

Online panel research has been a boon for market research and UX researchers alike. Since the late 1990s in fact, online panels have provided a cost effective pool of sample participants ready to take online studies, covering topics from soup to nuts (literally)…from apple juice to zippers. But can you trust the data you get

Read More »

5 Ways to Find Out More About Your Customers

It’s fundamental to creating both a usable customer experience and a better business: you need to know who your customers are. It however can be surprisingly difficult for organizations to connect with their customers to collect information. But just because it isn’t easy doesn’t mean you should skip it. Collecting core demographic information and customer

Read More »

5 Steps for Better Customer Sampling

For most customer research, you’re rarely able to measure the attitudes or behaviors of everyone. Instead you take a sample of your customers and use this sample to make inferences about the rest of your customers. Even if you’re in a situation where you can collect data from all current customers, it’s not possible to

Read More »
0
    0
    Your Cart
    Your cart is emptyReturn to Shop
    Scroll to Top