{"id":41595,"date":"2024-06-18T15:07:26","date_gmt":"2024-06-18T21:07:26","guid":{"rendered":"https:\/\/measuringu.com\/?p=41595"},"modified":"2024-06-18T15:07:26","modified_gmt":"2024-06-18T21:07:26","slug":"how-to-analyze-click-test-data-standalone","status":"publish","type":"post","link":"https:\/\/measuringu.com\/how-to-analyze-click-test-data-standalone\/","title":{"rendered":"How to Analyze Click Test Metrics in Stand-Alone Studies"},"content":{"rendered":"<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat.jpg\" rel=\"attachment wp-att-24969\"><img fetchpriority=\"high\" decoding=\"async\" class=\"alignleft wp-image-41682 size-medium\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat-300x169.jpg\" alt=\"feature image with computer mouse and bar graph\" width=\"300\" height=\"169\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat-300x169.jpg 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat-1024x576.jpg 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat-768x432.jpg 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat-600x338.jpg 600w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-Feat.jpg 1280w\" sizes=\"(max-width: 300px) 100vw, 300px\" \/><\/a>In an earlier article, we reviewed <a href=\"https:\/\/measuringu.com\/why-and-when-to-use-a-click-test\/\">when and why to use click testing<\/a>. Click testing involves presenting images to participants and tracking where they click based on tasks participants are asked to complete. It\u2019s typically administered using a tool like the <a href=\"https:\/\/measuringu.com\/muiq\/\">MUiQ<sup>\u00ae<\/sup> platform<\/a>.<\/p>\n<p>As we cover in our <a href=\"https:\/\/measuringu.com\/product\/click-testing-short-course-using-click-testing-to-answer-ux-research-questions\/\">short course<\/a>, click testing tends to be used in the design and release phases of product development, and it generates mostly quantitative data.<\/p>\n<p>Our earlier analyses also showed how click testing provides a reasonable approximation for how people would <a href=\"https:\/\/measuringu.com\/do-click-tests-predict-live-site-clicks\/\">click on a live website<\/a> or live <a href=\"https:\/\/measuringu.com\/do-click-tests-predict-clicks-on-product-pages\/\">product pages<\/a> (especially when the live web page doesn\u2019t contain dynamic elements).<\/p>\n<p>Click testing can be thought of as a specialized type of usability testing (defined by the <a href=\"https:\/\/measuringu.com\/iso-9241\/\">ISO specification of usability<\/a>). Therefore, <a href=\"https:\/\/measuringu.com\/essential-metrics-for-click-testing\/\">essential click-testing metrics<\/a>, like usability metrics, can be classified as:<\/p>\n<ul>\n<li>Effectiveness (e.g., location, success rate)<\/li>\n<li>Efficiency (e.g., completion time, number of clicks)<\/li>\n<li>Perception\/satisfaction (e.g., SEQ, confidence, preference)<\/li>\n<\/ul>\n<p>These metrics provide quantitative support for visually interpreted representations such as click maps and heat maps. Software like the MUiQ platform makes it relatively straightforward to see where people click or don\u2019t click on images.<\/p>\n<p>Beyond just eyeballing the data, how do you correctly analyze click-testing metrics? The answer depends on the study setup and your research questions. In this article, we\u2019ll walk through the steps to analyze the data you\u2019ve collected for common research questions addressed with click testing.<\/p>\n<p>We&#8217;ll use data from our earlier click-testing study in which participants attempted to locate information across five homepage website images: Creative Commons, NASA, Disqus, IKEA, and California Parks.<\/p>\n<p>There are two main ways to analyze click-test data: stand-alone analyses and comparative analyses. In stand-alone analyses, you use confidence intervals around your sample of data to infer the plausible range of a population parameter like a mean or proportion. In an upcoming article, we\u2019ll cover how to make comparisons with click-testing data (assessing differences in click patterns).<\/p>\n<p>To know which one to use, we\u2019ll start with the research questions and the metric used. When using the MUiQ platform, many of these computations are done automatically. Otherwise, you can use statistical packages or online calculators.<\/p>\n<h1>Stand-Alone Analysis (Confidence Intervals)<\/h1>\n<p>As the name suggests, a stand-alone analysis involves summarizing a metric from a sample to make inferences about the larger population of users who were not sampled. To do this, you provide an average or percentage (called a point estimate) and generate a confidence interval around this value to provide the plausible range within which the average would fluctuate if you were able to sample the entire population.<\/p>\n<p>There are two types of confidence intervals for click-testing metrics\u2014one for percentages (the adjusted-Wald binomial confidence interval) and one for rating scale and time data (the <em>t<\/em>-confidence interval, using a log transformation when analyzing time data).<\/p>\n<p>Below are common research questions for the three types of metrics and examples of their corresponding confidence intervals. These examples come from our <a href=\"https:\/\/measuringu.com\/do-click-tests-predict-live-site-clicks\/\">image versus live site click comparisons of five websites<\/a>: Creative Commons, NASA, Disqus, IKEA, and the California State website.<\/p>\n<h2>Effectiveness Measures: Percentages<\/h2>\n<p>The following are examples of research questions measuring effectiveness that use percentages:<\/p>\n<ul>\n<li>What percentage of people click on a designated part of the image (often called a hotspot)?<\/li>\n<li>How many participants have a successful first click?<\/li>\n<li>How many participants scroll down and click \u201cbelow the fold\u201d?<\/li>\n<\/ul>\n<h3>How to Analyze<\/h3>\n<p>To analyze percentages, we recommend computing adjusted-Wald binomial confidence intervals. They can be computed using our <a href=\"https:\/\/measuringu.com\/calculators\/wald\/\">online calculator<\/a> for binomial confidence intervals, or the intervals can be automatically generated in our <a href=\"https:\/\/measuringu.com\/muiq\/\">MUiQ platform<\/a>.<\/p>\n<p>Although some of the example research questions above could be interpreted as asking about total numbers (e.g., \u201cHow many participants \u2026\u201d), it\u2019s more useful to report percentages <a href=\"https:\/\/measuringu.com\/should-you-avoid-reporting-percentages-from-small-sample-studies\">even when sample sizes are small<\/a> (dividing the number of participants who made the designated click by the total number of participants who were exposed to the image, thus having an opportunity to click). This percentage applies to the larger population that will eventually get exposed to the image (e.g., usually a web page).<\/p>\n<p>For example, in our study on testing an image of the NASA home page, we wanted to know what percentage of participants would click on the \u201cAbout\u201d or \u201cHistory\u201d menu items shown in Figure 1.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1.png\" rel=\"attachment wp-att-41596\"><img decoding=\"async\" class=\"alignnone wp-image-41686 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1.png\" alt=\"Image from the Nasa.gov website with \u201cAbout\u201d and \u201cHistory\u201d hotspots identified. \" width=\"1118\" height=\"572\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1.png 1118w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1-300x153.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1-1024x524.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1-768x393.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F1-600x307.png 600w\" sizes=\"(max-width: 1118px) 100vw, 1118px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 1:<\/strong> Image from the Nasa.gov website with \u201cAbout\u201d and \u201cHistory\u201d hotspots identified.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/calculators\/wald\/\"><em>Online calculator<\/em><\/a>. Of the 62 participants who attempted to click on the optimal locations on the NASA homepage image, 57 were successful. Figure 2 shows the 90% <a href=\"https:\/\/measuringu.com\/article\/estimating-completion-rates-from-small-samples-using-binomial-confidence-intervals-comparisons-and-recommendations\/\">adjusted-Wald binomial confidence interval<\/a> from our online calculator for the task success rate for the image of the NASA site (determined by whether a participant\u2019s first click was on a valid area of interest on the image).<\/p>\n<p>The calculator shows results for four different methods, but for these types of analyses, we recommend reporting the maximum-likelihood estimate (MLE) as the observed percentage and the adjusted-Wald method for the confidence interval (inside the green boxes in Figure 2). For these data, the observed percentage (MLE) is 91.9%, with the adjusted-Wald interval ranging from a low of 84.1% to a high of 96.3% (shown as ratios rather than percentages in the calculator).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2.png\" rel=\"attachment wp-att-41597\"><img decoding=\"async\" class=\"alignnone wp-image-41687 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2.png\" alt=\"90% confidence interval for the NASA image condition\u2019s 57 successes out of 62 attempts using our online calculator. \" width=\"4202\" height=\"2015\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2.png 4202w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-300x144.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-1024x491.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-768x368.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-1536x737.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-2048x982.png 2048w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F2-600x288.png 600w\" sizes=\"(max-width: 4202px) 100vw, 4202px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 2:<\/strong> 90% confidence interval for the NASA image condition\u2019s 57 successes out of 62 attempts using our online calculator.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/muiq\/\"><em>MUiQ platform<\/em><\/a><em>.<\/em> Figure 3 shows the success rate analysis downloaded from the MUiQ platform with 90% adjusted-Wald confidence intervals for all five websites in both experimental conditions (image and live).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3.png\" rel=\"attachment wp-att-41602\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41688 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3.png\" alt=\"Task success rates (90% confidence intervals computed in the MUiQ platform). \" width=\"3554\" height=\"2378\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3.png 3554w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-300x201.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-1024x685.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-768x514.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-1536x1028.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-2048x1370.png 2048w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F3-600x401.png 600w\" sizes=\"(max-width: 3554px) 100vw, 3554px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 3:<\/strong> Task success rates (90% confidence intervals computed in the MUiQ platform).<\/p>\n<h2>Efficiency Measures: Time<\/h2>\n<p>When measuring efficiency in click, tests use time (measured in seconds and milliseconds). Examples of research questions include:<\/p>\n<ul>\n<li>How long does it take for people to make an initial selection (first click)?<\/li>\n<li>How much time do people typically take to complete a task with a UI design?<\/li>\n<\/ul>\n<h3>How to Analyze<\/h3>\n<p>When you analyze time data, you should use log-transformed <em>t<\/em>-confidence intervals, which can be done using our <a href=\"https:\/\/measuringu.com\/calculators\/time_intervals\/\">online calculator<\/a>, or they are automatically computed in the <a href=\"https:\/\/measuringu.com\/muiq\/\">MUiQ platform<\/a><em>.<\/em><\/p>\n<p><a href=\"https:\/\/measuringu.com\/calculators\/time_intervals\/\"><em>Online calculator<\/em><\/a><em>.<\/em> Figure 4 shows a 90% confidence interval from our online calculator, displaying task-completion times for the image of the Creative Commons homepage. The calculator shows three measures of central tendency: arithmetic mean, median, and our preferred estimate, the <a href=\"https:\/\/measuringu.com\/average-times\/\">geometric mean<\/a>. The geometric mean was 23.1 seconds with a 90% confidence interval ranging from 20.0 to 26.6. This online calculator always computes the confidence interval around the geometric mean rather than the median. <a href=\"https:\/\/measuringu.com\/article\/average-task-times-in-usability-tests-what-to-report\/\">Our research<\/a> has shown that the geometric mean is more accurate when <em>n<\/em> &lt; 25, and it&#8217;s about as good as the median when sample sizes are larger.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4.png\" rel=\"attachment wp-att-41600\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41689 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4.png\" alt=\"Time to task completion for Creative Commons (90% confidence interval around the geometric mean).\" width=\"1262\" height=\"726\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4.png 1262w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4-300x173.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4-1024x589.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4-768x442.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F4-600x345.png 600w\" sizes=\"(max-width: 1262px) 100vw, 1262px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 4:<\/strong> Time to task completion for Creative Commons (90% confidence interval around the geometric mean).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/muiq\/\"><em>MUiQ platform<\/em><\/a><em>.<\/em> Figure 5 shows the completion times and 90% confidence intervals computed in the MUiQ platform. The slight difference in the confidence interval for the Creative Commons image is due to presenting the confidence interval around the median rather than the geometric mean. (MUiQ computes confidence intervals around the median when <em>n <\/em>&gt; 25 and around the geometric mean when <em>n<\/em> &lt; 25.)<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5.png\" rel=\"attachment wp-att-41601\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41690 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5.png\" alt=\"Time to task completion (90% confidence intervals around the median). \" width=\"3554\" height=\"2295\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5.png 3554w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-300x194.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-1024x661.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-768x496.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-1536x992.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-2048x1322.png 2048w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F5-600x387.png 600w\" sizes=\"(max-width: 3554px) 100vw, 3554px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 5:<\/strong> Time to task completion (90% confidence intervals around the median).<\/p>\n<h2>Efficiency Measures: Clicks<\/h2>\n<p>We generally recommend <a href=\"https:\/\/measuringu.com\/click-clock\/\">time rather than clicks <\/a>to measure efficiency, but clicks can complement time. Research questions that involve clicks may include:<\/p>\n<ul>\n<li>What is the average number of clicks people make to find a correct link?<\/li>\n<li>How many times do people click to make their selections?<\/li>\n<\/ul>\n<h3>How to Analyze<\/h3>\n<p>To analyze clicks, we recommend using <em>t<\/em>-confidence intervals, which can be computed in our <a href=\"https:\/\/measuringu.com\/calculators\/ci-calc\/?summary=1\">online calculator<\/a> or automatically in the <a href=\"https:\/\/measuringu.com\/muiq\/\">MUiQ platform<\/a>.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/calculators\/ci-calc\/?summary=1\"><em>Online calculator<\/em><\/a><em>.<\/em> With a sample size of 62, the mean number of clicks to task completion for the Disqus image was 1.4 with a standard deviation of 1.9. The 90% confidence interval around the mean ranged from 0.997 to 1.803 (Figure 6).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6.png\" rel=\"attachment wp-att-41603\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41691 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6.png\" alt=\"90% confidence interval for the mean number of clicks to task completion on the Disqus image.\" width=\"1603\" height=\"638\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6.png 1603w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6-300x119.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6-1024x408.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6-768x306.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6-1536x611.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F6-600x239.png 600w\" sizes=\"(max-width: 1603px) 100vw, 1603px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 6:<\/strong> 90% confidence interval for the mean number of clicks to task completion on the Disqus image.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/muiq\/\"><em>MUiQ platform<\/em><\/a><em>.<\/em> Figure 7 shows 90% confidence intervals for all websites and conditions around the mean number of clicks to task completion. At a glance, it\u2019s apparent that except for IKEA, task completion on images took fewer clicks than on live websites.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7.png\" rel=\"attachment wp-att-41604\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41692 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7.png\" alt=\"90% confidence intervals around mean clicks to task completion computed in MUiQ for all five websites and both conditions (image and live).\" width=\"3554\" height=\"2295\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7.png 3554w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-300x194.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-1024x661.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-768x496.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-1536x992.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-2048x1322.png 2048w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F7-600x387.png 600w\" sizes=\"(max-width: 3554px) 100vw, 3554px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 7:<\/strong> 90% confidence intervals around mean clicks to task completion computed in MUiQ for all five websites and both conditions (image and live).<\/p>\n<h2>Perception Measures: Rating Scales (e.g., SEQ)<\/h2>\n<p>Examples of research questions assessing the perception of the experience include:<\/p>\n<ul>\n<li>How difficult did participants think it was to locate a function?<\/li>\n<li>Is it easy for people to click on the correct location?<\/li>\n<li>How confident are participants that they clicked the right location?<\/li>\n<\/ul>\n<h3>How to Analyze<\/h3>\n<p>When you analyze rating scale data, you can compute the mean (the average), top-box responses (extreme responders), or both.<\/p>\n<h4>Analyzing The Mean<\/h4>\n<p>You can compute confidence intervals around the mean with <em>t<\/em>-confidence intervals using our <a href=\"https:\/\/measuringu.com\/calculators\/ci-calc\/?summary=1\">online calculator<\/a> or the <a href=\"https:\/\/measuringu.com\/muiq\/\">MUiQ platform<\/a>.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/calculators\/ci-calc\/?summary=1\"><em>Online calculator<\/em><\/a><em>.<\/em> With the same calculator we used to analyze clicks, the 90% confidence interval around the mean SEQ of 5.18 with a standard deviation of 1.71 and sample size of 62 ranges from 4.817 to 5.543 for IKEA in the image condition (Figure 8).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8.png\" rel=\"attachment wp-att-41605\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41693 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8.png\" alt=\"90% confidence interval around the mean SEQ for the IKEA image (with summary data input).\" width=\"1618\" height=\"636\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8.png 1618w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8-300x118.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8-1024x403.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8-768x302.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8-1536x604.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F8-600x236.png 600w\" sizes=\"(max-width: 1618px) 100vw, 1618px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 8:<\/strong> 90% confidence interval around the mean SEQ for the IKEA image (with summary data input).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/muiq\/\"><em>MUiQ platform<\/em><\/a>. Figure 9 shows, for all websites and conditions, the 90% confidence intervals computed around the mean SEQ in the MUiQ platform.<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9.png\" rel=\"attachment wp-att-41606\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41694 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9.png\" alt=\"Mean SEQ ratings with 90% confidence intervals computed in MUiQ for all five websites and both conditions (image and live). \" width=\"3554\" height=\"2295\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9.png 3554w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-300x194.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-1024x661.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-768x496.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-1536x992.png 1536w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-2048x1322.png 2048w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F9-600x387.png 600w\" sizes=\"(max-width: 3554px) 100vw, 3554px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 9:<\/strong> Mean SEQ ratings with 90% confidence intervals computed in MUiQ for all five websites and both conditions (image and live).<\/p>\n<h4>Analyzing Top-Box Scores<\/h4>\n<p>Box scores are percentages based on the frequency distributions of responses to rating scales. There are different types of box score, including <a href=\"https:\/\/measuringu.com\/top-top-two-bottom-net-box\">top box, top-two box, bottom box, and net box<\/a>. The top-box score is the percentage of most favorable responses (e.g., for the SEQ, the percentage of 7s). Like other percentages, we recommend computing adjusted-Wald binomial confidence intervals with our <a href=\"https:\/\/measuringu.com\/calculators\/wald\/\">online calculator<\/a> for binomial confidence intervals.<\/p>\n<p>For the 62 participants who attempted the IKEA task in the click test study we ran, 15 selected the response option of 7 for the SEQ, so the top-box score was 24.2% with a 90% confidence interval ranging from 16.4 to 34.2% (Figure 10).<\/p>\n<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10.png\" rel=\"attachment wp-att-41609\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-41695 size-full\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10.png\" alt=\"90% confidence interval for the top box score of SEQ ratings for the IKEA task in the image condition. \" width=\"1398\" height=\"636\" srcset=\"https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10.png 1398w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10-300x136.png 300w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10-1024x466.png 1024w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10-768x349.png 768w, https:\/\/measuringu.com\/wp-content\/uploads\/2024\/06\/061824-F10-600x273.png 600w\" sizes=\"(max-width: 1398px) 100vw, 1398px\" \/><\/a><\/p>\n<p class=\"wp-caption-text\" style=\"text-align: left;\"><strong>Figure 10:<\/strong> 90% confidence interval for the top-box score of SEQ ratings for the IKEA task in the image condition.<\/p>\n<h1>Summary<\/h1>\n<p>The key points from this discussion of analysis of click test metrics in stand-alone studies are:<\/p>\n<ul>\n<li>Click testing is a specialized type of usability testing that can produce numerous metrics that can be classified as measures of effectiveness, efficiency, and perception\/satisfaction.<\/li>\n<li>Start with your research question (e.g., \u201cHow many people have a successful first click?\u201d) and operationalize it into a percentage or mean.<\/li>\n<li>Compute a confidence interval around the percentage or mean. The confidence interval provides the best estimate of what the percentage or mean would be if you could somehow measure all your users.<\/li>\n<li>For percentages, compute the adjusted-Wald binomial confidence intervals.<\/li>\n<li>For means, use the <em>t<\/em>-confidence interval (for time data, use a log transformation).<\/li>\n<li>An advantage of using the MUiQ platform for click testing is the automatic generation of appropriate confidence intervals for many research questions.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>In an earlier article, we reviewed when and why to use click testing. Click testing involves presenting images to participants and tracking where they click based on tasks participants are asked to complete. It\u2019s typically administered using a tool like the MUiQ\u00ae platform. As we cover in our short course, click testing tends to be [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":41682,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"default","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"set","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"_price":"field_56e41332a1ae5","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"Tribe__Tickets_Plus__Commerce__WooCommerce__Main","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[48,2,39],"tags":[503,425,51],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/41595"}],"collection":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/comments?post=41595"}],"version-history":[{"count":7,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/41595\/revisions"}],"predecessor-version":[{"id":41667,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/41595\/revisions\/41667"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media\/41682"}],"wp:attachment":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media?parent=41595"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/categories?post=41595"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/tags?post=41595"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}