{"id":78,"date":"2011-08-02T22:00:00","date_gmt":"2011-08-02T22:00:00","guid":{"rendered":"http:\/\/measuringu.com\/he-cw\/"},"modified":"2021-01-28T06:29:33","modified_gmt":"2021-01-28T06:29:33","slug":"he-cw","status":"publish","type":"post","link":"https:\/\/measuringu.com\/he-cw\/","title":{"rendered":"What\u2019s the difference between a Heuristic Evaluation and a Cognitive Walkthrough?"},"content":{"rendered":"
<\/a>Heuristic Evaluations and Cognitive Walkthroughs belong to a family of techniques called Inspection Methods.<\/p>\n Inspection methods, like Keystroke Level Modeling<\/a>, are analytic techniques. They don’t involve users and tend to generate results for a fraction of the time and cost as empirical techniques like usability testing.<\/p>\n They are also referred to as Expert Reviews because they are usually performed by an expert in usability or Human Computer Interaction.\u00a0 They are more than just some highly paid expert’s opinion. Inspection Methods are based on principles derived from observing and analyzing user actions and intentions.<\/p>\n Heuristic evaluations were introduced by Nielsen and Molich<\/a> in 1990 in the influential paper<\/a> “Heuristic Evaluation of User Interfaces” and later assembled as part of a book (Nielsen 1994). A heuristic evaluation involves having an expert review an interface against a set of guidelines or principles.\u00a0 These heuristics provide a template to help uncover problems a user will likely encounter. Nielsen’s 10 heuristics <\/a>are the most popular but there are actually many more.<\/a><\/p>\n Susan Weinschenk and Dean Barker (Weinschenk and Barker 2000) researched usability guidelines and heuristics from many sources (including Nielsen’s, Apple and Microsoft) and did a massive card sort to generate the list of 20 below.<\/p>\n One of the biggest criticisms of HE is that it tends to uncover many low-severity problems or issues that aren’t really problems (false positives<\/a>). An additional practical problem is that multiple usability experts should be used. It can often be more expensive and difficult to find 3-5 usability professionals as it is to test 3-5\u00a0users.<\/p>\n A cognitive walkthrough is also a usability inspection method like heuristic evaluation but the emphasis is on tasks. The idea is basically to identify users’ goals, how they attempt them in the interface, then meticulously identify problems users would have as they learn to use an interface. The method was also introduced at the same conference as Heuristic Evaluation (Lewis et al 1990). The cognitive walkthrough was an extension of earlier work by Polson and Lewis (1990).<\/p>\n For each action a user has to take to complete a task, a reviewer needs to describe the user’s immediate goal and answer 8 questions:<\/p>\n It may come as no surprise that one of the biggest complaints about using the CW method is how long it takes to answer each question. In response to this, Spencer (2000) proposed a Streamlined Cognitive Walkthrough technique in which you ask only two questions at each user action.<\/p>\n He found that by reducing the number of questions and setting up ground rules for the review team he was able to make CW work at Microsoft.<\/p>\n Despite their differences, the two techniques, like many inspection methods, have several things in common.<\/p>\n Double Experts<\/span>: Having expertise in both Human Computer Action and the specific domain (e.g., Finance, Automotive Parts, etc.) will yield the best insights.<\/p>\n Uncover Many Usability Problems:<\/span> In general both methods tend to find many of the problems in user-testing. The actual percentage of problems tends to vary from (30 to 90%) depending on the study (Hollingsed and Novick 2007). Interestingly enough, this percentage is similar to software inspection and walkthrough methods which tend to find between 30% and 70% of the logic-design and coding errors that are eventually detected (Myers 2004 p21).<\/p>\n Not User Testing<\/span>: Neither method is a substitute for testing with actual users.\u00a0 Both offer a potentially cheaper way of identifying problems at all stages of the development process. It can be difficult to test users on a prototype and these inspection methods provide for early feedback, especially in an iterative design methodology.<\/p>\n Users’ Point of View<\/span>: Both methods require the usability experts to take the users’ point of view as they inspect the interface.<\/p>\n Multiple Evaluators are Best:<\/span> Each evaluator is only uncovering some of the usability problems (often around 30% for more obvious issues) so having multiple evaluators inspecting an interface will generate both more problems are identify overlapping problems.<\/p>\n Inspections Can be more Thorough Than User Testing<\/span>: While usability testing is often looked at as the “gold-standard” for detecting problems, users are generally constrained to a small number of tasks. This limits their expose in the interface and the opportunity to detect more problems. With HE\/CW, a few evaluators can inspect all the “nooks and crannies” of an interface and provide more coverage of an interface.<\/p>\n<\/div>\n <\/p>\n In my experience, having a focus on the tasks is valuable for diagnosing interaction problems and minimizing some of the peripheral problems HE tends to uncover. When I perform an Expert Review I use heuristics and a streamlined CW technique using these steps.<\/p>\n I often perform an Expert Review prior to conducting a usability test and try and have at least two others independently review the interface with the same tasks. I typically see around 30-50% of problems we identified encountered by the users.\u00a0 This is encouraging because it shows these methods tend to uncover problems without testing users, while on the other hand it reminds us of the value of having actual users attempt the tasks.<\/p>\n Combining task scenarios with heuristics is nothing new. It’s also a strategy recommended by Sears (1997) and even Nielsen\u00a0 (Nielsen 1993). So I suspect these two inspection methods will continue to blend to suit the need of practitioners.<\/p>\n For more information on how inspection methods compare see the paper[pdf]<\/span><\/a> by Hollingsed and Novick which also contains one of the largest collections of references on Usability Inspection methods.<\/p>\n <\/p>\n","protected":false},"excerpt":{"rendered":" Heuristic Evaluations and Cognitive Walkthroughs belong to a family of techniques called Inspection Methods. Inspection methods, like Keystroke Level Modeling, are analytic techniques. They don’t involve users and tend to generate results for a fraction of the time and cost as empirical techniques like usability testing. They are also referred to as Expert Reviews because […]<\/p>\n","protected":false},"author":2,"featured_media":11092,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"_price":"field_56e41332a1ae5","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"","_tribe_ticket_capacity":"","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[64,41],"tags":[65,42],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/78"}],"collection":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/comments?post=78"}],"version-history":[{"count":0,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/78\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media\/11092"}],"wp:attachment":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media?parent=78"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/categories?post=78"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/tags?post=78"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}Heuristic Evaluation<\/h2>\n
\n
Cognitive Walkthrough<\/h2>\n
\n
\n
What HE and CW have in Common<\/h2>\n
A Hybrid Approach: HE+CW<\/h3>\n
\n
References<\/h3>\n
\n
\n<\/span>
\n<\/span><\/li>\n