{"id":486,"date":"2018-08-29T03:50:18","date_gmt":"2018-08-29T03:50:18","guid":{"rendered":"http:\/\/measuringu.com\/usgov-ux\/"},"modified":"2022-03-21T17:47:53","modified_gmt":"2022-03-21T23:47:53","slug":"usgov-ux","status":"publish","type":"post","link":"https:\/\/measuringu.com\/usgov-ux\/","title":{"rendered":"The User Experience of U.S. Government Websites"},"content":{"rendered":"<p><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/The-User-Experience-of-US-Government-Websites_Washington-DC.jpg\"><img fetchpriority=\"high\" decoding=\"async\" class=\" wp-image-12032 alignleft\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/The-User-Experience-of-US-Government-Websites_Washington-DC.jpg\" alt=\"The User Experience of US Government Websites_Washington DC\" width=\"334\" height=\"250\" \/><\/a>What forms do I need to file my taxes this year?<\/p>\n<p>How much is a National Park Pass?<\/p>\n<p>How do I renew my passport?<\/p>\n<p>Federal government websites are helpful for a wide variety of activities, from mailing a package to booking a camping site to filing taxes.<\/p>\n<p>Many federal branches have begun to computerize their services to streamline these tasks. But with the proliferation of websites for different department and functions of the federal government comes confusion on where to go to find information and how to complete common tasks.<\/p>\n<p>To understand the online experience of federal government websites, we benchmarked the desktop user experience of a selection of U.S. government websites:<\/p>\n<ul>\n<li>IRS (IRS.gov)<\/li>\n<li>NASA (NASA.gov)<\/li>\n<li>National Park Service (NPS.gov)<\/li>\n<li>United States Government (USA.gov)<\/li>\n<li>USPS (USPS.gov)<\/li>\n<\/ul>\n<p>We collected <a href=\"https:\/\/measuringu.com\/10-things-suprq\/\">SUPR-Q<\/a> data, including <a href=\"https:\/\/measuringu.com\/nps-ux\/\">NPS data<\/a>, and investigated visitors\u2019 reasons for using the site, website attitudes, understanding of key features, and ability to complete tasks on each of the websites. Full details are available in the <a href=\"https:\/\/measuringu.com\/product\/ux-nps-federal-government\/\">downloadable report<\/a>.<\/p>\n<h2>Study Details<\/h2>\n<p><strong>We recruited 402 participants in February 2018 for a perception and usability study to test the federal government sites.<\/strong> For the perception portion, we asked 252 users to reflect on their most recent experience on each of the federal government sites. Participants in the studies answered the 8-item SUPR-Q (including the Net Promoter Score) and questions about their prior experience. In particular, we were interested in current users\u2019 attitudes toward the site, and whether they felt the information was complete and easy to find.<\/p>\n<p>For the usability portion, we asked 150 participants to complete a task on one of the five federal government websites:<\/p>\n<ul>\n<li><b><\/b><strong><b>IRS: <\/b><\/strong>Find tax form 1040.<\/li>\n<li><b><\/b><strong><b>NASA: <\/b><\/strong>Find a page on NASA\u2019s history.<\/li>\n<li><b><\/b><strong><b>National Park Service:<\/b><\/strong> Find how much an annual national park pass costs.<\/li>\n<li><strong>USA.<b>gov:<\/b><\/strong> Find eligibility requirements to renew a passport.<\/li>\n<li><b><\/b><strong><b>USPS:<\/b><\/strong> Find out how long priority mail shipping takes to arrive.<\/li>\n<\/ul>\n<p>Participants also answered the 8-item SUPR-Q (including the Net Promoter Score) and questions about their experience completing the tasks on the website.<\/p>\n<h2>Quality of the Federal Government Website User Experience: SUPR-Q<\/h2>\n<p>The <a href=\"https:\/\/measuringu.com\/product\/suprq\/\">SUPR-Q<\/a> is a standardized measure of the quality of a website\u2019s user experience and is a good way to gauge users\u2019 attitudes. It\u2019s based on a rolling database of around 150 websites across dozens of industries. Scores are percentile ranks and tell you how a website experience ranks relative to the other websites. The SUPR-Q provides an overall score as well as detailed scores for subdimensions of trust, usability, appearance, and loyalty.<\/p>\n<p><strong>For the perception study, the scores for the five federal government websites range from a bit below average to well above average.<\/strong> The federal government desktop average SUPR-Q is at the 67<sup>th<\/sup>\u00a0percentile (scoring better than 67% of the websites in the database). The IRS website has the lowest SUPR-Q score of the group with a score at the 41<sup>st<\/sup>\u00a0percentile. The National Park Service website leads the group with scores at the 96<sup>th<\/sup>\u00a0percentile.<\/p>\n<p><strong>In the usability study, the National Park Service website also has the highest overall SUPR-Q score of the group (at the 99<sup>th<\/sup>\u00a0percentile)<\/strong> compared to IRS.gov that has the lowest at the 71<sup>st<\/sup>\u00a0percentile.<\/p>\n<h3>Usability Scores<\/h3>\n<p>For the usability of the federal government sites, the IRS website has the lowest scores of the group (at the 26<sup>th<\/sup>\u00a0percentile in the perception study and at the 63<sup>rd<\/sup>\u00a0percentile in the usability study). Compared to the National Park Service that has the highest usability scores for both the perception and usability studies (92% and 99% respectively).<\/p>\n<h3>Loyalty\/Net Promoter Scores<\/h3>\n<p><strong>This year, federal government websites have average Net Promoter Scores at about 8% in the perception study and 21% in the usability study.<\/strong> Likelihood to recommend the federal government websites was higher after users had completed a task on the website. The scores are surprisingly high, especially compared to <a href=\"https:\/\/measuringu.com\/ux-health-insurance\/\">health insurance<\/a>, <a href=\"https:\/\/measuringu.com\/social-media-ux\/\">social media<\/a>, and <a href=\"https:\/\/measuringu.com\/state-govt-ux\/\">state government<\/a> websites.<\/p>\n<h2>Why People Use Federal Government Sites<\/h2>\n<p>To make the most of limited federal budgets, these organizations should understand what tasks are most important to users online and optimize for them. Consequently, we asked participants what they were attempting to do on their last visit to the website and how often they visited in the last year.<\/p>\n<p>For IRS.gov, 59% of participants reported visiting the site a few times per year. 35% of NASA respondents come to the website a few times per year, but more than a quarter of them (29%) come to the site a few times per month. 54% of National Park Service website users visit a few times a year. Similarly, 50% of USA.gov respondents visit the site a few times per year, but a quarter of them visit a few times per month. 31% of USPS users come to the site a few times per month.<\/p>\n\n<table id=\"tablepress-31\" class=\"tablepress tablepress-id-31\">\n<thead>\n<tr class=\"row-1 odd\">\n\t<th class=\"column-1\"><strong>Federal government website<\/strong><\/th><th class=\"column-2\"><strong>Visit a few times a month<\/strong><\/th><th class=\"column-3\"><strong>Visit a few times in the past year<\/strong><\/th>\n<\/tr>\n<\/thead>\n<tbody class=\"row-hover\">\n<tr class=\"row-2 even\">\n\t<td class=\"column-1\">IRS<\/td><td class=\"column-2\">8%<\/td><td class=\"column-3\">59%<\/td>\n<\/tr>\n<tr class=\"row-3 odd\">\n\t<td class=\"column-1\">NASA<\/td><td class=\"column-2\">29%<\/td><td class=\"column-3\">35%<\/td>\n<\/tr>\n<tr class=\"row-4 even\">\n\t<td class=\"column-1\">National Park Service<\/td><td class=\"column-2\">19%<\/td><td class=\"column-3\">54%<\/td>\n<\/tr>\n<tr class=\"row-5 odd\">\n\t<td class=\"column-1\">USA.gov<\/td><td class=\"column-2\">25%<\/td><td class=\"column-3\">50%<\/td>\n<\/tr>\n<tr class=\"row-6 even\">\n\t<td class=\"column-1\">USPS<\/td><td class=\"column-2\">31%<\/td><td class=\"column-3\">44%<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<!-- #tablepress-31 from cache -->\n<p>The federal government websites have such diverse functions that the reasons for participants\u2019 last visit were quite different across the sites. For example, the most common reasons to visit the IRS website was to look up tax information (25%) and download forms (14%).<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cI was trying to find the answer to a specific question that might affect my tax situation.\u201d<\/i><\/em>\u2014IRS user<\/li>\n<li><i><\/i><em><i>\u201cDownload the forms that I&#8217;ll need to file my taxes this year.\u201d<\/i><\/em>\u2014IRS user<\/li>\n<\/ul>\n<p>While for NASA it was to look up mission updates (16%) and find information about planets (15%).<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cI was reading about the Jupiter mission and just wanted to see what information was posted.\u201d<\/i><\/em>\u2014NASA user<\/li>\n<li><i><\/i><em><i>\u201cI am interested in the new planets that are being discovered with the Kepler and, to some degree, Hubble telescopes.\u201d<\/i><\/em>\u2014NASA user<\/li>\n<\/ul>\n<p>19% of participants go to the National Park Service website to learn about visiting a park (e.g. driving directions, closures, etc.) and 18% were looking for a local state park.<\/p>\n<ul>\n<li><em><i>\u201cGet information on visiting Yosemite park.\u201d<\/i><\/em>\u2014NPS.gov user<\/li>\n<li><em><i>\u201cI was looking for National Parks in my home state.\u201d<\/i><\/em>\u2014NPS.gov user<\/li>\n<\/ul>\n<p>Almost a quarter of USA.gov participants went to the site to apply for a job (23%) and 13% went to find passport information.<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cI used it to apply for some jobs and recently to research how to start a small business.\u201d<\/i><\/em>\u2014USA.gov user<\/li>\n<li><i><\/i><em><i>\u201cTo find info on getting a passport.\u201d<\/i><\/em>\u2014USA.gov user<\/li>\n<\/ul>\n<p>Not surprisingly, 39% of USPS participants came to the site to track a package and 11% came to estimate a shipping price.<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cTrack one of my packages I sent.\u201d<\/i><\/em>\u2014USPS user<\/li>\n<li><i><\/i><em><i>\u201cTo look up the rates for postage.\u201d<\/i><\/em>\u2014USPS user<\/li>\n<\/ul>\n<h3>Understanding What the Website Can Do<\/h3>\n<p>With such diverse functions, it\u2019s not surprising that understanding what the website can be used to accomplish is a key driver of federal government website user experience. Basically, users need to know what they can and should do with the site, and if that\u2019s unclear, then the website user experience suffers. The statement, <em>\u201cIt was clear to me what I would be able to use the website to accomplish\u201d<\/em> explains 18% of the variance in SUPR-Q scores.<\/p>\n<p>USA.gov and the IRS are the lowest scorers in the group with only 70% of participants agreeing with the statement <em>\u201cIt was clear to me what I would be able to use this website to accomplish.\u201d<\/em><\/p>\n<ul>\n<li><i><\/i><em><i>\u201cI still don&#8217;t know what I can actually do on the website besides reading lots of information. How do I use it besides looking up general information? It almost seems like information overload. Maybe there&#8217;s a better way to organize the information available on the website.\u201d <\/i><\/em>\u2013USA.gov user<\/li>\n<\/ul>\n<p>The other three sites\u2014National Park Service, NASA, and USPS\u2014had much clearer use cases to participants. Their agreement with the statement, <em>\u201cIt was clear to me what I would be able to use this website to accomplish\u201d<\/em> is much higher, 96%, 75%, and 83% respectively, with NASA on the lower side.<\/p>\n<h3>Overwhelming Information Not Organized Clearly<\/h3>\n<p>In addition to having the lowest SUPR-Q and NPS scores in both the perception and usability studies, <strong>USA.gov also had the lowest task success rate<\/strong> with less than half (47%) of participants successfully finding the correct information about passport eligibility.<\/p>\n<p>The main reason the site suffered was ambiguous category labels that caused confusion about the correct path for finding the passport renewal information. For example, the categories<em> \u201cRecreation and Travel within the U.S.,\u201d \u201cVisas, Tourists, and Temporary Visitors,\u201d and \u201cU.S. Citizens Traveling Abroad\u201d<\/em> were lengthy and didn&#8217;t stand out as an obvious path for participants.<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cThere are a lot of links, which can get confusing.\u201d<\/i><\/em>\u2014USA.gov user<\/li>\n<\/ul>\n<p>Furthermore, the top reason for disliking the website in the perception study was too much information making the experience overwhelming.<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cIt&#8217;s so much information on it, which of course is useful, but it can be overwhelming.\u201d<\/i><\/em>\u2014USA.gov user<\/li>\n<\/ul>\n<p>With the huge variety of information necessary to cover on a website like USA.gov, it\u2019s important that the category labels are clear and provide an obvious path for users looking for specific types of information.<\/p>\n<p>Looking at the <a href=\"https:\/\/measuringu.com\/visualize-behaviors\/\">heat map<\/a> from <a href=\"https:\/\/measuringu.com\/services\/muiq\/\">MUIQ<\/a> for the USA.gov homepage, it\u2019s evident that the path for finding passport renewal eligibility information was not obvious to participants.<\/p>\n<p><em><i>USA.gov heat map:\u00a0<a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/USA.gov-heat-map.png\"><img decoding=\"async\" class=\"aligncenter size-full wp-image-12027\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/USA.gov-heat-map.png\" alt=\"USA.gov heat map\" width=\"815\" height=\"431\" \/><\/a><\/i><\/em><\/p>\n<h2>The Best and the Worst<\/h2>\n<p><strong>The National Park Service website is the leader of the group with the best SUPR-Q scores across all the federal government sites.<\/strong> Participants on the site had among the highest task success scores, along with NASA.gov (97%). The process of finding the price of a park pass was fairly streamlined for most participants. The category labels were concise and easy for users to understand and navigate through.\u00a0 The high scores may also be a function of task simplicity.<\/p>\n<p><strong><b>Video Example 1: <\/b><\/strong>easy category labels on NPS.gov<\/p>\n<div style=\"width: 640px;\" class=\"wp-video\"><!--[if lt IE 9]><script>document.createElement('video');<\/script><![endif]-->\n<video class=\"wp-video-shortcode\" id=\"video-486-1\" width=\"640\" height=\"448\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example1NPS.mp4?_=1\" \/><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example1NPS.mp4\">https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example1NPS.mp4<\/a><\/video><\/div>\n<p class=\"wp-caption-text\">\u201cPasses\u201d was clear and easy to find in the top navigation menu.<\/p>\n<p><strong>USA.gov has the worst SUPR-Q scores in the group and lowest task success rates.<\/strong> Participants also had low favorability toward the site as well as low trust.<\/p>\n<p>There is also an overwhelming amount of information and confusing category labels in the top navigation. Participants mentioned they had a hard time digging through the amount of information.<\/p>\n<ul>\n<li><i><\/i><em><i>\u201cIt&#8217;s a lot of information in one place and can be frustrating trying to find a specific answer.\u201d\u2014USA.<\/i><\/em>gov user<\/li>\n<\/ul>\n<p>In the task, participants didn&#8217;t see a clear path for finding eligibility rules for renewing a passport. Participants had a hard time differentiating between category labels like \u201cRecreation and Travel within the U.S\u201d and \u201cU.S. Citizens Traveling Abroad.\u201d Shorter category labels such as \u201cPassports\u201d or \u201cTravel\u201d would likely make it clearer for participants to digest and navigate through large amounts of information.<\/p>\n<p><strong><b>Video Example 2:\u00a0<\/b><\/strong><em><i>\u00a0<\/i><\/em><\/p>\n<div style=\"width: 640px;\" class=\"wp-video\"><video class=\"wp-video-shortcode\" id=\"video-486-2\" width=\"640\" height=\"308\" preload=\"metadata\" controls=\"controls\"><source type=\"video\/mp4\" src=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example2USAgov.mp4?_=2\" \/><a href=\"https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example2USAgov.mp4\">https:\/\/measuringu.com\/wp-content\/uploads\/2018\/08\/Video-Example2USAgov.mp4<\/a><\/video><\/div>\n<p class=\"wp-caption-text\">The participant had a hard time deciding where to go and looked through most of the categories in the menu.<\/p>\n<p>The low task success scores combined with low brand favorability, low trust, and unclear use cases were a recipe for a poor user experience on USA.gov.\u00a0 More videos examples are <a href=\"https:\/\/measuringu.com\/product\/ux-nps-federal-government\/\">available in the report<\/a>.<\/p>\n<h2><strong><b>Summary<\/b><\/strong><\/h2>\n<p>An analysis of the user experience of five U.S. federal government websites found:<\/p>\n<p><strong><b>1. Brand attitude is a key driver in SUPR-Q scores.<\/b><\/strong> We found that 20% of the variability in the federal government SUPR-Q scores can be explained by brand favorability. The sites that participants felt more favorable toward (National Park, NASA, and USPS) scored better compared to the sites that participants felt less favorably toward (IRS and USA.gov). Because participants are likely already familiar with the various federal government services, it\u2019s not surprising these preconceived attitudes drove SUPR-Q scores.<\/p>\n<p><strong><b>2. People need to know what they can do.<\/b><\/strong> Understanding what the website can be used to accomplish was also a key driver of federal government website user experience. Users need to know what they can accomplish on a site. For the low scorers (USA.gov and IRS), only 70% of users agreed with the statement \u201cIt was clear to me what I would be able to use this website to accomplish.\u201d<\/p>\n<p><b><\/b><strong><b>3. Trust and favorability usually go hand in hand, but not with the IRS.<\/b><\/strong> Interestingly, IRS.gov has the lowest brand favorability (maybe not surprising), but it scored in the 82<sup>nd<\/sup>\u00a0percentile for trust. So, people trust the IRS but still don&#8217;t like it.<\/p>\n<p><strong><b>4. An overwhelming amount of info is on USA.<\/b>gov. <\/strong>USA.gov has the lowest task completion rates in the group. Participants thought the amount of information was overwhelming and it was unclear where to start the task due to confusing category labels and poor site organization. Combined with low favorability, trust, and unclear use cases, it\u2019s not surprising that USA.gov is the worst in the group.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>What forms do I need to file my taxes this year? How much is a National Park Pass? How do I renew my passport? Federal government websites are helpful for a wide variety of activities, from mailing a package to booking a camping site to filing taxes. Many federal branches have begun to computerize their [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":2772,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"default","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"_price":"field_56e41332a1ae5","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"Tribe__Tickets_Plus__Commerce__WooCommerce__Main","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[57,52,39],"tags":[125,40],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/486"}],"collection":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/comments?post=486"}],"version-history":[{"count":2,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/486\/revisions"}],"predecessor-version":[{"id":31888,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/486\/revisions\/31888"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media\/2772"}],"wp:attachment":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media?parent=486"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/categories?post=486"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/tags?post=486"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}