Figure 4:<\/strong> The TAC-10.<\/figcaption><\/figure>\n <\/p>\n
Discussion and Summary<\/h1>\n
In this article, we\u2019ve described the use of Rasch analysis to produce Wright maps for analysis of the measurement properties of three versions of a technical activity checklist used to measure individual tech savviness. The key takeaways are<\/p>\n
The TAC-16 is comprehensive but inefficient.<\/strong> An important part of unidimensional scale standardization is to ask as many questions as you need to get a good measurement, but no more than that. The selection frequencies and Wright map of the TAC-16 showed numerous opportunities to remove activities from that checklist without affecting the breadth of the scale, which covers about 87% of the possible range of the scale as long as it includes the easiest and hardest items (respectively, installing a new app on your phone and programming efficiently in a language such as Java or C).<\/p>\nThe TAC-9 is concise but has a completeness issue.<\/strong> The TAC-9 does a good job of measuring a wide range of tech savviness with less redundancy than the TAC-16. As shown on the Wright map for the TAC-9, however, there is a large gap on the logit scale between detecting\/removing a computer virus and programming efficiently.<\/p>\nThe TAC-10 has the best balance between conciseness and completeness.<\/strong> The Wright map for the TAC-10 shows that including the activity \u201cUnderstanding and using HTML\u201d should work well to fill the gap in the TAC-9 between detecting\/removing a computer virus and programming efficiently, making it our currently preferred version of the TAC for practical use.<\/p>\nTACs could be used to identify some types of careless or dishonest respondents.<\/strong> Response patterns on a TAC generally start with the easiest activity and stop somewhere before the hardest one, except in those relatively rare cases where someone selects all the activities. Other types of response patterns can be indicative of response carelessness or dishonesty. For example, respondents who indicate they are confident programming efficiently in Java but are not confident installing an app on their phone should raise a red flag.<\/p>\nFuture research is planned.<\/strong> The most important next step in this research program is to validate the TAC by checking to see how strongly it is associated with actual performance of technical tasks. We have several sets of data from task-based usability studies in which parti<\/strong>cipants completed the TAC-9, and in two of those, participants completed the TAC-16, so we will be able to also validate the TAC-10 (because it\u2019s a subset of the TAC-16) to see whether it is any better than the TAC-9 in practice. Stay tuned.<\/p>\n","protected":false},"excerpt":{"rendered":"UX research is geared primarily toward understanding how to improve the experience of products, websites, and software. The intent is not to assess people but to use people to assess product experiences. But people\u2019s ability to solve technical problems\u2014what we often loosely refer to as tech savviness\u2014can confound our research findings. That is, including only […]<\/p>\n","protected":false},"author":1570,"featured_media":38277,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"default","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"_price":"field_56e41332a1ae5","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"Tribe__Tickets_Plus__Commerce__WooCommerce__Main","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[198,62,39],"tags":[502,498,501],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/36888"}],"collection":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/users\/1570"}],"replies":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/comments?post=36888"}],"version-history":[{"count":21,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/36888\/revisions"}],"predecessor-version":[{"id":38281,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/36888\/revisions\/38281"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media\/38277"}],"wp:attachment":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media?parent=36888"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/categories?post=36888"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/tags?post=36888"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}