{"id":266,"date":"2015-06-02T21:40:00","date_gmt":"2015-06-02T21:40:00","guid":{"rendered":"http:\/\/measuringu.com\/handle-missing-data\/"},"modified":"2021-08-10T09:29:18","modified_gmt":"2021-08-10T15:29:18","slug":"handle-missing-data","status":"publish","type":"post","link":"https:\/\/measuringu.com\/handle-missing-data\/","title":{"rendered":"7 Ways to Handle Missing Data"},"content":{"rendered":"<p>Data goes missing.<img decoding=\"async\" style=\"float: left; padding: 10px; margin-right: 20px;\" title=\"Dealing with Missing data\" src=\"https:\/\/measuringu.com\/images\/missing-data-small.jpg\" \/><\/p>\n<p>It&#8217;s a fact of life for the researcher.<\/p>\n<p>You put time and money into a research study. You do what you can to <a href=\"https:\/\/measuringu.com\/blog\/horrible-responserate.php\">prevent missing data and dropout, <\/a>but missing values happen and you have to deal with it.<\/p>\n<p>How do you address that lost data?<\/p>\n<p>First, determine the pattern of your missing data. There are <a href=\"https:\/\/measuringu.com\/blog\/missing-data.php\">three types of missing data<\/a>:<\/p>\n<ul>\n<li>Missing Completely at Random: There is no pattern in the missing data on any variables. This is the best you can hope for.<\/li>\n<li>Missing at Random: There is a pattern in the missing data but not on your primary dependent variables such as <a href=\"https:\/\/measuringu.com\/blog\/nps-ux.php\">likelihood to recommend<\/a> or <a href=\"https:\/\/measuringu.com\/blog\/10-things-SUS.php\">SUS Scores<\/a>.<\/li>\n<li>Missing Not at Random: There is a pattern in the missing data that affect your primary dependent variables. For example, lower-income participants are less likely to respond and thus affect your conclusions about income and likelihood to recommend. Missing not at random is your worst-case scenario. Proceed with caution.<\/li>\n<\/ul>\n<p>And here are seven things you can do about that missing data:<\/p>\n<ol>\n<li><b>Listwise Deletion<\/b>: Delete all data from any participant with missing values. If your sample is large enough, then you likely can drop data without substantial loss of statistical power. Be sure that the values are missing at random and that you are not inadvertently removing a class of participants.<\/li>\n<li><b>Recover the Values<\/b>: You can sometimes contact the participants and ask them to fill out the missing values. For in-person studies, we&#8217;ve found having an additional check for missing values before the participant leaves helps.<\/li>\n<\/ol>\n<h3>Imputation<\/h3>\n<p>Imputation is replacing missing values with substitute values. The following methods use some form of imputation.<\/p>\n<ol start=\"3\">\n<li><b>Educated Guessing<\/b>: It sounds arbitrary and isn&#8217;t your preferred course of action, but you can often infer a missing value. For related questions, for example, like those often presented in a matrix, if the participant responds with all &#8220;4s&#8221;, assume that the missing value is a 4.<img fetchpriority=\"high\" decoding=\"async\" src=\"https:\/\/measuringu.com\/images\/missing-data.jpg\" width=\"601\" height=\"307\" \/><\/li>\n<li><b>Average Imputation<\/b>: Use the average value of the responses from the other participants to fill in the missing value. If the average of the 30 responses on the question is a 4.1, use a 4.1 as the imputed value. This choice is not always recommended because it can artificially reduce the variability of your data but in some cases makes sense.<\/li>\n<li><b>Common-Point Imputation<\/b>: For a rating scale, using the middle point or most commonly chosen value. For example, on a five-point scale, substitute a 3, the midpoint, or a 4, the most common value (in many cases). This is a bit more structured than guessing, but it&#8217;s still among the more risky options. Use caution unless you have good reason and data to support using the substitute value.<\/li>\n<li><b>Regression Substitution<\/b>: You can use multiple-regression analysis to estimate a missing value. We use this technique to deal with missing SUS scores. Regression substitution predicts the missing value from the other values. In the case of missing SUS data, we had enough data to create stable regression equations and predict the missing values <a href=\"https:\/\/measuringu.com\/products\/SUSpack\">automatically in the calculator<\/a>.<\/li>\n<li><b>Multiple Imputation<\/b>: The most sophisticated and, currently, most popular approach is to take the regression idea further and take advantage of correlations between responses. In <a href=\"http:\/\/www.csos.jhu.edu\/contact\/staff\/jwayman_pub\/wayman_multimp_aera2003.pdf\">multiple imputation<\/a> [pdf], software creates plausible values based on the correlations for the missing data and then averages the simulated datasets by incorporating random errors in your predictions. It is one of a number of examples where computers continue to change the statistical landscape. Most statistical packages like SPSS come with a multiple-imputation feature. More on <a href=\"http:\/\/sites.stat.psu.edu\/~jls\/mifaq.html#ref\">multiple imputation<\/a>.<\/li>\n<\/ol>\n<p>Missing data is like a medical concern: ignoring it doesn&#8217;t make it go away. Ideally your data is missing at random and one of these seven approaches will help you make the most of the data you have.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Data goes missing. It&#8217;s a fact of life for the researcher. You put time and money into a research study. You do what you can to prevent missing data and dropout, but missing values happen and you have to deal with it. How do you address that lost data? First, determine the pattern of your [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":1735,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"site-sidebar-layout":"default","site-content-layout":"default","ast-site-content-layout":"","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","theme-transparent-header-meta":"default","adv-header-id-meta":"","stick-header-meta":"default","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-gradient":""}},"_price":"field_56e41332a1ae5","_stock":"","_tribe_ticket_header":"","_tribe_default_ticket_provider":"Tribe__Tickets_Plus__Commerce__WooCommerce__Main","_tribe_ticket_capacity":"0","_ticket_start_date":"","_ticket_end_date":"","_tribe_ticket_show_description":"","_tribe_ticket_show_not_going":false,"_tribe_ticket_use_global_stock":"","_tribe_ticket_global_stock_level":"","_global_stock_mode":"","_global_stock_cap":"","_tribe_rsvp_for_event":"","_tribe_ticket_going_count":"","_tribe_ticket_not_going_count":"","_tribe_tickets_list":"[]","_tribe_ticket_has_attendee_info_fields":false,"footnotes":""},"categories":[21],"tags":[22],"acf":[],"ticketed":false,"_links":{"self":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/266"}],"collection":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/comments?post=266"}],"version-history":[{"count":0,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/posts\/266\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media\/1735"}],"wp:attachment":[{"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/media?parent=266"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/categories?post=266"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/measuringu.com\/wp-json\/wp\/v2\/tags?post=266"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}