{"id":166,"date":"2018-06-27T17:52:06","date_gmt":"2018-06-27T17:52:06","guid":{"rendered":"https:\/\/fs.wp.odu.edu\/jrichman\/?p=166"},"modified":"2018-06-27T17:52:22","modified_gmt":"2018-06-27T17:52:22","slug":"of-data-and-the-kobach-verdict","status":"publish","type":"post","link":"https:\/\/fs.wp.odu.edu\/jrichman\/2018\/06\/27\/of-data-and-the-kobach-verdict\/","title":{"rendered":"Of Data and the Kobach Verdict"},"content":{"rendered":"<p>In my read of the opinion by Judge Robinson in the Kobach trial, I was disappointed to see that the judge&#8217;s interpretation of the data was riddled with omissions and inaccuracies. \u00a0 Let me give you a few examples:<\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-family: 'Calibri',sans-serif\">Throughout the entire opinion Judge Robinson ignored half of the evidence I brought to the questions at issue \u2013 all of the evidence concerning nationwide rates of non-citizen registration to vote, and all of the evidence concerning non-citizen registration to vote in other states.\u00a0 But surely such evidence is relevant.\u00a0 In the absence of a distinctive legal framework, one would expect Kansas and national non-citizen voter registration rates to be similar.\u00a0 I made this argument explicitly in my reports and to the best of my memory the expert witnesses for the plaintiffs did not take issue with it.\u00a0 None the less, the Judge Robinson ignored all of this evidence entirely.\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<div><span style=\"font-family: Calibri\">Judge Robinson also ignored substantial bodies of data from Kansas.\u00a0 For instance, she never discussed my analysis of Sedgwick County prior registration history of newly naturalizing citizens for the years 2014 and 2015. \u00a0<\/span><\/div>\n<p>&nbsp;<\/p>\n<p>The judge appeared to lack basic knowledge of the interpretation of statistical estimates.\u00a0<span style=\"font-family: Calibri\"> For instance, in a discussion of my analysis of a survey of individuals on the suspense list, Judge Robinson wrote: \u201cDr. Jesse Richman estimates that only 2.2% of the applicants on the suspense list lack access to DPOC, based on a survey he conducted of individuals on the suspense list.\u00a0 Yet Dr. Richman\u2019s results are not statistically distinguishable from zero, as the margin of error is 2.7.\u201d\u00a0 If the results are not distinguishable from zero, then then this implies that we CANNOT REJECT the null hypothesis that\u00a0 ALL citizens\u00a0 on the suspense list have access to DPOC.\u00a0 This would indicate the possibility that no citizen was excluded from registering to vote due to lack of DPOC, which would actually be a very strong result in favor of the argument made by the state of Kansas if true.\u00a0<\/span><\/p>\n<p><span style=\"font-family: Calibri\">\u00a0<\/span><\/p>\n<p><span style=\"font-family: Calibri\">The lack of basic knowledge of statistics allowed the judge to be led astray by trust in the plaintiffs experts even when they were patently and obviously wrong.\u00a0 For example, Professor Ansolabehere combined the analyses in my initial report inappropriately.\u00a0 Not only did he merely average them (not appropriate as it ignores variation in sample sizes) but he calculated the standard error of this estimate completely the wrong way. \u00a0I demolished Dr. Ansolabehere\u2019s calculation of a confidence interval for his \u2018meta analysis\u2019 of the various Kansas results.\u00a0 But the court sided with him none the less.\u00a0 Thus the court refused to recognize even basic statistical facts such as the appropriate calculation of the standard error of the mean, as I pointed out in paragraph 22 of my supplemental report.\u00a0 Ansolabehere incorrectly calculated the standard error of the mean as the standard deviation when it is in fact the standard deviation divided by the square root of the number of observations, as any basic statistics primer will tell you.\u00a0 See for instance:\u00a0<a id=\"LPlnk940616\" class=\"OWAAutoLink\" href=\"http:\/\/davidmlane.com\/hyperstat\/A103735.html\">http:\/\/davidmlane.com\/hyperstat\/A103735.html<\/a>.<br \/>\n<\/span><span style=\"font-family: Calibri\"><br \/>\n<\/span><\/p>\n<p><span style=\"font-family: Calibri\">And Judge Robinson also relied upon incorrect calculations by the plaintiffs experts concerning the confidence intervals for proportions for each of the estimates in my report.\u00a0 But don&#8217;t take my word for it.\u00a0 Let me walk you through it.\u00a0 One of the estimates I examined involved the proportion of newly naturalized citizens who registered to vote in Sedgwick County Kansas who had a voter registration history dating from before their naturalization.\u00a0 The basic numbers are\u00a0 that 8 out of 791 had a prior registration history.\u00a0 Now take this to the first calculator that pops up when you search Google for &#8220;confidence interval for proportions calculator&#8221; which is\u00a0<a id=\"LPlnk139467\" class=\"OWAAutoLink\" href=\"http:\/\/www.sample-size.net\/confidence-interval-proportion\/\">http:\/\/www.sample-size.net\/confidence-interval-proportion\/<\/a>.\u00a0 Enter the sample size as 791 and the number x = 8.\u00a0 When you hit calculate you will see that both confidence intervals do not include zero, contrary to the assertion made by Judge Robinson concerning this estimate.\u00a0 What this means is that we do have statistically significant evidence of prior registration &#8212; it is unlikely to be zero.\u00a0 The decision asserted otherwise.\u00a0<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>In my read of the opinion by Judge Robinson in the Kobach trial, I was disappointed to see that the judge&#8217;s interpretation of the data was riddled with omissions and inaccuracies. \u00a0 Let me give you a few examples: &nbsp;&#8230; <a class=\"more-link\" href=\"https:\/\/fs.wp.odu.edu\/jrichman\/2018\/06\/27\/of-data-and-the-kobach-verdict\/\">Continue Reading &rarr;<\/a><\/p>\n","protected":false},"author":817,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","wds_primary_category":0},"categories":[4],"tags":[],"_links":{"self":[{"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/posts\/166"}],"collection":[{"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/users\/817"}],"replies":[{"embeddable":true,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/comments?post=166"}],"version-history":[{"count":2,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/posts\/166\/revisions"}],"predecessor-version":[{"id":168,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/posts\/166\/revisions\/168"}],"wp:attachment":[{"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/media?parent=166"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/categories?post=166"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/fs.wp.odu.edu\/jrichman\/wp-json\/wp\/v2\/tags?post=166"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}