{"id":62953,"date":"2016-01-06T09:18:40","date_gmt":"2016-01-06T14:18:40","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=62953"},"modified":"2016-02-28T16:20:06","modified_gmt":"2016-02-28T21:20:06","slug":"john-henrys-hammer-continuous-variables-ii","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2016\/01\/06\/john-henrys-hammer-continuous-variables-ii\/","title":{"rendered":"john henry’s hammer: continuous variables II…"},"content":{"rendered":"\n

I got a bit garbled at the end of the last post, so let me start over. I’ve been looking at these two studies, each of which have four groups – placebo and three doses of medication. My table shows three pairwise comparisons in two articles – placebo vs each dose of Brexpiprazole: The results from my simple spreadsheet are nearly identical to those published in the two papers [with one exception discussed later]. But from a statistical point of view, I’ve skipped a step – one that’s often skipped in published RCTs. I have not tested the whole dataset to see if these four grouping are indeed significant [valid]. The null hypothesis is that they aren’t, but rather an arbitrary grouping that doesn’t differ from the overall dataset. The traditional test to verify that there is a statistical basis for this grouping is called a one way anova<\/font><\/em>. If we can’t reject this null hypothesis, the pairwise comparisons are meaningless, no matter how they come out.<\/p>\n\n\n\n\n\n\n\n\n\n\n\n
BREXPIPRAZOLE Trials in Schizophrenia<\/font><\/strong> <\/p>\n
<\/sup><\/td>\n<\/tr>\n
STUDY<\/sup><\/font><\/strong><\/td>\nDRUG<\/sup><\/font><\/strong><\/td>\nMEAN<\/sup><\/font><\/strong><\/td>\nSEM<\/sup><\/font><\/strong><\/td>\nσ<\/sup><\/font><\/strong><\/td>\nn<\/sup><\/font><\/strong><\/td>\np<\/sup><\/font><\/strong><\/td>\nd<\/sup><\/font><\/strong><\/td>\nlower<\/sup><\/font><\/strong><\/td>\nupper<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
Correll
et al<\/sup><\/td>\n		placebo<\/sup><\/td>\n-12.01<\/sup><\/td>\n1.60<\/sup><\/td>\n21.35<\/sup><\/font><\/strong><\/td>\n178<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n<\/tr>\n
0.25mg<\/sup><\/td>\n-14.90<\/sup><\/td>\n2.23<\/sup><\/td>\n20.80<\/sup><\/font><\/strong><\/td>\n87<\/sup><\/td>\n0.3<\/sup><\/td>\n0.14<\/sup><\/td>\n-0.120<\/sup><\/font><\/strong><\/td>\n0.393<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
2mg<\/sup><\/td>\n-20.73<\/sup><\/td>\n1.55<\/sup><\/td>\n20.80<\/sup><\/font><\/strong><\/td>\n180<\/sup><\/td>\n<0.0001<\/sup><\/td>\n0.41<\/sup><\/td>\n0.204<\/sup><\/font><\/strong><\/td>\n0.623<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
4mg<\/sup><\/td>\n-19.65<\/sup><\/td>\n1.54<\/sup><\/td>\n20.55<\/sup><\/font><\/strong><\/td>\n178<\/sup><\/td>\n0.0006<\/sup><\/td>\n0.36<\/sup><\/td>\n0.155<\/sup><\/font><\/strong><\/td>\n0.574<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
Kane
et al<\/sup><\/td>\n		placebo<\/sup><\/td>\n-13.53<\/sup><\/td>\n1.52<\/sup><\/td>\n20.39<\/sup><\/font><\/strong><\/td>\n180<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n<\/tr>\n
1mg<\/sup><\/td>\n-16.90<\/sup><\/td>\n1.86<\/sup><\/td>\n20.12<\/sup><\/font><\/strong><\/td>\n117<\/sup><\/td>\n0.1588<\/sup><\/td>\n0.166<\/sup><\/font><\/strong><\/td>\n-0.067<\/sup><\/font><\/strong><\/td>\n0.399<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
2mg<\/sup><\/td>\n-16.61<\/sup><\/td>\n1.49<\/sup><\/td>\n19.93<\/sup><\/font><\/strong><\/td>\n179<\/sup><\/td>\n0.1488<\/sup><\/td>\n0.153<\/sup><\/font><\/strong><\/td>\n-0.054<\/sup><\/font><\/strong><\/td>\n0.360<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
4mg<\/sup><\/td>\n-20.00<\/sup><\/td>\n1.48<\/sup><\/td>\n19.91<\/sup><\/font><\/strong><\/td>\n181<\/sup><\/td>\n0.0022<\/sup><\/td>\n0.321<\/sup><\/font><\/strong><\/td>\n0.113<\/sup><\/font><\/strong><\/td>\n0.529<\/sup><\/font><\/strong><\/td>\n<\/tr>\n<\/table>\n

So how can we do an anova<\/font><\/em> in the absence of the actual data? Again, Internet Calculator to the rescue! Specifically retired Georgetown statistician John C. Pezzullo’s statpages<\/a> has [among many other wonderful things] this one – Analysis of Variance from Summary Data<\/a>. This just-what-the-doctor-ordered<\/font><\/em> calculator takes as input the MEAN, either the SD or SEM, and n, and here’s what you end up with [reformatted for clarity]:<\/p>\n

<\/p>\n

<\/p>\n

[Note: I checked this with a situation where I had actual data and it was right on the money!] So add this tool to the toolbox [and read his helpful explanation]. Now our table grows a column:<\/p>\n\n\n\n\n\n\n\n\n\n\n\n
BREXPIPRAZOLE Trials in Schizophrenia<\/font><\/strong> <\/p>\n
<\/sup><\/td>\n<\/tr>\n
STUDY<\/sup><\/font><\/strong><\/td>\nDRUG<\/sup><\/font><\/strong><\/td>\nMEAN<\/sup><\/font><\/strong><\/td>\nSEM<\/sup><\/font><\/strong><\/td>\nσ<\/sup><\/font><\/strong><\/td>\nn<\/sup><\/font><\/strong><\/td>\np<\/sup><\/font><\/strong><\/td>\nd<\/sup><\/font><\/strong><\/td>\nlower<\/sup><\/font><\/strong><\/td>\nupper<\/sup><\/font><\/strong><\/td>\nanova p <\/sup><\/font><\/strong><\/td>\n<\/tr>\n
Correll
et al<\/sup><\/td>\n		placebo<\/sup><\/td>\n-12.01<\/sup><\/td>\n1.60<\/sup><\/td>\n21.35<\/sup><\/font><\/strong><\/td>\n178<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n0.0002 <\/sup><\/font><\/strong><\/td>\n<\/tr>\n
0.25mg<\/sup><\/td>\n-14.90<\/sup><\/td>\n2.23<\/sup><\/td>\n20.80<\/sup><\/font><\/strong><\/td>\n87<\/sup><\/td>\n0.3<\/sup><\/td>\n0.14<\/sup><\/td>\n-0.120<\/sup><\/font><\/strong><\/td>\n0.393<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
2mg<\/sup><\/td>\n-20.73<\/sup><\/td>\n1.55<\/sup><\/td>\n20.80<\/sup><\/font><\/strong><\/td>\n180<\/sup><\/td>\n<0.0001<\/sup><\/td>\n0.41<\/sup><\/td>\n0.204<\/sup><\/font><\/strong><\/td>\n0.623<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
4mg<\/sup><\/td>\n-19.65<\/sup><\/td>\n1.54<\/sup><\/td>\n20.55<\/sup><\/font><\/strong><\/td>\n178<\/sup><\/td>\n0.0006<\/sup><\/td>\n0.36<\/sup><\/td>\n0.155<\/sup><\/font><\/strong><\/td>\n0.574<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
Kane
et al<\/sup><\/td>\n		placebo<\/sup><\/td>\n-13.53<\/sup><\/td>\n1.52<\/sup><\/td>\n20.39<\/sup><\/font><\/strong><\/td>\n180<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n–<\/sup><\/td>\n0.0025 <\/sup><\/font><\/strong><\/td>\n<\/tr>\n
1mg<\/sup><\/td>\n-16.90<\/sup><\/td>\n1.86<\/sup><\/td>\n20.12<\/sup><\/font><\/strong><\/td>\n117<\/sup><\/td>\n0.1588<\/sup><\/td>\n0.166<\/sup><\/font><\/strong><\/td>\n-0.067<\/sup><\/font><\/strong><\/td>\n0.399<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
2mg<\/sup><\/td>\n-16.61<\/sup><\/td>\n1.49<\/sup><\/td>\n19.93<\/sup><\/font><\/strong><\/td>\n179<\/sup><\/td>\n0.1488<\/sup><\/td>\n0.153<\/sup><\/font><\/strong><\/td>\n-0.054<\/sup><\/font><\/strong><\/td>\n0.360<\/sup><\/font><\/strong><\/td>\n<\/tr>\n
4mg<\/sup><\/td>\n-20.00<\/sup><\/td>\n1.48<\/sup><\/td>\n19.91<\/sup><\/font><\/strong><\/td>\n181<\/sup><\/td>\n0.0022<\/sup><\/td>\n0.321<\/sup><\/font><\/strong><\/td>\n0.113<\/sup><\/font><\/strong><\/td>\n0.529<\/sup><\/font><\/strong><\/td>\n<\/tr>\n<\/table>\n

Not bad for data analysis in the absence of data. What’s missing? Well there’s a lot. With packages like SAS, SPSS, R, and data [a big and!], for example, we could do a formal ANCOVA<\/font><\/strong> <\/font><\/span><\/font>[a general linear model which blends ANOVA and regression] and partition the variance looking at any number of covariates or confounds that might be affecting the outcome. In this case, I’d like to explore the effect of having so many sites. They did that in this article, though their description of the statistical analysis is unnecessarily unintelligible to me. But my little table is enough to be able to make some independent judgements and even compare the results to other studies [see in the land of sometimes[5]…<\/a>].<\/p>\n

Unfortunately, the summary data [MEAN, either the SD or SEM, and n] isn’t always provided in the published articles [though by all rights it should be]. What can we do then? Stay tuned. The Internet hasn’t yet given up all of her secrets!…<\/div>\n","protected":false},"excerpt":{"rendered":"

I got a bit garbled at the end of the last post, so let me start over. I’ve been looking at these two studies, each of which have four groups – placebo and three doses of medication. My table shows three pairwise comparisons in two articles – placebo vs each dose of Brexpiprazole: The results […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-62953","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62953","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=62953"}],"version-history":[{"count":13,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62953\/revisions"}],"predecessor-version":[{"id":63730,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62953\/revisions\/63730"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=62953"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=62953"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=62953"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}