{"id":32847,"date":"2013-02-01T07:00:04","date_gmt":"2013-02-01T12:00:04","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=32847"},"modified":"2013-02-02T02:21:24","modified_gmt":"2013-02-02T07:21:24","slug":"gone-missing","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2013\/02\/01\/gone-missing\/","title":{"rendered":"gone missing…"},"content":{"rendered":"\n

Dr. Ben Goldacre is an entertaining speaker [something of value…<\/a>, another Ben\/TED talk…<\/a>], a journalist [Bad Science: The Guardian<\/a>], and the author of several books [Bad Science: Quacks, Hacks, and Big Pharma Flacks<\/span><\/a>, <\/span>Bad Pharma: How Drug Companies Mislead Doctors and Harm Patients<\/span><\/a>]. He’s a major force behind AllTrials<\/font><\/strong><\/a> [upper left], the petition calling for full data transparency in ALL Clinical Trials. On this blog, I’ve focused my attention on the ways in which the scientific data in Clinical Trials has been manipulated to distort both efficacy and safety in the service of commercial gain within the non-ethic of plausible deniability<\/a>. And while Dr. Goldacre is a master-sleuth at exposing that kind of sheenanigans, which he calls dodgy studies<\/font><\/strong><\/em>, he’s also on another tack that I haven’t sufficiently emphasized – studies gone missing<\/font><\/strong><\/em>. He uses an example that goes something like this: "If I flip a coin a hundred times and withhold half the data, I can convince you that I have a two-headed coin.<\/font><\/strong><\/em>" He calls this method of distorting science publication bias<\/font><\/strong><\/em>. It’s simple, just publish the positive studies. It gets around the tool of meta-analysis, since the negative studies simply aren’t available to be vetted. So the AllTrials<\/font><\/strong><\/a> campaign is not just asking for the raw data in published Clinical Trials to look at the hanky-panky used to create dodgy studies<\/font><\/strong><\/em>, they are asking that All Trials<\/font><\/strong><\/a> be published as a check on publication bias – eliminating the gone missing <\/font><\/strong><\/em>phenomena.<\/p>\n

In an earlier blog [at least that much…<\/a>], I reviewed a 2012 study of publication bias in the articles published on the Clinical Trials of the Atypical Antipsychotics, but I didn’t follow the trail far enough to their earlier study of the Antidepressants [2008]. Dr. Goldacre mentions that earlier study in the TED Talk below [another Ben\/TED talk…<\/a>]. Here it is:<\/div>\n
\n
Selective Publication of Antidepressant Trials and Its Influence on Apparent Efficacy<\/a>
by Erick H. Turner, Annette M. Matthews, Eftihia Linardatos, Robert A. Tell, and Robert Rosenthal<\/sup>
New England Journal of Medicine.<\/strong><\/font> 2008 358:252-260.
[full text on-line<\/a>]<\/div>\n

<\/p>\n

Background<\/font><\/u>: Evidence-based medicine is valuable to the extent that the evidence base is complete and unbiased. Selective publication of clinical trials — and the outcomes within those trials — can lead to unrealistic estimates of drug effectiveness and alter the apparent risk–benefit ratio.<\/strong><\/sup><\/div>\n
Methods<\/font><\/u>: We obtained reviews from the Food and Drug Administration [FDA] for studies of 12 antidepressant agents involving 12,564 patients. We conducted a systematic literature search to identify matching publications. For trials that were reported in the literature, we compared the published outcomes with the FDA outcomes. We also compared the effect size derived from the published reports with the effect size derived from the entire FDA data set.<\/strong><\/sup><\/div>\n
Results<\/font><\/u>:Among 74 FDA-registered studies, 31%, accounting for 3449 study participants, were not published. Whether and how the studies were published were associated with the study outcome. A total of 37 studies viewed by the FDA as having positive results were published; 1 study viewed as positive was not published. Studies viewed by the FDA as having negative or questionable results were, with 3 exceptions, either not published [22 studies] or published in a way that, in our opinion, conveyed a positive outcome [11 studies]. According to the published literature, it appeared that 94% of the trials conducted were positive. By contrast, the FDA analysis showed that 51% were positive. Separate meta-analyses of the FDA and journal data sets showed that the increase in effect size ranged from 11 to 69% for individual drugs and was 32% overall.<\/strong><\/sup><\/div>\n
Conclusions<\/font><\/u>:We cannot determine whether the bias observed resulted from a failure to submit manuscripts on the part of authors and sponsors, from decisions by journal editors and reviewers not to publish, or both. Selective reporting of clinical trial results may have adverse consequences for researchers, study participants, health care professionals, and patients.<\/strong><\/sup><\/div>\n<\/blockquote>\n
First off, this article only looks at the studies submitted to the FDA. The FDA rule is that the sponsor is required to submit at least two studies showing significant efficacy<\/font><\/strong>, but is required to submit all studies done to look at safety<\/font><\/strong>. I guess the FDA still carries its original mandate front and center – safety. Efficacy came later – a point for a later blog. So here’s what they found when they looked at whether the studies submitted to the FDA were published in the peer-reviewed literature: <\/div>\n
<\/div>\n
The Published, conflicts with FDA decision<\/font><\/strong> category refers to studies that the FDA said were negative or questionable that were published as positive [dodgy studies<\/font><\/strong><\/em>]. The Not published<\/font><\/strong> categories refers to the studies gone missing<\/font><\/em><\/strong>. They go on to show us which pharmaceutical companies were the worst offenders: <\/div>\n
<\/div>\n
So that’s a 45% [11 dodgy + 22 gone missing ÷ 74 total trials] fudge factor. That’s totally horrible! Grand Jury horrible! If you look at only the published studies, that’s still a 22% [11 dodgy ÷ 51 published trials] fudge factor. Even that’s pretty horrible! And this is only trials submitted to the FDA, so these numbers are low estimates. There’s another indictment in this article that’s another kind of publication bias [effect size inflation], but I’ll save it for another post. Right now, let me just say that this article is available full text, is clearly presented, and has other visuals that drive its powerful point home. And if you haven’t signed the AllTrials<\/font><\/strong><\/a> petition, read the article then reconsider signing it and anything else you can figure out to do. As Ben Goldacre preaches, this is Bad Science from Bad Pharma…<\/div>\n","protected":false},"excerpt":{"rendered":"

Dr. Ben Goldacre is an entertaining speaker [something of value…, another Ben\/TED talk…], a journalist [Bad Science: The Guardian], and the author of several books [Bad Science: Quacks, Hacks, and Big Pharma Flacks, Bad Pharma: How Drug Companies Mislead Doctors and Harm Patients]. He’s a major force behind AllTrials [upper left], the petition calling for […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-32847","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32847","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=32847"}],"version-history":[{"count":35,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32847\/revisions"}],"predecessor-version":[{"id":41222,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32847\/revisions\/41222"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=32847"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=32847"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=32847"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}