{"id":32907,"date":"2013-02-02T07:00:21","date_gmt":"2013-02-02T12:00:21","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=32907"},"modified":"2013-02-02T02:39:16","modified_gmt":"2013-02-02T07:39:16","slug":"more-distortions","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2013\/02\/02\/more-distortions\/","title":{"rendered":"more distortions&#8230;"},"content":{"rendered":"\n<div align=\"justify\"> And by the way,  speaking of synchronicity, guess who has an op-ed piece in the New York Times today? Ben Goldacre [<a href=\"http:\/\/www.nytimes.com\/2013\/02\/02\/opinion\/health-cares-trick-coin.html?emc=tnt&#038;tntemail1=y&#038;_r=1&#038;\" target=\"_blank\">Health Care&rsquo;s Trick Coin<\/a>]. Now for <strong>a chain of hat tips<\/strong>:<\/div>\n<ul>\n<div align=\"justify\"><sup><img decoding=\"async\" height=\"34\" border=\"0\" align=\"left\" src=\"http:\/\/1boringoldman.com\/images\/hat-tip-rev.gif\" \/><a href=\"http:\/\/pharmagossip.blogspot.com\/2013\/01\/drug-company-publications-found.html\" target=\"_blank\">Pharmagossip<\/a><br \/>                     by Jack Friday<br \/>                     January 30, 2013<\/sup><\/div>\n<p>                 <\/p>\n<div align=\"justify\"><sup><img decoding=\"async\" height=\"34\" border=\"0\" align=\"left\" src=\"http:\/\/1boringoldman.com\/images\/hat-tip-rev.gif\" \/><a href=\"http:\/\/ksj.mit.edu\/tracker\/2013\/01\/drug-company-publications-found-inaccura\" target=\"_blank\">Knight Science Journal at MIT<\/a><br \/>                     by Paul Raeburn<br \/>                     January 30, 2013<\/sup><\/div>\n<p>                 <\/p>\n<div align=\"justify\"><sup><img decoding=\"async\" height=\"34\" border=\"0\" align=\"left\" src=\"http:\/\/1boringoldman.com\/images\/hat-tip-rev.gif\" \/><a href=\"http:\/\/www.sciencenews.org\/view\/generic\/id\/347933\/description\/Published_clinical_trials_shown_to_be_misleading\" target=\"_blank\">Science News<\/a><br \/>                     by Rachel Ehrenberg<br \/>                     January 29, 2013<\/sup><\/div>\n<\/ul>\n<div align=\"justify\">I guess when it rains it pours. I&#8217;ve been writing about Ben Goldacre, studies <em><strong><font color=\"#200020\">gone missing<\/font><\/strong><\/em>, <em><strong><font color=\"#200020\">dodgy studies<\/font><\/strong><\/em>, and then along comes this article in PLoS Medicine:<\/div>\n<blockquote>\n<div align=\"center\"><a href=\"http:\/\/www.plosmedicine.org\/article\/info%3Adoi%2F10.1371%2Fjournal.pmed.1001378\" target=\"_blank\">Differences in Reporting of Analyses in Internal Company Documents Versus Published Trial Reports: Comparisons in Industry-Sponsored Trials in Off-Label Uses of Gabapentin   <\/a><br \/>           <strong><font color=\"#200020\">PLoS Medicine<\/font><\/strong><br \/>           by S. Swaroop Vedula, Tianjing Li, and Kay Dickersin <br \/>           January 29, 2013<br \/>        [<a href=\"http:\/\/www.plosmedicine.org\/article\/info%3Adoi%2F10.1371%2Fjournal.pmed.1001378\" target=\"_blank\">full text on-line<\/a>]<\/div>\n<p>    <\/p>\n<div align=\"justify\"><sup><strong><u><font color=\"#200020\">Background<\/font><\/u>: Details about the type of analysis [e.g., intent to treat [ITT]] and definitions [i.e., criteria for including participants in the analysis] are necessary for interpreting a clinical trial&rsquo;s findings. Our objective was to compare the description of types of analyses and criteria for including participants in the publication [i.e., what was reported] with descriptions in the corresponding internal company documents [i.e., what was planned and what was done]. Trials were for off-label uses of gabapentin sponsored by Pfizer and Parke-Davis, and documents were obtained through litigation.<\/strong><\/sup><\/div>\n<div align=\"justify\"><sup><strong><u><font color=\"#200020\">Methods and Findings<\/font><\/u>: For each trial, we compared internal company documents [protocols, statistical analysis plans, and research reports, all unpublished], with publications. One author extracted data and another verified, with a third person verifying discordant items and a sample of the rest. Extracted data included the number of participants randomized and analyzed for efficacy, and types of analyses for efficacy and safety and their definitions [i.e., criteria for including participants in each type of analysis]. We identified 21 trials, 11 of which were published randomized controlled trials, and that provided the documents needed for planned comparisons. For three trials, there was disagreement on the number of randomized participants between the research report and publication. Seven types of efficacy analyses were described in the protocols, statistical analysis plans, and publications, including ITT and six others. The protocol or publication described ITT using six different definitions, resulting in frequent disagreements between the two documents [i.e., different numbers of participants were included in the analyses].<\/strong><\/sup><\/div>\n<div align=\"justify\"><sup><strong><u><font color=\"#200020\">Conclusions<\/font><\/u>: Descriptions of analyses conducted did not agree between internal company documents and what was publicly reported. Internal company documents provide extensive documentation of methods planned and used, and trial findings, and should be publicly accessible. Reporting standards for randomized controlled trials should recommend transparent descriptions and definitions of analyses performed and which study participants are excluded.<\/strong><\/sup><\/div>\n<\/blockquote>\n<div align=\"justify\">In <a href=\"http:\/\/1boringoldman.com\/index.php\/2013\/02\/01\/dodginess\/\">dodginess&hellip;<\/a>, I was reporting on an article that compared the Clinical Trial data as reported to the FDA with the data as reported in the published version of the study in the peer-reviewed literature &#8211; specifically in the form of the <strong><font color=\"#200020\">effect sizes<\/font><\/strong>. There were discrepencies, always in the direction favorable to the drug&#8217;s efficacy. That suggests more than jury-rigging the presentation or spin. It suggests either changing the data or miscalculating on purpose. In either case, they&#8217;re stepping out of the range of <em>plausible deniability<\/em> into the domain of <em>just plain fraud <\/em>&#8211; AKA lies. But the explanations for the differences weren&#8217;t clear in that article. In this report, we find something similar. The researchers in the Department of Epidemiology at Johns Hopkins compared company documents obtained through litigation from Clinical Trials for off-label uses of gabapentin sponsored by Pfizer and Parke-Davis with the published version in the peer-reviewed literature. I&#8217;m not going to detail their findings because the full text study is available [and it&#8217;s nicely explained in the <a target=\"_blank\" href=\"http:\/\/www.sciencenews.org\/view\/generic\/id\/347933\/description\/Published_clinical_trials_shown_to_be_misleading\">Science News<\/a> article] but instead quote from their discussion:<\/div>\n<blockquote>\n<div align=\"justify\"><sup><strong>In our sample of industry-supported trials in off-label uses of  gabapentin, we observed discrepancies between what was reported in trial  publications and what was described in internal company research  reports. In this regard, we found that the trial publication was not a  transparent, or accurate (presuming that the research report truly  describes the facts), record for the numbers of participants randomized  and analyzed for efficacy. In three of ten trials in our sample, the  number of participants randomized in the trial, as specified in the  &ldquo;main publication&rdquo;,  was not the same as that described in the research report. The &ldquo;main  publication&rdquo; was a full-length journal article for two of the three  trials with a disagreement in the number of participants randomized in  the trial, and a conference abstract describing preliminary results for the third trial.  In one case, the description in the publication did not include data  from 40% of participants actually randomized in the trial.  There was such wide variation in describing the participant flow in the  included trials, even among documents for the same trial, that we were  unable to summarize what we found.<\/strong><\/sup><\/div>\n<p align=\"justify\"><sup><strong>In  addition, we observed extensive variability, both among documents for  the same trial and across trials, in the types of analyses specified for  efficacy and safety as well as in the criteria for including  participants in each type of analysis; this is consistent with Chan&#8217;s  findings comparing protocols and publications.  Our study extends comparisons of the protocol and publication to  comparisons of analyses presented in internal company research reports  and analyses presented publicly.<\/strong><\/sup><\/p>\n<div align=\"justify\"><sup><strong>We  are concerned that, even for commonly used types of analysis such as  ITT, a number of different definitions were used across trials included  in our sample. Trial findings may be sensitive to the alternative  definitions used for the type of analysis, i.e., analyses using  different definitions of the type of analysis can include different  subsets of participants, thereby leading to different findings. Because  internal company documents are not generally available, our study  provides a unique snapshot of how well a publication may reflect what is  known by the company. Since doctors rely on publications for  information about a drug&#8217;s effectiveness for off-label indications, our  study raises particularly important questions that may be applicable  more broadly to other drugs like gabapentin, which has been prescribed  so frequently for off-label indications.<\/strong><\/sup><\/div>\n<\/blockquote>\n<div align=\"justify\">Frankly, their discussion, damning as it is, soft-pedals what they found. Pfizer and Parke-Davis lied to us [us being doctors and patients] to get Neurontin sold for off-label uses. And it worked. In a clinic in a plenty rural place in the South, the number of people on Neurontin is remarkable. The patients are reticent to stop it because they were put on it for &quot;pain&quot; &#8211; just about any kind of &quot;pain&quot; you can imagine. They&#8217;re afraid to stop it because they think they&#8217;ll hurt more. Once off of it, neither they nor I can tell a great deal of difference one way or another. But the take-away point in the PLoS Medicine article is that the published articles that justified and popularized these off-label uses were <strong><font color=\"#200020\">FUBAR<\/font><\/strong>ed for publication &#8211; the published numbers and the numbers in the company documents were widely discrepant along a number of axes. In this case, they&#8217;ve mangled basic definitions and obviously shopped around for analyses that come out in their favor.<\/div>\n<p align=\"justify\">When I look back on my own wanderings in this literature, I am surprised what a slow learner I&#8217;ve been. Right at two years ago, after a few years of reading and writing about what others said about the corruption in the pharmaceutical companies&#8217; presentation of their data, I took the plunge and began to haunt <strong><font color=\"#200020\">clinicaltrials.gov<\/font><\/strong>, <strong><font color=\"#200020\">PubMed<\/font><\/strong>, the <strong><font color=\"#200020\">FDA<\/font><\/strong> site, and started reading our literature on the Clinical Trials myself in the original. I started with Seroquel [<a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2011\/02\/09\/seroquel-ii-version-20-guessing\/\">seroquel II [version 2.0]: guessing&hellip;<\/a>]. I was pretty naive, so it took me a while to realize how widespread all the pseudoscience really was. The more I looked, the more I found. I discovered what those who had gone before had known for years, but I guess I&#8217;m glad it unfolded slowly. I&#8217;m not sure I could&#8217;ve registered it all at once. With as much time as I&#8217;ve spent looking and as many times as I&#8217;ve been frustrated by not having full access to the data itself, it was only four or five months ago that it occurred to me that the solution was simple &#8211; that the raw data for <u>all<\/u> studies has to be made publicly available. And it took my actually running across the raw data for one study [Paxil Study 329] for me to have my belated awakening [<a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/08\/21\/a-movement\/\">a movement&hellip;<\/a>] because I saw how easy it was to see the distortions.<\/p>\n<p align=\"justify\">For reasons that I can&#8217;t even think of right now, I had passively gone along with the idea that the companies owned that data without even really thinking about it. That now seems crazy to me. There are no trade secrets&nbsp; in the data. They publish articles that are supposed to be accurate reflections of that data themselves. Why should they be a secret?  Right now, I can&#8217;t even mount an argument for why they should&#8217;ve been allowed to be secret in the first place. As I finally figured out five months ago, <strong><font color=\"#200020\">the <u>only<\/u> reason I can think of for keeping the raw data from clinical trials secret is <\/font><\/strong><a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/08\/22\/to-make-distortion-possible\/\">to make distortion possible<\/a>.<\/p>\n<div align=\"justify\">By the way, have I mentioned the <a target=\"_blank\" href=\"http:\/\/www.alltrials.net\/\"><strong><font color=\"#990000\">AllTrials<\/font><\/strong><\/a> petition and movement?&#8230; <\/div>\n","protected":false},"excerpt":{"rendered":"<p>And by the way, speaking of synchronicity, guess who has an op-ed piece in the New York Times today? Ben Goldacre [Health Care&rsquo;s Trick Coin]. Now for a chain of hat tips: Pharmagossip by Jack Friday January 30, 2013 Knight Science Journal at MIT by Paul Raeburn January 30, 2013 Science News by Rachel Ehrenberg [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-32907","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32907","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=32907"}],"version-history":[{"count":32,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32907\/revisions"}],"predecessor-version":[{"id":32925,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/32907\/revisions\/32925"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=32907"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=32907"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=32907"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}