{"id":28342,"date":"2012-10-04T20:01:48","date_gmt":"2012-10-05T00:01:48","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=28342"},"modified":"2012-10-05T12:00:49","modified_gmt":"2012-10-05T16:00:49","slug":"an-editorial-shell","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2012\/10\/04\/an-editorial-shell\/","title":{"rendered":"an editorial shell&#8230;"},"content":{"rendered":"<div align=\"justify\">Finding the actual data from Study 329 posted in early August was invigorating [<strong><a href=\"http:\/\/1boringoldman.com\/index.php\/2012\/08\/21\/a-movement\/\" target=\"_blank\"><u><font color=\"#200020\">a movement&hellip;<\/font><\/u><\/a><\/strong>]. I could finally have a go at looking at the things I&#8217;d only been able to guess about before. For example, I knew that the authors of that Study had abandoned a primary outcome parameter [<strong><font color=\"#200020\">HAM-D either &le;50% baseline <u>or<\/u> HAM-D &le;8<\/font><\/strong> <strong><font color=\"#200020\">@ 8 weeks<\/font><\/strong>] and introduced another [<strong><font color=\"#200020\">HAM-D &le;8<\/font><\/strong> <strong><font color=\"#200020\">@ 8 weeks<\/font><\/strong>]. It must&#8217;ve been because it looked better, but I didn&#8217;t know why. With the data available, it was easy to see:<\/div>\n<div align=\"center\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" vspace=\"7\" height=\"171\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/gsk-47.gif\" \/><\/div>\n<div align=\"justify\">The 8 week value with their newly constructed parameter [circled far right] was an <em>outlier<\/em> and made the difference look a whole lot more like what they wanted to see [wanted us to see]. And there were numerous other examples of what Neuroskeptic aptly calls the <em><strong><font color=\"#200020\">dark arts<\/font><\/strong><\/em>. I&#8217;ve kind of been on a data transparency high since I found that data. Not that I wasn&#8217;t there before, but now it seems more like an imperative. Thinking about Neuroskeptic&#8217;s analysis in the last post, <strong><font color=\"#200020\">falsifying or fabricating<\/font><\/strong> data is <strong><font color=\"#200020\">outright fraud<\/font><\/strong>, a crime. But the mis-use of the tools of science or other artifice in constructing an article is what he called <strong><font color=\"#200020\">questionable practices<\/font><\/strong>, all of which come <em>after the fact<\/em> and would be easily detected if we had the <em>facts in hand<\/em>. So the solution is posting the raw data and looking at the article itself as what it really is, an editorial shell around it [as opposed to hiding the data behind the article]:     <\/div>\n<div align=\"center\"><img decoding=\"async\" vspace=\"7\" height=\"150\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/data-2.gif\" \/><img decoding=\"async\" vspace=\"7\" height=\"150\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/data-1.gif\" \/><\/div>\n<div align=\"justify\">I don&#8217;t know if that would be necessary for every scientific paper, but history tells us that, for sure, it is the right thing to do for clinical trials in profit yielding psychopharmacologic drugs. We&#8217;ve had decades of the alternative and it has come to no good. I do have a question about the <strong><font color=\"#200020\">clinicaltrials.gov results database<\/font><\/strong> being up to the task of true data transparency. A few weeks back, I started to look into it&#8230;<\/div>\n<ul><sup><\/p>\n<div align=\"justify\"><strong><a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/12\/eyes-wide-shut-open-i\/\"><u><font color=\"#200020\">eyes wide <strike>shut<\/strike> open I&hellip;<\/font><\/u><\/a><\/strong><\/div>\n<div align=\"justify\"><strong><a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/12\/eyes-wide-shut-open-ii\/\"><u><font color=\"#200020\">eyes wide <strike>shut<\/strike> open II&hellip;<\/font><\/u><\/a><\/strong><\/div>\n<div align=\"justify\"><strong><a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/13\/eyes-wide-shut-open-iii\/\"><u><font color=\"#200020\">eyes wide <strike>shut<\/strike> open III&hellip;<\/font><\/u><\/a><\/strong><\/div>\n<div align=\"justify\"><strong><a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/13\/eyes-wide-shut-open-iv\/\"><u><font color=\"#200020\">eyes wide <strike>shut<\/strike> open IV&hellip;<\/font><\/u><\/a><\/strong><\/div>\n<p> <\/sup><\/ul>\n<div align=\"justify\">&#8230; but decided to table it until the doldrums of winter when I would have more time to think. It&#8217;s one of those situations where the devil&#8217;s in the details, and I was having trouble getting into a details frame of mind. Something about the way that database is constructed bothers me. I&#8217;d hate for us to spend the time insisting on something, only to find that it had some holes in it. More later. <\/div>\n<p>                  <\/p>\n<div align=\"justify\">Speaking of things about Clinical Trials, I was pointed to one recently that had some unusual features &#8211; actually it was two clinical trials of the same thing, six week of Geodon in Bipolar I Depression. It was an industry study through and through:<\/div>\n<ul>\n<div align=\"justify\"><strong><sup>This study was funded by Pfizer Inc. Editorial support was provided by Annie Neild, PhD, of PAREXEL and was funded by Pfizer Inc. AUTHOR DISCLOSURE INFORMATION: Drs Lombardo, Kolluri, Kremer, and Yang are employees of Pfizer Inc. Dr Sachs, owned stock in Concordant Rater Systems, Inc, and is now an employee of United BioSource Corporation. He has received grants for clinical research from Abbott, GlaxoSmithKline, Janssen, and Pfizer. Dr Sachs is on advisory boards for Abbott, Bristol-Myers Squibb, Dainippon Sumitomo Pharma, GlaxoSmithKline, Janssen, Eli Lilly, Merck, Otsuka, Pfizer, and Repligen.<\/sup><\/strong><\/div>\n<\/ul>\n<blockquote>\n<div align=\"center\"><a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed?term=22722504\" target=\"_blank\"><u><strong><font color=\"#200020\">Two 6-Week, Randomized, Double-Blind, Placebo-Controlled Studies of Ziprasidone in Outpatients With Bipolar I Depression<\/font><\/strong><\/u><\/a><br \/>                  <strong><font color=\"#200020\"><sup>Did Baseline Characteristics Impact Trial Outcome?<\/sup><\/font><\/strong><br \/>                  <strong><sup>by Ilise Lombardo, MD,* Gary Sachs, MD,&THORN;&thorn; Sheela Kolluri, PhD,* Charlotte Kremer, MD,* and Ruoyong Yang, PhD*<\/sup><\/strong><br \/>                 <strong><font color=\"#200020\">Journal of Clinical Psychopharmacology<\/font><\/strong>. 2012 32:470-478.<\/div>\n<p>                 <\/p>\n<div align=\"justify\"><sup><strong>Two randomized, double-blind, placebo-controlled, 6-week studies comparing ziprasidone versus placebo for treatment of bipolar depression [BPD] failed to meet their primary study objectives, indicating that either ziprasidone is ineffective in the treatment of BPD or the study failed.<\/p>\n<p>                  Adult outpatients with bipolar I depression with 17-item Hamilton Rating Scale for Depression total score more than 20 at screening and baseline received either ziprasidone 40 to 80 mg\/d, 120 to 160 mg\/d, or placebo [study 1], or ziprasidone 40 to 160 mg\/d or placebo [study 2]. Primary efficacy measure in both studies was change from baseline in Montgomery-&Aring;sberg Depression Rating Scale total scores at week 6 [end of the study]. Mixed-model repeated-measures methodology was used to analyze the primary efficacy measure in both studies. Secondary efficacy measures in both studies included Hamilton Rating Scale for Depression total score and Clinical Global Impression-Improvement score. Post hoc analyses were conducted for both studies to examine potential reasons for study failure. In both, ziprasidone treatment groups failed to separate statistically from placebo for change from baseline Montgomery-&Aring;sberg Depression Rating Scale score at week 6. Response rates were 49%, 53%, and 46% for placebo, ziprasidone 40 to 80 mg\/d, and ziprasidone 120 to 160 mg\/d, respectively [study 1], and 51% and 53% for placebo and ziprasidone 40 to 160 mg\/d, respectively [study 2]. <\/p>\n<p>         Ziprasidone 40 to 160 mg\/d did not show superiority over placebo at week 6 in the treatment of BPD. Post hoc analyses revealed serious inconsistencies in subject rating that may have limited the ability to detect a difference between drug and placebo response. Rating reliability warrants further investigation to improve clinical trial methodology in psychiatry.<\/strong><\/sup><\/div>\n<\/blockquote>\n<div align=\"center\"><img loading=\"lazy\" decoding=\"async\" width=\"500\" vspace=\"7\" height=\"173\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/ziprasidone-1.gif\" \/><\/div>\n<div align=\"justify\">These were CRO [Clinical Research Organization] studies [<strong><font color=\"#000066\">PAREXEL<\/font><\/strong>] started in 2005 &amp; 2006 [Clinical Trials <a href=\"http:\/\/clinicaltrials.gov\/ct2\/results?term=NCT00141271\" target=\"_blank\"><u><strong><font color=\"#200020\">NCT00141271<\/font><\/strong><\/u><\/a> &amp; <a href=\"http:\/\/clinicaltrials.gov\/ct2\/results?term=NCT00282464\" target=\"_blank\"><u><strong><font color=\"#200020\">NCT00282464<\/font><\/strong><\/u><\/a>]. CROs obviously profit from speedy [and positive] results. Since there&#8217;s such a strong placebo effect, they need large numbers [486 &amp; 369], and the only way to get them is to use large networks of multiple sites [56\/70 &amp; 45\/48]. Needless to say, these are <em>recruited<\/em> subjects, and in such studies, dropout rates are high [Placebo 33% &amp; 31%, Geodon 40% &amp; 38%].  In an &quot;<em>effort to mitigate against the baseline inflation<\/em>,&quot; they used the <strong><font color=\"#200020\">Hamilton Rating Scale for Depression [HAM-D]<\/font><\/strong> for screening and acceptance and the <strong><font color=\"#200020\">Montgomery-&Aring;sberg Depression Rating Scale [MADRS]<\/font><\/strong> for serial efficacy analysis. Baseline inflation is when eager raters maximize symptoms to include subjects in these lucrative trials. Both studies were solid busts by any measure [they&#8217;re called &quot;negative studies&quot; because there was no active comparator].<\/div>\n<p>   <\/p>\n<div align=\"justify\">At this point, my expected response would be to rant about the Clinical Research Organization studies, but I&#8217;m not going to do that because this time, they put the data to good use and gave us a peek behind the screen. First, one might think that these two commonly used depression rating scales might give similar results. In fact there&#8217;s even a conversion formula:<\/div>\n<p align=\"center\"><em><strong><font color=\"#200020\">MADRS = 1.43 &times; HAM-D + 0.87<\/font><\/strong><\/em><\/p>\n<div align=\"justify\">So they compared the HAM-D qualifying scores to the initial MADRS scores [I know the text is too small to read, but you won&#8217;t need it &#8211; there&#8217;s nothing subtle here]:<\/div>\n<div align=\"center\"><img decoding=\"async\" vspace=\"5\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/ziprasidone-2.gif\" \/><\/div>\n<div align=\"justify\">Studies 1 &amp; 2 are side-by-side. On top, the HAM-D scores at screening &#8211; below, the initial MADRS scores. They&#8217;re scaled to be equivalent by the formula. Not even close! They didn&#8217;t mitigate baseline inflation, they proved it! [they reanalyzed using only <em>MADRS confirmed<\/em> subjects and it was negative too]. One more for the road &#8211; the placebo response rates at different sites for the two studies side by side:<\/div>\n<div align=\"center\"><img decoding=\"async\" width=\"300\" vspace=\"7\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/ziprasidone-3.gif\" \/><\/div>\n<div align=\"justify\">They did some other <em>post hoc<\/em> analyses and the results were equally awful. No matter where they looked, they found uninterpretable correlations. We owe <strong><font color=\"#000066\">PAREXEL <\/font><\/strong>and <strong><font color=\"#200020\">Pfizer<\/font><\/strong> a debt of gratitude for&nbsp; publishing this article that was such a stinging indictment of this kind of clinical trial &#8211; the kind they rely on. I&#8217;m going to reserve comments on Clinical Research Organization trials in general for another post, and stick to the topic of data transparency, because this study points to a major reason that we need to insist on it. Had they not done this <em>post hoc<\/em> analysis for us, we couldn&#8217;t have known about the baseline inflation, the non-correlation between MADRS and HAM-D scales, or the large placebo effect and its variation across sites. With the raw data, we could&#8217;ve known those things and much more. As I said <a href=\"http:\/\/1boringoldman.com\/index.php\/2012\/08\/22\/to-make-distortion-possible\/\" target=\"_blank\"><u><strong><font color=\"#200020\">before<\/font><\/strong><\/u><\/a>, &quot;<strong><font color=\"#200020\">&hellip; <\/font><\/strong><strong><font color=\"#200020\">the <u>only<\/u> reason I can think of for keeping the raw data from clinical trials secret is to make distortion possible<\/font><\/strong>&quot;&#8230;  <\/div>\n<hr size=\"1\" \/>\n<div align=\"right\">[errors corrected 8AM 10\/05\/2012]<\/div>\n","protected":false},"excerpt":{"rendered":"<p>Finding the actual data from Study 329 posted in early August was invigorating [a movement&hellip;]. I could finally have a go at looking at the things I&#8217;d only been able to guess about before. For example, I knew that the authors of that Study had abandoned a primary outcome parameter [HAM-D either &le;50% baseline or [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-28342","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/28342","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=28342"}],"version-history":[{"count":62,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/28342\/revisions"}],"predecessor-version":[{"id":28445,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/28342\/revisions\/28445"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=28342"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=28342"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=28342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}