{"id":23458,"date":"2012-05-18T23:45:50","date_gmt":"2012-05-19T03:45:50","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=23458"},"modified":"2012-05-19T06:37:39","modified_gmt":"2012-05-19T10:37:39","slug":"sleight-of-hand","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2012\/05\/18\/sleight-of-hand\/","title":{"rendered":"(sleight of hand)<sup>2<\/sup>&#8230;"},"content":{"rendered":"<div align=\"justify\">I had sworn off vetting any clinical trials or meta-analyses for a while, but sometimes something special comes along. <a target=\"_blank\" href=\"http:\/\/neuroskeptic.blogspot.com\/2012\/05\/another-antidepressant-crashes-burns.html\"><u><strong><font color=\"#0033ff\">Neuroskeptic<\/font><\/strong><\/u><\/a> has already had his way with this one, but it had some features that seemed worthy of note. It&#8217;s a failed study [and how were they going to write <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong> on a pill anyway?]:             <\/div>\n<blockquote>\n<div align=\"center\"><a href=\"http:\/\/jpet.aspetjournals.org\/content\/early\/2012\/05\/08\/jpet.112.193995.full.pdf+html\" target=\"_blank\"><u><strong><font color=\"#200020\">Translational evaluation of JNJ-18038683, a 5-HT7 receptor antagonist, on REM sleep and in major depressive disorder<\/font><\/strong><\/u><\/a><br \/>                <sup>by Pascal Bonaventure, Christine Dugovic, Michelle Kramer, Peter De Boer, Jaskaran Singh, Sue Wilson, Kirk Bertelsen, Jianing Di, Jonathan Shelton, Leah Aluisio, Lisa Dvorak, Ian Fraser, Brian Lord, Diane Nepomuceno, Abdellah Ahnaou, Wilhelmus Drinkenburg, Wenying Chai, Curt Dvorak, Steve Sands, Nicholas Carruthers, and Timothy W. Lovenberg<\/sup><br \/>                <strong><font color=\"#200020\">Journal of Pharmacology and Experimental Therapeutics<\/font><\/strong><br \/>              Published on-line May 8, 2012. [full text on-line]             <\/div>\n<p>               <\/p>\n<div align=\"justify\"><sup>In rodents, 5-HT7 receptor blockade has been shown to be effective in models of depression and to increase the latency to REM sleep and decrease REM duration. In the clinic, the REM sleep reduction observed with many antidepressants may serve as a biomarker. We report here the preclinical and clinical evaluation of a 5-HT7 receptor antagonist, JNJ-18038683. In rodents, JNJ-18038683 increased the latency to REM sleep and decreased REM duration and this effect was maintained after repeated administration for 7 days. The compound was effective in the mouse tail suspension test. JNJ-18038683 enhanced serotonin transmission, antidepressant-like behavior, and REM sleep suppression induced by citalopram in rodents. In healthy human volunteers, JNJ-18038683 prolonged REM latency and reduced REM sleep duration demonstrating that the effect of 5-HT7 blockade on REM sleep translated from rodents to humans. Like in rats, JNJ-18038683 enhanced REM sleep suppression induced by citalopram in humans, although a drug-drug interaction could not be ruled out. In a double blind, active- and placebo-controlled clinical trial in 225 patients suffering from major depressive disorder, neither treatment with pharmacologically active doses of JNJ-18038683 or citalopram separated from placebo indicating a failed study lacking assay sensitivity. A post hoc analyses using an enrichment window strategy, where all the efficacy data from sites with an implausible high placebo response [placebo group MADRS&lt;= 12] and from sites with no placebo response [MADRS&gt;=28] are removed, there was a clinically meaningful and statistically significant difference between JNJ-18038683 and placebo. Further clinical studies are required to characterize the potential antidepressant efficacy of JNJ-18038683.<\/sup><\/div>\n<div align=\"center\"><img decoding=\"async\" vspace=\"5\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/683.gif\" \/>&nbsp;<\/div>\n<\/blockquote>\n<div align=\"justify\">One would think, looking at that graph, that you might just put <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong> back on the shelf and move on to something else. This <a href=\"http:\/\/clinicaltrials.gov\/ct2\/show\/NCT00566202?term=JNJ-18038683&#038;rank=1\" target=\"_blank\"><u><strong><font color=\"#200020\">Clinical Trial<\/font><\/strong><\/u><\/a> dates back to 2007 and changed more times than Elizabeth Taylor changed husbands. <a target=\"_blank\" href=\"http:\/\/neuroskeptic.blogspot.com\/2012\/05\/another-antidepressant-crashes-burns.html\"><u><strong><font color=\"#0033ff\">Neuroskeptic<\/font><\/strong><\/u><\/a> noted that they seemed to change the name of the active comparator from escitalopram to citalopram back and forth in the text. That was about the only thing that didn&#8217;t change during the Clinical Trial according to clinicaltrial.gov [it was always escitalopram though it was published as citalopram]. And it was an all in house show &#8211; all 21 authors were JNJ employees.<\/div>\n<p>          <\/p>\n<div align=\"justify\">For starters, notice that they used all the graph pretty-fication tricks: mean change instead of raw scores, standard error rather than standard deviation bars, leaving off that it was last observation carried forward [LOCF] corrected. Standard fare. Recall that a <strong><font color=\"#200020\">positive study<\/font><\/strong> is when a drug and the active comparator separate from placebo. A <strong><font color=\"#200020\">negative study<\/font><\/strong> is when a drug doesn&#8217;t separate but the active comparator does. And a study where neither drug nor active comparator separates from placebo is a <strong><font color=\"#200020\">failed study<\/font><\/strong> &#8211; money down the drain and usually an indictment of the state of the clinical research industry and their recruitment methods. But this study added something new to me &#8211; a <em>population enrichment window<\/em> strategy. Says <a target=\"_blank\" href=\"http:\/\/neuroskeptic.blogspot.com\/2012\/05\/another-antidepressant-crashes-burns.html\"><u><strong><font color=\"#0033ff\">Neuroskeptic<\/font><\/strong><\/u><\/a>:<\/div>\n<blockquote>\n<div align=\"justify\"><sup>Ouch! But it gets better. Unhappy that JNJ-18038683 bombed, Janssen reached for their copy of the <strong><a href=\"http:\/\/neuroskeptic.blogspot.co.uk\/2010\/09\/big-pharma-explain-how-to-pick-cherries.html\" target=\"_blank\">Cherrypicker&#8217;s Manifesto<\/a><\/strong>. This is a new statistical method, proposed by fellow Pharma company GSK in <a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/20861834\" target=\"_blank\">a <strong>2010 paper<\/strong><\/a>, which consists of excluding data from study centres with a very high [or very low] placebo response rate.<\/p>\n<p>             Anyway, after applying this &quot;filter&quot; JNJ-18038683 seemed to do a bit better than placebo, but the  benefit over placebo <em>still wasn&#8217;t statistically significant &#8211;<\/em> with a p value of 0.057, the  wrong side of the sacred p=0.05 line [on page 33].<br \/>             Yet Page 33&#8217;s &quot;trend towards statistical significance&quot; magically becomes &quot;significant&quot; &#8211; in the Abstract:<\/sup><\/div>\n<ul><sup><\/p>\n<div align=\"justify\">[with] a post hoc analyses (sic) using an enrichment window strategy&#8230; there was a clinically meaningful <strong><font color=\"#200020\">and statistically significant<\/font><\/strong> difference between JNJ-18038683 and placebo.<\/div>\n<p><\/sup><\/ul>\n<div><sup>Well, no, there wasn&#8217;t actually. It was only a trend. Look it up.<\/sup><\/div>\n<\/blockquote>\n<div align=\"justify\">With his usual style, <strong><font color=\"#0033ff\">Neuroskeptic<\/font><\/strong> explains this technique he names the <a target=\"_blank\" href=\"http:\/\/neuroskeptic.blogspot.co.uk\/2010\/09\/big-pharma-explain-how-to-pick-cherries.html\"><u><strong><font color=\"#200020\">Cherrypicker&#8217;s Manifesto<\/font><\/strong><\/u><\/a>. Here&#8217;s the original from GSK:<\/div>\n<blockquote>\n<div align=\"center\"><a target=\"_blank\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/20861834\"><u><strong><font color=\"#200020\">A new population-enrichment strategy to improve efficiency of placebo-controlled clinical trials of antidepressant drugs.<\/font><\/strong><\/u><\/a><br \/>         <sup>by Merlo-Pich E, Alexander RC, Fava M, Gomeni R.<\/sup><br \/>         <strong><font color=\"#200020\">Clinical Pharmacology Therapeutics.<\/font><\/strong> 2010 88[5]:634-642.<\/div>\n<p>        <\/p>\n<div align=\"justify\"><sup>The  rate-limiting factor in the discovery of novel antidepressants is the  inefficient methodology of traditional multicenter randomized clinical  trials (RCTs). We applied a model-based approach to a large clinical  database (five RCTs in major depressive disorder (MDD), involving 1,837  patients from 124 recruitment centers) with two objectives: (i) to learn  about the role of center-specific placebo response in RCT failure and  (ii) to apply what is learned to improve the efficiency of RCTs by  enhancing the detection of treatment effect (TE). Sensitivity analysis  indicated that center-specific placebo response was the most relevant  predictor of RCT failure. To reduce the statistical &quot;noise&quot; generated by  centers with nonplausible, excessively high\/low placebo responses, we  developed an enrichment-window strategy. Clinical trial simulation was  used to assess the enrichment strategy applied before the standard  statistical analysis, resulting in an overall reduction in failure of  RCTs from ~50 to ~10%.<\/sup><\/div>\n<\/blockquote>\n<div align=\"justify\">They&#8217;re trying to control for &quot;bad clinical research centers&quot; by dropping them based on &quot;bad&quot; &quot;placebo effect&quot; curves. Stand up, walk around your chair, and then consider for a moment what they are talking about. The &quot;placebo effect&quot; is a phenomenon of the modern psychiatric drug clinical trials. Subjects get better just by being in a Double Blind Randomized Placebo Controlled Clinical Trial. And the longer the Clinical Research Industry is in existence, the better they get on placebos. This technique proposes to drop centers where the subjects <em>don&#8217;t do well<\/em> on placebos and the ones where they do <em>too well<\/em> on placebos. The reason to walk around the chair is to break the spell and realize how incredibly bizarre this all is. They have the Mixed Method or the Last Observation Carried Forward methods to deal with drop-outs. Now they propose adding a drop-centers-with-atypical-placebo-responses method. In this case, when they apply this correction, they end up with p=0.057 for JNJ-18038683 and p=0.353 for citalopram [or escitalopram? whichever they actually used]. So that <em>almost significant p=0.057<\/em> becomes <em>significant<\/em>.        <\/div>\n<hr width=\"75%\" size=\"1\" \/>\n<div align=\"justify\">So you want to study the effect of <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong> as an antidepressant. Here&#8217;s what you do. You farm out your study of 225 subjects to 27 different Clinical Research Centers for recruitment [an average of 8.3 subjects per center, with an average of 2.7 subjects in each group at each center on either placebo, <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong>, or <strike>escitalopram<\/strike> <strike>citalopram<\/strike> an active comparator]. You medicate them and administer a MADRS questionnaire weekly for 8 weeks. Then you collect your numbers and begin to play with them. You correct for drop-outs [LOCF] and you pretty up your graph. From across the room, it&#8217;s a dud. The <strike>escitalopram<\/strike> <strike>citalopram<\/strike> active comparator didn&#8217;t work, nor did <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong>. You run your statistics and it still didn&#8217;t work. So now you give the new population-enrichment strategy a whirl. Neither <strike>escitalopram<\/strike> <strike>citalopram<\/strike> active comparator nor <strong><font color=\"#200020\">JNJ-18038683<\/font><\/strong> worked, but <strong><font color=\"#200020\">JNJ-18038683 <\/font><\/strong>got close. So you say&#8230;<\/div>\n<ul>\n<div align=\"justify\"><sup>A post hoc analyses using an enrichment window strategy, where all the  efficacy data from sites with an implausible high placebo response  [placebo group MADRS&lt;= 12] and from sites with no placebo response  [MADRS&gt;=28] are removed, there was a clinically meaningful and  statistically significant difference between JNJ-18038683 and placebo.  Further clinical studies are required to characterize the potential  antidepressant efficacy of JNJ-18038683.<\/sup><\/div>\n<\/ul>\n<div align=\"justify\">&#8230;ignoring the fact that the population-enrichment strategy didn&#8217;t bring the  <strike>escitalopram<\/strike> <strike>citalopram<\/strike> active comparator into significance, so even with all of that sleight of hand, it&#8217;s still a failed study or something like that. If you glanced at the graph before you started reading this, you already knew you wouldn&#8217;t recommend <strong><font color=\"#200020\">JNJ-18038683 <\/font><\/strong>to a depressed friend just from the graph, without reading a single word.<\/div>\n","protected":false},"excerpt":{"rendered":"<p>I had sworn off vetting any clinical trials or meta-analyses for a while, but sometimes something special comes along. Neuroskeptic has already had his way with this one, but it had some features that seemed worthy of note. It&#8217;s a failed study [and how were they going to write JNJ-18038683 on a pill anyway?]: Translational [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-23458","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/23458","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=23458"}],"version-history":[{"count":28,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/23458\/revisions"}],"predecessor-version":[{"id":23485,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/23458\/revisions\/23485"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=23458"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=23458"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=23458"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}