{"id":62665,"date":"2015-12-27T11:48:27","date_gmt":"2015-12-27T16:48:27","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=62665"},"modified":"2015-12-31T14:32:06","modified_gmt":"2015-12-31T19:32:06","slug":"a-story-the-beginning-of-the-end","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2015\/12\/27\/a-story-the-beginning-of-the-end\/","title":{"rendered":"a story: the beginning of the end…"},"content":{"rendered":"\n

I started the last post with a borrowed literary device, but I was just practicing. In The French Lieutenant’s Woman<\/a>, <\/font><\/em><\/sup> John Fowles<\/font><\/em> popped into his story and spoke in the first person <\/font><\/em><\/sup>with the reader. He did that, or at least claimed he did that, because he couldn’t decide how to end his novel. He ended up writing two endings. Well that’s my problem with this story. I’ve got two different endings, both of which matter to me, but they aim at substantively different conclusions and there’s no resolving them. So I’m just going to have two endings and be done with it. but first<\/font><\/em>…<\/font><\/em><\/sup><\/p>\n

In a story [starting in the middle]…<\/a>, I discussed the two Brexpiprazole studies and their attempt to make some post-hoc changes that would make it become significant, sleight of hand PHARMA-style. Then in a story: the end of the middle…<\/a>, we saw how the FDA reviewer didn’t let them get away with it, but in the end recommended approval of for Augmentation in Treatment Resistant Depression<\/font><\/em> based on the strong<\/font><\/strong><\/em> showing in the other study.<\/div>\n
\n
Thus, with one strong<\/font><\/strong><\/em>·ly positive trial and supportive evidence from two additional trials, there is adequate evidence of efficacy to approve this product for the adjunctive treatment of MDD.<\/div>\n<\/blockquote>\n
And that 2MG<\/font><\/strong> study did achieve a p=0.002 that survived correction for multiple variables. <\/div>\n

But is that what strong<\/font><\/strong><\/em> means? Very significant? We actually have other ways of looking at strong<\/font><\/strong><\/em>, called strength of effect or Effect Size<\/font><\/em>.  I mentioned them in in the land of sometimes[2]<\/sup>…<\/a> and in the land of sometimes[3]<\/sup>…<\/a>. The Primary Outcome Variable in these studies is the MADRS score at 6 weeks compared to baseline [a continuous variable]. The usual measure of Effect Size<\/font><\/em> would be Cohen’s d<\/font><\/em>, but they neither calculated it nor gave us enough parameters to do it ourselves. But they did use the MADRS score to tally Responders<\/font><\/em> [≥ <\/span>50% reduction] and Remitters<\/font><\/em> [≥ <\/span>50% reduction and ≤ <\/span>10]. So I looked to see how strong <\/font><\/strong><\/em>they were in the 2MG<\/font><\/strong> study. I found the NNT [Number Needed to Treat] and OR [Odds Ratio] for the original Efficacy Population<\/font><\/strong> and the Final Efficacy Protocol <\/font><\/strong>using their Table 2 and the Supplement: <\/p>\n

<\/p>\n

The NNT of 13 says that you have to treat 13 patients to get one that exceeds what you’d get with placebo alone. That’s a lousy number, on the other end of the scale from strong<\/font><\/strong><\/em>. It’s a weak if any effect. No matter which study you look at, or which population you use, these are all lackluster numbers. And the Odds Ratios consistently under 2.0 are low. Here’s the 1MG AND 3MG<\/font><\/strong> study, equally dismal:<\/p>\n

<\/p>\n

You might notice that the graphs look better than the numbers. You can do that using a change from baseline scale that obscures the fact that the MADRS is a 60 point scale and then using the SEM for limit markers rather than the SD or the 95% CIs which might show how close these lines really are [I think of it as presentation spin]. <\/p>\n

Since I couldn’t do the Cohen’s d<\/font><\/em> for the MADRS<\/font> scores, I had a look at the HDRS-17<\/font>:<\/p>\n

<\/p>\n

Finally, since I have a spreadsheet that converts the usual Mean, SEM, n<\/font><\/em> figures into Effect Sizes [Cohen’s d AKA Standardized Mean Diffierence]<\/font><\/em>, I kept going and put  in all of the continuous Secondary Outcome Variables for the two studies [recall d=0.2 is weak, d=0.5 is moderate, and d=0.8 is strong<\/font>]:<\/p>\n

 <\/p>\n

Scanning down the forest plots, there’s nothing at all that I see justifying the strong<\/font><\/em><\/strong> moniker. Brexpiperazole just didn’t leave many footprints in the sand. And as Spielmans et al pointed out in their meta-analysis [the extra mile…<\/a>], the self-reported depression scale [IDS-SR<\/font>] is in the hardly-noticed<\/font><\/em> range. Searching the text of the two articles, measurements of Effect Size are barely mentioned or reported. Certainly they play no important role in their analysis or discussion. So I’ll add that to my list of complaints about these papers. <\/p>\n

Let’s face it, these are not scientific papers. They’re sloppy sales jobs conducted by industry marketeers with a penchant for cutting and pasting, stealthily presented with scientific bells and whistles, and full of sound and fury signifying nothing. This medication doesn’t do much of anything strong<\/font><\/em><\/strong> for the targeted illness. Dr. Michael Thase and his academic institution [Perelman School of Medicine of the University of Pennsylvania, Philadelphia, Pennsylvania<\/font><\/em>] should be ashamed of themselves for even participating. Editorials to follow…<\/div>\n","protected":false},"excerpt":{"rendered":"

I started the last post with a borrowed literary device, but I was just practicing. In The French Lieutenant’s Woman,  John Fowles popped into his story and spoke in the first person with the reader. He did that, or at least claimed he did that, because he couldn’t decide how to end his novel. He […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-62665","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62665","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=62665"}],"version-history":[{"count":38,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62665\/revisions"}],"predecessor-version":[{"id":62816,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/62665\/revisions\/62816"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=62665"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=62665"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=62665"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}