{"id":68909,"date":"2016-10-29T21:22:28","date_gmt":"2016-10-30T01:22:28","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=68909"},"modified":"2016-10-29T21:22:28","modified_gmt":"2016-10-30T01:22:28","slug":"the-frenzied-match-of-ping-pong-step-one","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2016\/10\/29\/the-frenzied-match-of-ping-pong-step-one\/","title":{"rendered":"the frenzied match of ping pong: step one\u2026"},"content":{"rendered":"\n

So do I think that editors and researchers sit around thinking, "We’ve got to keep them from nailing down the process to insure that there’s some official copy of the a priori Primary and Secondary Outcome variables publicly available<\/font><\/em>"? I kind of doubt it. I expect there are some people inside the walls of Pharma whose understanding of this is more intentional, who consciously know that if they don’t keep this question always open and unresolved, they will lose an extremely valuable tool to market their drugs. But editors? I expect they think the reformers are just being too picky or are anti-pharmacology types or something like that. Maybe they feel like the lady outside the gala whose mink coat has just been sprayed with red paint by some unwashed hippie activist. Or maybe they don’t buy the scientific explanation for preregistration [see de Groot<\/a>]. I doubt that it occurs to them that there was some savvy ghost·organizer<\/font><\/em> in the background carefully orchestrating what Outcomes got presented in the article they published. But the net result is the same – the issue of the a priori <\/font><\/em>Primary and Secondary Outcome variables <\/font><\/em>just never gets resolved…<\/font><\/em><\/sup><\/p>\n

So here we are with the powerful publication editors, an astute investigative editor [Peter Doshi], and a preeminent clinical trial researcher [Ben Goldacre] engaged in a tête-à-tête about Clinical Trial preregistration, a priori variables, and "Outcome Switching" [that’s occurring after the fact, disconnected from the specific trial reports]. The clinicians who read all of those trials in their journals likely have no idea that this debate is taking place, and even more to the point, they didn’t and don’t know that the paper they read had the "Outcome Switched" [a selective reporting that may well have painted a picture of the results through rose colored glasses]. The discussion in Is this trial misreported? Truth seeking in the burgeoning age of trial transparency<\/a> by the editors is focused on COMPare’s methodology, whether the prespecifieded Outcome Variables are the best choice, or whether Goldacre’s team made an "accurate, complete and nuanced evaluation of the published trial reports."<\/p>\n

We have to wonder "Why are they talking about that?<\/font><\/em><\/strong>" Only the BMJ<\/font><\/strong> editor seems to have responded to the cogent question, "Did you know you were publishing an article where the Outcome Parameters had been switched?<\/font><\/em><\/strong>" The editors of the Annals of Internal Medicine<\/font><\/strong> and the New England Journal of Medicine<\/font><\/strong> either denied the facts or said that it didn’t make any difference – essentially ignoring the question. And Doshi’s article doesn’t address the Sponsors who submitted the articles or ask them the pertinent questions: "Why did you switch the Outcomes?<\/font><\/strong><\/em>" and "Why didn’t you tell us that you switched the Outcomes?<\/font><\/strong><\/em>" <\/p>\n

the first step
<\/font><\/strong><\/em><\/h2>\n
Ben Goldacre’s COMPare<\/font><\/strong> team and the BMJ<\/font><\/strong>‘s Peter Doshi have done yeoman’s service here. First, the COMPare<\/font><\/strong> group made it clear that "Outcome Switching" is not just a thing of the past [as in Paxil Study 329<\/font>, CIT-MD-18<\/font>, Paxil Study 352<\/font>, etc<\/font>]. It’s happening right now, and frequently. And by querying the journal editors, Doshi got the same kind of defensive or attacking response as years ago.<\/div>\n
\n
“COMPare objects to the format in which the data are communicated, but COMPare is silent about whether they dispute the key clinical message of the article,” NEJM<\/em> editor Jeffrey Drazen said through a spokesperson.<\/div>\n
Annals<\/em> echoed this sentiment: “COMPare’s methodology suggests a lack of recognition of the importance of clinical judgment when assessing pre-stated outcomes.”<\/div>\n<\/blockquote>\n
That’s a disappointing response to say the least. The COMPare<\/font><\/strong> team didn’t even call it "Outcome Switching<\/font><\/em>" if they said they were doing it and why in the article. They only catalogued instances where they changed the outcomes and didn’t tell us they were doing it. That’s a point the editors don’t seem to quite grasp. If either the authors or the editors were using clinical judgement to make their decisions, that’s their prerogative. But they need to say that. When I first read the COMPare study, I was impressed that they could even locate the a priori declarations. Frequently, I’ve either had a hard time finding them or actually failed in the endeavor. From the Compare FAQ<\/a>:<\/div>\n
\n
"Our gold standard<\/a> for finding pre-specified outcomes is a trial protocol that pre-dates trial commencement, as this is where CONSORT states outcomes should be pre-specified. However this is often not available, in which case, as a second best, we get the pre-specified outcomes from the trial registry entry that pre-dates the trial commencement. Where the registry entry has been modified since the trial began, we access the archived versions, and take the pre-specified outcomes from the last registry entry before the trial began."<\/em><\/div>\n<\/blockquote>\n
So I guess I would say that the first step in evaluating an RCT is to see if the outcomes reported are the same ones that were prespecified in the a priori<\/font><\/em> protocol. That’s the standard. If they’ve been changed, and the change isn’t addressed anywhere in the published article, you’re likely not reading a scientific document. You’re reading an advertisement…<\/div>\n","protected":false},"excerpt":{"rendered":"

So do I think that editors and researchers sit around thinking, "We’ve got to keep them from nailing down the process to insure that there’s some official copy of the a priori Primary and Secondary Outcome variables publicly available"? I kind of doubt it. I expect there are some people inside the walls of Pharma […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-68909","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68909","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=68909"}],"version-history":[{"count":18,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68909\/revisions"}],"predecessor-version":[{"id":68928,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68909\/revisions\/68928"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=68909"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=68909"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=68909"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}