{"id":68930,"date":"2016-10-30T16:43:38","date_gmt":"2016-10-30T20:43:38","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=68930"},"modified":"2016-10-30T16:53:36","modified_gmt":"2016-10-30T20:53:36","slug":"the-frenzied-match-of-ping-pong-the-last-stand","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2016\/10\/30\/the-frenzied-match-of-ping-pong-the-last-stand\/","title":{"rendered":"the frenzied match of ping pong: the last stand…"},"content":{"rendered":"
\n
\n
Is this trial misreported? Truth seeking in the burgeoning age of trial transparency<\/a><\/div>\n
by Peter Doshi, associate editor<\/div>\n
British Medical Journal<\/font><\/strong>. 2016 355:i5543<\/div>\n<\/blockquote>\n
We all agree that the participants in trials should be randomly assigned to the various arms of the study, and about the conditions of the double-blind design. The old pharma trick of not publishing negative studies has been mostly eliminated by required registration. So what’s left to complain about? I’ve been borrowing Ben Goldacre et al’s COMPare study, some of the Journal Editors’ responses, and Peter Doshi’s reporting aiming at a particular point – the a-priori<\/font><\/em>-ness<\/font><\/strong> of the outcome variables in the analysis of the clinical trial results. I see it as the last big hurrah – a place where there seems to be no enduring consensus supporting its importance. That’s apparent in some of the editor’s responses to COMPare.<\/div>\n
\n
Outraged editors<\/font><\/strong><\/div>\n

The long awaited goal of universal registration of trials now seemed achievable.5 and medical journal editors issued an ultimatum: preregister your trial or forgo publication in our pages. “Honest reporting begins with revealing the existence of all clinical studies, even those that reflect unfavourably on a research sponsor’s product,” a group of influential editors declared. “Unfortunately, selective reporting of trials does occur, and it distorts the body of evidence available for clinical decision-making.” The declaration had enormous impact, and public trial registers remain a key mechanism to prevent investigators from hiding or spinning unfavourable results. <\/p>\n

But more than a decade on, a small project from Oxford University’s Centre for Evidence Based Medicine seems to have journal editors eating their own words, with some of the world’s most powerful editors arguing that strict adherence to the registry entry’ or trial protocol may not always make sense…<\/div>\n<\/blockquote>\n
\n
Journal dissent<\/font><\/strong><\/div>\n

“Upon receipt of COMPARED initial communication, our editorial team (comprised of physicians and statisticians)thoroughly re-reviewed materials associated with the articles.” Annals’ editor in chief. Christine Laine, told The BMJ. “We concluded that the information reported in the articles audited by COMPare accurately represents the scientific and clinical intent detailed in the protocols.” In notices posted to the journal’s website, Annals editors acknowledged the good intentions of COMPare but warned people to be wary.<\/p>\n

“Until the COMPare Project’s methodology’ is modified to provide a more accurate, complete and nuanced evaluation of published trial reports, we caution readers and the research community’ against considering COMPare’s assessments as an accurate reflection of the quality’ of the conduct or reporting of clinical trials”…<\/p>\n

NEJM also flunked COMPare’s test. The journal’s editors refused to publicly engage with the group, rejecting all of  COMPare’s 20 letters, most with a tightly worded statement saying “we have not identified any clinically meaningful discrepancies between the protocol and the published paper that are of sufficient concern to require correction of the record… NEJM’s response has a certain irony. The journal’s editor, Jeffrey Drazen, has been a longtime supporter of trial registration, and NEJM was the first of its peers to publish trial protocols alongside trial publications, a practice now followed by JAMA, The BMJ, and most recendy-in part thanks to COMPare — Annals.<\/p>\n

The BMJ did not escape criticism but ultimately got a greenlight. COMPare sent rapid responses for two of the three trials evaluated, one of which led to a correction. It was “an example of best practice,” the group said in a blog. What about JAMA and the Lancet? JAMA rejected all 11 letters the group sent, and the Lancet rejected some but published others… <\/div>\n<\/blockquote>\n

Frankly, while "a more accurate, complete and nuanced evaluation of published trial reports<\/font><\/em>" sounds really good, it’s well off the mark. The whole point of a clinical trial is objectification, hard core evidence-based medicine. Of course there are instances where common sense says that the preregistered outcome need to be reconsidered, but that’s not what’s on the table here. COMPare<\/font> found that the majority of the articles<\/font><\/em> had some outcome changed. And the changes weren’t flagged or explained<\/font><\/em>. <\/p>\n

So some editors don’t really accept that the a priori<\/font><\/em> declaration of outcome variables is a fundamental element of a scientifically conducted Randomized Clinical Trial <\/font>[RCT]<\/font>. That’s what COMPare shows, and that’s what the editors’ responses say as well. Their proper response to COMPare <\/font>would’ve been "Whoops<\/em>." In spite of their comments to the contrary, they’re keeping the multi-billion loophole from being closed – making a "last stand."<\/font> <\/div>\n","protected":false},"excerpt":{"rendered":"

Is this trial misreported? Truth seeking in the burgeoning age of trial transparency by Peter Doshi, associate editor British Medical Journal. 2016 355:i5543 We all agree that the participants in trials should be randomly assigned to the various arms of the study, and about the conditions of the double-blind design. The old pharma trick of […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-68930","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68930","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=68930"}],"version-history":[{"count":11,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68930\/revisions"}],"predecessor-version":[{"id":68945,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68930\/revisions\/68945"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=68930"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=68930"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=68930"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}