the making of « wolf alert! wolf alert!… » part 2

Posted on Monday 11 April 2016

I hope I got across in the making of « wolf alert! wolf alert!… » part 1 that I think ClinicalTrials.gov is a good idea, and that putting it in the center of a system aiming towards appropriate Data Transparency is a good idea too, but that it needs some heavy tweaking before it will actually work. First, obviously, it needs to be used in a timely manner and that usage enforced. That part seems easy. No registration, no consideration for publication or regulatory approval. No Results posting, no consideration for publication or regulatory approval. No exceptions. Next, the a priori Protocol and Statistical Analysis Plan must be declared [in ClinicalTrials.gov] before the study starts and those results shown in the Results Database. If some investigator or sponsor wants to switch or add outcomes or methodologies in the published version, that’s their prerogative, but only if they also show us the results of their original plans. They can make their case in the paper, not behind closed doors. No exceptions.  At least that’s what I think. There are many opinions about whether the investigators should be held to their original choice of outcome variables and statistical methods. But there’s no controversy in my mind about secrecy. We need to hear what they thought a priori no matter what they decide after the study was underway or post hoc. No exceptions.

And now for a slight change in direction, what about the actual, rather than the summary data? Here’s what others think: From the National Academy’s Institute of Medicine COMMITTEE ON STRATEGIES FOR RESPONSIBLE SHARING OF CLINICAL TRIAL DATA come two very long policy documents…
and the International Committee of Medical Journal Editors, adds a more forgiving single pager…
The first two are tomes. I scanned them and I doubt they are much read; however, the one from ICMJE is short and a definite must read document. Here’s the central message:
by Darren B. Taichman, Joyce Backus, Christopher Baethge, Howard Bauchner, Peter W. de Leeuw, Jeffrey M. Drazen, John Fletcher, Frank A. Frizelle, Trish Groves, Abraham Haileamlak, Astrid James, Christine Laine, Larry Peiperl, Anja Pinborg, Peush Sahni, Sinan Wu
PLOS. Published on January 20, 2016

Note: This editorial is being published simultaneously in Annals of Internal Medicine, British Medical Journal, Canadian Medical Association Journal, Chinese Medical Journal, Deutsches Ärzteblatt (German Medical Journal), Ethiopian Journal of Health Sciences, JAMA (Journal of the American Medical Association), Nederlands Tijdschrift voor Geneeskunde (The Dutch Medical Journal), New England Journal of Medicine, New Zealand Medical Journal, PLOS Medicine, Revista Médica de Chile, The Lancet, and Ugeskrift for Laeger (Danish Medical Journal).

… As a condition of consideration for publication of a clinical trial report in our member journals, the ICMJE proposes to require authors to share with others the deidentified individual-patient data [IPD] underlying the results presented in the article [including tables, figures, and appendices or supplementary material] no later than 6 months after publication. The data underlying the results are defined as the IPD required to reproduce the article’s findings, including necessary metadata. This requirement will go into effect for clinical trials that begin to enroll participants beginning 1 year after the ICMJE adopts its data-sharing requirements.

Enabling responsible data sharing is a major endeavor that will affect the fabric of how clinical trials are planned and conducted and how their data are used. By changing the requirements of the manuscripts we will consider for publication in our journals, editors can help foster this endeavor. As editors, our direct influence is logically, and practically, limited to those data underpinning the results and analyses we publish in our journals.

The ICMJE also proposes to require that authors include a plan for data sharing as a component of clinical trial registration. This plan must include where the researchers will house the data and, if not in a public repository, the mechanism by which they will provide others access to the data, as well as other data-sharing plan elements outlined in the 2015 Institute of Medicine Report [e.g., whether data will be freely available to anyone upon request or only after application to and approval by a learned intermediary, whether a data use agreement will be required] [1]. ClinicalTrials.gov has added an element to its registration platform to collect data-sharing plans. We encourage other trial registries to similarly incorporate mechanisms for the registration of data-sharing plans. Trialists who want to publish in ICMJE member journals [or nonmember journals that choose to follow these recommendations] should choose a registry that includes a data-sharing plan element as a specified registry item or allows for its entry as a free-text statement in a miscellaneous registry field. As a condition of consideration for publication in our member journals, authors will be required to include a description of the data-sharing plan in the submitted manuscript. Authors may choose to share the deidentified IPD underlying the results presented in the article under less restrictive, but not more restrictive, conditions than were indicated in the registered data-sharing plan…

Data sharing is a shared responsibility. Editors of individual journals can help foster data sharing by changing the requirements of the manuscripts they will consider for publication in their journals. Funders and sponsors of clinical trials are in a position to support and ensure adherence to IPD sharing obligations. If journal editors become aware that IPD sharing obligations are not being met, they may choose to request additional information; to publish an expression of concern; to notify the sponsors, funders, or institutions; or in certain cases, to retract the publication…
I don’t personally think the behavior of the sponsors of Clinical Trials have earned the right to get as much consideration as they’re being given in these reports. The scientific misbehavior in Clinical Trial reporting, particularly in psychiatry, has been rampant rather than subtle, so I would’ve stonewalled for more ease of access. That being said, if this plan is put into action and actually enforced, it will do. But the enforcement paragraph is too weak as it stands. How about, if they don’t comply, publish a retraction notice and annotate ClinicalTrials.gov? How about, if they don’t live up to their agreement, put sponsor and authors on a no further acceptance until… list? So I’ve pushed the wolf in sheep’s clothing down one more rung. I promise  the making of « wolf alert! wolf alert!… » part 3 will have no more introductory remarks…

Sorry, the comment form is closed at this time.