{"id":68098,"date":"2016-09-21T20:19:46","date_gmt":"2016-09-22T00:19:46","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=68098"},"modified":"2016-09-21T20:27:54","modified_gmt":"2016-09-22T00:27:54","slug":"clinical-trials-visited-i","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2016\/09\/21\/clinical-trials-visited-i\/","title":{"rendered":"clinical trials visited again…"},"content":{"rendered":"
\n\n\n
\n
By all rights, the usual randomized clinical trial [RCT] of a medication ought to be relatively straightforward:<\/font><\/strong><\/em><\/sup><\/div>\n
    <\/p>\n
  1. \n
    Decide on the target population, the intervention arms of the study, and what outcome difference you would accept as clinically meaningful.<\/font><\/div>\n<\/li>\n
  2. \n
    Do the power computations to determine the study’s size.<\/font><\/div>\n<\/li>\n
  3. \n
    Preregister the study, declaring the Primary and Secondary Outcome Variables and the way they will be collected and analyzed.<\/font><\/div>\n<\/li>\n
  4. \n
    Begin the clinical trial, randomizing and blinding everyone.<\/font><\/div>\n<\/li>\n
  5. \n
    After the last subject completes the trial, break the blind and apply the [exact<\/u>] methods specified in 3.<\/font><\/div>\n<\/li>\n
  6. \n
    Post those results on the Registry.<\/font><\/div>\n<\/li>\n

    <\/strong><\/em><\/sup><\/ol>\n

    Some persist in arguing that 3. is too restrictive, that they should be able to change Outcomes or Analytic Methods in mid-stream before the blind is broken. First, the validity of the statistical methods depends on preregistration. And second, the track record of "outcome switching" being used to turn negative data into positive is too abysmal to even consider that argument. Preregistration is the only<\/u> way to insure against HARKing [hypothesis after results known], adapting variable choice and analytic method to get the desired result.<\/font><\/strong><\/em><\/sup><\/div>\n<\/td>\n<\/tr>\n<\/table>\n

    Building on a 1988 registry of HIV studies, in 1997 Congress created clinicaltrials.gov<\/a>, a public registry for clinical trials [see the history on Wikipedia<\/a> and clinicaltrials.gov<\/a>]. It prescribed the exact system described in the box above: preregistration of outcomes and analytic methods, and posting of the results prescribed before the outset of the trial. It is a [sort of<\/font><\/em>] user friendly structured online database, well designed for the task. I have no idea why it was created as part of the NIH instead of the FDA where it seemed most pertinent. But sadly, it has been a flop<\/font><\/em>. Because when it wasn’t being ignored, it was being abused. <\/p>\n

    Studies weren’t often preregistered, they were registered after the fact [sometimes after the study was completed]. The results database, due within one year of completion, was almost universally simply ignored.  Several attempts to strengthen the requirements had little or no impact. It was a great idea [see clinicaltrials.gov revisited…<\/a>], but it flopped because it needed  a cop<\/font><\/em>: <\/p>\n\n\n\n
    \n
    The 1boringoldman Doctrine
    <\/font><\/strong><\/em><\/div>\n
    <\/td>\n<\/tr>\n
    \n
    No reform of the clinical trials system will work if any<\/font><\/strong><\/em><\/sup> part of it relies on either ethical or voluntary compliance. The stakes are just too high. Clear legalistic rules with surveillance and predefined consequences are essential requirements.
    <\/font><\/strong><\/em><\/sup><\/div>\n<\/td>\n<\/tr>\n<\/table>\n

    There is, of course, a simple solution. Publish the a priori<\/font><\/em> Protocol<\/font>, the Statistical Analysis Plan<\/font>, and the raw data<\/font> as an online Addendum to the journal article. PHARMA has fought this solution with a vengeance arguing that it breaches Subject Privacy<\/font> and contains Confidential Commercial Information<\/font>. I think those are spurious arguments – a smoke screen. But so far they’ve been successful so Data Transparency is right now not the solution many of us hoped it might be. So where we’ve stood for a long time is that there are four potential versions of clinical trial results on FDA regulated drugs… <\/p>\n\n\n\n
    <\/td>\n<\/td>\n<\/td>\n<\/td>\n<\/tr>\n
    published
    journal article<\/sup><\/td>\n    		clinicaltrials.gov
    results database<\/sup><\/td>\n    		fda medical and
    statistical reviews<\/sup><\/td>\n    		raw data
    [IPD, CRF]
    <\/sup><\/td>\n<\/tr>\n<\/table>\n

    … but we have only gotten to see one of them – the published journal article<\/font><\/em>. Most sponsors neither registered a priori<\/em> nor even filled out the clinicaltrials.gov results database<\/font><\/em>. The fda medical and statistical reviews<\/font><\/em> are very slow in becoming public, if at all, and the raw data<\/font><\/em> itself is locked up in a safe in a place called PHARMA<\/font>. Singing the praises of Data Transparency<\/font><\/em>, PHARMA<\/font> reframed it as benevolent Data Sharing<\/font><\/em> for further research rather than checking for malfeasance, and offered a very restricted window for the persistent few who are willing the go through the process.<\/p>\n

    Fortunately the outrage has grown and the evidence of widespread data manipulation and corruption has accumulated to the point where people are beginning to call for action – including the NIH and the FDA! to be continued…<\/font><\/em><\/div>\n","protected":false},"excerpt":{"rendered":"

    By all rights, the usual randomized clinical trial [RCT] of a medication ought to be relatively straightforward: Decide on the target population, the intervention arms of the study, and what outcome difference you would accept as clinically meaningful. Do the power computations to determine the study’s size. Preregister the study, declaring the Primary and Secondary […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-68098","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68098","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=68098"}],"version-history":[{"count":32,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68098\/revisions"}],"predecessor-version":[{"id":68133,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/68098\/revisions\/68133"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=68098"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=68098"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=68098"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}