{"id":53073,"date":"2015-01-09T20:52:08","date_gmt":"2015-01-10T01:52:08","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=53073"},"modified":"2015-01-09T21:05:59","modified_gmt":"2015-01-10T02:05:59","slug":"beware-of-shiny-objects","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2015\/01\/09\/beware-of-shiny-objects\/","title":{"rendered":"Beware of Shiny Objects!&#8230;"},"content":{"rendered":"\n<p align=\"justify\" class=\"small\">During my forty years of an active medical career, I don&#8217;t recall thinking about the Food and Drug Administration [FDA] or, for that matter, the Clinical Trials of medications &#8211; even though they became obligatory about the same time I started medical school [1962] in the wake of the Thalidomide problem. Whenever there was a new drug I wasn&#8217;t familiar with, I opened the PDR and read the efficacy and adverse effects sections, assuming they were accurate. I generally stayed on the &quot;trailing edge&quot; of new drugs, preferring the familiarity of experience to &quot;the latest.&quot; And, to be honest, my own prescribing from the late 1970s through retirement was minimal. Had there been an exam on the FDA approval process, I would&#8217;ve flunked it. That said, I&#8217;ve always been a medical literature junkie, but my reading has been focused on the things I was actually doing &#8211; and psychopharmacology wasn&#8217;t it. So there has been a lot of catching up to do in the last few years.<\/p>\n<p align=\"justify\" class=\"small\">The idea of Randomized Clinical Trials [RCTs] for testing drugs makes perfect intuitive sense, particularly in psychiatry where the outcomes are subjective responses measured by standardized rating scales. Start with an <em><font color=\"#200020\">a priori<\/font><\/em> protocol describing the conduct of the whole study in detail &#8211; including the outcome variables, the analytic techniques, and criteria for the conclusions &#8211; and the trial should run itself. But looking at the process now fifty years later, things are anything but that simple. The story is one of recurrent regulatory reform to tighten the process countered by the creative exploitation of loopholes &#8211; a high stakes game played on the tables of medicine. And like any such gambling enterprise, it hinges on holding one&#8217;s cards <em>close to the chest<\/em> &#8211; on secrecy.      <\/p>\n<div align=\"justify\" class=\"small\">The idea of Clinical Trial Registration again makes perfect intuitive sense. If we know about the trial, its parameters, the changes along the way, and the results &#8211; how could it be jury-rigged? In <em>oh so many ways<\/em> is the answer. One way that has been front and center is to just skip the posting of results. There was no provision for enforcement, so the trialists just didn&#8217;t do it &#8211; shown in report after report. They just didn&#8217;t do it, so <u>finally<\/u> on to the next reform [see  <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/12\/eyes-wide-shut-open-i\/\">eyes wide <strike>shut<\/strike> open I&hellip;<\/a>, <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/12\/eyes-wide-shut-open-ii\/\">eyes wide <strike>shut<\/strike> open II&hellip;<\/a>, <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/13\/eyes-wide-shut-open-iii\/\">eyes wide <strike>shut<\/strike> open III&hellip;<\/a>, <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2012\/09\/13\/eyes-wide-shut-open-iv\/\">eyes wide <strike>shut<\/strike> open IV&hellip;<\/a>, and <a href=\"http:\/\/1boringoldman.com\/index.php\/2014\/11\/23\/promises-promises\/\" target=\"_blank\">promises, promises&hellip;<\/a>]. This is the NIH\/FDA call for commentary [see <a href=\"http:\/\/directorsblog.nih.gov\/2014\/11\/19\/honoring-our-promise-clinical-trial-data-sharing-2\/\" target=\"_blank\">Honoring Our Promise: Clinical Trial Data Sharing<\/a>]:      <\/div>\n<blockquote>\n<div align=\"center\" class=\"big\"><a href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMsr1414226\" target=\"_blank\">The Proposed Rule for U.S. Clinical Trial Registration and Results Submission<\/a><\/div>\n<div align=\"center\" class=\"small\">by Deborah A. Zarin, M.D., Tony Tse, Ph.D., and Jerry Sheehan, M.S.<\/div>\n<div align=\"center\" class=\"middle\"><strong><font color=\"#100010\">New England Journal of Medicine.<\/font><\/strong> 2015  372:174-180.<\/div>\n<div align=\"center\" class=\"middle\">[<a href=\"http:\/\/www.nejm.org\/doi\/full\/10.1056\/NEJMsr1414226\" target=\"_blank\">full text on-line<\/a>]<\/div>\n<p>               <\/p>\n<div align=\"justify\">Broad  access to information about clinical trials and their findings is  critical for advancing medicine, promoting public health, and fulfilling  ethical obligations to human volunteers.  Traditional methods of information dissemination [e.g., presentations  and publication] may nevertheless leave distortions and gaps in the  knowledge base because the results of many trials are not published. Title VIII of the Food and Drug Administration [FDA] Amendments Act of 2007 [FDAAA]  addressed some of these concerns by requiring the registration and  submission of summary results information to ClinicalTrials.gov for  certain clinical trials of drugs [including biologic products] and  devices. The Department of Health and Human Services [HHS] recently  published for public comment a proposed rule [or &ldquo;Notice of Proposed  Rulemaking [NPRM] for Clinical Trials Registration and Results  Submission&rdquo;]  to clarify and expand [as permitted] the FDAAA requirements and  ultimately facilitate compliance with the law. Separately, and in  keeping with a long-standing principle that systematic dissemination of  results is a critical step in realizing the value of the research  investment, the National Institutes of Health [NIH] has issued a draft policy for  public comment to promote registration and results submission to  ClinicalTrials.gov.  This policy is proposed to cover all NIH-funded clinical trials,  regardless of study phase, type of intervention, or whether they are  subject to the FDAAA requirements.<\/div>\n<\/blockquote>\n<div align=\"center\"><img loading=\"lazy\" decoding=\"async\" width=\"520\" height=\"296\" border=\"1\" src=\"http:\/\/1boringoldman.com\/images\/ctg-1.jpg\" \/><\/div>\n<p align=\"center\"><img loading=\"lazy\" decoding=\"async\" width=\"520\" height=\"340\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/ctg-1.gif\" \/><\/p>\n<div align=\"justify\" class=\"small\">I&#8217;ve already had a say about my own response letter [<a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2015\/01\/01\/why-data-transparency-i\/\">why data transparency? I&hellip;<\/a>, <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2015\/01\/01\/why-data-transparency-ii\/\">why data transparency? II&hellip;<\/a>, and <a target=\"_blank\" href=\"http:\/\/1boringoldman.com\/index.php\/2015\/01\/01\/why-data-transparency-iii\/\">why data transparency? III&hellip;<\/a>] after waiting for a new clinical trial to be published to use as an example. And I found one [<a href=\"http:\/\/alert.psychnews.org\/2014\/12\/study-finds-olanzapine-fluoxetine-combo.html?utm_source=feedburner&#038;utm_medium=feed&#038;utm_campaign=Feed%3A+PsychiatricNewsAlert+%28Psychiatric+News+Alert%29\" target=\"_blank\">Study Finds Olanzapine-Fluoxetine Combo Superior to Placebo for Bipolar Disorder in Children<\/a>]. But I have a couple of other comments:<\/div>\n<ul><span class=\"small\">    <\/p>\n<li>\n<div align=\"justify\"><em><font color=\"#200020\">As intuitive as RTCs seem, even when they&#8217;re run and published in a pristine manner, they are anything but a gold standard for measuring the effectiveness or the safety of a drug or device. They&#8217;re short term. The subjects are carefully picked and more closely watched than in clinical practice. They are capable of detecting significant differences that are well below the threshold of clinical relevance. And particularly in the domain of adverse events, their <strong><font color=\"#660033\">getting on first<\/font><\/strong> results are often interpreted as <strong><font color=\"#660033\">a home run<\/font><\/strong>. And they have offered a conduit for some of the most egregious deceit in the history of medicine. For my money, the best treatise on this topic remains David Healy&#8217;s <a href=\"http:\/\/davidhealy.org\/books\/pharmageddon-is-the-story-of-a-tragedy\/\" target=\"_blank\"><font color=\"#990000\">Pharmageddon<\/font><\/a>.<\/font><\/em><\/div>\n<\/li>\n<li>\n<div align=\"justify\"><em><font color=\"#200020\">The Results Database is a summary tool, not full Data Transparency. It can be helpful in vetting a Clinical Trial, particularly if the verbatim protocol is available. Many of the techniques used to distort results in published papers rely on the HARK technique [Hypothesis After Results Known] &#8211; poring over the numbers looking for something significant after the fact. But the more subtle techniques that play with data display or analysis can be buried in the summary just as in the published material. So it can be considered a step forward, but it doesn&#8217;t replace the kind of Data Transparency we really want &#8211; the raw data prior to <\/font><\/em><em><font color=\"#200020\"><em><font color=\"#200020\"><strong>any<\/strong><\/font><\/em> opportunity for manipulation [emphasis on <strong>any<\/strong>].<\/font><\/em><\/div>\n<\/li>\n<p> <\/span><\/ul>\n<div align=\"justify\" class=\"small\">So I&#8217;m glad to see the NIH and FDA working on this, and particularly with their adding enforcement with punishment, but the operative message after fifty years of history is <strong><font color=\"#200020\">Beware of Shiny Objects!<\/font><\/strong><\/div>\n<div align=\"center\" class=\"small\"><img decoding=\"async\" width=\"120\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/shine.gif\" \/>&nbsp;<\/div>\n","protected":false},"excerpt":{"rendered":"<p>During my forty years of an active medical career, I don&#8217;t recall thinking about the Food and Drug Administration [FDA] or, for that matter, the Clinical Trials of medications &#8211; even though they became obligatory about the same time I started medical school [1962] in the wake of the Thalidomide problem. Whenever there was a [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-53073","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/53073","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=53073"}],"version-history":[{"count":29,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/53073\/revisions"}],"predecessor-version":[{"id":53102,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/53073\/revisions\/53102"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=53073"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=53073"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=53073"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}