{"id":58173,"date":"2015-07-01T16:20:43","date_gmt":"2015-07-01T20:20:43","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=58173"},"modified":"2015-07-02T01:16:34","modified_gmt":"2015-07-02T05:16:34","slug":"a-priori","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2015\/07\/01\/a-priori\/","title":{"rendered":"<em>a priori<\/em>&#8230;"},"content":{"rendered":"\n<p align=\"center\"><img decoding=\"async\" height=\"80\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/ema.gif\" \/><\/p>\n<div align=\"justify\" class=\"small\">The European Medicines Agency&#8217;s Data Transparency policy has made many twists and turns along the way &#8211; so many that I summarized them with a timeline last October to serve as a placemarker for the day when the implementation was released. That <a href=\"http:\/\/1boringoldman.com\/index.php\/ema-data-transparency\/\" target=\"_blank\"><font color=\"#0033ff\">Timeline<\/font><\/a> is available for review. Tom Jefferson has reported on their recent <em>2+ hour<\/em> progress update <a href=\"https:\/\/www.youtube.com\/watch?t=47&#038;v=TjmsJzVlkFg\" target=\"_blank\">Webinar<\/a> in a couple of BMJ blogs &#8211; <em>mercifully<\/em> short and very clear. By my read, the news is good:<\/div>\n<blockquote>\n<div align=\"center\" class=\"big\"><a href=\"http:\/\/blogs.bmj.com\/bmj\/2015\/06\/30\/tom-jefferson-the-ema-revolution-gathers-pace\/\" target=\"_blank\">The EMA revolution gathers pace<\/a><\/div>\n<div align=\"center\" class=\"big\"><strong><font color=\"#0033ff\">BMJ Blogs<\/font><\/strong><\/div>\n<div align=\"center\" class=\"middle\">by Tom Jefferson<\/div>\n<div align=\"center\" class=\"small\">30 Jun, 15<\/div>\n<div align=\"center\" class=\"middle\">[<a href=\"http:\/\/blogs.bmj.com\/bmj\/2015\/06\/30\/tom-jefferson-the-ema-revolution-gathers-pace\/\" target=\"_blank\">full text on-line<\/a>]<\/div>\n<\/blockquote>\n<blockquote>\n<div align=\"center\" class=\"big\"><a href=\"http:\/\/blogs.bmj.com\/bmj\/2015\/06\/30\/tom-jefferson-are-we-ready-for-the-ema-revolution\/\" target=\"_blank\">Are we ready for the EMA revolution?<\/a><\/div>\n<div align=\"center\" class=\"big\"><strong><font color=\"#0033ff\">BMJ Blogs<\/font><\/strong><\/div>\n<div align=\"center\" class=\"middle\">by Tom Jefferson<\/div>\n<div align=\"center\" class=\"small\">30 Jun, 15<\/div>\n<div align=\"center\" class=\"middle\">[<a href=\"http:\/\/blogs.bmj.com\/bmj\/2015\/06\/30\/tom-jefferson-are-we-ready-for-the-ema-revolution\/\" target=\"_blank\">full text on-line<\/a>]<\/div>\n<\/blockquote>\n<div align=\"justify\" class=\"small\">For twenty five years, industry funded RCTs flooded the psychiatric literature, many grossly distorted &#8211; creating an illusion of safety and efficacy that produced billions of dollars in revenue for the pharmaceutical industry. There was no way to check those reports, because the actual data was a secret kept by the companies who financed the trials and sold the drugs. And so there was a major campaign to get that raw data into the public domain where it could be independently analyzed. The EMA lead the way vowing to make it available, in fits and starts, as outlined in the <a href=\"http:\/\/1boringoldman.com\/index.php\/ema-data-transparency\/\" target=\"_blank\"><font color=\"#0033ff\">Timeline<\/font><\/a>.      <\/div>\n<p align=\"justify\" class=\"small\">But be careful what you ask for. You might just get it. There are literally thousands of pages with each RCT. I&#8217;ve spent the last year and a half working on just one trial and it&#8217;s a maddening exercise, bouncing around in these documents looking for elusive needles among the hay. So how this data is presented and cataloged is as important as its availability. Tom&#8217;s blogs are about how the EMA is going to implement Phase I of their roll-out [the operative saying being, &quot;the devil&#8217;s in the details&quot;]. Here&#8217;s my monotonous graphic, updated to fit the new EMA proposals:<\/p>\n<p align=\"center\"><img loading=\"lazy\" decoding=\"async\" width=\"347\" height=\"285\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/clinical-trial-8.gif\" \/><\/p>\n<div align=\"justify\" class=\"small\">There are many ways to subtly distort to results of a clinical trial without committing actual fraud. The consensus is that having the raw data for a complete reanalysis is the only preventive. What are the essential pieces necessary? First, the investigator needs to specify in detail exactly how the study will be conducted; how the data will be collected; how it will be analyzed; and what criteria will be used to judge the results. All of this needs to be specified in advance. Anyone who has ever done a study knows that once you have the results, you can massage the data and make it say all sorts of things. So the <strong>PROTOCOL<\/strong> and the <strong>SAP<\/strong> [Statistical Analysis Plan] need to be prepared before the study begins [<em>a priori<\/em>]:<\/div>\n<ul>\n<div align=\"justify class=small\"><strong><font color=\"#660033\">a pri&middot;o&middot;ri&nbsp; <\/font><\/strong><font color=\"#200020\">[&auml;&prime; pr&euml;-&ocirc;r&prime;&euml;]<\/font><\/div>\n<div class=\"small\"><em><font color=\"#200020\">adj.<\/font><\/em><\/div>\n<ol><span class=\"small\"><font color=\"#200020\">                     <\/p>\n<li>\n<div align=\"justify\">from a general law to a particular instance;<br \/>              valid independently of observation.<\/div>\n<\/li>\n<li>\n<div align=\"justify\">existing in the mind independent of experience.<\/div>\n<\/li>\n<li>\n<div align=\"justify\"><strong><font color=\"#660033\">conceived beforehand<\/font><\/strong>.<\/div>\n<\/li>\n<p>              <\/font><\/span><\/ol>\n<\/ul>\n<div align=\"justify\" class=\"small\">Phase I plans to make the <strong>CSR<\/strong> [Clinical Study Report] available promptly after any regulatory action by the EMA. The reason I say it &quot;looks good&quot; is that they specify what&#8217;s in the <strong>CSR<\/strong>:<\/div>\n<blockquote>\n<div align=\"justify\">Phase 1 covers the release of clinical overviews [Module 2.5 in regulatory speak], clinical summaries [Module 2.7], and the all important <strong><font color=\"#660033\">clinical study reports [CSRs]<\/font><\/strong>. CSRs will include <strong><font color=\"#660033\">the main body<\/font><\/strong> [a sort of IMRAD style document], the <strong><font color=\"#660033\">trial protocol <\/font><\/strong>with its <strong><font color=\"#660033\">dated amendments<\/font><\/strong>, <strong><font color=\"#660033\">blank (or sample) case report forms [CRFs]<\/font><\/strong>, and <strong><font color=\"#660033\">the statistical analysis plan or SAP<\/font><\/strong> [appendices]. See this <a target=\"_blank\" href=\"http:\/\/bmjopen.bmj.com\/content\/3\/2\/e002496.full\">exploratory review<\/a> for a description of each cited document.  <\/div>\n<p>  <\/p>\n<div align=\"justify\">The value of these documents available at the click of a button to a researcher is difficult to overplay. For example, Module 2.5 contains a complete description of the manufacturer&rsquo;s trial programme. For those of us who laboured for six months to reconstruct trial programmes, cross-referencing fragments of information from disparate sources, this is the honey pot served on a plate. <a target=\"_blank\" href=\"http:\/\/bmjopen.bmj.com\/content\/3\/2\/e002496.full\">CSRs<\/a> are the most detailed accounts of the <strong><font color=\"#660033\">setting up<\/font><\/strong>, <strong><font color=\"#660033\">conduct<\/font><\/strong>, and <strong><font color=\"#660033\">analyses<\/font><\/strong> of trials on pharmaceuticals by their sponsors.<\/div>\n<\/blockquote>\n<div align=\"justify\" class=\"small\">The original offerings as the companies began to realize that they were going to have to go along with transparency was to make the <strong><font color=\"#660033\">CSR<\/font><\/strong>s available. It&#8217;s an extensive write-up on the study in narrative form with the results. The problem was that what was in those reports wasn&#8217;t specified. And in practice, the distortions and obfuscations that appeared in the articles could be just as easily put into the <strong><font color=\"#660033\">CSR<\/font><\/strong>. With the &quot;<em><strong><font color=\"#660033\">trial protocol <\/font><\/strong>with its <strong><font color=\"#660033\">dated amendments<\/font><\/strong>, <strong><font color=\"#660033\">blank [or sample] case report forms [CRFs]<\/font><\/strong>, and <strong><font color=\"#660033\">the statistical analysis plan or SAP<\/font><\/strong> [appendices]<\/em>&quot; specified, one has everything needed to check to see if the <em>a priori<\/em> defined study is the one they are reporting. This information will be available within 60 days of a drug approval and they have a reasonable process to manage redactions. The only things missing are the raw <strong><font color=\"#660033\">CRF<\/font><\/strong>s and the <strong><font color=\"#660033\">IPD<\/font><\/strong>s [tables of individual results]. That will be in Phase II. The CRFs would be required for a thorough vetting of the Adverse Events and the IPDs to actually repeat the statistical analyses. But otherwise, the available material would put someone looking into a study close to par with the regulators. Says Tom Jefferson [in the second blog]:  <\/div>\n<blockquote>\n<div align=\"justify\">The radical nature of the EMA&rsquo;s policy lies in its offer of routine  access to full clinical study reports [CSRs] with [hopefully] minimal  redactions just a few days after drug approval [or rejection]. CSRs  offer us the possibility of delving into and cross checking all aspects  of trials: from protocol to informed consent forms, from intended  analysis methods to those which were actually used, to templates for  participant data collection. Some other aspects of the policy and its  implementation are revolutionary, such as access to CSRs of drugs that  did not make it to the European market. The thousands of pages provide a hitherto rarely tapped bonanza of  detail and the possibility to address reporting bias &mdash; the biggest threat  to contemporary, ethical research synthesis.<\/div>\n<\/blockquote>\n<div align=\"justify\" class=\"small\">Tom addresses several implications of this &quot;revolution&quot; in the second blog which I&#8217;ll leave for you to read&nbsp; on your own except for one. <em><font color=\"#200020\">What about the FDA?<\/font><\/em> <\/div>\n<blockquote>\n<div align=\"justify\">Regulators will also be in a difficult position, with the Food and Drug  Administration [FDA] left looking like a stranded whale wrapped in a  sort of pre-New Deal commercial secrecy isolationism.&nbsp;The FDA does not  release CSRs and the public can only access FDA reviews of the market  authorisation application [which it calls NDAs or new drug  applications]. These, like all reviews, do not tell you everything about  all the trials in the programme, but represent the FDA&rsquo;s take on the  one or two pivotal trials that regulators looked at in depth with  sponsors&rsquo; agreement. We tried to reconstruct a CSR narrative with  sufficient detail to allow full appraisal from FDA medical officers  reviews [MORs] in our neuraminidase inhibitors review. We failed  completely because of a lack of sufficient information in the MOR and  other documents available from <a href=\"http:\/\/www.accessdata.fda.gov\/scripts\/cder\/drugsatfda\/\" target=\"_blank\">Drugs@FDA<\/a>.  Use of FDA MORs&nbsp;instead of full CSRs risks swapping one incomplete  source [journal articles] for another [FDA reviewers&rsquo; comments].<\/div>\n<\/blockquote>\n<div align=\"justify\" class=\"small\">When I first started looking into clinical trials and discovered Drugs@FDA and the NDAs, I was pretty impressed. I could find out things that went beyond just looking at the journal articles. I submitted a few FOIA requests, and fairly quickly received a disc with what I was looking for. But those early explorations were of drugs that had been approved a long time ago. And Dr. Jefferson&#8217;s right, what you get depends on the reviewer. When I tried to look at more recent drugs, things were less smooth. For one of the last requests I submitted, I got a call from the FDA and the lady tried to talk me out of making the request in the first place. When I refused and asked her how long it would take, she said about two years [that was three years ago] and I never heard from them again. As he says, they&#8217;re going to look pretty foolish continuing to keep the PHARMA data secret when the EMA is being so transparent.<\/div>\n","protected":false},"excerpt":{"rendered":"<p>The European Medicines Agency&#8217;s Data Transparency policy has made many twists and turns along the way &#8211; so many that I summarized them with a timeline last October to serve as a placemarker for the day when the implementation was released. That Timeline is available for review. Tom Jefferson has reported on their recent 2+ [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-58173","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/58173","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=58173"}],"version-history":[{"count":36,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/58173\/revisions"}],"predecessor-version":[{"id":58210,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/58173\/revisions\/58210"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=58173"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=58173"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=58173"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}