about “All”…

Posted on Monday 16 June 2014

As many of you are aware, the back and forth between David Healy, Ben Goldacre of AllTrials, and Tracey Brown of Sense about Science continues [Sense about Science: Follow the Rhetoric, Sense about Science: First Admit no Harm, Sense about Science: Follow the Lawsuit, and their respective comments]. There are many issues in contention, not the least of which is the place of GSK’s signing up to AllTrials [Healy: a Trojan Horse vs. AllTrials: a valuable ally – a 180° polarity]. In the spaces, of his last post, there’s a link to a transcript of the House of Commons Science and Technology Committee from May 2013 where Tracey Brown testified. A piece of it is posted as a Word Document and the whole transcript is on-line. Just for temporal context, the GSK $3 B suit settled in July 2012; AllTrials was launched  in January 2013; and GSK signed on to AllTrials in February 2013:

    Chair: So you are arguing in favour of full release of information. What impact do you think that would have on the pharmaceutical industry?

    Tracey Brown: When you say full release of information, I should just clarify that. It is helpful to think of this at four levels. One is the registration of trials; that is level 1. That has been a problem, certainly historically, although there have been some improvements since the 2007 FDA regulations and other interventions. We do not even have the contents list, if you like, of what has been done, never mind being able to track down some of the results. That is something that reviewers who are looking across a whole range of studies really struggle with; they spend a lot of time just trying to find out what has actually been done but been left in a cupboard somewhere. Registration is about knowing what the trial is for and registering the protocols.

    The second level of information, which is what AllTrials is calling for, is the basic summary of the clinical study report. That says what was actually found, what the primary outcomes were and what the protocols were. We would like to see as much information there as possible, but that certainly gives you some indication of what research has been done and how it has been undertaken.

    The area for quite a lot of discussion at the moment is what I would call level 3, which is the full clinical study report. That contains in many cases quite a lot. It is a very large report-quite often, it even runs to thousands of pages-and it may contain quite a lot of individual patient data, things that might be tracked to individual patients or other things that constitute reasons why people might be concerned. There is a discussion about the release of those. I just note that we are seeing their release by the European Medicines Agency already for those drugs that they have them for.

    Then there is the fourth level, which is individual patient data. A lot of very productive discussion is going on about how to establish good protocols for sharing that among the research community-for example, setting out the same requirements for secondary research as you would for primary research, looking at the same data…

    Pamela Nash: Ms Brown, just to be clear, is the aim of the AllTrials campaign to have all four levels published?

    Tracey Brown: No, the aim of the AllTrials campaign is to ensure that levels 1 and 2 are published. Levels 1 and 2 do not have a huge amount of practical implication. It’s just a shocker that they are not published already. Levels 3 and 4-level 4 particularly has a certain practical implication, depending on the organisation. The requirements of level 3 – what would be an equivalent to a clinical study report; there are such things, but for an academic, for example-just need to be ironed out and worked on. It is not a huge barrier to publishing that information. There is quite important information at level 3 about serious adverse events, for example, that may need to be shared, but that just takes a little more work and thinking about.

    We are really pleased that, in signing up to AllTrials, GlaxoSmithKline, for example, committed to publishing a lot of their level 3 data. Obviously, we are going to look at what they encounter in doing that. That is an ongoing discussion with them. A lot of the people who have signed up to AllTrials are committed to that, too, but what we want to do is just to get past the idea that secrecy is okay. That is really the ultimate aim ofAllTrials. It is just to find out what people have done and what they have found, at a very basic level, and then we can go on to look at some of the implications of sharing that…

Having made this division of four levels, the Committee members repeatedly try to clarify exactly what AllTrials is asking for, and each exchange is confusing, at least to me. I can see why Healy flagged this transcript because it goes from not-much-at-all to some to another not-much to confusing. I’d recommend reading the whole transcript to see if you can make sense of it. The other worrisome thing is that "GlaxoSmithKline, for example, committed to publishing a lot of their level 3 data. Obviously, we are going to look at what they encounter in doing that. That is an ongoing discussion with them." What is it about the word "All" [in "AllTrials"] that says anything about negotiations or ongoing discussions? This is just another version of selective publication – which is the very thing AllTrials is setting out to abolish. At least that’s what  we all  I thought. Admittedly, this testimony is from last year, and this scene has been repeatedly rewritten, but I’ve had some version of the same worries myself. It’s the reason I went all obsessive about the abbreviations [in the details…, achilles’ heel…, the wrong compromise…].

I don’t trust PHARMA, period. Besides the string of regular misbehavior with Clinical Trial Data reaching back over the last two decades, there’s been an aggressive campaign to undermine Data Transparency in the recent past:

In the 11th hour, we learned that the settlement with AbbVie made extensive changes in the EMA policy [the U Turn], and now in this piece we read that GSK didn’t sign on to the AllTrials that I originally knew, but negotiated their way on by specifying what they would and would not reveal. That’s why I don’t trust PHARMA. There’s always another part of the story that we may or may not find out about. There is no incentive for PHARMA to do the right thing and every incentive for them not to. Which is why I say repeatedly, they have no place at the table when it comes to Data Transparency. I would warn once again that the "devil is in the details." In evaluating any proposal, make no assumptions about the meaning of any term like CSR [Clinical Study Report] or even Full Clinical Study Report. These are not rigidly defined terms and there’s a lot of variability possible. To try your patience, once again, the things needed for a full analysis are:

  • the a priori protocol with all legitimate ammendments;
  • the raw data tables abstracted before the blind is broken [with the unblinding key];
  • access to the original CRFs to check the AEs;
which is what the sponsor/author receives when the blind is broken. The later narratives and summaries in the CSRs are vulnerable to H.A.R.K. [hypothesis after results known] AKA "spin"…
  1.  
    Paul Scott
    June 17, 2014 | 12:45 AM
     

    I also found that transcript worthy of more comment than it received.

  2.  
    June 17, 2014 | 4:55 AM
     

    “That is really the ultimate aim ofAllTrials. It is just to find out what people have done and what they have found, at a very basic level, and then we can go on to look at some of the implications of sharing that.”

    Interesting.

    Why stop at basic levels?

    Moreover, why feel implicated at sharing such ‘basic’ information?

    I’m confused?

    Was this a negotiation between AllTrials and GlaxoSmithKline, if so, who were those that negotiated? Was it GSK employees or just a bunch of attorneys?

    “GlaxoSmithKline, for example, committed to publishing a lot of their level 3 data. Obviously, we are going to look at what they encounter in doing that. That is an ongoing discussion with them.”

    Define ‘discussion’. Face to face meetings or emails back and forth?

    Again, name names. Who will be those involved in ‘discussions’?

    It’s quite vague, which is kind of ironic given that ‘transparency’ is being aired here.

    I think the word transparency has been loosely thrown around here to make it look like GSK are doing the right thing. In reality they are being more transparent than what they have been in the past but they are merely opening a magician’s can of worms. We, the public, can see inside the can but we can’t see the worms hidden in the secret compartment.

    I find it bizarre why AllTrials would allow a company on board who are currently facing bribery and fraud allegations across Europe and Asia and birth defect lawsuits across America. I think this is the question that needs to be addressed. Exactly what is the position of AllTrials on these allegations and why don’t they wait until these allegations have been proven/unproven… or in the case of GlaxoSmithKline, settled out-of-court with no admission of guilt.

  3.  
    June 17, 2014 | 2:58 PM
     

    The basic, or summary, levels mean nothing without being able to scrutinize the detail levels.

  4.  
    Jeff C
    June 17, 2014 | 10:52 PM
     

    Bob Fiddaman wrote:

    “I find it bizarre why AllTrials would allow a company on board who are currently facing bribery and fraud allegations across Europe and Asia and birth defect lawsuits across America.”

    You are right it is bizzare unless the intent of AllTrials all along was to provide the illusion of transparency rather than true reform.

    John Stone has long covered Goldacre’s role in the MMR controversy over at Age of Autism. Based on Goldacre’s past he seemed an unlikely crusader to clean up pharma. Those of us that have long followed vaccine safety know pharma suppresses adverse reaction information and Goldacre has been part of the problem not the solution. We aren’t surprised at how things have ended up here.

    http://www.ageofautism.com/2010/08/whats-behind-ben-goldacre-.html#more

  5.  
    June 19, 2014 | 10:44 PM
     

    Really enjoy reading your posts on the Alltrials data transparency debacle, and Dr Healy’s also. I can’t help but imagine Ben Goldacre as a kind of Icarus figure, infused with Hubris and naivety, and yourself and Dr Healy as Wise elders shaking your heads at his antics, and in turn being highly aware how catastrophic his actions will be if he fails to take heed of the obvious warnings and signs…

    For the sake of patients I sincerely hope that Ben Goldacre is playing GSK and not the other way around… but so far my hopes of that have not looked promising….

    Ben should really listen to yourself and Healy, he is being very unwise…

    Furthermore, I have never understood why he seems to think that Pharma should be given a place at the negotiating table either…

    They just simply cannot be trusted, and should be treated like the slippery animals that we all know them to be….

Sorry, the comment form is closed at this time.