a mighty hard row…

Posted on Tuesday 17 May 2016

“…it has become standard practice for pharmaceutical companies to pay medical communication companies to write articles [based on industry-designed studies], for academic physicians to be paid to essentially sign off on the articles, and then for communication companies to place the articles in prestigious medical journals, a process known as “ghost management.” Ghost management has resulted in the selective and imbalanced reporting of clinical trial data in medical journals, which in turn has supported the marketing of expensive new drugs with questionable risk/benefit profiles.”

Under the Influence: The Interplay among Industry, Publishing, and Drug Regulation.
by Cosgrove, Vannoy, Mintzes, and Shaughnessy

Looking at the twelve year old Citalopram in Adolescence Study, the recent deconstruction, and the problems they had getting it published reminded me of another more contemporary article that I had wanted to return to. It was about the RCTs used to gain FDA Approval for Vortioxetine. I mentioned it earlier [see a couple of points…], but at the time it was only available as an abstract:

As you can see from the opening quote, this article is about a lot more than just the specific papers or even the FDA Approval, it’s about the perversion of the scientific process in the industry funded RCTs, what the authors call ghost management [AKA total commercial control of the trial process from design and registration through the drafting of the paper for publication]. Being reminded of this paper, I recalled that when I first came across it I contacted the authors to get a copy and was told that they too had had a very hard time getting it published. It’s in a lower impact journal and it’s not available from the publisher on-line [an expensive proposition unless it’s part of grant or you’re involved with a well-heeled corporation]. So I recontacted them to find out if they had written about their publishing problems, and they hadn’t. But they mentionedf that they were disappointed with the paper’s reception, as was I. It’s a really strong and well documented article. Thinking back about our experience with the Paxil Study 329 RIAT article, the recent Citalopram deconstruction article, this Vortioxetine paper, the papers about the Tamiflu re-evaluation, and countless others, it’s apparent that there’s a common theme. So I want to revisit this Vortioxetine article later [I’ve found a way to get to it on-line], but first, I’d like to frame the common theme that unites these papers.

I’ve always had kind of a problem with “ear worms.” I get some song in my mind that repeats in the background. If I think about it, usually I can figure out how it got there. I was out and about all day, and there it was – an old Woodie Guthrie song called Pastures of Plenty:

    It’s a mighty hard row that my poor hands have hoed
    My poor feet have traveled a hot dusty road
    Out of your Dust Bowl and Westward we rolled
    And your deserts were hot and your mountains were cold
    I worked in your orchards of peaches and prunes
    I slept on the ground in the light of the moon
    On the edge of the city you’ll see us and then
    We come with the dust and we go with the wind…
It had to do with thinking about this Cosgrove et al paper this morning before I set out on my errand-filled day. Okay – my unconscious might be overly dramatic, even histrionic, but it’s on the right track. It is a mighty hard row and it can be a largely thankless task. We sure paid the piper to get our Paxil Study 329 paper in print [as did the Tamiflu team]. We made it to a big journal and it was well received, but there were years of work by a number of people to bring the paper we reanalyzed to the forefront. Even with that, we were scrutinized like few other [see Restoring Study 329: The Path To Publication]. Jureidini et al were able to take advantage of a lot of antecedent legal work producing documentation, but still traveled that same mighty hard row [see background notes]. Cosgrove et al didn’t have any specific pre-emptory work  by others, so they were flying blind.

What unites these articles is obvious – the are contrarian. They say that somebody else’s work is wrong, and in these cases, wrong on purpose. They use that somebody-else’s data in reanalysis to reach a different, often opposite conclusion. They make a serious charge, so they deserve careful scrutiny sure enough. But in the case of all four articles, they’re not, primarily, opinion pieces. They’re data-based analyses that, by definition, render an opinion, but it’s an evidence-based opinion rather than speculative. Yet even after being subjected to a rigorous examination far exceeding that applied to the originals, they’re still hot potatoes. There’s obviously a fear of reprisal, legal challenges by the powerful sponsors of the originals. And there’s something else, the authors are under suspicion for having ulterior motives, conflicts of interest. The obvious commercial conflicts of interest in the originals are buried in small print, but the fact that the reanalysis articles are contrarian in and of itself seems grounds for such a charge.

And so to a few of the bumps along the mighty hard row for the authors of contrarian articles:

  • data collection:
    In each of these cases, just getting hold of the data was itself a daunting task, coming from reluctant sources in formats that made analysis difficult.
  • funding:
    This is largely unfunded research. If there is grant support, it’s often for the investigator without allowance for statistical or technical support, indirect costs, or publication expenses.
  • heightened standards:
    The burden of proof for contrarian articles is uniformly higher than for the originals. Likewise, requirements for freedom from conflicting interests are more stringent – more on the side of guilty until proven innocent.
  • opinion rather than science:
    Contrarian articles tend to be judged as opinions rather than scientific exploration – and biased opinion at that.
  • accessibility:
    Because they’re often in lower impact journals and have to rely on charity to be available online, they can get lost in an ivory tower or a dusty corner of the library either never catching the wind, or if they do, having a short hang time.
  • seen as deprivation : 
    While their intent is health promoting, they can be seen as taking away something.
  • no PR:
    They’re not necessarily picked up by the news media, mentioned on the business pages, or reviewed in the professional trade journals

This is hardly a comprehensive list, just something off the cuff. But I think it captures the fact that these are hard articles to write and hard articles to publish. But that’s just the beginning. Often, getting them into the public and professional discourse is a another uphill climb. And while it’s tempting to see the difficulties as coming from evil opposing forces, and I’m certain that complaint is often justified, it’s also not the whole story. Contrarian literature in science is like that all on its own. We want to hear about breakthroughs, not breakdowns. That’s just the nature of things.

So now onto the skipped-over article by Cosgrove et al…
  1.  
    James OBrien, M.D.
    May 17, 2016 | 5:56 PM
     

    It’s very much the same dynamic that makes a celebrity out of boo-yah stockjobbers like Cramer on CNBC who simultaneously disdain the short sellers even when they are right.

  2.  
    1boringyoungman
    May 18, 2016 | 2:11 PM
     

    But theses points do not clarify the situation for the Wagners, Nemeroffs, Schatzbergs,…etc. it would be almost impossible for there to be more information out there on Wagner than there is. She’s been covered in the New York Times, WSJ, BMJ,…etc for over a decade now. There is not a single clearer publicly documented example of the systematic poor academic psychiatry practices that are the focus of this blog than Wagner. In this context, her selection as an AACAP presidential nominee and her subsequent election is not explained by the factors above. They do not explain why the child psychiatry community as a whole simply does not care about these behaviors. Even in the one example that really did make it to “the big time” so to speak. An argument could be made that she was the central focus for Grassley. A similar argument could be made for the $3 billion GSK settlement. This most recent open source paper you reference could not lay things out more clearly. And, there is significant evidence that this is representative of more than this Wagner publication.
    .
    Even if you could somehow get every single child psychiatrist in the country to read this paper do you think it would have any community wide impact? What factor explains that? I am at a loss to figure that one out. It’s NOT the taking money from pharma. It’s the knowledge that the academic authors were most likely not in a position to adequately vet the papers they were first authors on. This last sentence is the key. Even if the authors didn’t suspect it then, there is sure enough reason to suspect it now. What was that phrasing Keller used? What they knew or should have known?
    .
    This concept, that an academic author may very well have had significant authorship on papers and presentations that they were not in a position to adequately vet, why is this not deeply concerning? To them? To our colleagues? Because isn’t that at the heart of this? The assumption that Wagner first authoring that paper meant that, whatever the other details of disclosures, that she was in a position to adequately vet the handling of the data from START to finish?

  3.  
    1boringyoungman
    May 18, 2016 | 2:37 PM
     

    “by Karen Dineen Wagner, Adelaide S. Robb, Robert L. Findling, Jianqing Jin, Marcelo M. Gutierrez, and William E. Heydorn”

    If the first author potentially never asked to be adequately briefed on the data analysis that was the basis for the entire paper that isn’t an issue of ethics, or a basis for retraction. Isn’t that, however, a real basis for concern? Even if the disclosures had included a reference to the external writers?

    Given what has been documented over the years for Wagner, between the 329 safety poster presentations, the presentation of 329 in JAACAP, other Wagner JAACAP papers whose analysis and first drafts were likely handled almost entirely independently by others, the AJP example here, isn’t that the question? Didn’t Keller himself frame the question when it comes to being an academic author when the analysis and presentation of information seems highly selective:

    “we could look foolish, naive, incompetent, or biased””given the data we had and should have had as investigators”

    What is the quality of vetting that a primary academic author did of the FOUNDATIONAL analysis of the data from the trial? 1bom, why is it that when our colleagues look at the likely quality of that job from Wagner, over the course of so many papers and presentations, there is so little concern? Because taking pharma funding does not on its own have o mean doing a bad job of that. Isn’t Carroll an example of that? In all the talk of “disclosures” isn’t this being missed?

  4.  
    1boringyoungman
    May 18, 2016 | 4:19 PM
     

    Read from “placebo has no role if they don’t respond to psychotherapy” on down.
    https://www.industrydocumentslibrary.ucsf.edu/drug/docs/#id=qrmf0220
    Does taking pharmaceutical monies explain that? Is that about adequate “disclosure” of “editorial assistance”?

Sorry, the comment form is closed at this time.