a thought…

Posted on Sunday 24 June 2012

No publication of field trial data

Following posting of the third draft on May 2, it was anticipated APA would publish full results from the DSM-5 field trials “within a month”. [Source: Deborah Brauser for Medscape Medical News: interview with Darrel Regier, May 8, 2012.]

No report emerged and stakeholders had little choice but submit feedback on this latest iteration without the benefit of scrutiny of reliability data to inform their submissions. APA has yet to account for its failure to place its field trial results in the public domain while the feedback exercise was in progress, other than releasing some Kappa data at its May 5-9 Annual Conference.

American Psychiatric Association CEO and Medical Director, James H. Scully, Jr., M.D., blogs at Huffington Post. Last week, I asked Dr Scully why the field trial report has been withheld; whether Task Force still intends publishing field trial data and when that report might now be anticipated. I’ve received no response from Dr Scully and APA has put out no clarification…

DSM-5 Field Trials Generate Mixed Results
Medscape
by Deborah Brauser
May 8, 2012

Members of the task force said they hope to publish the full results "within a month." However, the third and final public comment period for the manual opened last week and ends on June 15. Although the entire period is 6 weeks long, the public may only have 2 weeks to comment after the publication of the field trials’ findings.

However, according to Dr. Regier, the release of the field trials results has not been seen as linked to the public comment period. "These preliminary data analyses were to directly inform the Work Groups on the results so that they could consider the reliability of their formulations as well as the clinical utility and feasibility of the proposed changes. Although the general public may be interested in these results, it is more important to have them reviewed by scientific peers before they are entered into the scientific literature," Dr. Regier told Medscape Medical News.

"These will form a part of the basis not only for the current revision but for future revisions as well. The analysis, peer-review, and publication process usually takes quite a bit more time than 2 weeks to a month. We will certainly make these findings available for clinicians, scientists, and the public as soon as possible — possibly online ahead of print if the chosen journal is able to provide this service. What we were able to do at the annual meeting is provide an overview and preliminary presentation of some of the most important findings. However, much more detailed information will be needed for a thorough evaluation of these findings in the peer review and publication process," he added…

I guess this quote from the DSM-5 site is no longer operative:
After completion of the DSM-5 Field Trials, work group members will make any necessary revisions to their draft criteria. These revised criteria will be posted online, and this site will once again be open to submission of public comments.
I was sitting in a boat on a very peaceful salt-marsh not thinking about much of anything, and I had a quick thought pass through that I marked for later pondering. It was about this business of not reporting the Field Trial results during the public comment period. We’ve known that the Field Trial results must’ve been problematic from January 1 when they published DSM-5: How Reliable Is Reliable Enough?. So when they reported on the results in early May at the APA Meeting, the dismal numbers were no surprise. Nor am I totally surprised that they didn’t publish them. The thought I had last week wasn’t just about that. It was, "I don’t believe them." For example, I don’t believe this statement is true:
…according to Dr. Regier, the release of the field trials results has not been seen as linked to the public comment period. "These preliminary data analyses were to directly inform the Work Groups on the results so that they could consider the reliability of their formulations as well as the clinical utility and feasibility of the proposed changes."
And I don’t believe this either:
The analysis, peer-review, and publication process usually takes quite a bit more time than 2 weeks to a month…
They already had the Field Trial results well before the May meeting. I think they’re telling us what they want us to believe, adjusting their story in this case to the results they’d rather us not see. It’s a chronic pattern of "spin" apparent from their first response to Dr. Frances [Setting the Record Straight: A Response to Frances Commentary on DSM-V]. Every time I read something they say, my mind starts arguing with it. I just don’t believe them…
  1.  
    Peggi
    June 25, 2012 | 7:25 AM
     

    Thomas Jefferson: “It is more honorable to repair a wrong than to persist in it.”

  2.  
    June 25, 2012 | 6:24 PM
     

    Zen saying: “Whatever you hit, call it the target.”

Sorry, the comment form is closed at this time.