{"id":31872,"date":"2013-01-09T20:07:43","date_gmt":"2013-01-10T01:07:43","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=31872"},"modified":"2013-01-10T14:03:46","modified_gmt":"2013-01-10T19:03:46","slug":"not-what-they-said-it-was","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2013\/01\/09\/not-what-they-said-it-was\/","title":{"rendered":"not what they said it was…"},"content":{"rendered":"
While this article puts more faith in the reliability figures from the DSM-5 Field Trials than I have, the account of the history of the endeavor is instructive. My own hypothesis has been that the DSM-5 Task Force leaders didn’t accept the stated DSM-III\/DSM-IV atheoretical<\/em> paradigm themselves [speaking of forests…<\/a>]. They set out determined to put diagnosis on the solid biological footing they believed in and failed. They are now pressing on with what remains after their failed attempt [which is next to nothing]. Dr. Phillips takes a look and asks, "Is that it?<\/em>" meaning "Is that all there is to the DSM-5 in the end, just a few more reliable syndromes without validity?<\/em>"<\/div>\n
\n
DSM-5 Field Trials: What Was Learned<\/a>
Psychiatric Times<\/font><\/strong>
By James Phillips, MD
January 8, 2013<\/div>\n

With DSM-5 now approved by the APA Board of Trustees — and, to the dismay of this reader, all discussion removed from the DSM-5 Web site—how are we to evaluate the results of the field trials for the end product? I suggest beginning with the short piece published in Psychiatric News, “What We Learned from DSM-5 Field Trials.” Authors David Kupfer and Helena Kraemer wrote, “We ultimately tested the criteria for 23 disorders. The question we asked was a straightforward one: In the hands of regular clinicians, assessing typically symptomatic patients in no different way than they would during everyday practice, was a particular disorder reliable?” <\/strong><\/sup><\/p>\n

In responding to this statement, let me begin with a confession of ignorance. Since I was not a participant in the field trials—neither for DSM-5 nor for previous versions of the manual—I didn’t appreciate that the major purpose of the field trials was to test reliability of the diagnostic constructs. I labored under a naïve illusion that since the ongoing crisis in the DSM has to do with diagnostic validity, field testing would somehow involve working on validity of new diagnoses. The “Guidelines for Making Changes to DSM-V” did hold out a little hope for work on validity with the statement: “Although some preliminary ‘convergent validity’ may be obtained in the field test [clinicians find the criteria fit syndromes expressed by real patients], a full test of the validity of these criteria will occur after DSM-V is published.”<\/strong><\/sup><\/p>\n

A little history<\/u><\/strong><\/sup><\/div>\n
Let me give a quick reminder of the relevant history. The goal of DSM-III was to establish diagnostic reliability through operational definitions and diagnostic criteria. It was assumed that psychiatric science would fill in and establish validity for the DSM-III diagnostic constructs. Thirty years later, as we were preparing for DSM-5, everyone acknowledged the great shock of the previous 3 decades:  diagnostic validity for the DSM-III\/IV diagnostic categories was in shambles. As the DSM-5 leaders wrote in the 2002 white paper, “A Research Agenda for DSM-V”:<\/strong><\/sup><\/div>\n
    \n
    In the more than 30 years since the introduction of the Feighner criteria by Robins and Guze, which eventually led to DSM-III, the goal of validating these syndromes and discovering common etiologies has remained elusive. Despite many proposed candidates, not one laboratory marker has been found to be specific in identifying any of the DSM-defined syndromes. Epidemiologic and clinical studies have shown extremely high rates of comorbidities among the disorders, undermining the hypothesis that the syndromes represent distinct etiologies. Furthermore, epidemiologic studies have shown a high degree of short-term diagnostic instability for many disorders. With regard to treatment, lack of treatment specificity is the rule rather than the exception.<\/strong><\/sup><\/em><\/div>\n<\/ul>\n
    The authors’ response to this crisis was a vague appeal for a “paradigm shift”:<\/strong><\/sup><\/div>\n
      \n
      All these limitations in the current diagnostic paradigm suggest that research exclusively focused on refining the DSM-defined syndromes may never be successful in uncovering their underlying etiologies. For that to happen, an as yet unknown paradigm shift may need to occur. Therefore, another important goal of this volume is to transcend the limitations of the current DSM paradigm and to encourage a research agenda that goes beyond our current ways of thinking to attempt to integrate information from a wide variety of sources and technologies.<\/strong><\/sup><\/em><\/div>\n<\/ul>\n
      In the ensuing years, advances in neuroscience and genetics were still not validating the DSM-IV categories. The perfectly reasonable directives for the Work Groups outlined in the Guidelines mentioned above could not accomplish much without clear support from basic science. In the face of this limitation, the DSM-5 leadership moved to dimensional measures as one solution to the validity problem. In 2009 Regier and colleagues wrote:<\/strong><\/sup><\/div>\n
        \n
        The single most important precondition for moving forward to improve the clinical and scientific utility of DSM-V will be the incorporation of simple dimensional measures for assessing syndromes within broad diagnostic categories and supraordinate dimensions that cross current diagnostic boundaries. Thus, we have decided that one, if not the major, difference between DSM-IV and DSM-V will be the more prominent use of dimensional measures in DSM-V.<\/strong><\/sup><\/em><\/div>\n<\/ul>\n
        As the dimensional measures were being challenged [they were dismissed by the Board of Trustees in May of 2012], Kupfer and Regier moved to the NIMH Research Domain Criteria project as the ultimate salvation of DSM-5—almost implying that the RDoC project, developed independent of DSM-5 and the DSM categories because the categories don’t work for research, was somehow developed in conjunction with the DSM work:<\/strong><\/sup><\/div>\n
          \n
          A logical extension of those discussions, as detailed in our Research Agenda articles, is the Research Domain Criteria (RDoC) initiative recently launched by the National Institute of Mental Health … This NIMH objective is consistent with our research planning conferences and conclusions, which underscored our commitment to examining evidence from neurobiology and assessing the readiness of proposed revisions for DSM-5. We are pleased with the work on RDoC that is being undertaken, and we believe this initiative will be very informative for subsequent versions: DSM-5.1, DSM-5.2, and beyond…It is important to emphasize that DSM-5 does not represent a radical departure from the past, nor does it represent a radical separation from the goals of the RDoC.<\/strong><\/sup><\/em><\/div>\n<\/ul>\n
          Back to 1980?<\/u><\/strong><\/sup><\/div>\n
          So there we were, waiting for the appearance of DSM-5 in May, and being reassured that those new diagnoses that have survived the chopping block of the Board of Trustees and the Scientific Review Committee have been field tested and proven to be reliable. Isn’t this where we were in 1980 with the appearance of DSM-III—now another handful of new diagnoses with demonstrated reliability and minimal evidence of scientific validity? Since we still don’t have adequate validity for the existing ton of DSM-IV diagnostic categories, is there any reason to think that the new handful won’t suffer the fate of the DSM-III\/IV categories—heterogeneity of presentation, fuzzy boundaries, excessive comorbidity, and failure of neuroscientific and genetic foundation. And we really can’t count on the RDoC to save the day for DSM-5.1, DSM-5.2, and beyond, given that the RDoC researchers are not working with DSM categories and have no expectation that the constructs for which they are seeking disruptions of neural circuitry will match up with existing diagnostic categories. If you check the working grid of RDoC, you won’t find a column for “DSM diagnosis.”<\/strong><\/sup><\/div>\n

          <\/p>\n

          What did we learn from the DSM-5 field trials?<\/u><\/strong><\/sup><\/div>\n
          We learned that with diagnostic criteria, it’s not that hard to assure diagnostic reliability. And that we now have such reliability for another small group of new diagnoses. But didn’t we already know from DSM-III that diagnostic reliability is fairly easy? How can one not respond to Kupfer and Kraemer: is that it?<\/strong><\/sup><\/div>\n<\/blockquote>\n
          We can hear the answer in the wind, "Yes. That’s it. That’s all there is." When it became apparent how things were going, both of the previous Task Force directors began to speak up. First, Dr. Robert Spitzer of the DSM-III and DSM-IIIR complained that the DSM-V Task Force was running a closed shop.<\/div>\n
            \n
            "I didn’t know whether to laugh or cry. Laugh — because there is no way task force and work group members can be made to refrain from discussing the developing DSM-V with their colleagues. Cry — because this unprecedented attempt to revise DSM in secrecy indicates a failure to understand that revising a diagnostic manual — as a scientific process — benefits from the very exchange of information that is prohibited by the confidentiality agreement. Such exchange of information with colleagues was encouraged with the development of DSM-III, DSM-III-R, and DSM-IV."<\/strong><\/sup><\/div>\n<\/ul>\n
            Then, Dr. Allen Frances joined in and began a campaign questioning many of the Task Force’s decisions and their consequences, joined by a broad coalition of mental health professionals primarily from outside psychiatry. While most of the public debate has revolved around specific diagnoses and the consequences of the proposed changes – Attenuated Psychosis Syndrome, Aspergers, the Bereavement Exclusion, Mixed Anxiety Depression Disorder, etc. – there have been a number of other questions on the table. Are the pharmaceutical connections of the Task Force members introducing a commercial bias? Are the members revising the existing system or just adding on ‘pet diagnoses’? What are they aiming to accomplish? For a time, the elements of that melee occupied the foreground and the big picture<\/em> got lost in the fray. Then the results of the Field Trials were announced and brought the whole enterprise into question.<\/div>\n

            In Dr. Phillips’ take on the DSM-5, the Task Force started with a criticism, a "crisis". The system hadn’t lived up to the expectations of Drs. Robins and Guze, the primo neoKraepelinians. After thirty years, we still had no evidence that the DSM Disorders were discrete biomedical entities – no confirming biological markers, no lab work<\/em>, nothing to validate the syndromes – "diagnostic validity for the DSM-III\/IV diagnostic categories was in shambles<\/font><\/em><\/strong>."<\/p>\n\n\n
            \n
            EXCUSE ME! I don’t recall the DMS-III mentioning the dreams and aspirations of Drs. Robins and Guze. I read about them as the "Deans of the Invisible College" much later in a history book, but at the time the DSM-III came out in 1980, this is what I read:
            <\/font><\/strong><\/sup><\/div>\n
              \n
              "For most of the DSM-III disorders, however, the etiology is unknown. A variety of theories have been advanced, buttressed by evidence – not always convincing – to explain how these disorders came about. The approach taken in DSM-III is atheoretical with regard to etiology or pathophysiological process except for those disorders for which this is well established and therefore included in the definition of the disorder. Undoubtedly, with time, some of the disorders of unknown etiology will be found to have specific etiologies, others to have specific psychological causes, and still others to result from a particular interplay of psychological, social, and biological factors,"
              <\/font><\/strong><\/sup><\/div>\n<\/ul>\n
              I thought that was the essential justification for the change to a descriptive diagnostic system in the first place…<\/font><\/strong><\/sup><\/div>\n<\/td>\n<\/tr>\n<\/table>\n

              So they spent years pursuing their research agenda looking for the elusive validators, having a series of mega-conferences, but nothing appeared. So they went to an add in diagnostic idea – cross cutting dimensions, adding in a parallel system to refine diagnoses. It was rejected by the Trustees [and anyone else who read much about it]. Having failed to solve the crisis, they deferred to the RDoC project of the NIMH which proposes to classify human subjectivity by technology [genetics, neuroimaging, neurocognitive studies]. As Dr. Phillips points out, this project neither arose from nor addresses DSM-5 diagnoses. So Dr. Phillips concludes that other that a few new categories that made it through the Field Trials, there’s nothing much there that wasn’t in the DSM-IV.<\/p>\n

              What about that crisis? the one where the "diagnostic validity for the DSM-III\/IV diagnostic categories was in shambles<\/em>"? From their point of view, the DSM-III\/IV diagnostic categories must’ve been in shambles on the day they were written for the very first time. Their pseudo-crisis simply confirms what we’ve lived for the last thirty years. Maybe Dr. Spitzer believed that the "DSM-III was atheoretical with regard to etiology or pathophysiological process<\/font><\/strong>" [and maybe not considering how he handled depression], but the body psychiatric has steadfastly treated all mental illness as biological and all treatment as biological since the DSM-III appeared. The other revisions [DSM-III 1980, DSM-IIIR 1988, DSM-IV 1994] have stuck to the atheoretical meme [though the possibility of finding "specific psychological causes<\/font><\/strong>" was in the range of zero in the system as written]. <\/p>\n

              So instead of revising the diagnostic system to make it better, more useful, they took their appointments as an opportunity to pursue [yes, this really is the right word] their ideology, and they fell on their faces. Nobody told them to turn it into a referendum on the biomedical etiology of mental illness, but that’s what they did. And in their report on the Field Trial results, they said, "We are now coming to the end of the neo-Kraepelinian era initiated in the U.S. by Robins and Guze<\/em>…" I guess that’s what it has been the whole time, but that’s sure not what they said it was…<\/div>\n","protected":false},"excerpt":{"rendered":"

              While this article puts more faith in the reliability figures from the DSM-5 Field Trials than I have, the account of the history of the endeavor is instructive. My own hypothesis has been that the DSM-5 Task Force leaders didn’t accept the stated DSM-III\/DSM-IV atheoretical paradigm themselves [speaking of forests…]. They set out determined to […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-31872","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/31872","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=31872"}],"version-history":[{"count":35,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/31872\/revisions"}],"predecessor-version":[{"id":31927,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/31872\/revisions\/31927"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=31872"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=31872"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=31872"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}