algorithmic psychiatry: the fallacy…

Posted on Saturday 28 May 2011

In the last post, I reviewed Drs. Rush and Trivedi’s studies on the TMAP patients. They were buoyed up by the fact that the clinics using their algorithms [ALGO] outperformed their clinics where the docs were left to their own devices [TAU], even though their reanalysis of the data when they eliminated the psychotic patients and the milder cases wasn’t very exciting in its own right. But where there’s an algorithm, can a computer be far behind? In 2003, Dr. Trevidi received an NIMH grant [5 year] to implement the TMAP algorithm in a software system and test it:

COMPUTERIZED DECISION SUPPORT SYSTEM FOR DEPRESSION
PROJECT PRINCIPLE INVESTIGATOR YEAR FUNDING AMOUNT
1R01MH064062-01A2 TRIVEDI, MADHUKAR H 2003 NIMH $604,135
5R01MH064062-02 TRIVEDI, MADHUKAR H 2004 NIMH $698,180
5R01MH064062-03 TRIVEDI, MADHUKAR H 2005 NIMH $717,974
5R01MH064062-04 TRIVEDI, MADHUKAR H 2006 NIMH $718,293
5R01MH064062-05 TRIVEDI, MADHUKAR H 2007 NIMH    $605,420
TOTAL  
$3,344,002

As usual, there were a number of lead-up articles [even before the grant]:
    • Trivedi MH, Kern JK, Baker SM, et al: Computerized medication algorithms and decision support systems in major psychiatric disorders. Journal of Psychiatric Practice 6:237–246, 2000
    • Trivedi MH, Kern JK, Voegle T, et al: Computerized medical algorithms in behavioral health care, in Behavioral Health Care Informatics. Edited by Dewan NA, Lorenzi N, Riley R, Bhattacharya SR. New York, Springer-Verlag, 2001
    • Trivedi MH, Kern JK, Marcee AK, et al: Development and implementation of computerized clinical guidelines: barriers and solutions. Methods of Information in Medicine 41:435–442, 2002
    • Trivedi MH, Kern JK, et al: A Computerized Clinical Decision Support System as a Means of Implementing Depression Guidelines. Psychiatric Services 55:879–885, 2004
    • Trivedi MH, Claassen CA, et al: Assessing physicians’ use of treatment algorithms: Project IMPACTS study design and rationale. Contemp Clin Trials. 28(2):192-212, 2007

      2.11. Timeline Project IMPACTS was implemented beginning in spring 2003. A project management team was formed and meets bimonthly to address strategic questions related to data fidelity and other study policy matters. A hands-on operations team meets weekly to address ongoing study logistics. Physician recruitment and training for the initial study site took place in July-August 2003, and physician support structures were put in place immediately thereafter. Patient enrollment began in August 2003 and is projected to be complete by October 2006 at an average enrollment of 14 new patients per month. The DSMB began meeting in winter 2004. Twenty months into enrollment, 898 potentially eligible public sector patients being treated for depressive symptoms had been contacted about study enrollment, resulting in 214 enrolled patients. In addition, a total of 705 telephone follow-up assessments have been completed out of a possible 710.
    • Trivedi MH, Daly EJ, Kern JK, et al: Barriers to implementation of a computerized decision support system for depression: an observational report on lessons learned in "real world" clinical settings. BMC Medical Informatics and Decision Making, 9:6, 2009

      Abstract
      Background: Despite wide promotion, clinical practice guidelines have had limited effect in changing physician behavior. Effective implementation strategies to date have included: multifaceted interventions involving audit and feedback, local consensus processes, marketing; reminder systems, either manual or computerized; and interactive educational meetings. In addition, there is now growing evidence that contextual factors affecting implementation must be addressed such as organizational support (leadership procedures and resources) for the change and strategies to implement and maintain new systems.
      Methods: To examine the feasibility and effectiveness of implementation of a computerized decision support system for depression (CDSS-D) in routine public mental health care in Texas, fifteen study clinicians (thirteen physicians and two advanced nurse practitioners) participated across five sites, accruing over 300 outpatient visits on 168 patients.
      Results: Issues regarding computer literacy and hardware/software requirements were identified as initial barriers. Clinicians also reported concerns about negative impact on workflow and the potential need for duplication during the transition from paper to electronic systems of medical record keeping.
      Conclusion: The following narrative report based on observations obtained during the initial testing and use of a CDSS-D in clinical settings further emphasizes the importance of taking into account organizational factors when planning implementation of evidence-based guidelines or decision support within a system.
Hmm. Did I miss something here? Has this train remained in the station all this time? Did it go by and I missed seeing it? The grant has run out, but there’s no study, just articles about the study that’s coming – until this one, a feasibility study? now some 5 years after patient recruitment has already begun? Odd.

Well, there is a Clinical Trial of CDSS-D [Computer Decision Support System for Depression] registered by Madhukar Trivedi in March 2005 that was completed in June 2006 – but it’s for only 60 patients, in a Primary Care setting, and was financed by Pfizer. Finally there’s an article with results, published in 2009:
    • Kurian BT, Trivedi MH, Grannemann BD, et al: A computerized decision support system for depression in primary care. Prim Care Companion, J Clin Psychiatry,11(4):140-1466, 2009

      Abstract
      OBJECTIVE: In 2004, results from The Texas Medication Algorithm Project (TMAP) showed better clinical outcomes for patients whose physicians adhered to a paper-and-pencil algorithm compared to patients who received standard clinical treatment for major depressive disorder (MDD). However, implementation of and fidelity to the treatment algorithm among various providers was observed to be inadequate. A computerized decision support system (CDSS) for the implementation of the TMAP algorithm for depression has since been developed to improve fidelity and adherence to the algorithm.
      METHOD: This was a 2-group, parallel design, clinical trial (one patient group receiving MDD treatment from physicians using the CDSS and the other patient group receiving usual care) conducted at 2 separate primary care clinics in Texas from March 2005 through June 2006. Fifty-five patients with MDD (DSM-IV criteria) with no significant difference in disease characteristics were enrolled, 32 of whom were treated by physicians using CDSS and 23 were treated by physicians using usual care. The study’s objective was to evaluate the feasibility and efficacy of implementing a CDSS to assist physicians acutely treating patients with MDD compared to usual care in primary care. Primary efficacy outcomes for depression symptom severity were based on the 17-item Hamilton Depression Rating Scale (HDRS(17)) evaluated by an independent rater.
      RESULTS: Patients treated by physicians employing CDSS had significantly greater symptom reduction, based on the HDRS(17), than patients treated with usual care (P < .001).
      CONCLUSIONS: The CDSS algorithm, utilizing measurement-based care, was superior to usual care for patients with MDD in primary care settings. Larger randomized controlled trials are needed to confirm these findings.
Looks like their CDSS program helped Primary Care Physicians [significant but of questionable relevance] treat MDD. The methodology to arrive at the y-axis they used here was unintelligible to me.
Frankly, while I don’t doubt that they had trouble getting their physicians to use their CDSS-D computer program, my guess is that the things that shut down Trivedi’s study were more complex than his article suggests. His study spanned the period when TMAP was under attack and being sued for fraud by Allen Jones and the State of Texas. The whole department was renamed and TMAP was no longer mentioned. John Rush had been targeted by Senator Grassley and left Texas for Singapore. STAR*D had come and gone with its 100+papars before going silent. And Rush had left Trivedi to mop up CO-MED [another dud]. So the publication of this last irrelevant IMPACTS study joined CO-MED as the last gasp of the Age of Algorithms in Texas. I think I’ll let this digest and put my comments about all of this in a separate post Speaking of "tangled webs"…
  1.  
    Nancy Wilson
    May 28, 2011 | 5:15 PM
     

    “And Rush had left Trivedi to mop up CO-MED [another dud].”

    I chuckled at this one. Seriously though, who will mop up the mess in the scientific literature?

  2.  
    Tom
    May 28, 2011 | 7:18 PM
     

    One wonders if there is any “scientific” literature out there any more. Medicine has become so corrupted by Pharma payouts and buyouts that “scientific literature” may now be an oxymoron. In this regard, I just finished reading a NY Times article about how older diabetes drugs are now considered to be “best.” What has gone on over the past 25 years in “academic medicine” (another oxymoron) is criminal. But the perps (e.g KOL’s) have no shame. Sadly, we do indeed live in a “post superego” age.

Sorry, the comment form is closed at this time.