{"id":7076,"date":"2011-04-09T08:00:23","date_gmt":"2011-04-09T12:00:23","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=7076"},"modified":"2011-04-10T20:17:22","modified_gmt":"2011-04-11T00:17:22","slug":"the-appearance-of-conflict-of-interest","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2011\/04\/09\/the-appearance-of-conflict-of-interest\/","title":{"rendered":"the appearance of conflict of interest&#8230;"},"content":{"rendered":"\n<p>I&#8217;m still on <strong><font color=\"#200020\">STAR*D<\/font><\/strong>, and I put this first part in a box for two reasons &#8211; it&#8217;s convoluted, in spite of my attempts to make it clear. You might even skip it if you have an aversion to initials and technical talk. My second reason is so you can find it when you get to the end and decide you want to look it over again [or for the first time]:                   <\/p>\n<table width=\"95%\" cellspacing=\"0\" cellpadding=\"2\" border=\"0\" align=\"center\">\n<tr>\n<td>\n<div align=\"justify\">In looking at the <strong><font color=\"#300030\">STAR*D<\/font><\/strong> study [<u><strong><a href=\"http:\/\/1boringoldman.com\/index.php\/2011\/04\/06\/recalculating\"><font color=\"#300030\">recalculating&hellip;<\/font><\/a><\/strong><\/u>], there was a very confusing part about changing the primary out come measures along the way &#8211; from the standard HRSD [<strong><font color=\"#300030\">Hamilton Rating Scale for Depression<\/font><\/strong>] to the QIDS-SR [<strong><font color=\"#300030\">Quick Inventory of Depressive Symptomatology&ndash;Self-Report<\/font><\/strong>]. If you don&#8217;t remember it, you might want to look back at my post about it. It turned out that that change was never approved by the NIMH DSMB [<strong><font color=\"#300030\">Data Safety and  Monitoring Board<\/font><\/strong>]. It turns out that this is not just some picky point, because this new outcome measure was <u>not blinded<\/u> during the study and available to the treating clinicians along the way. What made it worse, in the paper, the authors said, &quot;t<strong><font color=\"#200020\">he QIDS-SR was not used to make treatment decisions, which minimizes the potential for clinician bias.<\/font><\/strong>&quot; I claimed that was a lie. But looking back at the exact wording in the paper,<\/div>\n<ul>\n<div align=\"justify\"><sup>The clinical research coordinators also completed the 16-item, clinician-rated Quick Inventory of Depressive Symptomatology [QIDS-C16] at each clinic visit to assess symptoms over the prior week&#8230; Patients also completed the 16-item Quick Inventory of Depressive Symptomatology-Self-Report [QIDS-SR16] and the Frequency, Intensity, and Burden of Side Effects Rating at each clinic visit.<\/sup><\/div>\n<\/ul>\n<div align=\"justify\">maybe they&#8217;ve got me on a technicality. The QIDS-C and the QIDS-SR are identical. Maybe they are trying to sell us that the clinician rated version was open, and the self-report was blinded. Since they&#8217;re identical and were done in the same visit, their statement is certainly not the truth. And then they used the QIDS-IVR&nbsp; [<strong><font color=\"#300030\">Quick Inventory of Depressive Symptomatology&ndash;Interactive Voice Response<\/font><\/strong>] which is a call-in telephone system version to follow subjects for a year to detect relapses. Here&#8217;s how they put it:<\/div>\n<div align=\"justify\">\n<ul>\n<div align=\"justify\"><sup>We  used the Quick Inventory of Depressive  Symptomatology&ndash;Self-Report  (QIDS-SR) as the primary measure to define  outcomes for acute and  follow-up phases because:<\/sup><\/div>\n<ol><sup>1. QIDS-SR ratings were available for all participants at each acute treatment clinic visit<\/sup><\/p>\n<div align=\"justify\"><sup>2. QIDS-SR and HRSD outcomes are highly related<\/sup><\/div>\n<div align=\"justify\"><sup>3. the QIDS-SR was not used to make treatment decisions, which minimizes the potential for clinician bias<\/sup><\/div>\n<div align=\"justify\"><sup>4. the  QIDS-SR scores obtained from the  interactive voice response system, the  main follow-up outcome measure,  and the paper-and-pencil QIDS-SR16 are  virtually interchangeable, which  allows us to use a similar metric to  summarize the acute and follow-up  phase results.<\/sup><\/div>\n<\/ol>\n<div><sup>Response was defined as at least a 50% reduction from treatment step entry in QIDS-SR16 score. Remission was defined as a QIDS-SR16 score &le;5 [corresponding to an HRSD17 score of &le;7]. Relapse was declared when the QIDS-SR16 score collected by the interactive voice response system during the followup phase was &ge;11 [corresponding to an HRSD17 &ge;14].<\/sup><\/div>\n<\/ul><\/div>\n<\/td>\n<\/tr>\n<\/table>\n<p align=\"justify\">None of this makes one iota of sense. Why change from a tried and true standard like the HRSD [<strong><font color=\"#300030\">Hamilton Rating Scale for Depression<\/font><\/strong>] to the QIDS-SR [<strong><font color=\"#300030\">Quick Inventory of Depressive Symptomatology&ndash;Self-Report<\/font><\/strong>] which none of us have ever heard of? Why say that the change was approved by the NIMH DSMB when it wasn&#8217;t? Why would you count on a telephone call-in system as your main follow-up measure? It sure didn&#8217;t work &#8211; in fact it may have made the outcome virtually unusable:<\/p>\n<div align=\"center\"><a href=\"http:\/\/content.karger.com\/ProdukteDB\/produkte.asp?Aktion=ShowPDF&#038;ArtikelNr=318293&#038;Ausgabe=254424&#038;ProduktNr=223864&#038;filename=318293.pdf#page=6\" target=\"_blank\"><img loading=\"lazy\" decoding=\"async\" width=\"450\" height=\"141\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/pigott-4.gif\" \/><\/a><\/div>\n<div align=\"justify\"><em><sup>How many relapsed and how many dropped out? Who knows? I can&#8217;t figure it out or find anyone else who can. This table by Pigott et al is as good as it gets. But it suggests that the call-in system didn&#8217;t exactly pull in the data. These numbers either indict the treatment or the call-in data collection [or both].<\/sup><\/em><\/div>\n<p align=\"justify\">So far, we&#8217;ve got a confusing box and an inconclusive table. It seems only fitting to follow that up with unprovable suspicions.<\/p>\n<p align=\"justify\">The QIDS-SR was introduced in 2003 by Rush, Trivedi, et al [accepted for publication Nov 2002]. There are&nbsp; nine articles in <a target=\"_blank\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed?term=QIDS[Title]\"><u><strong>PubMed<\/strong><\/u><\/a> with &quot;QIDS&quot; in the title [six from their group], all validating the scale. So it seems to have been developed for or around the time of <strong><font color=\"#200020\">STAR*D<\/font><\/strong>. I can only find <a target=\"_blank\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed?term=16199008\"><u><strong><font color=\"#200020\">one study<\/font><\/strong><\/u><\/a> comparing the QIDS-C, QID-SR, QID-IVR, and the HRSD &#8212; written by the <strong><font color=\"#200020\">STAR*D<\/font><\/strong> group and published a few months before the <strong><font color=\"#200020\">STAR*D<\/font><\/strong> report in 2006. The correlation looks okay to me:<\/p>\n<p align=\"center\"><img decoding=\"async\" border=\"0\" src=\"http:\/\/1boringoldman.com\/images\/star-d-5.gif\" \/><\/p>\n<p align=\"justify\">When I was looking over Dr. Pigott&#8217;s studies, he and I had some correspondence, and among the things he sent was a piece of his sleuthing he didn&#8217;t publish because it was conjecture. I thought it was worth saying and with his permission, I&#8217;ll add it here.<\/p>\n<div align=\"justify\">Dr. Rush was closely involved with developing both the IDS [<strong><font color=\"#300030\">Inventory of Depressive Symptomatology<\/font><\/strong>] and the QIDS [<strong><font color=\"#300030\">Quick Inventory of Depressive Symptomatology<\/font><\/strong>]. Dr. Pigott noticed something about their availability [<em>from<\/em> <a href=\"http:\/\/www.ids-qids.org\" target=\"_blank\">http:\/\/www.ids-qids.org<\/a>]:<\/div>\n<blockquote>\n<div align=\"center\"><u><a target=\"_blank\" href=\"http:\/\/www.ids-qids.org\/index2.html#ABOUT\"><strong>ABOUT THE IDS AND QIDS<\/strong><\/a><\/u><\/div>\n<p align=\"justify\">The 30 item Inventory of Depressive Symptomatology (IDS) (Rush et al.  1986, 1996) and the 16 item Quick Inventory of Depressive  Symptomatology (QIDS) (Rush et al. 2003) are designed to assess the  severity of depressive symptoms.  Both the IDS and the QIDS are  available in the clinician (IDS-C30 and QIDS-C16) and self-rated versions (IDS-SR30 and QIDS-SR16).   The IDS and QIDS assess all the criterion symptom domains designated  by the American Psychiatry Association Diagnostic and Statistical Manual  of Mental Disorders &#8211; 4th edition (DSM-IV) (APA 1994) to diagnose a  major depressive episode&#8230;<\/p>\n<div align=\"justify\">Current translations of the pencil and paper versions of the IDS and  QIDS are available at no cost to clinicians and researchers.  Copies may  be downloaded from this site and used without permission. <strong><font color=\"#200020\">The IDS and  QIDS are available in an automated telephone-administered format (IVR)  exclusively licensed to Health Technology Systems.  Those wishing to  consider the IVR versions or other electronic versions should contact: Healthcare Technology Systems, Inc.<\/font><\/strong><\/div>\n<\/blockquote>\n<div align=\"justify\">And <a target=\"_blank\" href=\"http:\/\/www.healthtechsys.com\/ivr\/ivrassessmain.html\"><u><strong><font color=\"#008060\">Healthcare Technology Systems<\/font><\/strong><\/u><\/a> was in fact the provider of <strong><font color=\"#200020\">STAR*D<\/font><\/strong>&rsquo;s telephonic IVR system that was used to capture 8 of its 11 pre-specified research outcome measures, including the IVR-administered version of the QIDS. <strong><font color=\"#008060\">HTS<\/font><\/strong> is mentioned all through the <a target=\"_blank\" href=\"http:\/\/www.madinamerica.com\/madinamerica.com\/STARD%20Documents_files\/STAR_D%20Clinical%20Procedures%20Manual.htm\"><u><strong><font color=\"#300030\">STAR*D <\/font><font color=\"#300030\">procedures<\/font><\/strong><\/u><\/a> manual . Then if we look at the <a target=\"_blank\" href=\"http:\/\/ajp.psychiatryonline.org\/cgi\/content\/abstract\/163\/11\/1905\"><u><strong><font color=\"#300030\">STAR*D<\/font><\/strong> <strong><font color=\"#300030\">article<\/font><\/strong><\/u><\/a> in the disclosures at the end of the article, we see:<\/div>\n<ul>\n<div align=\"justify\">Dr. Rush has served as an advisor, consultant, or speaker for or  received research support from &#8230; Healthcare Technology Systems,  Inc&#8230; <\/div>\n<div align=\"justify\">He has equity holdings in  Pfizer Inc and receives royalty\/patent income from Guilford Publications  and Healthcare Technology Systems, Inc.<\/div>\n<\/ul>\n<div align=\"justify\">Dr. Pigott also found that in another <strong><font color=\"#200020\">STAR*D<\/font><\/strong> paper [<strong><a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/16554525\" target=\"_blank\">New England Journal of Medicine.<\/a><a href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/16554525\" target=\"_blank\"> 2006 Mar 23;354(12):1231-42.<\/a><\/strong>], Dr. Rush reported that he also received consulting fees from and had served on Healthcare Technology Systems&rsquo; advisory board.<\/div>\n<p align=\"justify\">I guess I can see why Dr. Pigott didn&#8217;t include any of this in his publications or communications. It&#8217;s all suggestive but circumstantial, and he&#8217;s being careful not to say anything he can&#8217;t prove. I started to pass over it myself, but then I thought about what conflict of interest is really supposed to mean &#8211; anything that gives <u>the appearance<\/u> of bias. The standards for a scientist or a physician are different than they are in criminal court, at least they ought to be.<\/p>\n<p align=\"justify\">They apparently decided to use the QIDS as the primary outcome measure late in the game. The definitive study comparing the QIDS-C, QID-SR, QID-IVR, and the HRSD wasn&#8217;t even done until the <strong><font color=\"#200020\">STAR*D<\/font><\/strong> data was available. How do we know that other than its publication date being only a few months before the study itself? We know it because the study data itself was used to <a target=\"_blank\" href=\"http:\/\/www.ncbi.nlm.nih.gov\/pubmed?term=16199008\"><u><strong><font color=\"#200020\">derive<\/font><\/strong><\/u><\/a> those correlations shown above.<\/p>\n<div align=\"justify\">But we don&#8217;t really know if the decision to drop the IDS-C or to not use the HRSD and substitute the not so widely known QIDS[s] had to do with the fact that Dr. Rush developed the scales, or because they made the data look better [which they apparently did], or because they had so many drop-outs that they were scrambling for numbers, or who-knows-what. And we don&#8217;t know if it had something to do with Dr. Rush&#8217;s connections with HTS, or if the royalty\/payments were related to the QIDS-IVR licensing [which would be a hard core financial conflict of interest], or why they&#8217;ve never published the before and after HRSD or IDS at the different levels like they said they would. And we don&#8217;t have any way to know if using the QIDS-IVR was connected to their perserveration about <strong><font color=\"#200020\">measurement-based care<\/font><\/strong><\/div>\n<ul>\n<div align=\"justify\"><sup>&lsquo;Finally, high quality of care was delivered (measurement-based care) with additional support from the clinical research coordinator. Consequently, the outcomes in this report may exceed those that are presently obtained in daily practice wherein neither symptoms nor side-effects are consistently measured and wherein practitioners vary greatly in the timing and level of dosing&rsquo;<\/sup><\/div>\n<\/ul>\n<div align=\"justify\">representing some fantasy that practitioners would be using the QIDS-IVR in their offices to follow their patient&#8217;s responses.<\/div>\n<p>  <\/p>\n<div align=\"justify\">I can&#8217;t prove that any of these possibilities are true. But that&#8217;s the whole point of scientific research. I shouldn&#8217;t even be&nbsp; in a position of wondering about any of them. That&#8217;s why we have the standard we have &#8211; nothing that <u>gives the appearance of<\/u> bias. And by that standard, the <strong><font color=\"#200020\">STAR*D <\/font><\/strong>paper should never have even been published.<\/div>\n<hr size=\"1\" \/>\n<div align=\"justify\"><strong>       Update<\/strong>: If you question who created the QIDS, check it out on the Southwestern <a target=\"_blank\" href=\"http:\/\/www8.utsouthwestern.edu\/utsw\/cda\/dept153397\/files\/203000.html\"><u>web site<\/u><\/a>. Take it yourself, read the disclaimers, and look at the Copyright near the bottom of the page.<\/div>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;m still on STAR*D, and I put this first part in a box for two reasons &#8211; it&#8217;s convoluted, in spite of my attempts to make it clear. You might even skip it if you have an aversion to initials and technical talk. My second reason is so you can find it when you get [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-7076","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/7076","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=7076"}],"version-history":[{"count":55,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/7076\/revisions"}],"predecessor-version":[{"id":40082,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/7076\/revisions\/40082"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=7076"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=7076"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=7076"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}