{"id":15362,"date":"2011-10-26T09:21:35","date_gmt":"2011-10-26T13:21:35","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=15362"},"modified":"2011-10-26T14:32:15","modified_gmt":"2011-10-26T18:32:15","slug":"tortured-numbers","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2011\/10\/26\/tortured-numbers\/","title":{"rendered":"tortured numbers…"},"content":{"rendered":"
I said previously that I wasn’t going to argue with this FDA warning business [pretty loud coi…<\/font><\/a><\/strong><\/u>]. I should never say such a thing, because when I started peeping into the volumes written about this controversy, I got captured. So I take it back. Here comes some more of one piece of this story – that the FDA warning of suicidal thinking in adolescents caused an increase in suicides [and many other negative things] by depriving depressed kids of antidepressants<\/em>. I’m still not interested in chasing down the other allegations in the National Bureau of Economic Research Report<\/u><\/a><\/font><\/strong>: <\/div>\n

THE SUICIDE STATISTICS<\/font><\/strong><\/u><\/p>\n

The suicide numbers came from the CDC Compressed Mortality, 1999-2007 Results<\/font><\/strong><\/u><\/a> database. The image on the left are the suicide rates [per 100,000] for females at various age groups over the period available [the absolute number graph looks essentially the same]. Parenthetically, when I look at the graph, the most striking thing is the steady increase in the suicide rate in women in the two groups over 35 y\/o. There is something of a blip in 2004 in both the over 35 y\/o and under 20 y\/o groups. The National Bureau of Economic Research<\/font><\/strong> <\/font> study we’re reviewing focuses attention on that blip in 2004 and is going to compare the 10-19 y\/o group [red<\/font>+blue<\/font><\/strong><\/font>] to the 20-24 y\/o group [yellow<\/font><\/strong><\/font>] and ignore the others.<\/p>\n

Here’s their explanation for how these CDC<\/font><\/strong><\/u><\/a> suicide statistics are going to be used in the NBER study<\/font><\/strong><\/u><\/a>: <\/div>\n
\n
To better understand how the FDA activity around pediatric antidepressant use may have affected symptoms in the population of adolescents with depression, Figure 4 presents information regarding suicides in the United States over the period from 1999 to 2007. These data are drawn from the Centers for Disease Control and Prevention’s publicly available information on deaths by cause and selected demographic characteristics. Because of dramatically different levels of suicides by age and gender [males commit suicide more often, and between ages 10 and 24, suicide rates rise with age], the figure presents the natural log of suicide deaths per 100,000 population, separately for two age groups [10-19 and 20-24], and by sex. <\/font><\/strong>Because the 2004 FDA warnings applied to pediatric antidepressant use, they did not directly affect 20-24 year olds. Youth suicides had been flat or declining among 10-19 year olds in the years preceding the warnings, but in 2004, 10-19 year old girls experienced a sharp increase in suicides, of over 30 percent. There was no abrupt rise among older ages [20-24] as expected, given that these early warnings focused on pediatric populations.<\/sup><\/div>\n<\/blockquote>\n
Notice that the data and their suggested meaning are presented all mixed together. Not so fast – let’s look at just the data first. On the left are the raw suicide rates for 10-19 y\/o and 20-24 y\/o separated by gender as suicides per 100,000. On the right, the same data expressed as the natural log of suicides per 100,000. <\/div>\n
<\/div>\n
When I read the piece explaining why they used the natural log values, it made little sense [highlighted in red above]. Looking at these two graphs, it makes more sense. The log graph heightens the smaller values accentuating the otherwise imperceptible blip. So by eliminating the values of the women over 35 y\/o and plotting the log values, they can arrive at a graph that shows their desired rise in teen suicides in 2004.<\/div>\n

THE MEDIA COVERAGE<\/font><\/strong><\/u><\/p>\n

In January 2010, Susan Busch, one of the authors of the NBER study<\/font><\/strong><\/u><\/a><\/font><\/strong><\/u> and a colleague at Yale published a paper about the media coverage surrounding the FDA’s deliberations that ultimately lead to the Black Box warnings about suicidal ideation in adolescents on antidepressants: <\/div>\n
\n
News coverage of FDA warnings on pediatric antidepressant use and suicidality<\/font><\/strong><\/u>
by Barry CL and Busch SH.<\/sup>
Pediatrics<\/font><\/strong>. 2010 125[1]:88-95.
[full text online<\/font><\/strong><\/u><\/a>]<\/div>\n

<\/p>\n

OBJECTIVE<\/font><\/strong><\/u>: In 2004, after an 18-month investigation, the Food and Drug Administration [FDA] directed pharmaceutical manufacturers to add a black box warning to antidepressants regarding increased risk of suicidality in children. Our objective was to evaluate the quality and content of and overall impression conveyed in news coverage of this issue.
METHODS<\/font><\/strong><\/u>: We collected all news stories on pediatric antidepressant use and suicidality published in a convenience sample of 10 of the highest-circulation print newspapers in the United States, the 3 major television networks, and a major cable news network in 2003 and 2004 [N = 167]. Two researchers coded news articles by using a 9-item instrument.
RESULTS<\/font><\/strong><\/u>: The quality of news reporting on key health messages included in FDA warnings was mixed. The overwhelming majority of news stories correctly described a risk of suicidality associated with pediatric antidepressant use, as opposed to suicide itself. However, other key health messages highlighted in FDA warnings often were absent from news coverage. News stories were more likely to include anecdotes of children harmed versus children helped by antidepressants, whereas expert sources quoted were more likely to emphasize the benefits of antidepressants over their risks. However, the majority of news stories conveyed neither the overall impression that the risks of pediatric antidepressant use outweighed the benefits nor the impression that the benefits outweighed the risks, and coverage became increasingly neutral over time.
CONCLUSIONS<\/font><\/strong><\/u>: Inclusion of key health messages in FDA safety warnings was not sufficient to ensure their communication to the public through the lay press.<\/sup><\/div>\n<\/blockquote>\n


[reformatted to fit the page]<\/sup><\/p>\n

While the article seemed to be about the inadequacy of press reports to fully inform the public, there was another agenda in the full conclusion:<\/div>\n
\n
Because depression is an undertreated disease with the potential for long-term negative consequences, the sharp decreases in pediatric antidepressant use that occurred in the aftermath of the FDA risk disclosure are troubling, to the extent that they represent an increase in unmet need. Clinical trial data indicated that one antidepressant, fluoxetine, was clinically effective in treating children with major depressive disorder. The efficacy of other antidepressants in treating children has not been proved. In the 1990s, increased antidepressant use after the introduction of SSRIs was hailed by many as an important advancement in public health. Steady decreases in youth suicide rates suggested to some that antidepressants were saving lives. This trend reversed unexpectedly with the upswing in national youth suicide rates in 2004 and 2005, leading to the speculation that less antidepressant use after FDA safety warnings might have increased rather than decreased youth suicide rates, although other explanations also are possible [eg, changes in youth access to firearms, the prevalence of alcohol use, and Internet-based social networks].<\/sup><\/div>\n<\/blockquote>\n
But for our purposes, the media reports speak to the broad coverage of this issue, particularly in the Fall of 2004 prior to the Black Box warning being mandated in October.<\/div>\n

THE PRESCRIPTION RATES FOR ADOLESCENTS<\/font><\/strong><\/u><\/p>\n

So why all the focus on the media reports? The Black Box warnings weren’t mandated until October 2004, so they couldn’t have had that much effect on the 2004 suicide statistics. And since this Report is determined to show that the FDA warnings essentially caused a suicide increase in adolescents in 2004, they would have to show that all the media noise caused a drop in prescriptions for adolescents before<\/u> they were mandated.<\/p>\n

In fact, one of the slides in the NBER<\/font><\/strong><\/u><\/a> paper [reproduced on the right using their numbers] would suggest that prescribing didn’t fall until 2005, negating their argument altogether. But that was not the only shot at trying to quantitate a fall in antidepressant prescribing in adolescents that lasted throughout 2004 which might support their hypothesis. One such study is one I’ve already reviewed [the apogee…<\/font><\/a><\/strong>]. If you review the graph<\/font><\/strong><\/u><\/a>, the reported prescription rate does fall early in the year in that cohort. Now, have a look at what the authors have to say. I’ve included their Appendix with links to the particular studies they chose to focus on. <\/p>\n

\n
…The most often cited of these studies are summarized briefly in Appendix Table I. Studies that focus on monthly antidepressant sales demonstrate an initial abrupt decline in prescribing of antidepressants in pediatric populations beginning in January-March of 2004, the time of public hearings on the safety of pediatric antidepressant use [Benji T Kurian, Wayne A. Ray, Patrick G. Arbogast, D. Catherine Fuchs, Judith A. Dudley and William O. Cooper, 2007, Charles B. Nemeroff, Amir Kalali, Martin B. Keller, Dennis S. Charney, Susan E. Lenderts, Elisa F. Cascade, Hugo Stephenson and Alan F. Schatzberg, 2007]. One study of all-payer data representing about half of all prescription activity in the U.S., shows the precipitous drop in the number of prescriptions for children under age 18 that occurred in January-June 2004 coincident with intense media coverage of FDA’s hearings and its second advisory on safety risks of pediatric antidepressant use [Charles B. Nemeroff, Amir Kalali, Martin B. Keller, Dennis S. Charney, Susan E. Lenderts, Elisa F. Cascade, Hugo Stephenson and Alan F. Schatzberg, 2007].<\/sup><\/div>\n<\/blockquote>\n\n\n\n\n\n\n\n\n\n\n\n
Appendix Table I.
Peer-reviewed studies of declines in pediatric antidepressant use in the United States<\/font><\/strong>
 <\/td>\n<\/tr>\n
Citation<\/font><\/strong><\/td>\n Population\/Data <\/font><\/strong><\/td>\nResults<\/font><\/strong><\/td>\n<\/tr>\n
\n
<\/td>\n<\/tr>\n
*<\/font><\/td>\nNemeroff<\/u> et al., 2007<\/sup><\/font><\/strong><\/a><\/td>\n Verispan data; represents ~ ½ of retail prescriptions in US
[ages 0-17]<\/sup><\/td>\n		 5% decline in pediatric antidepressant volume in Q1 2004; Additional 11% decline in Q2 2004; No further change through March 2005<\/sup><\/td>\n<\/tr>\n
*<\/font><\/td>\nGibbons<\/u> et al., 2007<\/sup><\/font><\/strong><\/a><\/td>\n IMS pharmacy data; aggregated to national level
[ages 0-14]<\/sup><\/td>\n		 22% decline in youth antidepressant volume from 2003 to 2005; 30% decline in new youth antidepressant prescription volume from 2003 to 2005<\/sup><\/td>\n<\/tr>\n
*<\/font><\/td>\nKurian<\/u> et al., 2007<\/sup><\/font><\/strong><\/a><\/td>\n Tennessee Medicaid pharmacy data;
[ages 2-17]<\/sup><\/td>\n		 33% decline in new antidepressant use [i.e. individual fills any antidepressant prescription in month]<\/sup><\/td>\n<\/tr>\n
 <\/td>\nBusch et al., 2010<\/sup><\/font><\/strong><\/td>\n Medical Expenditure Panel Survey; nationally representative survey data
[ages 5-21]<\/sup><\/td>\n		 26% decline in twelve-month prevalence rates of antidepressant use from 2002\/3 to 2005\/6 [i.e., individual fills any antidepressant prescription in year]<\/sup><\/td>\n<\/tr>\n
*<\/font><\/td>\nLibby<\/u> et al., 2009<\/sup><\/font><\/strong><\/a><\/td>\n PharMetrics Patient-Centric Database; eighty-five managed care plans
[ages 5-18]<\/sup><\/td>\n		 After accounting for prescribing trends, 58 % decline in antidepressant use among individuals newly diagnosed with depression [within 30 days post diagnosis.]<\/sup><\/td>\n<\/tr>\n
*<\/font> <\/td>\nBusch<\/u> et al., 2010b<\/sup><\/font><\/strong><\/a><\/td>\n Marketscan data; privately insured
[ages 5-17]<\/sup><\/td>\n		 19% decline in antidepressant use among individuals newly diagnosed with depression [within 30 days post diagnosis.]<\/sup><\/td>\n<\/tr>\n
 <\/td>\nValluri<\/u> et al, 2010<\/sup><\/font><\/strong><\/a><\/td>\n i3 Innovus database; commercial insurance enrollees
[ages 2-17]<\/sup><\/td>\n		 17% decline in antidepressant use among individuals newly diagnosed with depression [within 180 days post diagnosis.]<\/sup><\/td>\n<\/tr>\n<\/table>\n
I was unable to locate the article by Busch with the Medical Expenditure Panel Survey, it is shown in the NEBR Report<\/font><\/strong><\/u><\/a> as is the Marketscan data.
<\/sup><\/div>\n

Could there be anything more to say on this issue? Plenty more, but I’m only going to add one more piece, the comments from a Lawyer in the firm that has handled many of the big lawsuits against the Pharmaceutical Manufacturers: <\/p>\n

\n
NBER’s Contentions Regarding the Level of Prescriptions and Suicides Are Factually Flawed<\/font><\/strong><\/u><\/a>
Baum Hedlund<\/font><\/strong>
by Bijan Esfandiari
September 30, 2011<\/div>\n

Moving past the efficacy issue, NBER’s contention that youth suicides have increased following the advent of the black-box warning is also factually flawed.  The Reason article cites NBER’s fallacious working paper for the proposition that “Youth suicides had been flat or declining among 10-19 year olds in the years preceding the warnings, but in 2004, 10-19 year old girls experienced a sharp increase in suicides, of over 30 percent.”  This is simply not supported by the data, which, as outlined below, reveal that suicide rates were not only rising prior to issuance of the black box warnings, but actually went down following issuance of the black box warnings.<\/sup><\/p>\n

In 2004, the year suicides increased, “there was no significant drop in SSRI prescribing." [The Black Box Warning: Decreased Prescriptions and Increased Youth Suicide? by JON JUREIDINI<\/font><\/strong><\/u><\/a>]. As Jureidini pointed out, Gibbons “incorrectly analyzed the relationship” between prescription rates and suicide rates among children and, when carefully examined, Gibbons’ suggestion of a clear causal association from the data analyzed “show no such association.” Id. <\/em> Like Gibbons, the NBER working paper is making erroneous “[a]larmist predictions regarding the consequences of decreased prescribing.” Id.<\/em><\/sup><\/p>\n

Gibbons, himself, has since acknowledged that his data did not support a causal link:  “We really need to see the 2005 numbers on suicide to see what happened." [Experts Question Study on Youth Suicide Rates<\/font><\/strong><\/u><\/a>] (The alleged culprit of the NBER’s “list of terribles,” i.e., the black box warning, was implemented in early 2005, and antidepressant prescriptions did decrease that year.)  The FDA’s Dr. Thomas Laughren confirmed at a 2008 hearing that antidepressant prescribing did not change until 2005 and the 2005 suicide numbers “are down from where they were in 2004."<\/em><\/sup><\/p>\n

Moreover, one of the studies cited by the working paper authors by Gibbons et al. was so scientifically illegitimate that it was described by the British Medical Journal<\/em> as “astonishing,” “misleading” and "reckless." [Dutch academics criticise suicide claims made in American psychiatry journal<\/font><\/strong><\/u><\/a>]. Further, one of the Gibbons study authors, Ron Herings admitted the study’s findings are “not right” and that it “doesn’t follow from the data, it is not true and serves just to scare people.  It is hard to admit this, as I am one of the authors of the article and I attached my name to it …" [Interview with Ron Herings, Argos<\/em>, VPRO\/VARA, Radio 1 (December 7, 2007)<\/font><\/strong>].<\/sup><\/p>\n

Finally, NBER’s reliance upon ecological studies to support their arguments is methodologically flawed.  Authors of ecological “studies” universally agree you cannot conclude that increasing or decreasing suicides (or any other malady) is the result of a lack of antidepressant consumption based on these types of analyses.<\/sup><\/div>\n<\/blockquote>\n
This whole story is truly remarkable – particularly in light of the simple set of suicide statistics on the right that underpins the whole discussion. The hypothesis is that the decision to append a black box warning had all kinds of negative repercussions – including an increase in teen suicides. The only evidence was that 2004 increase in the red line. Since the warning came at the end of that year, they propose that the media reporting lead to a pre-emptive decrease in prescribing, and various records were produced to show this was indeed the case. But when you look at the graph, the suicide rate for teenaged girls is now falling as opposed to the over 35 y\/o groups which definitely seem to be on the rise [groups still taking antidepressants].<\/div>\n

I don’t know why the suicide rate was higher in 2004 for teens [or for that matter in women over 35 y\/o]. But it seems silly to continue to claim that depressed kids are killing themselves by being deprived of SSRIs – for the obvious reason that they’re not. It’s not happening. The SSRIs don’t seem to be doing that much for the over 35 y\/o set either. And if they want to blame that 2004 blip on something, how about withdrawal symptoms from stopping them too quickly? – something else the drug manufacturers denied along the way [see, I can make up stuff too]. This continued assault on the FDA warnings is yet another example of the direct intrusion of the drug industry into the psychiatric literature – a conclusion in search of an argument. Simply looking at the suicide statistics disproves their premise without any of the window dressing. <\/p>\n

In this contrarian literature, there are implied arguments against every level of the Black Box warning decision. Some still deny that the drugs can cause suicidal thoughts. Others argue that the FDA didn’t consider the cost\/benefit ratio carefully enough – the unintended consequences like the mythical increase in suicide rate – as if that’s the FDA’s job. The Report’s authors think that the now unmedicated depressed kids have diminished school performance or increasing substance abuse. They seem to believe the efficacy of these drugs in adolescence is like it’s portrayed in the direct-to-consumer t.v. ads – magic [hardly the case]. In fact, the marginal efficacy of antidepressants in youths strengthens the argument that safety is the preeminent question on the table. They end with the premise that the FDA decision has actually caused a public health problem, and I presume they’re suggesting that the FDA shouldn’t have issued it in the first place – whether it was true or not. <\/div>\n
\n
They suggest that the unintended consequences of policies designed to protect consumer safety extend well beyond the clinical considerations that typically contribute to decisions about the costs and benefits of regulatory actions. The FDA’s decision to issue the warning on antidepressants rested on evidence of suicidal thoughts and actions, but not suicide itself. Indeed, the FDA panel of experts convened to make the decision about a black box warning was divided regarding the relative costs and benefits of issuing the warning for public health. The “costs” of issuing the warning considered were clinical in nature, with potential suicide among depressed patients being the most extreme of these. However, the discussion did not consider the broader non-clinical costs [and benefits] of treating depression with antidepressants. Second, our findings also confirm research in very different settings suggesting that depression interferes with academic outcomes, especially for girls.<\/p>\n

The third and most significant innovation of this empirical work is that it suggests that treatment of depression can mitigate adverse effects of depression on both cognitive and non cognitive aspects of human capital among adolescents. Families, schools, and clinicians devote significant effort to help students with behavioral health issues because they interfere with academic outcomes. These findings suggest that treatment of depression can improve both cognitive outcomes such as grades, as well as delinquent behaviors and the initiation of substance use, all of which are important aspects of human capital. Our paper focuses on outcomes that occurred within 1 to 12 months of being surveyed, and thus they should be viewed as relatively short-run outcomes. Given controversy over the risks and benefits of antidepressants in the long run, our findings do not suggest we should abandon other forms of treating depression, but rather as evidence that depression affects economic outcomes, and thus successful treatments of depression yields potential benefits that reach far beyond the clinical outcomes typically measured.<\/sup><\/div>\n<\/blockquote>\n

The job of the FDA is to certify the safety and efficacy of drugs available for prescription, and to inform physicians about the adverse effects of the drugs they use. To suggest that the FDA withhold a warning of a potentially dangerous adverse effect of a medication based on the considerations in these concluding remarks betrays either a massive misunderstanding of the practice of medicine or a wish to totally change our basic system. If they want to get doctors prescribing SSRIs to adolescents in spite of the possible adverse reactions, talk to the doctors, not the FDA. I know why the compromised KOLs fought this decision and keep hammering at it. They were colluding with the pharmaceutical companies to increase drug sales. I would assume that the National Bureau of Economic Research<\/font><\/strong> has a vested interest in that their leader is on the Board of Eli Lilly. But this article and some that preceded it are from health policy academics at Yale. I can only conclude that the drug companies have found a way to get to them too. They should know better.<\/p>\n

At the risk of being accused of terminal optimism, there’s a piece of this story that’s encouraging to me. After a decade of suppression of this adverse effect of antidepressants in adolescents, the FDA finally added a warning to the label on the drugs and the media spread to word. Doctors stopped prescribing the drugs to kids en masse. And this onslaught of jury-rigged pseudo-science [above] hasn’t reversed anything. The system is intact. That’s comforting…<\/div>\n","protected":false},"excerpt":{"rendered":"

I said previously that I wasn’t going to argue with this FDA warning business [pretty loud coi…]. I should never say such a thing, because when I started peeping into the volumes written about this controversy, I got captured. So I take it back. Here comes some more of one piece of this story – […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-15362","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/15362","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=15362"}],"version-history":[{"count":112,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/15362\/revisions"}],"predecessor-version":[{"id":15474,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/15362\/revisions\/15474"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=15362"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=15362"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=15362"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}