{"id":59342,"date":"2015-09-17T08:00:34","date_gmt":"2015-09-17T12:00:34","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=59342"},"modified":"2015-09-16T19:40:25","modified_gmt":"2015-09-16T23:40:25","slug":"study-329-vii-variable-variables","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2015\/09\/17\/study-329-vii-variable-variables\/","title":{"rendered":"study 329 vii – variable<\/em> variables?…"},"content":{"rendered":"\n

WARNING:<\/strong> Sometimes the devil is in the details. Here, we need to get pretty far into the details…<\/em><\/sup><\/p>\n\n\n\n\n\n\n\n\n
RATING SCALES<\/font><\/strong> <\/p>\n
<\/td>\n<\/tr>\n
HAM-D<\/font><\/strong><\/td>\n   <\/td>\nHamilton Depression Rating Scale<\/td>\n<\/tr>\n
K-SADS-L<\/font><\/strong><\/td>\nKiddie Schedule for Affective Disorders – Lifetime<\/td>\n<\/tr>\n
CGI<\/font><\/strong><\/td>\nClinical Global Impressions Scale<\/td>\n<\/tr>\n
AFC<\/font><\/strong><\/td>\nAutonomous Function Checklist<\/td>\n<\/tr>\n
SPP<\/font><\/strong><\/td>\nSelf-Perception Profile<\/td>\n<\/tr>\n
SIP<\/font><\/strong><\/td>\nSickness Impact Profile<\/td>\n<\/tr>\n<\/table>\n

It is essential in Clinical Trials to declare the specific outcome variables and the statistical analytic methodology in the a priori protocol [before the study begins]. That’s the only way to assure that the methodology hasn’t been adjusted, jury-rigged to make the data look a certain way. The standard is to not even allow for the possibility of mistrust. And any changes to the a priori protocol need to be added in as an amendment or modification, approved by the certifying agency ie the Institutional Review Board [IRB]. In a recent study of Clinical Trials in Psychiatry [Is Mandatory Prospective Trial Registration Working to Prevent Publication of Unregistered Trials and Selective Outcome Reporting?<\/a>], only one third of the studies from the five journals with the highest impact rating in Psychiatry abided by this rule, and in the end, only 14% of the total cohort carried out the analysis precisely as described in the a priori protocol – even though it was a requirement for publication in all five journals.<\/p>\n

The protocol for Paxil Study 329 was written well before the actual Clinical Trial began and was quite clear in reference to the outcome variables. They are unambiguously declared in the a priori protocol<\/a>:<\/div>\n
\n
Primary Efficacy Variables<\/font><\/strong><\/u><\/div>\n
• Change in total HAMD score from beginning of treatment phase to the endpoint of the acute phase.<\/div>\n
• The proportion of responders at the end of the eight week acute treatment phase. "Responders are defined as 50% or greater reduction in the HAM-D or a HAM-D score equal to or less than 8.<\/div>\n
Secondary Efficacy Variables<\/font><\/strong><\/u><\/div>\n
• Change from baseline to endpoint (acute phase) in the depression items of the K-SADS-L, global impressions, autonomic function checklist, self perception profile and sickness impact scale.<\/div>\n
• The number of patients who relapse during the maintenance phase.<\/div>\n<\/blockquote>\n
Likewise, the requirements for changing the protocol<\/a> are explicit:<\/div>\n
\n
PROTOCOL AMENDMENTS<\/font><\/strong><\/div>\n
No changes to the study protocol will be allowed unless discussed in detail with the SmithKline Beecham (SB) Medical  Monitor and filed as <\/font>an amendment\/modification to this protocol. <\/font>Any amendment\/modification to the protocol will be adhered to by the <\/font>participating centre (or all participating centres) and will apply to all <\/font>subjects following approval as appropriate by the Ethical Review <\/font>Committee or Institutional Review Board.<\/font><\/div>\n<\/blockquote>\n
Yet in the published 2001 paper, we find that some of the outcome variables have been changed [in the Efficacy and Safety Evaluation<\/a> Section]:<\/div>\n
\n
"The protocol described<\/font><\/strong> two primary outcome measures: (1) response, which was defined as a HAM-D score of <8 or a >50% reduction in baseline HAM-D score at the end of treatment; and (2) change from baseline in HAM-D total score. Five other depression-related variables<\/font><\/strong> were declared a priori<\/font><\/strong>: (1) change in the depressed mood item of the HAM-D; (2) change in the depression item of the K-SADS-L; (3) Clinical Global Impression (CGI) improvement scores  of 1 (very much improved) or 2 (much improved); (4) change in the nine-item depression subscale of the K-SADS-L; and (5) mean CGI improvement scores."<\/div>\n<\/blockquote>\n
Notice that the two primary outcome measures are identified as protocol described<\/font><\/strong>, whereas the remaining five are not labeled as coming from the protocol, nor are they called secondary outcome variables. Instead, they’re identified as depression-related variables<\/font><\/strong> and declared a priori<\/font><\/strong>. Then later in the article, there’s yet a different version in the Efficacy Results<\/a> section text and Table 2 [page 766], adding in response<\/font><\/strong>:<\/div>\n
\n
Of the depression-related variables, paroxetine separated statistically from placebo at endpoint among four of the parameters: response<\/font> (i.e., primary outcome measure)<\/font><\/strong>, HAM-D depressed mood item, K-SADS-L depressed mood item, and CGI score of 1 (very much improved) or 2 (much improved) and trended toward statistical significance on two measures (K-SADS-L nine-item depression subscore and mean CGI score).<\/div>\n<\/blockquote>\n

non-protocol variables in blue
<\/sup><\/div>\n

I’ve colored the non-protocol variables blue. Those differences are the very devil in the details that are unexplained in the article itself. In fact, without having the protocol in hand, one would not likely notice them [and very few did  notice them]. Here’s a summary of the various versions:<\/p>\n

<\/p>\n

This discrepancy is what caught the attention of a few early nay-sayers about this article. All four of the significant variables in Table 2 are nowhere mentioned in the protocol,<\/font><\/strong> so the designation, a priori<\/font><\/strong>, doesn’t really make a bit of sense. For that matter, why use the term depression-related<\/font><\/strong> rather than Secondary? And where did response<\/font><\/strong><\/em> [HAM-D <<\/u>8] come from? In order to explain these changes, you have to have the 500+ page CSR <\/font>[Clinical Study Report<\/a>] available and a keen eye. And recall that the CSR<\/font> only became available as part of the 2004 settlement between GSK<\/font><\/strong> and the State of New York.<\/p>\n

So far, only questions, but some answers are just around the corner…<\/div>\n","protected":false},"excerpt":{"rendered":"

WARNING: Sometimes the devil is in the details. Here, we need to get pretty far into the details… RATING SCALES HAM-D     Hamilton Depression Rating Scale K-SADS-L Kiddie Schedule for Affective Disorders – Lifetime CGI Clinical Global Impressions Scale AFC Autonomous Function Checklist SPP Self-Perception Profile SIP Sickness Impact Profile It is essential in Clinical […]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_topic_count_hidden":0,"_bbp_reply_count_hidden":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[5],"tags":[],"class_list":["post-59342","post","type-post","status-publish","format-standard","hentry","category-opinion"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/59342","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=59342"}],"version-history":[{"count":43,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/59342\/revisions"}],"predecessor-version":[{"id":59995,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/59342\/revisions\/59995"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=59342"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=59342"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=59342"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}