{"id":35640,"date":"2013-04-23T08:50:09","date_gmt":"2013-04-23T12:50:09","guid":{"rendered":"http:\/\/1boringoldman.com\/?p=35640"},"modified":"2013-04-23T12:21:10","modified_gmt":"2013-04-23T16:21:10","slug":"pre-registration","status":"publish","type":"post","link":"https:\/\/1boringoldman.com\/index.php\/2013\/04\/23\/pre-registration\/","title":{"rendered":"pre\u00b7registration&#8230;"},"content":{"rendered":"\n<p align=\"center\"><img loading=\"lazy\" decoding=\"async\" border=\"0\" width=\"490\" height=\"59\" src=\"http:\/\/1boringoldman.com\/images\/neuroskeptic-1.gif\" \/><\/p>\n<p align=\"justify\">In the early days of computing, I lived on the leading edge of hardware and software. The advances were just such exciting stuff. But over the ensuing decades, that has reversed. I actively ride the trailing edge &#8211; still use Windows XP and early Linux. I groan when I am forced to update something. So I was slow to <em>twitter<\/em>, and rarely <em>tweet<\/em>, requiring help from my daughter to get the blog to <em>auto&middot;tweet<\/em> [and none of those italicized words have yet entered my everyday vocabulary]. But I have to admit that it&#8217;s a pretty clever idea. I wouldn&#8217;t have found that last UK Parliamentary hearing without <em>twitter<\/em>. And then there&#8217;s stuff like the <em>tweet<\/em> from Neuroskeptic above.<\/p>\n<p align=\"justify\"><img decoding=\"async\" border=\"0\" align=\"right\" width=\"150\" hspace=\"4\" src=\"http:\/\/1boringoldman.com\/images\/friden.gif\" \/>While fundamental neuroscience is not my area, the issues raised in this post are pertinent to a important debate on the table. In my college days, I was a math type, but statistics weren&#8217;t part of that. It was that sure thing math like calculus and topology. The statistics came later in immunology, but I wasn&#8217;t using them to see significance. It was molecular biology and the significance was visible from 100 yards &#8211; not part of the question. It was using alalysis of variance to factor out the contributions and interactions of various parameters &#8211; plenty enough to keep a Friden calculator sounding like an assault rifle or filling boxes of punch cards. <img decoding=\"async\" border=\"0\" align=\"left\" width=\"135\" hspace=\"4\" src=\"http:\/\/1boringoldman.com\/images\/punch-card.gif\" \/>My brother-in-law, the experimental psychologist across town, was doing that other kind of statistics. It seemed mighty soft to me, and I tended to be skeptical of differences I couldn&#8217;t see with my proverbial naked eye.<\/p>\n<p align=\"justify\">But then along came retirement with a reason to learn about the modern clinical trials and the softer side of statistics was all around me [speaking of trailing edges]. So I found myself grappling with small differences where <em>p-values<\/em> and <em>effect sizes<\/em> were of primary importance and regressions didn&#8217;t refer to neurotic processes. And there was something kind of new for me &#8211; misusing math on purpose to make tons of money &#8211; as in to sell expensive pharmaceuticals.<\/p>\n<p align=\"justify\">One of the obvious ways to clean up the horrible <em>mathemangled<\/em> clinical trials is to insist that the raw subject level data be available &#8211; data transparency. That&#8217;s the part Ben Goldacre, the Cochrane Collaboration, and AllTrials petition are all about. The PHARMA offering is to have pseudo-impartial boards decide if the proposal of some research justifies access. I see that as smoke and mirrors. We don&#8217;t want to see their numbers to do further research. We want to check their work to see if they&#8217;re cheating. So it&#8217;s not yet resolved.<\/p>\n<p align=\"justify\">Neuroskeptic and&nbsp; COGSCI are on another tack altogether. It has to do with pre<em>&middot;<\/em>registration &#8211; declaring how the study will be done and analyzed up front in order to block the kind of data-play after the fact that haunts the clinical trial literature. In this <em>tweet<\/em>, Neuroskeptic is talking about a work in progress to respond to COGSCI [Sebastiaan Math&ocirc;t], but I&#8217;m heavily recommending reading the prequels <a href=\"http:\/\/www.cogsci.nl\/blog\/miscellaneous\/217-the-black-swan\">The black swan<\/a> and <a href=\"http:\/\/www.cogsci.nl\/blog\/miscellaneous\/215-the-pros-and-cons-of-pre-registration-in-fundamental-research\">The pros and cons of pre<em>&middot;<\/em>registration in fundamental research<\/a> by Math&ocirc;t and <a href=\"http:\/\/blogs.discovermagazine.com\/neuroskeptic\/2013\/03\/23\/more-on-preregistration\/\" title=\"Permanent Link to Interview: Raising the Scientific Standard\">Interview: Raising the Scientific Standard<\/a> by Neuroskeptic. Beyond the issue of tightening scientific standards by pre<em>&middot;<\/em>registration, these articles give insights into the meanings of our statistical analyses that I found both helpful and understandable [emphasis on understandable].<\/p>\n<p align=\"justify\">The best part of all of this is that the problem is on the table. They&#8217;re bickering about how to do something rather than whether there&#8217;s a something that needs doing, which is where we&#8217;ve been stuck for a long time. Kudos to the muckrakers who stuck with watch<em>&middot;<\/em>dogging and debunking the dodgy studies we&#8217;ve been fed for years. Without them, this debate wouldn&#8217;t even be happening. <\/p>\n<div align=\"justify\">You can put a lot into a <em>tweet<\/em>&#8230; <\/div>\n","protected":false},"excerpt":{"rendered":"<p>In the early days of computing, I lived on the leading edge of hardware and software. The advances were just such exciting stuff. But over the ensuing decades, that has reversed. I actively ride the trailing edge &#8211; still use Windows XP and early Linux. I groan when I am forced to update something. So [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_bbp_topic_count":0,"_bbp_reply_count":0,"_bbp_total_topic_count":0,"_bbp_total_reply_count":0,"_bbp_voice_count":0,"_bbp_anonymous_reply_count":0,"_bbp_forum_subforum_count":0,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-35640","post","type-post","status-publish","format-standard","hentry","category-politics"],"_links":{"self":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/35640","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/comments?post=35640"}],"version-history":[{"count":25,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/35640\/revisions"}],"predecessor-version":[{"id":35666,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/posts\/35640\/revisions\/35666"}],"wp:attachment":[{"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/media?parent=35640"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/categories?post=35640"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/1boringoldman.com\/index.php\/wp-json\/wp\/v2\/tags?post=35640"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}