Do Anything Great with Unsecured Signature Loans
The very first problem, even as we were made painfully aware, is the fact that this may result in an expansion of false-positive outcomes (Camerer et al., 2018; Ebersole, Axt, & Nosek, 2016; Hagger et al., 2016; Klein et al., 2014, 2018; O’Donnell et al., 2018; Open Science Collaboration, 2015; Wagenmakers et al., 2016).
An additional problem is if we let a thousand flowers bloom (and these predictions have been validated by formal models; Smaldino & McElreath, 2016) that it is very easy to predict what will happen. This does not look great for quality and transparency control. Those who opt out will be able to take shortcuts, make bolder claims, and get more rewards if there are no negative consequences for being less transparent, for opting out of scrutiny and accountability. The greater amount of transparent scientists whose errors have caught and corrected will totally lose the competition for jobs, tenure, funds, and awards.
In a method for which we usually need certainly to compare research outputs across candidates ( ag e.g., for jobs, prizes, grants), exactly just how should we compare the researcher who transparently reports all analyses, studies, and results and so has a messy or boring story to inform with the researcher whom informs us they own a solid and compelling pair of results but does not provide us with the information we’d have to verify this claim? We are de facto punishing the first researcher if we give the second researcher the benefit of the doubt. In a method for which opacity may be the acceptable standard, there is no way to survive as a transparent researcher.
Needless to say, we must maybe maybe not assume that transparent scientific studies are good research. But we don’t have actually to — that’s the point of transparency. Transparency is actually for scrutiny, review, and modification. We have ton’t assume research that is transparent rigorous, we must assess if it is. Transparency doesn’t guarantee credibility; scrutiny and transparency together guarantee that research gets the credibility it deserves. Continue reading →