"Modeling Interventions in the Replication Crisis" by Aydin Mohseni скачать в хорошем качестве

"Modeling Interventions in the Replication Crisis" by Aydin Mohseni

ABSTRACT: Scientific studies vary in their methodological soundness. Interventions in evidentiary standards and research practices can differentially affect studies as a function of their soundness. The conjunction of these facts has unrecognized implications for proposed interventions in the replication crisis. I argue that we should expect these facts to obtain, and demonstrate that, when accounting for differential effects of interventions as a function of soundness, several of the proposed interventions—lowering the significance threshold, promoting preregistration, and sample splitting—can produce counterintuitive effects on false discovery rates, sign error rates, and magnitude exaggeration ratios.