Waiting to evaluate one section of a paper (e.g., the Methods) until you have decided whether another section (e.g., the front end) passes muster is analogous to “multiple hurdle” systems in personnel selection. This usually creates a suboptimal weighting scheme in which the part of the system that represents the first hurdle is overvalued. I explain why “multiple hurdle” reviewing is counterproductive and offer a superior alternative.
EdenD.ShaniA. B.1982. Pygmalion goes to boot camp: Expectancy, leadership, and trainee performance. Journal of Applied Psychology, 67: 194-199.
2.
McNamaraG.SchleicherD. J.2024. What constitutes a contribution at JOM?Journal of Management, 50: 1495-1501.
3.
SackettP. R.DahlkeJ. A.ShewachO. R.KuncelN. R.2017. Effects of predictor weighting methods on incremental validity. Journal of Applied Psychology, 102: 1421-1434.
4.
SackettP. R.RothL.1996. Multi-stage selection strategies: A Monte Carlo investigation of effects on performance and minority hiring. Personnel Psychology, 49: 549-572.