This article illustrates the difficulty of replicating results in the area of sports economics. This article gives three different examples that seem straightforward, but are actually quite difficult to replicate. Furthermore, the evidence suggests that the discrepancies are not due to human error. It is argued that the differences in results are due to differences in computing power over time, differences in statistical programs, or slight differences in available data. This gives evidence that researchers should be somewhat skeptical of any single empirical study.
Bear, J. ( 2005). What’s my DNA worth, anyway? - a response to the commercialization of individuals DNA information. Perspectives in Biology and Medicine, 47, 273-289.
2.
Beaton, A., Rubin, D., & Barone, J. ( 1976). The acceptability of regression solutions: Another look at computational accuracy. Journal of the American Statistical Association, 71, 158-168.
3.
Birnbaum, P. ( 2008). Is there really racism among MLB umpires?Personal correspondence (further analysis available at http://philbirnbaum.com/).
4.
Devany, A. (in press). Steroids, home runs and the Law of Genius. Economic Inquiry.
5.
Dewald, W., Thursby, J., & Anderson, R. ( 1986). Replication in Empirical Economics: The journal of money, credit and banking project. The American Economic Review, 76, 587-603.
6.
Dinardo, J., & Winfree, J. (in press). The law of genius and home runs refuted, Economic Inquiry.
7.
Fort, R., & Gill, A. ( 2000). Race and ethnicity assessment in Baseball Card Markets . Journal of Sports Economics, 1, 21-38.
8.
Francis, I. ( 1973). A comparison of several analysis of variance programs . Journal of the American Statistical Association, 68, 860-865.
9.
Krautmann, A. ( 1999). What’s wrong with Scully-estimates of a player’s MRP? Economic Inquiry, 37, 369-382.
10.
Longley, J. ( 1967). An appraisal of least squares programs for the electronic computer from the point of view of the user. Journal of the American Statistical Association, 62, 819-841.
11.
Noll, R. ( 1974). Attendance and price setting. In R. Noll (Ed.), Government and the Sports Business. Washington DC: Brookings Institution.
12.
Parsons, C., Sulaeman, J., Yates, M., & Hamermesh, D. ( 2007). Strike three: Umpires’ demand for discrimination . NBER Working Paper No. W13665.
13.
Porter, P., & Scully, G. ( 1982). Measuring managerial efficiency: The case of Baseball . Southern Economic Journal, 48, 642-650.
14.
Rimmer, R., & Nolan, J. ( 2005). Stable distributions in Mathematica. Mathematica Journal, 9, 776-789.
15.
Scully, G. ( 1974). Pay and performance in Major League Baseball. American Economic Review, 64, 915-930.
16.
Scully, G. ( 1989). The business of Major League Baseball. University of Chicago Press.
17.
Tainsky, S., & Winfree, J. ( 2009). Estimating MLB Umpire discrimination. Working Paper at the University of Michigan, Sport Management .
18.
Vrooman, J. ( 1996). The Baseball players’ labor market reconsidered . Southern Economic Journal, 63, 339-360.
19.
Zimbalist, A. ( 1992a). Baseball and billions. NYBasic Books .
20.
Zimbalist, A. ( 1992b). Salaries and performance: Beyond the Scully model. In P. M. Sommers (Ed.), Diamonds are forever (pp. 109-133). Washington, DC: The Brookings Institution.
