The number of resamplings necessary to accurately estimate a probability value is an open question. One million resamplings is shown to be sufficient to ensure precision to three places under most conditions.
Get full access to this article
View all access options for this article.
References
1.
BailerA. J. (1989) Testing variance equality with randomization tests. Journal of Statistical Compulation and Simulation, 31, 1–8.
2.
BerryK. J.MielkeP. W.MielkeH. W. (2002) The Fisher-Pitman permutation test: An attractive alternative to the F test. Psychological Reports, 90, 495–502.
FisherR. A. (1925) Statistical methods for research workers. Edinburgh, Scot.: Oliver & Boyd.
7.
FisherR. A. (1935) The design of experiments. Edinburgh, Scot.: Oliver & Boyd.
8.
FisherR. A. (1936) The coefficient of racial likeness and the future of craniometry. The Journal of the Royal Anthropological Institute, 66, 57–63.
9.
GoodP. (2000) Permutation tests: A practical guide to resampling methods for testing hypotheses. New York: Springer.
10.
HigginsJ. J. (2004) Introduction to modern nonparametric tests. Pacific Grove, CA: Brooks/Cole.
11.
HowellD. C. (2007) Statistical methods for psychology. (6th ed.) Belmont, CA: Thomson.
12.
Keller-McNultyS.HigginsJ. J. (1987) Effect of tail weight and outliers and power and type-I error of robust permutation tests for location. Communications in Statistics—Computation and Simulation, 16, 17–35.
13.
KennedyP. E. (1995) Randomization tests in econometrics. Journal of Business & Economic Statistics, 13, 85–94.
14.
KimM. J.NelsonC. R.StartzR. (1991) Mean revision in stock prices? A reappraisal of the empirical evidence. Review of Economic Studies, 58, 515–528.
15.
LunneborgC. E. (2000) Data analysis by resampling: Concepts and applications. Pacific Grove, CA: Duxbury.
16.
ManlyB. F. J. (1991) Randomization and Monte Carlo methods in biology. London, UK: Chapman & Hall.
17.
MaximP. S. (1999) Quantitative research methods in the social sciences. New York: Oxford Univer. Press.
18.
McQueenG. (1992) Long-horizon mean-reverting stock prices revisited. Journal of Financial and Quantitative Analysis, 27, 1–17.
19.
MielkeP. W.BerryK. J. (2007) Permutation methods: A distance function approach. (2nd ed.) New York: Springer-Verlag.
20.
PitmanE. J. G. (1937a) Significance tests which may be applied to samples from any populations. Supplement to the Journal of the Royal Statistical Society, 4, 119–130.
21.
PitmanE. J. G. (1937b) Significance tests which may be applied to samples from any populations: II. The correlation coefficient test. Supplement to the Journal of the Royal Statistical Society, 4, 225–232.
22.
PitmanE. J. G. (1938) Significance tests which may be applied to samples from any populations: III. The analysis of variance test. Biometrika, 29, 322–335.
