The Fisher-Pitman permutation test is shown to possess significant advantages over conventional alternatives when analyzing differences among independent samples with unequal variances.
Get full access to this article
View all access options for this article.
References
1.
BehrensW. V. (1929) Ein Berrag zur Fehlerberechnung bei wenigen Beobactungen. Landwirtschaftliche Jarbücher, 68, 807–837.
2.
BergmannR.LudbrookJ.SpoorenW. P. J. M. (2000) Different outcomes of the Wilcoxon-Mann-Whitney test from different statistics packages. The American Statistician, 54, 72–77.
3.
BerryK. J.MielkeP. W. (1983) Moment approximations as an alternative to the F test in analysis of variance. British Journal of Mathematical and Statistical Psychology, 36, 202–206.
4.
BerryK. J.MielkeP. W. (1998) A program for F distributions with fractional degrees of freedom. Perceptual and Motor Skills, 87, 972–974.
5.
BerryK. J.MielkeP. W. (2000) Exact and Monte Carlo resampling procedures for the Wilcoxon-Mann-Whitney and Kruskal-Wallis tests. Perceptual and Motor Skills, 91, 749–754.
6.
BoneauC. A. (1960) The effects of violations of assumptions underlying the t test. Psychological Bulletin, 57, 49–64.
7.
BoxG. E. P. (1953) Non-normality and tests on variance. Biometrika, 40, 318–335.
8.
BoxG. E. P.AndersonS. L. (1955) Permutation theory in the derivation of robust criteria and the study of departures from assumption. Journal of the Royal Statistical Society, Series B, 17, 1–34.
9.
BradleyJ. V. (1968) Distribution-free statistical tests. Englewood Cliffs, NJ: Prentice-Hall.
10.
EdenT.YatesF. (1933) On the validity of Fisher's z test when applied to an actual example of non-normal data. The Journal of Agricultural Science, 23, 6–17.
11.
EdgingtonE. S. (1995) Randomization tests. (3rd ed.) New York: Marcel Dekker.
12.
FeinsteinA. R. (1993) Permutation tests and “statistical significance.”M. D. Computing: Computers in Medical Practice, 10, 28–41.
13.
FisherR. A. (1934) Statistical methods for research workers. (5th ed.) Edinburgh, Scot.: Oliver & Boyd.
14.
FisherR. A. (1935a) The design of experiments. Edinburgh, Scot.: Oliver & Boyd.
15.
FisherR. A. (1935b) The fiducial argument in statistical inference. Annals of Eugenics, 6, 391–398.
16.
FlignerM. A.PolicelloG. E. (1981) Robust rank procedures for the Behrens-Fisher Problem. Journal of the American Statistical Association, 76, 162–168.
17.
GoodeP. (2000) Permutation tests: a practical guide to resampling methods for testing hypotheses. (2nd ed.) New York: Springer-Verlag.
18.
HaberM. (1990) Comments on “The test of homogeneity for 2×2 contingency tables: a review of and some personal opinions on the controversy” by G. Camilli. Psychological Bulletin, 108, 146–149.
19.
HoeffdingW. (1952) The large sample power of tests based on permutations of observations. Annals of Mathematical Statistics, 23, 169–192.
20.
HubertL. J. (1987) Assignment methods in combinatorial data analysis. New York: Marcel Dekker.
21.
HunterM. A.MayR. B. (1993) Some myths concerning parametric and nonparametric tests. Canadian Psychology, 34, 384–389.
22.
KempthorneO. (1955) The randomization theory of statistical inference. Journal of the American Statistical Association, 50, 946–967.
23.
KennedyP. E. (1995) Randomization tests in econometrics. Journal of Business & Economic Statistics, 13, 85–94.
24.
LudbrookJ.DudleyH. (1998) Why permutation tests are superior to t and F tests in biomedical research. The American Statistician, 52, 127–132.
25.
LunneborgC. E. (2000) Data analysis by resampling: concepts and applications. Pacific Grove, CA: Duxbury.
26.
ManlyB. F. J. (1997) Randomization, bootstrap and Monte Carlo methods in biology. (2nd ed.) London: Chapman & Hall.
27.
MannH. B.WhitneyD. R. (1947) On a test of whether one or two random variables is stochastically larger than the other. Annals of Mathematical Statistics, 18, 50–60.
28.
MarascuiloL. A.McSweeneyM. (1977) Nonparametric and distribution-free methods for the social sciences. Belmont, CA: Brooks/Cole.
29.
MayR. B.HunterM. A. (1993) Some advantages of permutation tests. Canadian Psychology, 34, 401–407.
30.
MielkeH. W.SmithM. K.GonzalesC. R.MielkeP. W. (1999) The urban environment and children's health: soils as an integrator of lead, zinc and cadmium in New Orleans, Louisiana, U.S.A.Environmental Research, 80, 117–129.
31.
MielkeP. W.BerryK. J. (2001) Permutation methods: a distance function approach. New York: Springer-Verlag.
32.
NoreenE. W. (1989) Computer intensive methods for testing hypotheses: an introduction. New York: Wiley.
33.
PitmanE. J. G. (1937a) Significance tests which may be applied to samples from any populations. Supplement to the Journal of the Royal Statistical Society, 4, 119–130.
34.
PitmanE. J. G. (1937b) Significance tests which may be applied to samples from any populations: II. The correlation coefficient test. Supplement to the Journal of the Royal Statistical Society, 4, 225–232.
35.
PitmanE. J. G. (1938) Significance tests which may be applied to samples from any populations: III. The analysis of variance test. Biometrika, 29, 322–335.
36.
SatterthwaiteF. E. (1946) An approximate distribution of estimates of variance components. Biometrics Bulletin, 2, 110–114.
37.
StillA. W.WhiteA. P. (1981) The approximate randomization test as an alternative to the F test in analysis of variance. British Journal of Mathematical and Statistical Psychology, 34, 243–252.
38.
Student. (1908) The probable error of a mean. Biometrika, 6, 1–25.
39.
WaldA.WolfowitzJ. (1944) Statistical tests based on permutations of the observations. Annals of Mathematical Statistics, 15, 358–372.
40.
WelchB. L. (1937) The significance of the difference between two means when the population variances are unequal. Biometrika, 29, 250–262.
41.
WilcoxonF. (1945) Individual comparisons by ranking methods. Biometrics, 1, 80–83.
