When the categories of the independent variable in an analysis of variance are quantitative, it is more informative to evaluate the trends in the treatment means than to simply compare differences among the treatment means. A permutation alternative to the conventional F test is shown to possess significant advantages when analyzing trend among quantitative treatments in a one-way analysis of variance. An example with and without an extreme data point illustrates the effectiveness of the permutation alternative for the analysis of trend when homogeneity of variance is compromised.
Get full access to this article
View all access options for this article.
References
1.
AlginaJ.KeselmanH. J.PenfieldR. D. (2007) Confidence intervals for an effect size measure in multiple linear regression. Educational and Psychological Measurement, 67, 207–218.
2.
AlginaJ.KeselmanH. J.PenfieldR. D. (2010) Confidence intervals for squared semipartial correlation coefficients: The effect of nonnormality. Educational and Psychological Measurement, 70, 926–940.
3.
AndersonR. L.HousemanE. E. (1942) Tables of orthogonal polynomial values extended to n = 104. Ames, IA: Iowa Agricultural Experiment Station Research Bulletin No. 297.
4.
BakemanR.RobinsonB. F.QueraV. (1996) Testing sequential association: Estimating exact p values using sampled permutations. Psychological Methods, 1, 4–15.
5.
BerryK. J. (1993) Orthogonal polynomials for the analysis of trend. Educational and Psychological Measurement, 53, 139–141.
6.
BerryK. J.MielkeP. W. (1983) Moment approximations as an alternative to the F test in analysis of variance. British Journal of Mathematical and Statistical Psychology, 36, 202–206.
7.
BoxG. E. P.AndersonS. L. (1955) Permutation theory in the derivation of robust criteria and the study of departures from assumption. Journal of the Royal Statistical Society, Series B, 17, 1–34.
8.
BozivichH.BancroftT. A.HartleyH. O. (1956) Power of analysis of variance test procedures for certain incompletely specified models, I. Annals of Mathematical Statistics, 27, 1017–1043.
9.
BradleyJ. V. (1977) A common situation conducive to bizarre distribution shapes. The American Statistician, 31, 147–150.
10.
EdenT.YatesF. (1933) On the validity of Fisher's z test when applied to an actual example of non-normal data. The Journal of Agricultural Science, 23, 6–17.
EverittB. S. (2001) Statistics for psychologists: An intermediate course. Mahwah, NJ: Erlbaum.
13.
FeinsteinA. R. (1993) Permutation tests and “statistical significance.”M. D. Computing: Computers in Medical Practice, 10, 28–41.
14.
FergusonG. A. (1981) Statistical analysis in psychology and education. (5th ed.) New York: McGraw-Hill.
15.
FisherR. A. (1925) Statistical methods for research workers. Edinburgh, Scotland: Oliver and Boyd.
16.
FisherR. A. (1935) The design of experiments. Edinburgh, Scotland: Oliver and Boyd.
17.
FisherR. A.YatesF. (1957) Statistical tables for biological, agricultural, and medical research. New York: Hafner.
18.
GaitoJ. (1965) Unequal intervals and unequal n in trend analysis. Psychological Bulletin, 63, 125–127.
19.
GearyR. C. (1947) Testing for normality. Biometrika, 34, 1070–1100.
20.
GoodP. I. (2000) Permutation tests: A practical guide to resampling methods for testing hypotheses. (2nd ed.) New York: Springer-Verlag.
21.
GoodP. I. (2006) Resampling methods: A practical guide to data analysis. (3rd ed.) Boston: Birkhäuser.
22.
HaberM. (1990) Comments on “The test of homogeneity for 2 × 2 contingency tables: A review of and some personal opinions on the controversy” by G. Camilli. Psychological Bulletin, 108, 146–149.
23.
HaysW. L. (1988) Statistics. (4th ed.) New York: Holt, Rinehart and Winston.
24.
HoeffdingW. (1952) The large sample power of tests based on permutations of observations. Annals of Mathematical Statistics, 23, 169–192.
25.
HowellD. C. (2010) Statistical methods for psychology. (7th ed.) Belmont, CA: Cengage Wadsworth.
26.
HubertL. J. (1987) Assignment methods in combinatorial data analysis. New York: Marcel Dekker.
27.
HunterM. A.MayR. B. (1993) Some myths concerning parametric and nonparametric tests. Canadian Psychology, 34, 384–389.
28.
JohnstonJ. E.BerryK. J.MielkeP. W. (2007) Permutation tests: Precision in estimating probability values. Perceptual and Motor Skills, 105, 915–920.
29.
KempthorneO. (1955) The randomization theory of statistical inference. Journal of the American Statistical Association, 50, 946–967.
30.
KennedyP. E. (1995) Randomization tests in econometrics. Journal of Business & Economic Statistics, 13, 85–94.
31.
KeppelG. (1982) Design and analysis: A researcher's handbook. (2nd ed.) Englewood Cliffs, NJ: Prentice Hall.
32.
KirkR. E. (1968) Experimental design: Procedures for the behavioral sciences. Belmont, CA: Brooks/Cole.
33.
LahiriS. N. (2003) Resampling methods for dependent data. New York: Springer-Verlag.
34.
LorenzenT. J.AndersonV. L. (1993) Design of experiments: A no-name approach. New York: Marcel Dekker.
35.
LudbrookJ.DudleyH. (1998) Why permutation tests are superior to t and F tests in biomedical research. The American Statistician, 52, 127–132.
36.
LunneborgC. E. (2000) Data analysis by resampling: Concepts and applications. Pacific Grove, CA: Duxbury.
37.
ManlyB. F. J. (2007) Randomization, bootstrap and Monte Carlo methods in biology. (3rd ed.) London: Chapman & Hall/CRC.
38.
MarascuiloL. A.McSweeneyM. (1977) Nonparametric and distribution-free methods for the social sciences. Belmont, CA: Brooks/Cole.
39.
MarascuiloL. A.SerlinR. C. (1988) Statistical methods for the social and behavioral sciences. New York: Freeman.
40.
MayR. B.HunterM. A. (1993) Some advantages of permutation tests. Canadian Psychology, 34, 401–407.
41.
MayR. B.MassonM. E. J.HunterM. A. (1990) Application of statistics in behavioral research. New York: Harper & Row.
42.
MicceriT. (1989) The unicorn, the normal curve, and other improbable creatures. Psychological Bulletin, 105, 156–166.
43.
MielkeP. W.BerryK. J. (2007) Permutation methods: A distance function approach. (2nd ed.) New York: Springer-Verlag.
44.
MyersJ. L.WellA. D. (1991) Research design and statistical analysis. New York: HarperCollins.
45.
NoreenE. W. (1989) Computer intensive methods for testing hypotheses: An introduction. New York: Wiley.
46.
PedhazurE. J. (1982) Multiple regression in behavioral research: Explanation and prediction. (2nd ed.) New York: Holt, Rinehart and Winston.
47.
PesarinF. (2001) Multivariate permutation tests: With applications in biostatistics. Chichester, UK: Wiley.
48.
PitmanE. J. G. (1937a) Significance tests which may be applied to samples from any populations. Supplement to the Journal of the Royal Statistical Society, 4, 119–130.
49.
PitmanE. J. G. (1937b) Significance tests which may be applied to samples from any populations. II. The correlation coefficient test. Supplement to the Journal of the Royal Statistical Society, 4, 225–232.
50.
PitmanE. J. G. (1938) Significance tests which may be applied to samples from any populations: III. The analysis of variance test. Biometrika, 29, 322–335.
51.
ReadT. R. C.CressieN. A. C. (1988) Goodness-of-fit statistics for discrete multivariate data. New York: Springer-Verlag.
52.
RobsonD. S. (1959) A simple method for constructing orthogonal polynomials when the independent variable is unequally spaced. Biometrics, 15, 187–191.
53.
SnedecorG. (1934) Analysis of variance and covariance. Ames, IA: Collegiate Press.
54.
StillA. W.WhiteA. P. (1981) The approximate randomization test as an alternative to the F test in analysis of variance. British Journal of Mathematical and Statistical Psychology, 34, 243–252.
55.
TadikamallaP. R. (1974) Constructing orthogonal polynomials when the independent variable is unequally spaced. Journal of Quality Technology, 6, 113–115.
56.
WaldA.WolfowitzJ. (1944) Statistical tests based on permutations of the observations. Annals of Mathematical Statistics, 15, 358–372.
57.
WelchB. L. (1937) The significance of the difference between two means when the population variances are unequal. Biometrika, 29, 250–262.
58.
WinerB. J. (1962) Statistical principles in experimental design. New York: McGraw-Hill.
