The current article proposes a bootstrap-F method and a bootstrap-T2 method for use in a one-way repeated measure ANOVA design. Using a Monte Carlo approach in which sample size, nonsphericity, and nonnormality are systematically manipulated, the Type I error rate of the two bootstrap methods are compared to that of the traditional F test, the Geisser-Greenhouse adjusted F test, the Box adjusted F test, the Huynh-Feldt adjusted F test, the β-trimmed mean method using β =.1and β = .2, and the one-sample multivariate T2 test. Results show the bootstrap-F method controls Type I error better than all other methods considered when normality and sphericity assumptions are violated simultaneously.
Get full access to this article
View all access options for this article.
References
1.
Aptech Systems . (1996). GAUSS system and graphics manual. Maple Valley, WA: Aptech Systems, Inc.
2.
Box, G.E.P. (1954).Some theorems on quadratic forms applied in the study of analysis of variance problems. Annals of Mathematical Statistics, 25,290-302, 484-498.
3.
Bradley, J. V. (1978).Robustness?British Journal of Mathematical and Statistical Psychology, 31, 144-152.
4.
DeCarlo, L. T. (1997). On the meaning and use of kurtosis. Psychological Methods, 2,292-307.
5.
Diaconis, P. , & Efron, B. (1983, May). Computer-intensive methods in statistics. Scientific American, 116-130.
6.
Efron, B. (1979).Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7,1-26.
7.
Efron, B. , & Gong, G. (1983).A leisurely look at the bootstrap, the jackknife, and cross-validation. American Statistician, 37,36-48.
8.
Fleishman, A. I. (1978).A method for simulating non-normal distributions. Psychometrika, 43,521-532.
9.
Geisser, S. , & Greenhouse, S. W. (1958).An extension of Box’s results on the use of the F distribution in multivariate analysis. Annals of Mathematical Statistics, 29,885-891.
10.
Greenhouse, S. W. , & Geisser, S. (1959).On methods in the analysis of profile data. Psychometrika, 24,95-112.
11.
Harwell, M. R. , & Serlin, R. C. (1997).An empirical study of five multivariate tests for the single factor repeated measures model. Communications in Statistics-Simulation and Computation, 26,605-618.
12.
Huynh, H. , & Feldt, L. S. (1976).Estimation of the Box correction for degrees of freedom from sample data in randomized block and split-plot designs. Journal of Educational Statistics, 1,69-82.
13.
Keppel, G. (1991). Design and analysis: A researcher’s handbook. Englewood Cliffs, NJ: Prentice Hall.
14.
Keselman, J. C. , & Keselman, H. J. (1990).Analyzing unbalanced repeated measures designs. British Journal of Mathematical and Statistical Psychology, 43,265-282.
15.
Lix, L. M. , Keselman, J. C., & Keselman, H. J. (1994, April). Analysis of single-group repeated measures designs: A quantitative review. Paper presented at the annual meeting of the American Educational Research Association, New Orleans, LA.
16.
Lomax, R. G. (1998). Statistical concepts: A second course for education and the behavioral sciences. Mahwah, NJ: Lawrence Erlbaum.
17.
Lunneborg, C. E. (2000). Data analysis by resampling: Concepts and applications. Pacific Grove, CA: Duxbury.
18.
Lunneborg, C. E. , & Tousignant, J. P. (1985).Efron’s bootstrap with application to the repeated measures design. Multivariate Behavioral Research, 20,161-178.
19.
Maxwell, S. E. , & Delaney, H. D. (1990). Designing experiments and analyzing data. Belmont, CA: Wadsworth.
20.
Nevitt, J. , & Hancock, G. R. (1999).PWRCOEFF & NNORMULT: A set of programs for simulating multivariate nonnormal data. Applied Psychological Measurement, 23,54-54.
21.
Quintana, S. M. , & Maxwell, S. E. (1994).A Monte Carlo comparison of seven ε-adjustment procedures in repeated measures designs with small sample sizes. Journal of Educational Statistics, 19,57-71.
22.
Rasmussen, J. L. (1987).Parametric and bootstrap approaches to repeated measures designs. Research Methods, Instruments and Computers, 4,357-360.
23.
Stevens, J. (1996). Applied multivariate statistics for the social sciences. Mahwah, NJ: Lawrence Erlbaum.
24.
Tandon, P. K. , & Moeschberger, M. L. (1989).Comparison of nonparametric and parametric methods in repeated measures designs—A simulation study. Communications in Statistics-Simulation and Computation, 18,777-792.
25.
Vale, C. D. , & Maurelli, V. A. (1983).Simulating multivariate non-normal distributions. Psychometrika, 48,465-471.
26.
Westfall, P. H. , & Young, S. S. (1993). Resampling based multiple testing. New York: John Wiley.
27.
Wilcox, R. R. (1993).Analyzing repeated measures or randomized block designs using trimmed means. British Journal of Mathematical and Statistical Psychology, 46,63-76.
28.
Wilcox, R. R. (1997). Introduction to robust estimation and hypothesis testing. San Diego: Academic Press.
29.
Wilcox, R. R. (1998).How many discoveries have been lost by ignoring modern statistical methods?American Psychologist, 53, 300-314.
