A ten-year review of the Clothing and Textiles Research Journal, Home Economics Research Journal, and Journal of Consumer Studies and Home Economics was conducted to investigate methods used by clothing and textiles researchers for pairwise mean comparisons. The mostpopular methods included Fisher's Least Significant Difference, Duncan's Multiple Range, and the Scheffe and Newman-Keuls procedures. Problems of familywise Type I error control associated with the Fisher, Duncan, and Newman-Keuls methods, and the potential lack of power of Scheffe's test are discussed Some alternative multiple comparison methods, for both independent and correlated groups designs, are considered Methods for obtaining numerical results for these procedures are discussed, and illustrative examples are provided.
Carmer, S.G., & Swanson, M.R. (1973). An evaluation of ten multiple comparison procedures by Monte Carlo methods. Journal of the American Statistical Association,68, 66-74.
2.
Cohen, J. ( 1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
3.
Dixon, W.J., Brown, M.B., Engelman, L., Hill, M.A., & Jennrich, R.I. (1990). BMDP statistical software manual, Vol. 2 (rev. ed.). Berkeley: University of California Press.
4.
Duncan, D.B. (1955). Multiple range and multiple F tests. Biometyics, 11, 1-42.
5.
Dunn, O.J. (1961). Multiple comparisons among means. Journal of the American Statistical Association,56, 52-64.
6.
Dunnett, C.W. (1955). A multiple comparison procedure for comparing several treatments with a control. Journal of the American Statistical Association,50, 1096-1121.
7.
Einot, I., & Gabriel, K.R. (1975). A study of the powers of several methods in multiple comparisons. Journal of the American Statistical Association,70, 574-583.
8.
Fisher, R.A. (1935). The design of experiments. Edinburgh: Oliver & Boyd.
9.
Games, P.A., & Howell, J.F. (1976). Pairwise multiple comparison procedures with unequal n's and/or variances: A Monte Carlo study. Journal of Educational Statistics, 1, 113-125.
10.
Green, S., & Barcikowski, R.S. (1992, April). Sphericity in the repeated measures univariate mixed-model design. Paper presented at the annual meeting of the American Educational Research Association, San Francisco.
11.
Hayter, A.J. (1986). The maximum familywise error rate of Fisher's least significant difference test. Journal of the American Statistical Association,81, 1000-1004.
12.
Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802.
13.
Hochberg, Y., & Tamhane, A.C. (1987). Multiple comparison procedures. New York: John Wiley.
14.
Hutton, S.S. (1984). State of the art: Clothing as a form of human behavior. Home Economics Research Journal, 12, 340-353.
15.
Huynh, H., & Feldt, L.S. (1970). Conditions under which mean square ratios in repeated measurements designs have exact F-distributions. Journal of the American Statistical Association,65, 1582-1589.
16.
Jaccard, J., Becker, M.A., & Wood, G. (1984). Pairwise multiple comparison procedures: A review . Psychological Bulletin, 96, 589-596.
17.
Keselman, H.J. (1982). Multiple comparisons for repeated measures means . Multivariate Behavioral Research, 17, 87-92.
18.
Keselman, H.J., & Keselman, J.C. (1993). Analysis of repeated measurements . In L. K. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 105-146). New York: Marcel Dekker.
19.
Keselman, H.J., Keselman, J.C., & Shaffer, J.P. (1991). Multiple pairwise comparisons of repeated measures means under violation of multisample sphericity. Psychological Bulletin,110, 162-170.
20.
Keuls, M. (1952). The use of the "Studentized range" in conjunction with an analysis of variance. Euphytica, 1, 112-122.
21.
Kirk, R.E. (1982). Experimental design: Procedures for the behavioral sciences. Monterey, CA: Brooks/Cole.
22.
Lix, L.M., & Keselman, H.J. (in press). Approximate degrees of freedom tests: A unified perspective on testing for mean equality. Psychological Bulletin
23.
Maxwell, S.E. (1980). Pairwise multiple comparisons in repeated measures designs. Journal of Educational Statistics, 5, 269-287.
24.
Maxwell, S.E., & Delaney, H.D. (1990). Designing experiments and analyzing data: A model comparison perspective. Belmont, CA: Wadsworth.
25.
Moran, J.D., III. (1986). Let the t-test rest in peace: A note on the control of error rates. Home Economics Research Journal, 14, 380-383.
26.
Newman, D. (1939). The distribution of the range in samples from a normal population expressed in terms of an independent estimate of standard deviation. Biometrika, 31, 20-30.
27.
Myers, J.L., & Well, A.D. ( 1991 ). Research design and statistical analysis. New York: Harper Collins.
28.
Norusis, M.J. (1990). SPSS introductory statistics. New York: McGraw-Hill.
29.
Olejnik, S., & Lee, J. (1990). Multiple comparison procedures when population variances differ. Paper presented at the annual meeting of the American Educational Research Association, Boston. (ERIC Document Reproduction Service No. ED 319 754)
30.
Oliver, B.A., & Mahoney, M.Y. ( 1991 ). The Clothing and Textiles Research Journal: An empirical examination. Clothing and Textiles Research Journal , 9(3), 22-27.
31.
Ramsey, P.H. (1993). Multiple comparisons of independent means. In L. K. Edwards (Ed.), Applied analysis of variance in behavioral science (pp. 25-62). New York: Marcel Dekker.
32.
Ramsey, P.H., & Ramsey, P.P. (1990). Critical values for two multiple comparison procedures based on the studentized range distribution. Journal of Educational Statistics, 15, 341-352.
33.
Ryan, T.A. (1960). Significance tests for multiple comparison of proportions, variance, and other statistics. Psychological Bulletin,57, 318-328.
34.
SAS Institute Inc. (1989). SASlSTAT user's guide, Version 6 (4th ed.). Cary, NC: Author.
35.
Scheffe, H. (1953). A method for judging all contrasts in analysis of variance. Biometrika, 40, 87-104.
36.
Seaman, M.A., Levin, J.R., & Serlin, R.C. (1991). New developments in pairwise multiple comparisons: Some powerful and practicable procedures. Psychological Bulletin,110, 577-586.
37.
Shaffer, J.P. (1979). Comparison of means: An F test followed by a modified multiple range procedure. Journal of Educational Statistics , 1, 14-23.
38.
Stevens, J. (1992). Applied multivariate statistics for the social sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum Associates.
39.
Stoline, M.R. (1981). The status of multiple comparisons: Simultaneous estimation of all pairwise comparisons in one-way ANOVA designs. The American Statistician, 35, 134-141.
40.
Toothaker, L.E. (1991). Multiple comparisons for researchers. Newbury Park, CA: Sage.
41.
Turnbull, S.G., & Lix, L.M. (1991). Looking back: A content analysis of clothing and textiles research. Unpublished manuscript, University of Manitoba, Winnipeg, MB.
42.
Welsch, R.E. (1977). Stepwise multiple comparison procedures. Journal of the American Statistical Association, 72, 566-575.
43.
Wilcox, R.R. (1989). New designs in analysis of variance. Annual Review ofPsychology, 38, 29-60.
