The authors used Monte Carlo methods to assess the per-contrast and experimentwise Type I error rates of two post hoc tests of cellwise residuals and four post hoc tests of pairwise contrasts in 3 4 chi-square contingency tables. The six post hoc procedures were evaluated under three sample sizes and under the null hypotheses of independence and homogeneity. Results of the study indicate that the cellwise adjusted residual method provided adequate experimentwise Type I error rate control when appropriate adjustments to the alpha level were made, and the Gardner pairwise post hoc procedure provided several advantages over the other pairwise procedures. This was true for both the independence and homogeneity models.
Get full access to this article
View all access options for this article.
References
1.
Agresti, A. (1996). An introduction to categorical data analysis. New York: John Wiley.
2.
Beasley, T. M. , & Schumacker, R. E. (1995). Multiple regression approach to analyzing contingency tables: Post hoc and planned comparison procedures. Journal of Experimental Education, 64(1), 79-93.
3.
Delucchi, K. L. (1983). The use and misuse of chi-square: Lewis and Burke revisited. Psychological Bulletin, 94(1), 166-176.
4.
Delucchi, K. L. (1993). On the use and misuse of chi-square. In G. Keren & C. Lewis (Eds.), A handbook for data analysis in the behavioral sciences: Statistical issues. Hillsdale, NJ: Lawrence Erlbaum.
5.
Edgington, E. S. (1974). A new tabulation of statistical procedures used in APA journals. American Psychologist, 29, 25-26.
6.
Evans, M. , Hastings, N., & Peacock, B. (1993). Statistical distributions (2nd ed.). New York: John Wiley.
7.
Gardner, R. C. (in press). Psychological statistics using SPSS for Windows. Upper Saddle River, NJ: Prentice Hall.
8.
Gart, J. J. (1962). Approximate confidence limits for the relative risk. Journal of the Royal Statistical Society, Series B, 24, 454-463.
9.
Gold, R. Z. (1963). Tests auxillary to tests in a Markov chain. Annals of Mathematical Statistics, 32, 535-548.
10.
Goodman, L. A. (1964a). Simultaneous confidence intervals for contrasts among multinomial populations. Annals of Mathematical Statistics, 35, 716-725.
11.
Goodman, L. A. (1964b). Simultaneous confidence limits for cross-products ratios in contingency tables. Journal of the Royal Statistical Society, Series B, 26, 86-102.
12.
Goodwin, L. D. , & Goodwin, W. L. (1985). Statistical techiniques in AERJ articles, 1979-1983: The preparation of graduate students to read the educational research literature. Educational Researcher, 14, 5-11.
13.
Haberman, S. J. (1973). The analysis of residuals in cross-classified tables. Biometrics, 29, 205-220.
14.
Haberman, S. J. (1978). Analysis of qualitative data (Vol. 1). London: Academic Press.
15.
Hinkle, D. E. , Wiersma, W., & Jurs, S. G. (1988). Applied statistics for the behavioral sciences (2nd ed.). Boston: Houghton Mifflin.
16.
Lam, T. C. (1996). On the interpretation of an R A C chi-square: A Monte Carlo investigation. Unpublished senior undergraduate honors thesis, University of Western Ontario, London, Ontario, Canada.
17.
Marascuilo, L. A. , & McSweeney, M. (1977). Nonparametric and distribution-free methods for the social sciences. Monterey, CA: Brooks/Cole.
18.
Marascuilo, L. A. , & Serlin, R. C. (1988). Statistical methods for the social and behavioral sciences. New York: W. H. Freeman.
19.
Mouly, G. J. (1978). Educational research: The art and science of investigation. Boston: Allyn & Bacon.
20.
Popham, W. J. , & Sirotnik, K. A. (1973). Educational statistics: Use and interpretation (2nd ed.). New York: Harper & Row.
21.
Reynolds, H. T. (1984). Analysis of nominal data. Beverly Hills, CA: Sage.
22.
Schinka, J. A. , LaLone, L., & Broeckel, J. A. (1997). Statistical methods in personality assessment research. Journal of Personality Assessment, 68(3), 487-496.
23.
Seaman, M. H. , & Hill, C. C. (1996). Pairwise comparisons for proportions: A note on Cox and Key. Educational and Psychological Measurement, 56(3), 452-459.
24.
Sidak, Z. (1967). Rectangular confidence regions for the means of multivariate normal distributions. Journal of the American Statistical Association, 62, 626-633.
25.
Siegel, S. , & Castellan, N. J. (1988). Nonparametric statistics for the behavioral sciences (2nd ed.). New York: McGraw-Hill.
26.
Thompson, B. (1988). Misuse of chi-square contingency-table test statistics. Educational and Psychological Research, 8(1), 39-49.
