This study compared the accuracies of nine previously proposed statistical significance tests for selecting identity, linear, and equipercentile equating functions in an equivalent groups equating design. The strategies included likelihood ratio tests for the loglinear models of tests' frequency distributions, regression tests, Kolmogorov—Smirnov tests, and equated score difference tests. Results showed that the most accurate strategies were the likelihood ratio tests and the equated score difference tests. The implications of these results are discussed in terms of applications to equating practice.
Dorans, N.J., & Lawrence, I.M. (1990). Checking the statistical equivalence of nearly identical test editions. Applied Measurement in Education, 3, 245-254.
5.
Hanson, B.A. (1996). Testing for differences in test score distributions using loglinear models. Applied Measurement in Education, 9(4), 305-321.
6.
Holland, P.W., & Thayer, D.T. (1987). Notes on the use of log-linear models for fitting discrete probability distributions (Technical Rep. No. 87-79). Princeton, NJ: Educational Testing Service.
7.
Holland, P.W., & Thayer, D.T. (2000). Univariate and bivariate loglinear models for discrete test score distributions. Journal of Educational and Behavioral Statistics, 25, 133-183.
8.
Jaeger, R.M. (1981). Some exploratory indices for selection of a test equating method. Journal of Educational Measurement, 18, 23-38.
9.
Kolen, M.J., & Brennan, R.J. (2004). Test equating: Methods and practices (2nd ed.). New York: Springer-Verlag.
Lomax, R.G. (2001). Statistical concepts: A second course for education and the behavioral sciences (2nd ed.). Mahwah, NJ: Lawrence Erlbaum.
12.
Moses, T., & Holland, P. (2007). Kernel and traditional equipercentile equating with degrees of presmoothing (Research Rep. No. 07-15). Princeton, NJ: Educational Testing Service.
13.
Moses, T., & Holland, P.W. (in press). Notes on a general framework for observed score equating . Princeton, NJ: Educational Testing Service.
14.
Moses, T., Yang, W., & Wilson, C. (2007). Using kernel equating to assess item order effects on test scores. Journal of Educational Measurement, 44(2), 157-178.
15.
Smirnov, N.V. (1948). Table for estimating the goodness of fit of empirical distributions. Annals of Mathematical Statistics, 19, 279-281.
16.
von Davier, A.A., Holland, P.W., & Thayer, D.T. (2004). The kernel method of test equating. New York: Springer-Verlag.
17.
Wilcox, R.R. (2005). Introduction to robust estimation and hypothesis testing (2nd ed.). San Diego, CA: Academic Press.
