Invariance of Score Linkings Across Gender Groups for Forms of a Testlet-Based College-Level Examination Program Examination

Abstract

This study investigates whether the functions linking number-correct scores to the College-Level Examination Program (CLEP) scaled scores remain invariant over gender groups, using test data on the 16 testlet-based forms of the CLEP College Algebra exam. To be consistent with the operational practice, linking of various test forms to a common reference form is based on the Rasch model. Equatability indices proposed by Dorans and Holland (2000) were used to evaluate linking invariance over gender subpopulations. Overall, linkings based on the gender groups are very similar to linkings for the total group. At all score levels, differences between subgroup and total group linkings are smaller than the difference that will affect the pass/fail decision for CLEP candidates. On only one form, linking based on the male group would pass slightly more candidates than linking for the total group at the recommended CLEP cut score of 50 due to rounding.

Keywords

Index terms: test equating linking invariance of linking equatability

Get full access to this article

View all access options for this article.

References

Camilli, G. , Wang, M.M. , & Fesq, J. (1995). The effects of dimensionality on equating the Law School Admission Test. Journal of Educational Measurement , 32, 79-96.

Dorans, N.J. , & Feigenbaum, M.D. (1994). Equating issues engendered by changes to the SAT and PSAT/NMSQT. In I. M. Lawrence , N. J. Dorans , M. D. Feigenbaum , N. J. Feryok , A. P. Schmitt , & N. K. Wright (Eds.), Technical issues related to the introduction of the new SAT and PSAT/NMSQT (ETS Research Memorandum No. RM-94-10). Princeton, NJ: Educational Testing Service.

Dorans, N.J. , & Holland, P.W. (2000). Population invariance and equatability of tests: Basic theory and the linear case. Journal of Educational Measurement , 37, 281-306.

Dorans, N.J. , & Kingston, N.M. (1985). The effects of violations of unidimensionality on the estimation of item and ability parameters and on item response theory equating of the GRE verbal scale. Journal of Educational Measurement, 22, 249-262.

Hambleton, R.K. , & Swaminathan, H. (1990). Item response theory: Principles and applications. Boston: Kluwer Nijhoff.

Reckase, M.D. (1979). Unifactor latent trait models applied to multifactor tests: Results and implications. Journal of Educational Statistics , 4, 207-230.

Reckase, M.D. , Ackerman, T.A. , & Carlson, J.E. (1988). Building a unidimensional test using multidimensional items. Journal of Educational Measurement, 25, 193-203.

Stocking, M.L. , & Lord, F.M. (1983). Developing a common metric in item response theory . Applied Psychological Measurement, 7, 201-210.

von Davier, A.A. , Holland, P.W. , & Thayer, D.T. (2004). The chain and post-stratification methods for observed-score equating and their relationship to population invariance. Journal of Educational Measurement, 41, 15-32.

10.

Yang, W.-L. (2004). Sensitivity of linkings between AP multiple-choice scores and composite scores to geographical region: An illustration of checking for population invariance. Journal of Educational Measurement , 41, 33-41.