Sage Journals: Discover world-class research

Abstract

In educational and psychological testing, individuals are often repeatedly measured to assess the changes in their abilities over time or their latent trait growth. If a test consists of several subtests, the latent traits may have a higher order structure, and traditional item response theory (IRT) models for longitudinal data are no longer applicable. In this study, various multilevel higher order item response theory (ML-HIRT) models for simultaneously measuring growth in the second- and first-order latent traits of dichotomous and polytomous items are proposed. A series of simulations conducted using the WinBUGS software with Markov chain Monte Carlo (MCMC) methods reveal that the parameters could be recovered satisfactorily and that latent trait estimation was reliable across measurement times. The application of the ML-HIRT model to longitudinal data sets is illustrated with two empirical examples.

Keywords

item response theory multilevel model higher order model latent growth Bayesian estimation

Get full access to this article

View all access options for this article.

References

Andersen

E. B.

(1985). Estimating latent correlations between repeated testings. Psychometrika, 50, 3-16.

Bianconcini

(2012). A general multivariate latent growth model with applications to student achievement. Journal of Educational and Behavioral Statistics, 37, 339-364.

Birnbaum

(1968). Some latent trait models and their use in inferring an examinees’ ability. In Lord

F. M.

Novick

M. R.

(Eds.), Statistical theories of mental test scores (pp. 397-479). Reading, MA: Addison-Wesley.

Bollen

K. A.

Curran

P. J.

(2006). Latent curve models: A structural equation perspective. New York, NY: John Wiley.

Chang

L.-Y.

(2007). Taiwan education panel survey: Users’ guide and base year (2007) student questionnaire for junior high school. Taipei, Taiwan: Center for Survey Research, Academia Sinica.

De Boeck

Wilson

(Eds.). (2004). Explanatory item response models: A generalized linear and nonlinear approach. New York, NY: Springer.

Embretson

S. E.

(1991). A multidimensional latent trait model for measuring learning and change. Psychometrika, 56, 495-515.

Hoogland

J. J.

Boomsma

(1998). Robustness studies in covariance structure modeling: An overview and a meta-analysis. Sociological Methods & Research, 26, 329-367.

Huang

H.-Y.

Wang

W.-C.

Chen

P.-H.

C.-M.

(2013). Higher-order item response models for hierarchical latent traits. Applied Psychological Measurement, 37, 619-637.

10.

Hung

L.-F.

Wang

W.-C.

(2012). The generalized multilevel facets model for longitudinal data. Journal of Educational and Behavioral Statistics, 37, 231-255.

11.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159-176.

12.

Muthén

(2007). Mplus user’s guide (4th ed.). Los Angeles, CA: Author.

13.

Raykov

(2007). Longitudinal analysis with regressions among random effects: A latent variable modeling approach. Structural Equation Modeling: A Multidisciplinary Journal, 14, 146-169.

14.

Spiegelhalter

D. J.

Best

N. G.

Carlin

B. P.

van der Linde

(2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64, 583-616.

15.

Spiegelhalter

D. J.

Thomas

Best

(2003). WinBUGS version 1.4 [Computer program]. Cambridge, UK: MRC Biostatistics Unit, Institute of Public Health.

16.

Wang

W.-C.

(2004). Effects of anchor item methods on the detection of differential item functioning within the family of Rasch models. Journal of Experimental Education, 72, 221-261.

17.

Y.-Y.

Tsai

C.-C.

Siao

R.-F.

(2010). Parental involvement of Southeastern Asian female immigrants and its relationship to their children’s school life adjustments. Journal of Research in Education Sciences, 55, 157-186.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.26 MB

A Multilevel Higher Order Item Response Theory Model for Measuring Latent Growth in Longitudinal Data

Abstract

Keywords

Get full access to this article

References

Supplementary Material