This study introduces an order-constrained Bayes inference framework useful for analyzing data containing dichotomous-scored item responses, under the assumptions of either the monotone homogeneity model or the double monotonicity model of nonparametric item response theory (NIRT). The framework involves the implementation of Gibbs sampling to estimate order-constrained parameters, followed by inference with the posterior-predictive distribution to test the monotonicity, invariant item ordering, and local independence assumptions of NIRT. The Bayes framework is demonstrated through the analysis of real test data, and possible extensions of it are discussed.
Get full access to this article
View all access options for this article.
References
1.
Barlow, R. E., Bartholomew, D. J., Bremner, J. M., & Brunk, H. D. (1972). Statistical inference under order restrictions. New York: John Wiley.
2.
Bayarri, M. J., & Berger, J. O. (2000). P-values for composite null models. Journal of the American Statistical Association, 95, 1127-1142.
3.
Bayarri, M. J., & Castellanos, M. E. (2000). A comparison of p-values for goodness-offit checking (Working Paper Series, 00-40, Institute for Statistics and Decision Sciences). Durham, NC: Duke University. Available: http://ftp.isds.duke.edu/WorkingPapers/00-40.ps
4.
Berger, J. O., & Bernardo, J. M. (1992). On the development of the reference prior method. In J. M. Bernardo, J. O. Berger, D. V. Lindley, & A. F. M. Smith (Eds.), Bayesian statistics 4. Oxford, UK: Oxford University Press.
5.
Bernardo, J. M. (1979). Reference posterior distributions for Bayesian inference (with discussion). Journal of the Royal Statistical Society, Series B, 41, 113-147.
6.
Carlin, B. P., & Louis, T. A. (1996). Bayes and empirical Bayes methods for data analysis(Reprint of 1st ed.). New York: Chapman & Hall/CRC.
7.
Croon, M. A. (1991). Investigating Mokken scalability of dichotomous items by means of ordinal latent class analysis. British Journal of Mathematical and Statistical Psychology, 44, 315-341.
8.
Devroye, L. (1986). Non-uniform random variate generation. New York: Springer-Verlag.
9.
Dunson, D. B., & Neelon, B. (2003). Bayesian inferences on order constrained parameters in generalized linear models. Biometrics, 5, 286-295.
10.
Evans, M. (1997). Bayesian inference procedures derived via the concept of relative surprise. Communications in Statistics: Theory and Methods, 26, 1125-1143.
11.
Gelfand, A. E., & Smith, A. F. M. (1990). Samplingbased approaches to calculating marginal densities. Journal of the American Statistical Association, 85, 398-409.
12.
Gelfand, A. E., Smith, A. F. M., & Lee, T.-M. (1992). Bayesian analysis of constrained parameter and truncated data problems using Gibbs sampling. Journal of the American Statistical Association, 87, 523-532.
13.
Gelman, A., Meng, X.-L., & Stern, H. (1996). Posterior predictive assessment of model fitness via realized discrepancies. Statistic Sinica, 6, 733-807.
14.
Geyer, C. J. (1992). Practical Markov chain Monte Carlo. Statistical Science, 7, 473-511.
15.
Grayson, D. A. (1988). Two-group classification in latent trait theory: Scores with monotone likelihood ratio. Psychometrika, 53, 383-392.
16.
Hemker, B. T., Sijtsma, K., Molenaar, I. W., & Junker, B. W. (1997). Stochastic ordering using the latent trait and the sum score in polytomous IRT models. Psychometrika, 62, 331-347.
17.
Hoijtink, H. J. A., & Molenaar, I. W. (1997). A multidimensional item response model: Constrained latent class analysis using the Gibbs sampler and posterior predictive checks. Psychometrika, 62, 171-189.
18.
Holland, P. W., & Rosenbaum, P. R. (1986). Conditional association and unidimensionality in monotone latent variable models. Annals of Statistics, 14, 1523-1543.
19.
Huynh, H. (1994). A new proof for monotone likelihood ratio for the sum of independent Bernoulli random variables. Psychometrika, 59, 77-79.
20.
Johnson, N. L., & Kotz, S. (1970). Continuous univariate distributions(Vol. 2). Boston: Houghton-Mifflin.
21.
Junker, B. W. (1991). Essential independence and likelihood-based ability estimation for polytomous items. Psychometrika, 56, 255-278.
22.
Junker, B. W. (1993). Conditional association, essential independence and monotone unidimensional item response models. Annals of Statistics, 21, 1359-1378.
23.
Junker, B. W., & Ellis, J. L. (1997). A characterization of monotone unidimensional latent variable models. Annals of Statistics, 25, 1327-1343.
24.
Junker, B. W., & Sijtsma, K. (2000). Latent and manifest monotonicity in item response models. Applied Psychological Measurement, 24, 65-81.
25.
Junker, B. W., & Sijtsma, K. (2001). Nonparametric item response theory in action: An overview of the special issue. Applied Psychological Measurement, 25, 211-220.
26.
Karabatsos, G. (2001). The Rasch model, additive conjoint measurement, and new models of probabilistic measurement theory. Journal of Applied Measurement, 2, 389-423.
27.
Karabatsos, G. (2003). A Bayesian Dirichlet model for testing deterministic axioms of measurement and decision. Manuscript under review.
28.
Karabatsos, G. (in press). Additivity tests. In B. Everitt & B. C. Howell (Eds.), Encyclopedia of behavioral statistics. New York: John Wiley.
29.
Karabatsos, G., & Batchelder, W. H. (2003). Markov chain Monte-Carlo estimation for test theory without an answer key. Psychometrika, 68, 373-389.
30.
Karabatsos, G.,& Ullrich, J. (2002). Enumerating and testing conjoint measurement models. Mathematical Social Sciences, 43, 487-505.
31.
Krantz, D. H., Luce, R. D., Suppes, P., & Tversky, A. (1971). Foundations of measurement(Vol. 1). New York: Academic Press.
32.
Liu, J. S., Wong, W. H., & Kong, A. (1994). Covariance structure of the Gibbs sampler with applications to the comparisons of estimators and augmentation schemes. Biometrika, 81, 27-40.
Meredith, W. (1965). Some results based on a general stochastic model for mental tests. Psychometrika, 30, 419-440.
35.
Mokken, R. J. (1971). A theory and procedure of scale analysis. Paris: Mouton.
36.
Mokken, R. J., & Lewis, C. (1982). A non-parametric approach to the analysis of dichotomous item responses. Applied Psychological Measurement, 6, 417-430.
37.
Patz, R. J., & Junker, B. W. (1999). A straight forward approach to Markov chain Monte Carlo methods for item response models. Journal of Educational and Behavioral Statistics, 24, 146-178.
38.
Polson, N., & Wasserman, L. (1990). Prior distributions for the bivariate binomial. Biometrika, 77, 901-904.
39.
Robert, C. P. (2001). The Bayesian choice: From decision-theoretic foundations to computer implementation(2nd ed.). New York: Springer.
40.
Robertson, T., Wright, F. T., & Dykstra, R. L. (1988). Order restricted statistical inference. New York: John Wiley.
41.
Robins, J. M., van der Vaart, A., & Ventura, V. (2000). The asymptotic distribution of p-values for composite null models. Journal of the American Statistical Association, 95, 1143-1156.
42.
Rubin, D. B. (1984). Bayesianly justifiable and relevant frequency calculations for the applied statistician. Annals of Statistics, 12, 1151-1172.
Sijtsma, K. (1988). Contributions to Mokken’s nonparametric item response theory. Amsterdam: Free University Press.
48.
Sijtsma, K. (1998). Methodology review: Nonparametric IRT approaches to the analysis of dichotomous item scores. Applied Psychological Measurement, 22, 3-31.
49.
Sijtsma, K., & Junker, B.W. (1996). A survey for theory and methods of invariant item ordering. British Journal of Mathematical and Statistical Psychology, 49, 79-105.
50.
Stout, W. F. (1990). A new item response theory modeling approach with applications to unidimensionality assessment and ability estimation. Psychometrika, 55, 293-325.
51.
Tierney, L. (1994). Markov chains for exploring posterior distributions. Annals of Statistics, 22, 1701-1728.
52.
Van Onna, M. J. H. (2002). Bayesian estimation and model selection in ordered latent class models for polytomous items. Psychometrika, 67, 519-538.
53.
Vermunt, J. K. (2001). The use of restricted latent class models for defining and testing nonparametric and parametric item response theory models. Applied Psychological Measurement, 25, 283-294.
54.
Yang, R., & Berger, J. O. (1997). A catalog of noninformative priors(Working Paper Series, 97-42, Institute for Statistics and Decision Sciences, Duke University) [Online]. Available: http://ftp.isds.duke.edu/WorkingPapers/97-42.html
55.
Yen, W. M. (1993). Scaling performance assessments: Strategies for managing local item dependence. Journal of Educational Measurement, 30(3), 187-213.
