Sage Journals: Discover world-class research

Abstract

This article proposes a generalized distance discriminating method for test with polytomous response (GDD-P). The new method is the polytomous extension of an item response theory (IRT)-based cognitive diagnostic method, which can identify examinees’ ideal response patterns (IRPs) based on a generalized distance index. The similarities between observed response patterns and IRPs for polytomous response situation are measured by the index of GDD-P, and the attribute patterns can be recognized via the relationship between attribute patterns and IRPs. Feasible designs about polytomous Q-matrix and scoring items for polytomous response are also discussed. In simulation, the classification accuracy of the GDD-P method for the test with polytomous response was investigated, and results indicated that the proposed method had promising performance in recognizing examinees’ attribute patterns.

Keywords

IRT-based cognitive diagnosis generalized distance discrimination for polytomous response polytomous Q-matrix item scoring method classification accuracy

Get full access to this article

View all access options for this article.

References

Chiu

Douglas

J. A.

(2009). Cluster analysis for cognitive diagnosis: Theory and applications. Psychometrika, 74, 633-665.

de la Torre

(2008). An empirically-based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45, 343-362.

de la Torre

(2009). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115-130.

de la Torre

(2011). The generalized DINA model framework. Psychometrika, 76, 179-199.

de la Torre

Douglas

(2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333-353.

Ding

S. L.

Yang

S. Q.

Wang

W. Y.

(2010). The importance of reachability matrix in constructing cognitively diagnostic testing. Journal of Jiangxi Normal University (Natural Science), 34, 490-494.

Embretson

S. E.

Reise

S. P.

(2000). Item response theory for psychologists. Mahwah, NJ: Erlbaum.

J. B.

(2005). A polytomous extension of the fusion model and its Bayesian parameter estimation (Unpublished doctoral dissertation). University of Wisconsin, Madison.

J. B.

Y. M.

(2007, April). Cognitively diagnostic psychometric models: An integrative review. Paper presented at NCME, Chicago, IL.

10.

Haertel

E. H.

(1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333-352.

11.

Junker

B. W.

Sijtsma

(2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258-272.

12.

Leighton

J. P.

Gierl

M. J.

Hunka

S. M.

(2004). The attribute hierarchy method for cognitive assessment: A variation on Tatsuoka’s rule-space approach. Journal of Educational Measurement, 41, 205-237.

13.

Maris

(1999). Estimating multiple classification latent class models. Psychometrika, 64, 187-212.

14.

Nichols

P. D.

Chipman

S. F.

Brennan

R. L.

(Eds.). (1995). Cognitively diagnostic assessment. Hillsdale, NJ: Erlbaum.

15.

Rupp

A. A.

Templin

J. L.

(2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68, 78-96.

16.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores (Psychometrika Monograph No. 17). Richmond, VA: Psychometric Society.

17.

Sun

Zhang

Xin

Bao

(2011). A cognitive diagnosis method based on Q-matrix and generalized distance. Acta Psychologica Sinica, 43, 1095-1102.

18.

Tatsuoka

K. K.

(1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354.

19.

Tatsuoka

K. K.

(1995). Architecture of knowledge structure and cognitive diagnosis: A statistical pattern recognition and classification approach. In Nichols

P. D.

Chipman

S. F.

Brennan

R. L.

(Eds.), Cognitively diagnostic assessment (pp. 327-359). Hillsdale, NJ: Erlbaum.

20.

Woodruff

D. J.

Hanson

B. A.

(1996). Estimation of item response models using the EM algorithm for finite mixture (ACT Research Rep. 96–6). Iowa City, IA: ACT.

A Polytomous Extension of the Generalized Distance Discriminating Method

Abstract

Keywords

Get full access to this article

References