Sage Journals: Discover world-class research

Abstract

We present a monotonic polynomial graded response (GRMP) model that subsumes the unidimensional graded response model for ordered categorical responses and results in flexible category response functions. We suggest improvements in the parameterization of the polynomial underlying similar models, expand upon an underlying response variable derivation of the model, and in lieu of an overall discrimination parameter we propose an index to aid in interpreting the strength of relationship between the latent variable and underlying item responses. In applications, the GRMP is compared to two approaches: (a) a previously developed monotonic polynomial generalized partial credit (GPCMP) model; and (b) logistic and probit variants of the heteroscedastic graded response (HGR) model that we estimate using maximum marginal likelihood with the expectation–maximization algorithm. Results suggest that the GRMP can fit real data better than the GPCMP and the probit variant of the HGR, but is slightly outperformed by the logistic HGR. Two simulation studies compared the ability of the GRMP and logistic HGR to recover category response functions. While the GRMP showed some ability to recover HGR response functions and those based on kernel smoothing, the HGR was more specific in the types of response functions it could recover. In general, the GRMP and HGR make different assumptions regarding the underlying response variables, and can result in different category response function shapes.

Keywords

graded response model nonparametric item response theory monotonic polynomial heteroscedastic graded response model

Get full access to this article

View all access options for this article.

References

Birnbaum

(1968). Some latent trait models and their use in inferring an examinee’s ability. In Lord

Novick

M. R.

(Eds.), Statistical theories of mental test scores (pp. 395–479). Addison-Wesley.

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443–459.

Bock

R. D.

Lieberman

(1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179–197.

Bolt

D. M.

(2005). Limited and full information estimation of item response theory models. In Maydeu-Olivares

McArdle

J. J.

(Eds.), Contemporary psychometrics (pp. 27–71). Lawrence Erlbaum.

Chalmers

R. P.

(2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48(6), 1–29.

Condon

D. M.

(2018). The SAPA personality inventory: An empirically-derived, hierarchically-organized self-report personality assessment model. https://doi.org/10.31234/osf.io/sc4p9

Condon

D. M.

Revelle

(2015). Selected personality data from the SAPA-project: 08Dec2013 to 26Jul2014 [Data set]. Harvard Dataverse. http://doi.org/10.7910/DVN/SD7SVE

Duncan

K. A.

MacEachern

S. N.

(2013). Nonparametric Bayesian modeling of item response curves with a three-parameter logistic prior mean. In Edwards

M. C.

MacCallum

R. C.

(Eds.), Current topics in the theory and application of latent variable models (pp. 108–125). Routledge.

Falk

C. F.

(2019). Model selection for monotonic polynomial item response models. In Wiberg

Culpepper

Janssen

Gonzalez

Molenaar

(Eds.), Quantitative psychology: The 83rd annual meeting of the psychometric society (pp. 75–85). Springer Nature.

10.

Falk

C. F.

Cai

(2016a). Maximum marginal likelihood estimation of a monotonic polynomial generalized partial credit model with applications to multiple group analysis. Psychometrika, 81, 434–460.

11.

Falk

C. F.

Cai

(2016b). Semi-parametric item response functions in the context of guessing. Journal of Educational Measurement, 53, 229–247.

12.

Feuerstahler

L. M.

(2016). Exploring alternate latent trait metrics with the filtered monotonic polynomial IRT model [Doctoral thesis]. Department of Psychology, University of Minnesota.

13.

Feuerstahler

L. M.

(2019). Metric transformations and the filtered monotonic polynomial item response model. Psychometrika, 84, 105–123.

14.

Hansen

Cai

Stucky

B. D.

Tucker

J. S.

Shadel

W. G.

Edelen

M. O.

(2014). Methodology for developing and evaluating the PROMIS® smoking item banks. Nicotine & Tobacco Research, 16(Suppl. 3), S175–S189.

15.

Lee

Ashton

M. C.

(2018). Psychometric properties of the HEXACO-100. Assessment, 25, 543–556.

16.

Lee

Bolt

D. M.

(2018). Asymmetric item characteristic curves and item complexity: Insights from simulation and real data analyses. Psychometrika, 83, 453–475.

17.

Lee

Y.-S.

(2007). A comparison of methods for nonparametric estimation of item characteristic curves for binary items. Applied Psychological Measurement, 31, 121–134.

18.

Liang

(2007). A semi-parametric approach to estimating item response functions [Doctoral thesis]. Department of Psychology, The Ohio State University.

19.

Liang

Browne

M. W.

(2015). A quasi-parametric method for fitting flexible item response functions. Journal of Educational and Behavioral Statistics, 40, 5–34.

20.

Lord

F. M.

(1980). Applications of item response theory to practical testing problems. Lawrence Erlbaum.

21.

Maydeu-Olivares

(2005). Further empirical results on parametric versus non-parametric IRT modeling of Likert-type personality data. Multivariate Behavioral Research, 40, 261–279.

22.

Mazza

Punzo

McGuire

(2013). KernSmoothIRT: Nonparametric Item Response Theory (R Package Version 5.0). http://CRAN.R-project.org/package=KernSmoothIRT

23.

Meijer

R. R.

Baneke

J. J.

(2004). Analyzing psychopathology items: A case for nonparametric item response theory modeling. Psychological Methods, 9(3), 354–368.

24.

Mislevy

R. J.

(1986). Bayes modal estimation in item response models. Psychometrika, 51(2), 177–195.

25.

Miyazaki

Hoshino

(2009). A Bayesian semiparametric item response model with drichlet process priors. Psychometrika, 74(3), 375–393.

26.

Molenaar

Dolan

C. V.

de Boeck

(2012). The heteroscedastic graded response model with a skewed latent trait: Testing statistical and substantive hypotheses related to skewed item category functions. Psychometrika, 77(3), 455–478.

27.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm. Applied Psychological Measurement, 16, 159–176.

28.

Murray

Müller

Turlach

B. A.

(2013). Revisiting fitting monotone polynomials to data. Computational Statistics, 28, 1989–2005.

29.

Neale

M. C.

Boker

S. M.

Xie

Maes

H. H.

(2002). Mx: Statistical modeling (6th ed.). Virginia Commonwealth University.

30.

Neale

M. C.

Hunter

M. D.

Pritikin

J. N.

Zahery

Brick

T. R.

Kickpatrick

R. M.

Boker

S. M.

(2016). OpenMx 2.0: Extended structural equation and statistical modeling. Psychometrika, 81, 535–549.

31.

Orlando

Thissen

(2000). Likelihood-based item-fit indices for dichotomous item response theory models. Applied Psychological Measurement, 24, 50–64.

32.

Pritikin

J. N.

(2016). rpf: Response probability functions. https://CRAN.R-project.org/package=rpf

33.

Pritikin

J. N.

Hunter

M. D.

Boker

S. M.

(2015). Modular open-source software for item factor analysis. Educational and Psychological Measurement, 75(3), 458–475.

34.

Ramsay

J. O.

(1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56(4), 611–630.

35.

Ramsay

J. O.

Wiberg

(2017). A strategy for replacing sum scoring. Journal of Educational and Behavioral Statistics, 42(3), 282–307.

36.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometric Monographs, 17.

37.

Samejima

(1972). A general model of free-response data. Psychometric Monographs, 18.

38.

Samejima

(2000). Logistic positive exponent family of models: Virture of asymmetric item characteristic curves. Psychometrika, 65, 319–335.

39.

Samejima

(2008). Graded response model based on the logistic positive exponent family of models for dichotomous response. Psychometrika, 73, 561–578.

40.

Samejima

(2010). The general graded response model. In Nering

Ostini

(Eds.), Handbook of polytomous item response theory models: Developments and applications (pp. 77–107). Taylor & Francis.

41.

Santor

D. A.

Ramsay

J. O.

Zuroff

D. C.

(1994). Nonparametric item analyses of the Beck Depression Inventory: Evaluating gender item bias and response option weights. Psychological Assessment, 6(3), 255–270.

42.

Takane

de Leeuw

(1987). On the relationship between item response theory and factor analysis of discretized variables. Psychometrika, 52(3), 393–408.

43.

Turlach

B. A.

Murray

(2019). MonoPoly: Functions to fit monotone polynomials. https://rdrr.io/cran/MonoPoly/

44.

Waller

Feuerstahler

L. M.

(2017). Bayesian model estimation of the four-parameter item response model in real, realistic, and idealized data sets. Multivariate Behavioral Research, 52, 350–370.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.44 MB

The Monotonic Polynomial Graded Response Model: Implementation and a Comparative Study

Abstract

Keywords

Get full access to this article

References

Supplementary Material