Sage Journals: Discover world-class research

Abstract

If standard two-parameter item response functions are employed in the analysis of a test with some newly constructed items, it can be expected that, for some items, the item response function (IRF) will not fit the data well. This lack of fit can also occur when standard IRFs are fitted to personality or psychopathology items. When investigating reasons for misfit, it is helpful to compare item response curves (IRCs) visually to detect outlier items. This is only feasible if the IRF employed is sufficiently flexible to display deviations in shape from the norm. A quasi-parametric IRF that can be made arbitrarily flexible by increasing the number of parameters is proposed for this purpose. To take capitalization on chance into account, the use of Akaike information criterion or Bayesian information criterion goodness of approximation measures is recommended for suggesting the number of parameters to be retained. These measures balance the effect on fit of random error of estimation against systematic error of approximation. Computational aspects are considered and efficacy of the methodology developed is demonstrated.

Keywords

item response theory flexible item response function monotonic polynomial

Get full access to this article

View all access options for this article.

References

Akaike

(1973). Information theory and an extension of the maximum likelihood principle. In Petrox

B. N.

Caski

(Eds.), Second international symposium on information theory (pp. 267–281). Budapest, Hungary: Akademiai Kiado.

Baker

F. B.

(1992). Item response theory: Parameter estimation techniques. New York, NY: Marcel Dekker.

Birnbaum

(1968). Some latent trait models and their use in inferring an examinee's ability. In Lord

F. M.

Novick

M. R.

(Eds.), Statistical theories of mental test scores (pp. 399–402). Reading MA: Addison-Wesley.

Bock

R. D.

Aitkin

(1981). Marginal maximum likelihood estimation of item parameters: Application of an EM algorithm. Psychometrika, 46, 443–459.

Bock

R. D.

Lieberman

(1970). Fitting a response model for n dichotomously scored items. Psychometrika, 35, 179–197.

Bock

R. D.

Moustaki

(2007). Item response theory in a general framework. In Rao

C. R.

Sinharay

(Eds.), Handbook of statistics, volume 26: Psychometrics (pp. 469–514). Amsterdam, The Netherlands: North-Holland.

Browne

M. W.

(2000). Cross-validation methods. Journal of Mathematical Psychology, 44, 108–132.

Burnham

K. P.

Anderson

D. R.

(2004). Multimodel inference: Understanding AIC and BIC in model selection. Sociological Methods and Research, 33, 261–304.

Cudeck

Henly

S. J.

(1991). Model selection in covariance structures analysis and the “problem” of sample size: A clarification. Psychological Bulletin, 109, 512–519.

10.

De Leeuw

(1992). Introduction to Akaike (1973) information theory and an extension of the maximum likelihood principle. In Kotz

Johnson

N. L.

(Eds.), Breakthroughs in statistics (Vol. 1, pp. 599–609). London, England: Springer-Verlag.

11.

Drasgow

Levine

M. V.

Williams

McLaughlin

M. E.

Candell

G. L.

(1989). Modeling incorrect responses to multiple-choice items with multilinear formula score theory. Applied Psychological Measurement, 13, 285–299.

12.

Duncan

K. A.

MacEachern

S. N.

(2008). Nonparametric Bayesian modeling for item response. Statistical Modeling, 8, 41–66.

13.

Duncan

K. A.

MacEachern

S. N.

(2013). Nonparametric Bayesian modeling for item response with a three parameter logistic prior mean. In Edwards

M. C.

MacCallum

R. C.

(Eds.), Current topics in the theory and application of latent variable methods. New York, NY: Routledge.

14.

Elphinstone

C. D.

(1983). A target distribution model for nonparametric density estimation. Communications in Statistics—Theory and Methods, 12, 161–198.

15.

Elphinstone

C. D.

(1985). A method of distribution and density estimation (Unpublished dissertation). University of South Africa, Pretoria, South Africa.

16.

Hayley

D.C.

(1952). Estimation of the dosage mortality relationship when the dose is subject to error. (Technical Report No. 15). Stanford, CA: Stanford University, Applied Mathematics and Statistics Laboratory.

17.

Hawkins

D. M.

(1994). Fitting monotonic polynomials to data. Computational Statistics, 9, 233–247.

18.

Lee

Y.-S.

(2007). A comparison of methods for nonparametric estimation of item characteristic curves for binary items. Applied Psychological Measurement, 31, 121–134.

19.

Lord

F. M.

Novick

M. R.

(1968). Statistical theories of mental test scores. Reading, MA: Addison Wesley.

20.

Meijer

R. R.

Baneke

J. J.

(2004). Analyzing psychopathology items: A case for nonmetric item response theory modeling. Psychological Methods, 9, 354–368.

21.

Neyman

Scott

E. L.

(1948). Consistent estimates based on partially consistent observations. Econometrika, 16, 1–32.

22.

Ramsay

J. O.

(1977). Monotonic weighted power transformations to additivity. Psychometrika, 42, 83–109.

23.

Ramsay

J. O.

(1991). Kernel smoothing approaches to nonparametric item characteristic curve estimation. Psychometrika, 56, 611–630.

24.

Ramsay

J. O.

(2000). TestGraf: A program for the graphical analysis of multiple choice test and questionnaire data [Computer program and manual]. Retrieved from http://www.psych.mcgill.ca/faculty/ramsay/ramsay.html

25.

Ramsay

J. O.

Winsberg

(1991). Maximum marginal likelihood estimation for semiparametric item analysis. Psychometrika, 56, 365–379.

26.

Schwarz

(1978). Estimating the dimension of a model. The Annals of Statistics, 6, 461–464.

27.

Sinnott

L. T.

(1997). Filtered polynomial density approximations and their application to discriminant analysis (MS Thesis). The Ohio State University, Columbus, OH.

28.

Thissen

Chen

W.-H

Bock

R. D.

(2003). Multilog (version 7) [Computer software]. Lincolnwood, IL: Scientific Software International.

29.

Thissen

Orlando

(2001). Item response theory for items scored in two categories. In Thissen

Wainer

(Eds.), Test scoring (pp. 73–140). Mahwah, NJ: Lawrence Erlbaum.

30.

Woods

C. M.

Thissen

(2006). Item response theory with estimation of the latent population distribution using spline-based densities. Psychometrika, 71, 281–301.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.12 MB

A Quasi-Parametric Method for Fitting Flexible Item Response Functions

Abstract

Keywords

Get full access to this article

References

Supplementary Material