Sage Journals: Discover world-class research

Abstract

Ramsay and Wiberg used a new version of item response theory that represents test performance over nonnegative closed intervals such as [0, 100] or [0, n] and demonstrated that optimal scoring of binary test data yielded substantial improvements in point-wise root-mean-squared error and bias over number right or sum scoring. We extend these results by showing that optimal scoring of the full information in option choices produces about as much further improvement in these measures of score performance as was achieved by going from sum scoring to optimal binary scoring.

Keywords

item characteristic curves multinomial log-odds transformation log-odds slope weighting;sum scoring optimal scoring two-stage test data analysis

Get full access to this article

View all access options for this article.

References

Lee

Y.-S.

(2007). A comparison of methods for nonparametric estimation of item characteristic curves for binary items. Applied Psychological Measurement, 37, 121–134.

Ramsay

J. O.

(1997). A functional approach to modeling test data. In van der Linden

W. J.

Hambleton

R. K.

(Eds.), Handbook of modern item response theory (pp. 351–367). New York, NY: Springer.

Ramsay

J. O.

Hooker

Graves

(2009). Functional data analysis with R and MATLAB. New York, NY: Springer-Verlag.

Ramsay

J. O.

Silverman

B. W.

(2002). Applied functional data analysis. New York, NY: Springer-Verlag.

Ramsay

J. O.

Wiberg

(2017). A strategy to replace sum scoring. Journal of Educational and Behavioral Statistics, 42, 282–307.

Rossi

Wang

Ramsay

J. O.

(2002). Nonparametric item response function estimates with the EM algorithm. Journal of the Behavioral and Educational Sciences, 27, 291–317.

Wiberg

Ramsay

J. O.

(2018). Optimal scores as an alternative to sum scores. In Wiberg

Culpepper

S. A.

Jansen

González

Molenaar

(Eds.), Quantitative psychology: 82nd Annual Meeting of the psychometric society (pp. 1–10). New York, NY: Springer.

Wiberg

Ramsay

J. O.

(2019). Optimal scores: An alternative to parametric item response theory and sum scores. Psychometrika, 84, 310–322.

Woods

C. M.

(2006). Ramsay-Curve item response theory (RC-IRT) to detect and correct for nonnormal latent variables. Psychological Methods, 11, 253–270.

10.

Woods

C. M.

Thissen

(2006). Item response theory with estimation of the latent population distribution using spline-based densities. Psychometrika, 71, 281–301.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB

Full Information Optimal Scoring

Abstract

Keywords

Get full access to this article

References

Supplementary Material