Sage Journals: Discover world-class research

Abstract

As part of a scale development project, we fit a nominal response item response theory model to responses to the Health Care Engagement Measure (HEM). When using the original 5-point response format, categories were not ordered as intended for six of the 23 items. For the remaining, the category boundary discrimination between Categories 0 (not at all true) and 1 (a little bit true) was only weakly discriminating, suggesting uninformative categories. When the lowest two categories were collapsed, psychometric properties improved greatly. Category boundary discriminations within items, however, varied significantly. Specifically, higher response category distinctions, such as responding 3 (very true) versus 2 (mostly true) were considerably more discriminating than lower response category distinctions. Implications for HEM scoring and for improving measurement precision at lower levels of the construct are presented as is the unique role of the nominal response model in category analysis.

Keywords

nominal response model item response theory patient engagement item discrimination category boundary discrimination

Get full access to this article

View all access options for this article.

References

Andersen

E. B.

(1977). Sufficient statistics and latent trait models. Psychometrika, 42, 69–81.

Andrich

(1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.

Bandura

(2004). Health promotion by social cognitive means. Health Education & Behavior, 31, 143–164. https://doi.org/10.1177/1090198104263660

Berwick

D. M.

Nolan

T. W.

Whittington

(2008). The triple aim: Care, health, and cost. Health Affairs, 27, 759–769. https://doi.org/10.1377/hlthaff.27.3.759

Blumenthal

McGinnis

J. M.

(2015). Measuring vital signs: An IOM report on core metrics for health and health care progress. JAMA, 313, 1901–1902. https://doi.org/10.1001/jama.2015.4862

Bock

R. D.

(1972). Estimating item parameters and latent ability when responses are scored in two or more nominal categories. Psychometrika, 37, 29–51.

Bock

R. D.

(1997). The nominal categories model. In van der Linden

W. J.

Hambleton

R. K.

(Eds.), Handbook of modern item response theory (pp. 33–49). Springer.

Bock

R. D.

Mislevy

R. J.

(1982). Adaptive EAP estimation of ability in a microcomputer environment. Applied Psychological Measurement, 6, 431–444.

Carman

K. L.

Dardess

Maurer

Sofaer

Adams

Bechtel

Sweeney

(2013). Patient and family engagement: A framework for understanding the elements and developing interventions and policies. Health Affairs, 32, 223–231. https://doi.org/10.1377/hlthaff.2012.1133

10.

Chalmers

R. P.

(2012). Mirt: A multidimensional item response theory package for the R environment. Journal of Statistical Software, 48, 1–29.

11.

Dzau

V. J.

McClellan

M. B.

McGinnis

Burke

S. P.

Coye

M. J.

Diaz

Daschle

T. A.

Frist

W. H.

Gaines

Hamburg

M. A.

Henney

J. E.

Kumanyika

Leavitt

M. O.

Parker

R. M.

Sandy

L. G.

Schaeffer

L. D.

Steele

G. D.

Jr. Thompson

Zerhouni

(2017). Vital directions for health and health care: Priorities from a national academy of medicine initiative. JAMA, 317, 1461–1470. https://doi.org/10.1001/jama.2017.1964

12.

Falk

C. F.

(2020). Estimation of response styles using the multidimensional nominal response model: A tutorial and comparison with sum scores. Frontiers in Psychology, 11, Article 72.

13.

Gensheimer

S. G.

A. W.

Snyder

C. F.

, PRO-EHR Users’ Guide Steering Group, & PRO-EHR Users’ Guide Working Group. (2018). Oh, the places we’ll go: Patient-reported outcomes and electronic health records. The Patient, 11, 591–598. https://doi.org/10.1007/s40271-018-0321-9

14.

Gruman

Rovner

M. H.

French

M. E.

Jeffress

Sofaer

Shaller

Prager

D. J.

(2010). From patient education to patient engagement: Implications for the field of patient education. Patient Education and Counseling, 78, 350–356. https://doi.org/10.1016/j.pec.2010.02.002

15.

Kimerling

Lewis

E. T.

Javier

S. J.

Zulman

D. M.

(2020). Opportunity or burden? A behavioral framework for patient engagement. Medical Care, 58, 161–168. https://doi.org/10.1097/MLR.0000000000001240

16.

Lucke

J. F.

(2014). Unipolar item response models. In Reise

Revicki

(Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 272–284). Routledge.

17.

Masters

G. N.

(1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149–174.

18.

Muraki

(1992). A generalized partial credit model: Application of an EM algorithm. ETS Research Report Series, 1992(1), i–30.

19.

Pilkonis

P. A.

Choi

S. W.

Reise

S. P.

Stover

A. M.

Riley

W. T.

Cella

, & PROMIS Cooperative Group. (2011). Item banks for measuring emotional distress from the Patient-Reported Outcomes Measurement Information System (PROMIS®): Depression, anxiety, and anger. Assessment, 18, 263–283.

20.

Preston

K. S.

Reise

S. P.

(2014). Detecting faulty within-item category functioning with the nominal response model. In Reise

S. P.

Revicki

(Eds.), Handbook of item response theory modeling: Applications to typical performance assessment (pp. 404–423). Routledge.

21.

Preston

K. S.

Reise

S. P.

Cai

Hays

R. D.

(2011). Using the nominal response model to evaluate response category discrimination in the PROMIS emotional distress item pools. Educational and Psychological Measurement, 71, 523–550.

22.

Revelle

(2019). psych: Procedures for psychological, psychometric, and personality research (R package version 1.9.12, 31 ed.). The Comprehensive R Archive Network.

23.

Samejima

(1969). Estimation of latent ability using a response pattern of graded scores. Psychometrika Monograph Supplement, 34(4 Pt. 2), Article 100.

24.

Schalet

B. D.

Reise

S. P.

Zulman

D. M.

Lewis

E. T.

Kimerling

(2021). Psychometric evaluation of a patient-reported item bank for healthcare engagement. Quality of Life Research, 30, 2363–2374.

25.

Thissen

Steinberg

(1986). A taxonomy of item response models. Psychometrika, 49, 501–519.

26.

Thissen

Steinberg

Fitzpatrick

A. R.

(1989). Multiple-choice models: The distractors are also part of the item. Journal of Educational Measurement, 26, 161–176.

27.

Thissen

Cai

Bock

R. D.

Nering

M. L.

Ostini

(2010). Handbook of polytomous item response theory models: Developments and applications (pp. 43–75). Routledge.

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.04 MB

Response Category Functioning on the Health Care Engagement Measure Using the Nominal Response Model

Abstract

Keywords

Get full access to this article

References

Supplementary Material