With its basis in the development of intelligence testing, classical test theory paved the way to develop patient-reported outcome measures – tools capable of quantifying otherwise immeasurable traits. In hand surgery, many of the popular outcome measures were developed using classical test theory. However, these techniques are increasingly being superseded by novel mathematical approaches. This review article will chart the progress from established scientific methods through to modern day item response theory and computerized adaptive testing, and explore the opportunities that artificial intelligence may afford.
AbbottR.I think, therefore I invent: creative computers and the future of patent law. Boston College Law Review. 2016,
57: 1079–126.
2.
AiyegbusiOLRoydhouseJRiveraSC, et al.
Key considerations to reduce or address respondent burden in patient-reported outcome (pro) data collection. Nature Communications. 2022,
13: 6026.
3.
BorsboomDMellenberghGJvan HeerdenJ.The theoretical status of latent variables. Psychol Rev. 2003,
110: 203–19.
4.
Choi SW, Lim S, Schalet BD, Kaat AJ, Cella D. PROsetta: An R package for linking patient-reported outcome measures. Psychological Measurement. 2021, 45: 386–88.
5.
ChowdhuryG.Natural language processing. ARIST. 2005,
37: 51–89.
6.
DeVillisRF.Scale Development: Theory and Applications, 3 edn.
London,
Sage, 2011.
7.
DowrickASGabbeBJWilliamsonODCameronPA.Does the disabilities of the arm, shoulder and hand (dash) scoring system only measure disability due to injuries to the upper limb?J Bone Joint Surg Br. 2006,
88: 524–7.
8.
FanZWangCChangH-HDouglasJ.Utilizing response time distributions for item selection in cat. J Educ Behav Statist. 2012,
37: 655–70.
9.
GiladiAMChungKC.Measuring outcomes in hand surgery. Clin Plast Surg. 2013,
40: 313–22.
10.
GoldbergLRJohnsonJAEberHW, et al.
The international personality item pool and the future of public-domain personality measures. J Res Personal. 2006,
40: 84–96.
11.
HanKCT.Components of the item selection algorithm in computerized adaptive testing. J Educ Eval Health Prof. 2018,
15: 7.
12.
HarrisonCClellandADDavisTRC, et al.
A comparative analysis of multidimensional computerized adaptive testing for the dash and quickdash scores in dupuytren's disease. J Hand Surg Eur Vol. 2022,
47: 750–4.
13.
HarrisonCTrickettRWormaldJ, et al.
Remote symptom monitoring with ecological momentary computerized adaptive testing: pilot cohort study of a platform for frequent, low-burden, and personalized patient-reported outcome measures. J Med Internet Res. 2023,
25: e47179.
14.
HaysRDMoralesLSReiseSP.Item response theory and health outcomes measurement in the 21st century. Med Care. 2000,
38: II28–42.
15.
HijjiFYLondonDASchneiderADViaGGFrankoOI.Automating patient-reported outcome measures following hand surgery. J Hand Surg Am. 2024,
49: 1272e1–e7.
16.
HuZLinLWangYLiJ.The integration of classical testing theory and item response theory. Psychology. 2021,
12: 1397–409.
17.
HuangRSBenourAKemppainenJLeungFH.The future of AI clinicians: assessing the modern standard of chatbots and their approach to diagnostic uncertainty. BMC Med Educ. 2024,
24: 1133.
18.
HungMStuartARHigginsTFSaltzmanCLKubiakEN.Computerized adaptive testing using the promis physical function item bank reduces test burden with less ceiling effects compared with the short musculoskeletal function assessment in orthopaedic trauma patients. J Orthop Trauma. 2014,
28: 439–43.
19.
Lloyd-HughesHGeogheganLRodriguesJ, et al.
Systematic review of the use of patient reported outcome measures in studies of electively-managed hand conditions. J Hand Surg Asian Pac Vol. 2019,
24: 329–41.
20.
McCarthy A, Yancey K, LaFlair G, Egbert J, Liao M, Settles B. Jump-starting item parameters for adaptive language tests. Proceedings of the 2021 conference on empirical methods in natural language processing. Online and Punta Cana, Dominican Republic. Association for Computational Linguistics, 2021, 883–99.
21.
MorrisSBBassMHowardENeapolitanRE.Stopping rules for computer adaptive testing when item banks have nonuniform information. Int J Test. 2020,
20: 146–68.
22.
RogersMJDaryoushJRZhangCCizikAPressonAPKazmersNH.Crosswalk between the promis physical function cat and promis upper extremity cat v1.2 in a hand surgery population. J Patient Rep Outcomes. 2024,
8: 53.
23.
SettlesBT. LaFlairGHagiwaraM.Machine learning-driven language assessment. Trans Assoc Computat Linguist. 2020,
8: 247–63.
24.
ShiffmanSStoneAAHuffordMR.Ecological momentary assessment. A Rev Clin Psychol. 2008,
4: 1–32.
25.
StirlingPHCMcEachanJERodriguesJNHarrisonCJ.Quickdash questionnaire items behave as 2 distinct subscales rather than one scale in Dupuytren’s disease. J Hand Ther. 2023,
36: 228–33.
26.
TerweeCBBotSDde BoerMR, et al.
Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007,
60: 34–42.
27.
TerweeCBMokkinkLBKnolDLOsteloRWBouterLMde VetHC.Rating the methodological quality in systematic reviews of studies on measurement properties: a scoring system for the cosmin checklist. Qual Life Res. 2012,
21: 651–7.
28.
TeunissenJSHoviusSERUlrichDJOIssaFRodriguesJNHarrisonCJ.Computerized adaptive testing for the patient evaluation measure (PEM) in patients undergoing cubital tunnel syndrome surgery. J Hand Surg Eur Vol. 2023,
48: 1042–7.
29.
ThomasML.The value of item response theory in clinical assessment: a review. Assessment. 2011,
18: 291–307.
30.
WangCWeissDJSuSSuenKYBasfordJChevilleAL.Multidimensional computerized adaptive testing: A potential path toward the efficient and precise assessment of applied cognition, daily activity, and mobility for hospitalized patients. Arch Phys Med Rehabil. 2022,
103: S3–S14.
31.
WeberEGoveroverYDeLucaJ.Beyond cognitive dysfunction: relevance of ecological validity of neuropsychological tests in multiple sclerosis. Mult Scler. 2019,
25: 1412–9.
32.
WeissDJ.Improving measurement quality and efficiency with adaptive testing. Appl Psychol Measurem. 1982,
6: 473–92.
33.
WormaldJCRGeogheganLSierakowskiK, et al.
Site-specific patient-reported outcome measures for hand conditions: systematic review of development and psychometric properties. Plast Reconstr Surg Glob Open. 2019,
7: e2256.
