Restricted accessResearch articleFirst published online 2022-10
Improving Prediction of Long-Term Care Utilization Through Patient-Reported Measures: Cross-Sectional Analysis of High-Need U.S. Veterans Affairs Patients
This article examines the relative merit of augmenting an electronic health record (EHR)-derived predictive model of institutional long-term care (LTC) use with patient-reported measures not commonly found in EHRs. We used survey and administrative data from 3,478 high-risk Veterans aged ≥65 in the U.S. Department of Veterans Affairs, comparing a model based on a Veterans Health Administration (VA) geriatrics dashboard, a model with additional EHR-derived variables, and a model that added survey-based measures (i.e., activities of daily living [ADL] limitations, social support, and finances). Model performance was assessed via Akaike information criteria, C-statistics, sensitivity, and specificity. Age, a dementia diagnosis, Nosos risk score, social support, and ADL limitations were consistent predictors of institutional LTC use. Survey-based variables significantly improved model performance. Although demographic and clinical characteristics found in many EHRs are predictive of institutional LTC, patient-reported function and partnership status improve identification of patients who may benefit from home- and community-based services.
ArlingG.AbrahamsonK. A.CookeV.KaneR. L.LewisT. (2011). Facility and market factors affecting transitions from nursing home to community. Medical Care, 49(9), 790–796. https://doi.org/10.1097/MLR.0b013e31821b3548
2.
BassD. M.NoelkerL. S. (1987). The influence of family caregivers on elder’s use of in-home services: An expanded conceptual framework. Journal of Health and Social Behavior, 28(2), 184–196. https://doi.org/10.2307/2137131
3.
BerkowitzS. A.SeligmanH. K.ChoudhryN. K. (2014). Treat or eat: Food insecurity, cost-related medication underuse, and unmet needs. The American Journal of Medicine, 127(4), 303–310.e3. https://doi.org/10.1016/j.amjmed.2014.01.002
4.
BorrayoE. A.SalmonJ. R.PolivkaL.DunlopB. D. (2002). Utilization across the continuum of long-term care services. The Gerontologist, 42(5), 603–612. https://doi.org/10.1093/geront/42.5.603
DavidsonK. W.McGinnT. (2019). Screening for social determinants of health: The known and unknown. JAMA, 322(11), 1037–1038. https://doi.org/10.1001/jama.2019.10915
7.
DeSalvoK. B.BloserN.ReynoldsK.HeJ.MuntnerP. (2006). Mortality prediction with a single general self-rated health question. Journal of General Internal Medicine, 21(3), 267–275. https://doi.org/10.1111/j.1525-1497.2005.00291.x
8.
DillmanD. A.SmythJ. D.ChristianL. M. (2014). Internet, phone, mail, and mixed-mode surveys: The tailored design method (4th ed.). Wiley.
9.
Duan-PorterW.UllmanK.RosebushC.McKenzieL.EnsrudK. E.RatnerE.GreerN.ShippeeT.GauglerJ. E.WiltT. J. (2020). Interventions to prevent or delay long-term nursing home placement for adults with impairments—A systematic review of reviews. Journal of General Internal Medicine, 35(7), 2118–2129. https://doi.org/10.1007/s11606-019-05568-5
10.
FillenbaumG. G.SmyerM. A. (1981). The development, validity, and reliability of the OARS multidimensional functional assessment questionnaire. Journal of Gerontology, 36(4), 428–434. https://doi.org/10.1093/geronj/36.4.428
11.
GauglerJ. E.DuvalS.AndersonK. A.KaneR. L. (2007). Predicting nursing home admission in the U.S: A meta-analysis. BMC Geriatrics, 7(1), Article 13. https://doi.org/10.1186/1471-2318-7-13
12.
GoldR.CottrellE.BunceA.MiddendorfM.HollombeC.CowburnS.MahrP.MelgarG. (2017). Developing electronic health record (EHR) strategies related to health center patients’ social determinants of health. Journal of the American Board of Family Medicine, 30(4), 428–447. https://doi.org/10.3122/jabfm.2017.04.170046
13.
GoodwinJ. S.LiS.ZhouJ.GrahamJ. E.KarmarkarA.OttenbacherK. (2017). Comparison of methods to identify long term care nursing home residence with administrative data. BMC Health Services Research, 17(1), Article 376. https://doi.org/10.1186/s12913-017-2318-9
14.
GrabowskiD. C. (2006). The cost-effectiveness of noninstitutional long-term care services: Review and synthesis of the most recent evidence. Medical Care Research and Review, 63(1), 3–28.
15.
HausmanJ. A.AbrevayaJ.Scott-MortonF. M. (1998). Misclassification of the dependent variable in a discrete-response setting. Journal of Econometrics, 87(2), 239–269. https://doi.org/10.1016/S0304-4076(98)00015-3
16.
HeinzeG.WallischC.DunklerD. (2018). Variable selection—A review and recommendations for the practicing statistician. Biometrical Journal. Biometrische Zeitschrift, 60(3), 431–449. https://doi.org/10.1002/bimj.201700067
17.
IglehartJ. K. (2016). Future of long-term care and the expanding role of Medicaid managed care. New England Journal of Medicine, 374(2), 182–187.
18.
JetteA. M.TennstedtS.CrawfordS. (1995). How does formal and informal community care affect nursing home use?The Journals of Gerontology: Series B, 50(1), S4–S12. https://doi.org/10.1093/geronb/50B.1.S4
19.
KayeH. S. (2012). Gradual rebalancing of Medicaid long-term services and supports saves money and serves more people, statistical model shows. Health Affairs, 31(6), 1195–1203. https://doi.org/10.1377/hlthaff.2011.1237
20.
KayeH. S.LaPlanteM. P.HarringtonC. (2009). Do noninstitutional long-term care services reduce Medicaid spending?Health Affairs, 28(1), 262–272.
21.
KinosianB.WielandD.GuX.StallardE.PhibbsC. S.IntratorO. (2018). Validation of the JEN frailty index in the National Long-Term Care Survey community population: Identifying functionally impaired older adults from claims data. BMC Health Services Research, 18(1), Article 908. https://doi.org/10.1186/s12913-018-3689-2
22.
KitchenerM.CarrilloH.HarringtonC. (2003). Medicaid community-based programs: A longitudinal analysis of state variation in expenditures and utilization. Inquiry, 40(4), 375–389. https://doi.org/10.5034/inquiryjrnl_40.4.375
23.
KonetzkaR. T. (2014). The hidden costs of rebalancing long-term care. Health Services Research, 49(3), 771–777.
24.
Lo SassoA. T.JohnsonR. W. (2002). Does informal care from adult children reduce nursing home admissions for the elderly?Inquiry, 39(3), 279–297. https://doi.org/10.5034/inquiryjrnl_39.3.279
25.
MitchellJ.MathewsH. F.HackK. A. (2000). Difference by race in long-term care plans. Journal of Applied Gerontology, 19(4), 424–440. https://doi.org/10.1177/073346480001900404
26.
MoserA.StuckA. E.SillimanR. A.GanzP. A.Clough-GorrK. M. (2012). The eight-item modified Medical Outcomes Study Social Support Survey: Psychometric evaluation showed excellent performance. Journal of Clinical Epidemiology, 65(10), 1107–1116. https://doi.org/10.1016/j.jclinepi.2012.04.007
27.
NicosiaF. M.SparM. J.SteinmanM. A.LeeS. J.BrownR. T. (2019). Making function part of the conversation: Clinician perspectives on measuring functional status in primary care. Journal of the American Geriatrics Society, 67(3), 493–502. https://doi.org/10.1111/jgs.15677
28.
PowersJ. S.XieC.MoseleyM.AbrahamL.BucknerJ.AzubikeN. (2018). Implementation of a geriatric patient-centered medical home: The geriatric patient—Aligned care team (GeriPACT). OBM Geriatrics, 2(3), Article 008. http://www.lidsen.com/journals/geriatrics/
29.
RoystonP.WhiteI. (2011). Multiple imputation by chained equation (MICE): Implementation in stata. Journal of Statistical Software, 45(4), 1–20. https://doi.org/10.18637/jss.v045.i04
30.
Sanchez-PintoL. N.VenableL. R.FahrenbachJ.ChurpekM. M. (2018). Comparison of variable selection methods for clinical predictive modeling. International Journal of Medical Informatics, 116, 10–17. https://doi.org/10.1016/j.ijmedinf.2018.05.006
SchickedanzA.HamityC.RogersA.SharpA. L.JacksonA. (2019). Clinician experiences and attitudes regarding screening for social determinants of health in a large integrated health system. Medical Care, 57, S197–S201. https://doi.org/10.1097/MLR.0000000000001051
33.
SegelmanM.IntratorO.LiY.MukamelD.VeazieP.Temkin-GreenerH. (2017). HCBS spending and nursing home admissions for 1915(c) waiver enrollees. Journal of Aging & Social Policy, 29(5), 395–412. https://doi.org/10.1080/08959420.2017.1319714
34.
SeversonM. A.SmithG. E.TangalosE. G.PetersenR. C.KokmenE.IvnikR. J.AtkinsonE. J.KurlandL. T. (1994). Patterns and predictors of institutionalization in community-based dementia patients. Journal of the American Geriatrics Society, 42(2), 181–185. https://doi.org/10.1111/j.1532-5415.1994.tb04949.x
35.
SteyerbergE. W.VickersA. J.CookN. R.GerdsT.GonenM.ObuchowskiN.PencinaM. J.KattanM. W. (2010). Assessing the performance of prediction models: A framework for some traditional and novel measures. Epidemiology (Cambridge, Mass.), 21(1), 128–138. https://doi.org/10.1097/EDE.0b013e3181c30fb2
ThomasK. S.CoteD.MakineniR.IntratorO.KinosianB.PhibbsC. S.AllenS. M. (2018). Change in VA community living centers 2004-2011: Shifting long-term care to the community. Journal of Aging & Social Policy, 30(2), 93–108. https://doi.org/10.1080/08959420.2017.1414538
US Government Accountability Office. (2020, February). Veterans’ use of long-term care is increasing, and VA faces challenges in meeting the demand (Report to Congressional Committees GAO-20-284). https://www.gao.gov/assets/gao-20-284.pdf
WagnerT. H.UpadhyayA.CowgillE.StefosT.MoranE.AschS. M.AlmenoffP. (2016). Risk adjustment tools for learning health systems: A comparison of DxCG and CMS-HCC V21. Health Services Research, 51(5), 2002–2019. https://doi.org/10.1111/1475-6773.12454
42.
WelchH. G.WalshJ. S.LarsonE. B. (1992). The cost of institutional care in Alzheimer’s disease: Nursing home and hospital use in a prospective cohort. Journal of the American Geriatrics Society, 40(3), 221–224. https://doi.org/10.1111/j.1532-5415.1992.tb02072.x
43.
WhiteI. R.RoystonP.WoodA. M. (2011). Multiple imputation using chained equations: Issues and guidance for practice. Statistics in Medicine, 30(4), 377–399. https://doi.org/10.1002/sim.4067
44.
WolffJ. L.KasperJ. D.ShoreA. D. (2008). Long-term care preferences among older adults: A moving target?Journal of Aging & Social Policy, 20(2), 182–200. https://doi.org/10.1080/08959420801977574
45.
YoudenW. J. (1950). Index for rating diagnostic tests. Cancer, 3(1), 32–35.
46.
YuanY.ThomasK. S.FraktA. B.PizerS. D.GarridoM. M. (2019). Users of veteran-directed care and other purchased care have similar hospital use and costs over time. Health Affairs, 38(6), 1037–1045. https://doi.org/10.1377/hlthaff.2019.00020
47.
YunH.KilgoreM. L.CurtisJ. R.DelzellE.GaryL. C.SaagK. G.MorriseyM. A.BeckerD.MatthewsR.SmithW.LocherJ. L. (2010). Identifying types of nursing facility stays using Medicare claims data: An algorithm and validation. Health Services and Outcomes Research Methodology, 10(1), 100–110. https://doi.org/10.1007/s10742-010-0060-4
48.
ZulmanD. M.MaciejewskiM. L.GrubberJ. M.WeidenbacherH. J.BlalockD. V.ZulligL. L.GreeneL.WhitsonH. E.HastingsS. N.SmithV. A. (2020). Patient-reported social and behavioral determinants of health and estimated risk of hospitalization in high-risk veterans affairs patients. JAMA Network Open, 3(10), Article e2021457. https://doi.org/10.1001/jamanetworkopen.2020.21457
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
