Readmission to the Intensive Care Unit (ICU) is associated with a high risk of in-hospital mortality and higher health care costs. Previously published tools to predict ICU readmission in surgical ICU patients have important limitations that restrict their clinical implementation. We sought to develop a clinically intuitive score that can be implemented to predict readmission to the ICU after surgery or trauma. We designed the score to emphasize modifiable predictors.
Methods:
In this retrospective cohort study, we included surgical patients requiring critical care between June 2015 and January 2019 at Beth Israel Deaconess Medical Center, Harvard Medical School, MA, USA. We used logistic regression to fit a prognostic model for ICU readmission from a priori defined, widely available candidate predictors. The score performance was compared with existing prediction instruments.
Results:
Of 7,126 patients, 168 (2.4%) were readmitted to the ICU during the same hospitalization. The final score included 8 variables addressing demographical factors, surgical factors, physiological parameters, ICU treatment and the acuity of illness. The maximum score achievable was 13 points. Potentially modifiable predictors included the inability to ambulate at ICU discharge, substantial positive fluid balance (>5 liters), severe anemia (hemoglobin <7 mg/dl), hyperglycemia (>180 mg/dl), and long ICU length of stay (>5 days). The score yielded an area under the receiver operating characteristic curve of 0.78 (95% CI 0.74-0.82) and significantly outperformed previously published scores. The performance of the underlying model was confirmed by leave-one-out cross-validation.
Conclusion:
The RISC-score is a clinically intuitive prediction instrument that helps identify surgical ICU patients at high risk for ICU readmission. The simplicity of the score facilitates its clinical implementation across surgical divisions.
CooperLMLinde-ZwirbleWT. Medicare intensive care unit use: analysis of incidence, cost, and payment. Crit Care Med. 2004;32(11):2247–2253. doi:10.1097/01.ccm.0000146301.47334.bd
2.
KramerAAHigginsTLZimmermanJE. The association between ICU readmission rate and patient outcomes. Crit Care Med. 2013;41(1):24–33. doi:10.1097/CCM.0b013e3182657b8a
3.
KramerAAHigginsTLZimmermanJE. Intensive care unit readmissions in U.S. hospitals: patient characteristics, risk factors, and outcomes. Crit Care Med. 2012;40(1):3–10. doi:10.1097/CCM.0b013e31822d751e
4.
Al-JaghbeerMJTekwaniSSGunnSRKahnJM. Incidence and etiology of potentially preventable ICU readmissions. Crit Care Med. 2016;44(9):1704–1709. doi:10.1097/CCM.0000000000001746
5.
RhodesAMorenoRPAzoulayE, et al.Prospectively defined indicators to improve the safety and quality of care for critically ill patients: a report from the Task Force on Safety and Quality of the European Society of Intensive Care Medicine (ESICM). Intensive Care Med. 2012;38(4):598–605. doi:10.1007/s00134-011-2462-3
6.
NatesJLNunnallyMKleinpellR, et al.ICU admission, discharge, and triage guidelines: a framework to enhance clinical operations, development of institutional policies, and further research. Crit Care Med. 2016;44(8):1553–1602. doi:10.1097/CCM.0000000000001856
7.
WillsiePHunterKSchorrCMilcarekBRachoinJ-SCerceoE. 652: Identifying risk factors for ICU readmission. Crit Care Med. 2012;40:1–328. doi:10.1097/01.ccm.0000424868.88811.74
8.
VollamSDuttonSLambSPetrinicTYoungJDWatkinsonP. Out-of-hours discharge from intensive care, in-hospital mortality and intensive care readmission rates: a systematic review and meta-analysis. Intensive Care Med. 2018;44(7):1115–1129. doi:10.1007/s00134-018-5245-2
9.
LinY-WZhouYFaghriFShawMJCampbellRH. Analysis and prediction of unplanned intensive care unit readmission using recurrent neural networks with long short-term memory. PLoS One. 2019;14(7):e0218942. doi:10.1371/journal.pone.0218942
10.
DesautelsTDasRCalvertJ, et al.Prediction of early unplanned intensive care unit readmission in a UK tertiary care hospital: a cross-sectional machine learning approach. BMJ Open. 2017;7(9):e017199. doi:10.1136/bmjopen-2017-017199
11.
MagruderJTKashiourisMGrimmJC, et al.A predictive model and risk score for unplanned cardiac surgery intensive care unit readmissions. J Card Surg. 2015;30(9):685–690. doi:10.1111/jocs.12589
12.
FrostSATamVAlexandrouE, et al.Readmission to intensive care: development of a nomogram for individualising risk. Crit Care Resusc. 2010;12(2):83–89.
13.
MartinLAKilpatrickJAAl-DulaimiR, et al.Predicting ICU readmission among surgical ICU patients: development and validation of a clinical nomogram. Surgery. 2019;165(2):373–380. doi:10.1016/j.surg.2018.06.053
14.
Markazi-MoghaddamNFathiMRamezankhaniA. Risk prediction models for intensive care unit readmission: a systematic review of methodology and applicability. Aust Crit Care. 2020;33(4):367–374. doi:10.1016/j.aucc.2019.05.005
15.
HammerMGrabitzSDTejaBSerranoMEikermannM; SICU Optimal Mobilization Team (SOMT). Functional mobility recovery predicts readmission to the surgical intensive care unit. Intensive Care Med. 2020;46(5):1054–1056. doi:10.1007/s00134-020-05972-0
Van CalsterBWynantsLVerbeekJFM, et al.Reporting and interpreting decision curve analysis: a guide for investigators. Eur Urol. 2018;74(6):796–804. doi:10.1016/j.eururo.2018.08.038
18.
FialhoASCismondiFVieiraSMRetiSRSousaJMCFinkelsteinSN. Data mining using clinical physiology at discharge to predict ICU readmissions. Exp Syst Appl. 2012;39(18):13158–13165. doi:10.1016/j.eswa.2012.05.086
19.
MasloveDMDubinJAShrivatsALeeJ. Errors, omissions, and outliers in hourly vital signs measurements in intensive care. Crit Care Med. 2016;44(11):e1021–e1030. doi:10.1097/CCM.0000000000001862
20.
World Health Organization. International Classification of Functioning, Disability and Health : ICF : Short Version. Short Version. World Health Organization; 2001.
21.
SchweickertWDPohlmanMCPohlmanAS, et al.Early physical and occupational therapy in mechanically ventilated, critically ill patients: a randomised controlled trial. Lancet. 2009;373(9678):1874–1882. doi:10.1016/S0140-6736(09)60658-9
22.
SchallerSJAnsteyMBlobnerM, et al.Early, goal-directed mobilisation in the surgical intensive care unit: a randomised controlled trial. Lancet. 2016;388(10052):1377–1388. doi:10.1016/S0140-6736(16)31637-3
23.
SchallerSJScheffenbichlerFTBoseS, et al.Influence of the initial level of consciousness on early, goal-directed mobilization: a post hoc analysis. Intensive Care Med. 2019;45(2):201–210. doi:10.1007/s00134-019-05528-x
24.
LatronicoNHerridgeMHopkinsRO, et al.The ICM research agenda on intensive care unit-acquired weakness. Intensive Care Med. 2017;43(9):1270–1281. doi:10.1007/s00134-017-4757-5
25.
MazerCDWhitlockRPFergussonDA, et al.Restrictive or liberal red-cell transfusion for cardiac surgery. N Engl J Med. 2017;377(22):2133–2144. doi:10.1056/NEJMoa1711818
26.
CarsonJLGuyattGHeddleNM, et al.Clinical practice guidelines from the AABB: red blood cell transfusion thresholds and storage. JAMA. 2016;316(19):2025–2035. doi:10.1001/jama.2016.9185
27.
MazerCDWhitlockRPFergussonDA, et al.Six-month outcomes after restrictive or liberal transfusion for cardiac surgery. N Engl J Med. 2018;379(13):1224–1233. doi:10.1056/NEJMoa1808561
28.
HareGMTBakerJEPavenskiK. Assessment and treatment of preoperative anemia: continuing professional development. Can J Anaesth. 2011;58(6):569–581. doi:10.1007/s12630-011-9498-2
29.
GrossoMJBoddapatiVCooperHJGellerJAShahRPNeuwirthAL. The effect of preoperative anemia on complications after total hip arthroplasty. J Arthroplasty. 2020;35(6S):S214–S218. doi:10.1016/j.arth.2020.01.012
30.
OngBRockeyDC. The syndrome of a large drop in hematocrit in hospitalized patients: clinical features and gastrointestinal bleeding outcomes. J Investig Med. 2014;62(8):963–967. doi:10.1097/JIM.0000000000000109
31.
FecsoABSamuelTElnahasA, et al.Clinical indicators of postoperative bleeding in bariatric surgery. Surg Laparosc Endosc Percutan Tech. 2018;28(1):52–55. doi:10.1097/SLE.0000000000000480
32.
TomizawaMShinozakiFHasegawaR, et al.Low hemoglobin levels are associated with upper gastrointestinal bleeding. Biomed Rep. 2016;5(3):349–352. doi:10.3892/br.2016.727
33.
VincentJL. Anemia and blood transfusion in critically ill patients. JAMA. 2002;288(12):1499. doi:10.1001/jama.288.12.1499
34.
ThevathasanTCopelandCCLongDR, et al.The impact of postoperative intensive care unit admission on postoperative hospital length of stay and costs: a prespecified propensity-matched cohort study. Anesth Analg. 2019;129(3):753–761. doi:10.1213/ANE.0000000000003946
35.
WunschH. Is there a starling curve for intensive care?Chest. 2012;141(6):1393–1399. doi:10.1378/chest.11-2819
36.
WunschHGershengornHBCookeCR, et al.Use of intensive care services for Medicare beneficiaries undergoing major surgical procedures. Anesthesiology. 2016;124(4):899–907. doi:10.1097/ALN.0000000000001024
37.
TiruvoipatiRBothaJFletcherJ, et al.Intensive care discharge delay is associated with increased hospital length of stay: a multicentre prospective observational study. PLoS One. 2017;12(7):e0181827. doi:10.1371/journal.pone.0181827
38.
WilliamsTLeslieG. Delayed discharges from an adult intensive care unit. Aust Health Rev. 2004;28(1):87–96. doi:10.1071/ah040087
39.
KahanBCKoulentiDArvanitiK, et al.Critical care admission following elective surgery was not associated with survival benefit: prospective analysis of data from 27 countries. Intensive Care Med. 2017;43(7):971–979. doi:10.1007/s00134-016-4633-8
40.
van den BergheGWoutersPWeekersF, et al.Intensive insulin therapy in critically ill patients. N Engl J Med. 2001;345(19):1359–1367. doi:10.1056/NEJMoa011300
41.
NICE-SUGAR Study Investigators; FinferSLiuB, et al.Hypoglycemia and risk of death in critically ill patients. N Engl J Med. 2012;367(12):1108–1118. doi:10.1056/NEJMoa1204942
42.
Van den BergheGMesottenDVanhorebeekI. Intensive insulin therapy in the intensive care unit. CMAJ. 2009;180(8):799–800. doi:10.1503/cmaj.090500
43.
GriesdaleDEGde SouzaRJvan DamRM, et al.Intensive insulin therapy and mortality among critically ill patients: a meta-analysis including NICE-SUGAR study data. CMAJ. 2009;180(8):821–827. doi:10.1503/cmaj.090206
44.
GunstJDe BruynAVan den BergheG. Glucose control in the ICU. Curr Opin Anaesthesiol. 2019;32(2):156–162. doi:10.1097/ACO.0000000000000706
45.
JacobiJBircherNKrinsleyJ, et al.Guidelines for the use of an insulin infusion for the management of hyperglycemia in critically ill patients. Crit Care Med. 2012;40(12):3251–3276. doi:10.1097/CCM.0b013e3182653269
46.
ShinCHLongDRMcLeanD, et al.Effects of intraoperative fluid management on postoperative outcomes: a hospital registry study. Ann Surg. 2018;267(6):1084–1092. doi:10.1097/SLA.0000000000002220
47.
BalakumarVMuruganRSileanuFEPalevskyPClermontGKellumJA. Both positive and negative fluid balance may be associated with reduced long-term survival in the critically ill. Critical Care Medicine. 2017;45(8):e749–e757. doi:10.1097/CCM.0000000000002372
48.
ArslantasMKKaraHVTuncerBB, et al.Effect of the amount of intraoperative fluid administration on postoperative pulmonary complications following anatomic lung resections. J Thorac Cardiovasc Surg. 2015;149(1):314–320, 321.e1. doi:10.1016/j.jtcvs.2014.08.071
49.
HolteKFossNBAndersenJ, et al.Liberal or restrictive fluid administration in fast-track colonic surgery: a randomized, double-blind study. Br J Anaesth. 2007;99(4):500–508. doi:10.1093/bja/aem211
50.
Comparison of two fluid-management strategies in acute lung injury. N Engl J Med. 2006;354(24):2564–2575. doi:10.1056/NEJMoa062200
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
