To systematically summarize the reported prediction models for hypoglycemia in patients with diabetes, compare their performance, and evaluate their applicability in clinical practice.
Methods
We selected studies according to the PRISMA, appraised studies according to the Prediction model Risk of Bias Assessment Tool (PROBAST), and extracted and synthesized the data according to the CHARMS. The databases of PubMed, Web of Science, Embase, and Cochrane Library were searched from inception to 31 October 2021 using a systematic review approach to capture all eligible studies developing and/or validating a prognostic prediction model for hypoglycemia in patients with diabetes. The risk bias and clinical applicability were assessed using the PROBAST. The meta-analysis of the performance of the prediction models were also conducted. The protocol of this study was recorded in PROSPERO (CRD42022309852).
Results
Sixteen studies with 22 models met the eligible criteria. The predictors with the high frequency of occurrence among all models were age, HbA1c, history of hypoglycemia, and insulin use. A meta-analysis of C-statistic was performed for 21 prediction models, and the summary C-statistic and its 95% confidence interval and prediction interval were 0.7699 (0.7299–0.8098), 0.7699 (0.5862–0.9536), respectively. Heterogeneity exists between different hypoglycemia prediction models (τ2 was 0.00734≠0).
Conclusions
The existing predictive models are not recommended for widespread clinical use. A high-quality hypoglycemia screening tool should be developed in future studies.
AlbaA. C.AgoritsasT.WalshM.HannaS.IorioA.DevereauxP. J.McGinnT.GuyattG. (2017). Discrimination and calibration of clinical prediction models: Users’ guides to the medical literature. Jama, 318(14), 1377–1384. https://doi.org/10.1001/jama.2017.12126
2.
AssociationA. D. (2021a). 12. Older adults: Standards of medical care in diabetes-2021. Diabetes Care, 44(Suppl 1), S168–s179. https://doi.org/10.2337/dc21-s012
3.
AssociationA. D. (2021b). 6. Glycemic targets: Standards of medical care in diabetes-2021. Diabetes Care, 44(Suppl 1), S73–s84. https://doi.org/10.2337/dc21-s006
4.
BaeJ. P.DuanR.FuH.HoogwerfB. J. (2017). Risk factors for nocturnal hypoglycemia in insulin-treated patients with type 2 diabetes: A secondary analysis of observational data derived from an integrated clinical trial database. Clinical Therapeutics, 39(9), 1790–1798.e1797. https://doi.org/10.1016/j.clinthera.2017.07.037
5.
BellaryS.KyrouI.BrownJ. E.BaileyC. J. (2021). Type 2 diabetes mellitus in older adults: Clinical considerations and management. Nature Reviews. Endocrinology, 17(9), 534–548. https://doi.org/10.1038/s41574-021-00512-2
6.
BellouV.BelbasisL.KonstantinidisA. K.TzoulakiI.EvangelouE. (2019). Prognostic models for outcome prediction in patients with chronic obstructive pulmonary disease: Systematic review and critical appraisal. Bmj: British Medical Journal, 367, l5358. https://doi.org/10.1136/bmj.l5358
7.
BondsD. E.MillerM. E.BergenstalR. M.BuseJ. B.ByingtonR. P.CutlerJ. A.DudlR. J.Ismail-BeigiF.KimelA. R.HoogwerfB.HorowitzK. R.SavageP. J.SeaquistE. R.SimmonsD. L.SivitzW. I.Speril-HillenJ. M.SweeneyM. E. (2010). The association between symptomatic, severe hypoglycaemia and mortality in type 2 diabetes: Retrospective epidemiological analysis of the ACCORD study. Bmj: British Medical Journal, 340, b4909. https://doi.org/10.1136/bmj.b4909
8.
CardonaS.GomezP. C.VellankiP.AnzolaI.RamosC.UrrutiaM. A.HawJ. S.FayfmanM.WangH.GalindoR. J.PasquelF. J.UmpierrezG. E. (2018). Clinical characteristics and outcomes of symptomatic and asymptomatic hypoglycemia in hospitalized patients with diabetes. BMJ Open Diabetes Research and Care, 6(1), Article e000607. https://doi.org/10.1136/bmjdrc-2018-000607
9.
ChandranK.TaiK. P.TohM. P. H. S.PhngF. W. L.SeahD. E.-J.WuC. X. (2019). Development and validation of a primary care tool to identify patients with type 2 diabetes mellitus at high risk of hypoglycemia-related inpatient Admissions. Journal of Endocrinology and Metabolism, 9(3), 43–50. https://doi.org/10.14740/jem563
10.
ChenY.DuH.WeiB. H.ChangX. N.DongC. M. (2017). Development and validation of risk-stratification delirium prediction model for critically ill patients: A prospective, observational, single-center study. Medicine, 96(29), Article e7543. https://doi.org/10.1097/md.0000000000007543
11.
ChowL. S.ZmoraR.MaS.SeaquistE. R.SchreinerP. J. (2018). Development of a model to predict 5-year risk of severe hypoglycemia in patients with type 2 diabetes. BMJ Open Diabetes Research and Care, 6(1), Article e000527. https://doi.org/10.1136/bmjdrc-2018-000527
12.
Claydon-PlattK.ManiasE.DunningT. (2014). Development and evaluation of a screening tool to identify people with diabetes at increased risk of medication problems relating to hypoglycaemia and medication non-adherence. Contemporary Nurse, 48(1), 10–25. https://doi.org/10.1080/10376178.2014.11081922
13.
CollinsG. S.ReitsmaJ. B.AltmanD. G.MoonsK. G. (2015). Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. Annals of Internal Medicine, 162(1), 55–63. https://doi.org/10.7326/m14-0697
14.
CosentinoF.GrantP. J.AboyansV.BaileyC. J.CerielloA.DelgadoV.FedericiM.FilippatosG.GrobbeeD. E.HansenT. B.HuikuriH. V.JohanssonI.JuniP.LettinoM.MarxN.MellbinL. G.OstgrenC. J.RoccaB.RoffiM. ESC Scientific Document Group (2020). 2019 ESC Guidelines on diabetes, pre-diabetes, and cardiovascular diseases developed in collaboration with the EASD. European Heart Journal, 41(2), 255–323. https://doi.org/10.1093/eurheartj/ehz486
15.
Dagogo-JackS. E.CraftS.CryerP. E. (1993). Hypoglycemia-associated autonomic failure in insulin-dependent diabetes mellitus. Recent antecedent hypoglycemia reduces autonomic responses to, symptoms of and defense against subsequent hypoglycemia. J Clin Invest, 91(3), 819–828. https://doi.org/10.1172/jci116302
16.
DebrayT. P.DamenJ. A.RileyR. D.SnellK.ReitsmaJ. B.HooftL.CollinsG. S.MoonsK. G. (2019). A framework for meta-analysis of prediction model studies with binary and time-to-event outcomes. Statistical Methods in Medical Research, 28(9), 2768–2786. https://doi.org/10.1177/0962280218785504
17.
DebrayT. P.DamenJ. A.SnellK. I.EnsorJ.HooftL.ReitsmaJ. B.RileyR. D.MoonsK. G. M. (2017). A guide to systematic review and meta-analysis of prediction model performance. Bmj: British Medical Journal, 356, i6460. https://doi.org/10.1136/bmj.i6460
18.
D'NettoM.MurphyC. V.MitchellA.DunganK. (2016). Predictors of recurrent hypoglycemia following a severe hypoglycemic event among hospitalized patients. Hosp Pract 1995, 44(1), 1–8. https://doi.org/10.1080/21548331.2016.1130584
19.
EchevarriaC.SteerJ.Heslop-MarshallK.StentonS. C.HickeyP. M.HughesR.WijesingheM.HarrisonR. N.SteenN.SimpsonA. J.GibsonG. J.BourkeS. C. (2017). The PEARL score predicts 90-day readmission or death after hospitalisation for acute exacerbation of COPD. Thorax, 72(8), 686–693. https://doi.org/10.1136/thoraxjnl-2016-209298
20.
ElbazM.NashashibiJ.KushnirS.LeiboviciL. (2021). Predicting hypoglycemia in hospitalized patients with diabetes: A derivation and validation study. Diabetes Research and Clinical Practice, 171, 108611. https://doi.org/10.1016/j.diabres.2020.108611
21.
EnaJ.GaviriaA. Z.Romero-SánchezM.Carretero-GómezJ.Carrasco-SánchezF. J.Segura-HerasJ. V.Porto-PerezA. B.Vazquez-RodriguezP.Gonzalez-BecerraC.Gomez-HuelgasR. (2018). Derivation and validation model for hospital hypoglycemia. European Journal of Internal Medicine, 47, 43–48. https://doi.org/10.1016/j.ejim.2017.08.024
22.
EUROASPIRE, I, & II Group & European action on secondary prevention by intervention to reduce Events. (2001). Clinical reality of coronary prevention guidelines: A comparison of EUROASPIRE I and II in nine countries. EUROASPIRE I and II Group. European action on secondary prevention by intervention to reduce events. Lancet, 357(9261), 995–1001. https://doi.org/10.1016/s0140-6736(00)04235-5
23.
FarrokhiF.KlindukhovaO.ChandraP.PengL.SmileyD.NewtonC.PasquelF.FereiraM. E.UmpierrezG. (2012). Risk factors for inpatient hypoglycemia during subcutaneous insulin therapy in non-critically ill patients with type 2 diabetes. Journal of Diabetes Science and Technology, 6(5), 1022–1029. https://doi.org/10.1177/193229681200600505
24.
FrierB. M. (2014). Hypoglycaemia in diabetes mellitus: Epidemiology and clinical implications. Nature Reviews. Endocrinology, 10(12), 711–722. https://doi.org/10.1038/nrendo.2014.170
25.
HanK.YunJ. S.ParkY. M.AhnY. B.ChoJ. H.ChaS. A.KoS. H. (2018). Development and validation of a risk prediction model for severe hypoglycemia in adult patients with type 2 diabetes: A nationwide population-based cohort study. Clinical Epidemiology, 10, 1545–1559. https://doi.org/10.2147/clep.s169835
26.
HanS. J. (2020). Response: Hypoglycemia and dementia risk in older patients with type 2 diabetes mellitus: A propensity-score matched analysis of a population-based cohort study (diabetes metab J 2020;44:125-33). Diabetes and Metabolism Journal, 44(2), 360–361. https://doi.org/10.4093/dmj.2020.0079
27.
HellerS.LingvayI.MarsoS. P.Philis-TsimikasA.PieberT. R.PoulterN. R.PratleyR. E.Hachmann-NielsenE.KvistK.LangeM.MosesA. C.Trock AndresenM.BuseJ. B.DEVOTE Study Group (2020). Development of a hypoglycaemia risk score to identify high-risk individuals with advanced type 2 diabetes in DEVOTE. Diabetes, Obesity & Metabolism, 22(12), 2248–2256. https://doi.org/10.1111/dom.14208
28.
HolbrookT.TangY.DasR.ShankarR. R.TunceliK.WilliamsJ.RadicanL.HoldenS. E.MorganC. L.PiercyJ.CurrieC. J. (2017). Direct medical costs of severe hypoglycaemic events in patients with type 2 diabetes in England: A retrospective database study. International Journal of Clinical Practice, 71(6), Article e12958. https://doi.org/10.1111/ijcp.12958
HuX.XuW.LinS.ZhangC.LingC.ChenM. (2020). Development and validation of a hypoglycemia risk model for intensive insulin therapy in patients with type 2 diabetes. Journal of Diabetes Research, 2020, 7292108. https://doi.org/10.1155/2020/7292108
31.
International Hypoglycaemia StudyG. (2019). Hypoglycaemia, cardiovascular disease, and mortality in diabetes: Epidemiology, pathogenesis, and management. Lancet Diabetes Endocrinol, 7(5), 385–396. https://doi.org/10.1016/s2213-8587(18)30315-2
32.
KarterA. J.WartonE. M.LipskaK. J.RalstonJ. D.MoffetH. H.JacksonG. G.HuangE. S.MillerD. R. (2017). Development and validation of a tool to identify patients with type 2 diabetes at high risk of hypoglycemia-related emergency department or hospital use. JAMA Internal Medicine, 177(10), 1461–1470. https://doi.org/10.1001/jamainternmed.2017.3844
33.
KhuntiK.AlsifriS.AronsonR.Cigrovski BerkovićM.Enters-WeijnenC.ForsénT.GalstyanG.Geelhoed-DuijvestijnP.GoldfrachtM.GydesenH.KapurR.LalicN.LudvikB.MobergE.Pedersen-BjergaardU.RamachandranA. on behalf of the HAT Investigator Group (2016). Rates and predictors of hypoglycaemia in 27 585 people from 24 countries with insulin-treated type 1 and type 2 diabetes: The global HAT study. Diabetes, Obesity & Metabolism, 18(9), 907–915. https://doi.org/10.1111/dom.12689
34.
LaganiV.ChiarugiF.ThomsonS.FursseJ.LakasingE.JonesR. W.TsamardinosI. (2015). Development and validation of risk assessment models for diabetes-related complications based on the DCCT/EDIC data. Journal of Diabetes and its Complications, 29(4), 479–487. https://doi.org/10.1016/j.jdiacomp.2015.03.001
35.
LeeA. K.LeeC. J.HuangE. S.SharrettA. R.CoreshJ.SelvinE. (2017). Risk factors for severe hypoglycemia in Black and White adults with diabetes: The atherosclerosis risk in communities (ARIC) study. Diabetes Care, 40(12), 1661–1667. https://doi.org/10.2337/dc17-0819
36.
LeeJ. J. W.PhilteosJ.LevinM.NamavarianA.PropstE. J.WolterN. E. (2021). Clinical prediction models for suspected pediatric foreign body aspiration: A systematic review and meta-analysis. JAMA Otolaryngol Head Neck Surg, 147(9), 787–796. https://doi.org/10.1001/jamaoto.2021.1548
37.
LiT. C.WangH. C.LiC. I.LiuC. S.LinW. Y.LinC. H.YangS. Y. (2018). Establishment and validation of a prediction model for ischemic stroke risks in patients with type 2 diabetes. Diabetes Research and Clinical Practice, 138, 220–228. https://doi.org/10.1016/j.diabres.2018.01.034
38.
MathioudakisN. N.AbusamaanM. S.ShakarchiA. F.SokolinskyS.FayzullinS.McGreadyJ.ZilbermintM.SariaS.GoldenS. H. (2021). Development and validation of a machine learning model to predict near-term risk of iatrogenic hypoglycemia in hospitalized patients. JAMA Netw Open, 4(1), Article e2030913. https://doi.org/10.1001/jamanetworkopen.2020.30913
39.
MeulsteeM.WhittemoreR.WattsS. A. (2015). Development of an educational program on prevention of hypoglycemic events among elderly veterans with type 2 diabetes. The Diabetes Educator, 41(6), 690–697. https://doi.org/10.1177/0145721715606805
40.
Misra-HebertA. D.JiX.PantaloneK. M.HuB.DeyT.MilinovichA.BaumanJ. M.ZimmermanR. S.KattanM. W. (2020). Risk prediction for severe hypoglycemia in a type 2 diabetes population with previous non-severe hypoglycemia. J Diabetes Complications, 34(1), 107490. https://doi.org/10.1016/j.jdiacomp.2019.107490
41.
MoonsK. G.AltmanD. G.ReitsmaJ. B.IoannidisJ. P.MacaskillP.SteyerbergE. W.VickersA. J.RansohoffD. F.CollinsG. S. (2015). Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): Explanation and elaboration. Annals of Internal Medicine, 162(1), W1–W73. https://doi.org/10.7326/m14-0698
42.
MoonsK. G.de GrootJ. A.BouwmeesterW.VergouweY.MallettS.AltmanD. G.ReitsmaJ. B.CollinsG. S. (2014). Critical appraisal and data extraction for systematic reviews of prediction modelling studies: The CHARMS checklist. Plos Medicine, 11(10), Article e1001744. https://doi.org/10.1371/journal.pmed.1001744
43.
MoonsK. G.KengneA. P.GrobbeeD. E.RoystonP.VergouweY.AltmanD. G.WoodwardM. (2012). Risk prediction models: II. External validation, model updating, and impact assessment. Heart, 98(9), 691–698. https://doi.org/10.1136/heartjnl-2011-301247
44.
MurataG. H.HoffmanR. M.ShahJ. H.WendelC. S.DuckworthW. C. (2004). A probabilistic model for predicting hypoglycemia in type 2 diabetes mellitus: The Diabetes Outcomes in Veterans Study (DOVES). Archives of Internal Medicine, 164(13), 1445–1450. https://doi.org/10.1001/archinte.164.13.1445
45.
PageM. J.McKenzieJ. E.BossuytP. M.BoutronI.HoffmannT. C.MulrowC. D.ShamseerL.TetzlaffJ. M.AklE. A.BrennanS. E.ChouR.GlanvilleJ.GrimshawJ. M.HrobjartssonA.LaluM. M.LiT.LoderE. W.Mayo-WilsonE.McDonaldS.MoherD. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. Bmj: British Medical Journal, 372, n71. https://doi.org/10.1136/bmj.n71
46.
PratleyR. E.KanapkaL. G.RickelsM. R.AhmannA.AleppoG.BeckR.BhargavaA.BodeB. W.CarlsonA.ChaytorN. S.FoxD. S.GolandR.HirschI. B.KrugerD.KudvaY. C.LevyC.McGillJ. B.PetersA.PhilipsonL. for the Wireless Innovation for Seniors With Diabetes Mellitus WISDM Study Group (2020). Effect of continuous glucose monitoring on hypoglycemia in older adults with type 1 diabetes: A randomized clinical trial. Jama, 323(23), 2397–2406. https://doi.org/10.1001/jama.2020.6928
47.
RickelsM. R. (2019). Hypoglycemia-associated autonomic failure, counterregulatory responses, and therapeutic options in type 1 diabetes. Annals of the New York Academy of Sciences, 1454(1), 68–79. https://doi.org/10.1111/nyas.14214
48.
RuanY.BellotA.MoysovaZ.TanG. D.LumbA.DaviesJ.van der SchaarM.ReaR. (2020). Predicting the risk of inpatient hypoglycemia with machine learning using electronic health records. Diabetes Care, 43(7), 1504–1511. https://doi.org/10.2337/dc19-1743
49.
RuanY.MoysovaZ.TanG. D.LumbA.DaviesJ.ReaR. (2021). Inpatient hypoglycaemia in older people is associated with a doubling in the increased length of stay compared with the younger population. Age and Ageing, 50(2), 576–580. https://doi.org/10.1093/ageing/afaa212
50.
SchroederE. B.XuS.GoodrichG. K.NicholsG. A.O'ConnorP. J.SteinerJ. F. (2017). Predicting the 6-month risk of severe hypoglycemia among adults with diabetes: Development and external validation of a prediction model. J Diabetes Complications, 31(7), 1158–1163. https://doi.org/10.1016/j.jdiacomp.2017.04.004
51.
SeaquistE. R.AndersonJ.ChildsB.CryerP.Dagogo-JackS.FishL.HellerS. R.RodriguezH.RosenzweigJ.VigerskyR. (2013). Hypoglycemia and diabetes: A report of a workgroup of the American diabetes association and the endocrine society. Diabetes Care, 36(5), 1384–1395. https://doi.org/10.2337/dc12-2480
52.
ShahB. R.WaljiS.KissA.JamesJ. E.LoweJ. M. (2019). Derivation and validation of a risk-prediction tool for hypoglycemia in hospitalized adults with diabetes: The hypoglycemia during hospitalization (HyDHo) score. Canadian Journal of Diabetes, 43(4), 278–282.e271https://doi.org/10.1016/j.jcjd.2018.08.061
53.
SiriyothaS.TantrakulV.PlitphonganphimS.RattanasiriS.ThakkinstianA. (2021). Prediction models of obstructive sleep apnea in pregnancy: A systematic review and meta-analysis of model performance. Diagnostics (Basel), 11(6), 1097. https://doi.org/10.3390/diagnostics11061097
54.
WolffR. F.MoonsK. G. M.RileyR. D.WhitingP. F.WestwoodM.CollinsG. S.ReitsmaJ. B.KleijnenJ.MallettS.for the PROBAST Group† (2019). PROBAST: A tool to assess the risk of bias and applicability of prediction model studies. Ann Internal Medicine, 170(1), 51–58. https://doi.org/10.7326/m18-1376
55.
Workgroup on Hypoglycemia, American Diabetes Association (2005). Defining and reporting hypoglycemia in diabetes: A report from the American diabetes association workgroup on hypoglycemia. Diabetes Care, 28(5), 1245–1249. https://doi.org/10.2337/diacare.28.5.1245
56.
YaffeK.FalveyC. M.HamiltonN.HarrisT. B.SimonsickE. M.StrotmeyerE. S.ShorrR. I.MettiA.SchwartzA. V. Health ABC Study (2013). Association between hypoglycemia and dementia in a biracial cohort of older adults with diabetes mellitus. JAMA Internal Medicine, 173(14), 1300–1306. https://doi.org/10.1001/jamainternmed.2013.6176
57.
YueX.WuJ.RuanZ.WoldenM. L.LiL.LinY. (2020). The burden of hypoglycemia in patients with insulin-treated diabetes mellitus in China: Analysis of electronic medical records from 4 tertiary hospitals. Value Health Reg Issues, 21, 17–21. https://doi.org/10.1016/j.vhri.2019.06.003
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
