The widespread use of antibiotics has led to a gradual adaptation of bacteria to these drugs, diminishing the effectiveness of treatments.
OBJECTIVE:
To comprehensively assess the research progress of antibiotic resistance prediction models based on machine learning (ML) algorithms, providing the latest quantitative analysis and methodological evaluation.
METHODS:
Relevant literature was systematically retrieved from databases, including PubMed, Embase and the Cochrane Library, from inception up to December 2023. Studies meeting predefined criteria were selected for inclusion. The prediction model risk of bias assessment tool was employed for methodological quality assessment, and a random-effects model was utilised for meta-analysis.
RESULTS:
The systematic review included a total of 22 studies with a combined sample size of 43,628; 10 studies were ultimately included in the meta-analysis. Commonly used ML algorithms included random forest, decision trees and neural networks. Frequently utilised predictive variables encompassed demographics, drug use history and underlying diseases. The overall sensitivity was 0.57 (95% CI: 0.42–0.70; 0.001; 99.7%), the specificity was 0.95 (95% CI: 0.79–0.99; 0.001; I2 = 99.9%), the positive likelihood ratio was 10.7 (95% CI: 2.9–39.5), the negative likelihood ratio was 0.46 (95% CI: 0.34–0.61), the diagnostic odds ratio was 23 (95% CI: 7–81) and the area under the receiver operating characteristic curve was 0.78 (95% CI: 0.74–0.81; 0.001), indicating a good discriminative ability of ML models for antibiotic resistance. However, methodological assessment and funnel plots suggested a high risk of bias and publication bias in the included studies.
CONCLUSION:
This meta-analysis provides a current and comprehensive evaluation of ML models for predicting antibiotic resistance, emphasising their potential application in clinical practice. Nevertheless, stringent research design and reporting are warranted to enhance the quality and credibility of future studies. Future research should focus on methodological innovation and incorporate more high-quality studies to further advance this field.
FerriMRanucciERomagnoliP, et al. Antimicrobial resistance: A global emerging threat to public health systems. Crit Rev Food Sci Nutr.2017; 57(13): 2857-2876. doi: 10.1080/10408398.2015.1077192.
2.
VasalaAHytönenVPLaitinenOH. Modern Tools for Rapid Diagnostics of Antimicrobial Resistance. Front Cell Infect Microbiol.2020; 10: 308. doi: 10.3389/fcimb.2020.00308.
3.
HolmesAHMooreLSSundsfjordA, et al. Understanding the mechanisms and drivers of antimicrobial resistance. Lancet.2016 Jan 9; 387(10014): 176-87. doi: 10.1016/S0140-6736(15)00473-0.
4.
KimJIMaguireFTsangKK, et al. Machine Learning for Antimicrobial Resistance Prediction: Current Practice, Limitations, and Clinical Perspective. Clin Microbiol Rev.2022 Sep 21; 35(3): e0017921. doi: 10.1128/cmr.00179-21.
5.
LycholipVPuronaitėRSkorniakovVNavickasPTarutytėGTrinkūasJBurneikaitėGKazėnaitėEJankauskienėA. Assessment of the disease severity in patients hospitalized for COVID-19 based on the National Early Warning Score (NEWS) using statistical and machine learning methods: An electronic health records database analysis. Technol Health Care. 2023; 31(6): 2513-2524. doi: 10.3233/THC-235016.
6.
ChoudhuryA. Predicting cancer using supervised machine learning: Mesothelioma. Technol Health Care.2021; 29(1): 45-58. doi: 10.3233/THC-202237.
7.
NgiamKYKhorIW. Big data and machine learning algorithms for health-care delivery. Lancet Oncol.2019; 20(5): e262-e273. doi: 10.1016/S1470-2045(19)30149-4.
8.
EraslanGAvsecŽGagneurJ, et al. Deep learning: new computational modelling techniques for genomics. Nat Rev Genet.2019; 20(7): 389-403. doi: 10.1038/s41576-019-0122-6.
9.
AziziSCulpLFreybergJ, et al. Robust and data-efficient generalization of self-supervised machine learning for diagnostic imaging. Nat Biomed Eng.2023 Jun; 7(6): 756-779. doi: 10.1038/s41551-023-01049-7.
10.
SchreiberJSinghR. Machine learning for profile prediction in genomics. Curr Opin Chem Biol.2021; 65: 35-41. doi: 10.1016/j.cbpa.2021.04.008.
11.
WangYXiaoYYangQWangFWangYYuanC. Clinical prediction models for multidrug-resistant organism colonisation or infection in critically ill patients: a systematic review protocol. BMJ Open.2022 Sep 29; 12(9): e064566. doi: 10.1136/bmjopen-2022-064566.
12.
TangRLuoRTangSSongHChenX. Machine learning in predicting antimicrobial resistance: a systematic review and meta-analysis. Int J Antimicrob Agents.2022 Nov-Dec; 60(5-6): 106684. doi: 10.1016/j.ijantimicag.2022.106684.
13.
LiberatiAAltmanDGTetzlaffJ, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med.2009 Jul 21; 6(7): e1000100. doi: 10.1371/journal.pmed.1000100.
14.
WolffRFMoonsKGMRileyRD, et al. PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Ann Intern Med.2019 Jan 1; 170(1): 51-58. doi: 10.7326/M18-1376.
15.
FeretzakisGLoupelisESakagianniA, et al. Using Machine Learning Techniques to Aid Empirical Antibiotic Therapy Decisions in the Intensive Care Unit of a General Hospital in Greece. Antibiotics (Basel).2020 Jan 31; 9(2): 50. doi: 10.3390/antibiotics9020050.
16.
FeretzakisGLoupelisESakagianniA, et al. Using Machine Learning Algorithms to Predict Antimicrobial Resistance and Assist Empirical Treatment. Stud Health Technol Inform.2020 Jun 26; 272: 75-78. doi: 10.3233/SHTI200497.
17.
FeretzakisGSakagianniALoupelisE, et al. Using Machine Learning to Predict Antimicrobial Resistance of Acinetobacter Baumannii, Klebsiella Pneumoniae and Pseudomonas Aeruginosa Strains. Stud Health Technol Inform.2021 May 27; 281: 43-47. doi: 10.3233/SHTI210117.
18.
Garcia-VidalCPuerta-AlcaldePCardozoC, et al. Machine Learning to Assess the Risk of Multidrug-Resistant Gram-Negative Bacilli Infections in Febrile Neutropenic Hematological Patients. Infect Dis Ther.2021 Jun; 10(2): 971-983. doi: 10.1007/s40121-021-00438-2.
19.
GoodmanKELesslerJCosgroveSE, et al. A Clinical Decision Tree to Predict Whether a Bacteremic Patient Is Infected With an Extended-Spectrum β-Lactamase-Producing Organism. Clin Infect Dis.2016 Oct 1; 63(7): 896-903. doi: 10.1093/cid/ciw425.
20.
GoodmanKELesslerJHarrisAD, et al. A methodological comparison of risk scores versus decision trees for predicting drug-resistant infections: A case study using extended-spectrum beta-lactamase (ESBL) bacteremia. Infect Control Hosp Epidemiol.2019 Apr; 40(4): 400-407. doi: 10.1017/ice.2019.17.
21.
GoodmanKESimnerPJKleinEY, et al. Predicting probability of perirectal colonization with carbapenem-resistant Enterobacteriaceae (CRE) and other carbapenem-resistant organisms (CROs) at hospital unit admission. Infect Control Hosp Epidemiol.2019 May; 40(5): 541-550. doi: 10.1017/ice.2019.42.
22.
LeeALHToCCKLeeALS, et al. Deep learning model for prediction of extended-spectrum beta-lactamase (ESBL) production in community-onset Enterobacteriaceae bacteraemia from a high ESBL prevalence multi-centre cohort. Eur J Clin Microbiol Infect Dis.2021 May; 40(5): 1049-1061. doi: 10.1007/s10096-020-04120-2.
23.
Martínez-AgüeroSMora-JiménezILérida-GarcíaJ, et al. Machine Learning Techniques to Identify Antimicrobial Resistance in the Intensive Care Unit. Entropy (Basel).2019; 21(6): 603. doi: 10.3390/e21060603.
24.
MoranERobinsonEGreenC, et al. Towards personalized guidelines: using machine-learning algorithms to guide antimicrobial selection. J Antimicrob Chemother.2020; 75(9): 2677-2680. doi: 10.1093/jac/dkaa222.
25.
NomanSMZeeshanMArshadJ, et al. Machine Learning Techniques for Antimicrobial Resistance Prediction of Pseudomonas Aeruginosa from Whole Genome Sequence Data. Comput Intell Neurosci.2023 Mar 1; 2023: 5236168. doi: 10.1155/2023/5236168.
26.
OonsivilaiMMoYLuangasanatipN, et al. Using machine learning to guide targeted and locally-tailored empiric antibiotic prescribing in a children’s hospital in Cambodia. Wellcome Open Res.2018 Oct 10; 3: 131. doi: 10.12688/wellcomeopenres.14847.1.
27.
RenYChakrabortyTDoijadS, et al. Prediction of antimicrobial resistance based on whole-genome sequencing and machine learning. Bioinformatics.2022 Jan 3; 38(2): 325-334. doi: 10.1093/bioinformatics/btab681.
28.
ShangJSLinYSGoetzAM. Diagnosis of MRSA with neural networks and logistic regression approach. Health Care Manag Sci.2000; 3(4): 287-297. doi: 10.1023/a1019018129822.
29.
Sick-SamuelsACGoodmanKERapsinskiG, et al. A Decision Tree Using Patient Characteristics to Predict Resistance to Commonly Used Broad-Spectrum Antibiotics in Children With Gram-Negative Bloodstream Infections. J Pediatric Infect Dis Soc.2020 Apr 30; 9(2): 142-149. doi: 10.1093/jpids/piy137.
30.
SousaAPérez-RodríguezMTSuarezM, et al. Validation of a clinical decision tree to predict if a patient has a bacteraemia due to a β-lactamase producing organism. Infect Dis (Lond).2019 Jan; 51(1): 32-37. doi: 10.1080/23744235.2018.1508883.
31.
ValizadehAslaniTZhaoZSokhansanjBA, et al. Amino Acid k-mer Feature Extraction for Quantitative Antimicrobial Resistance (AMR) Prediction by Machine Learning and Model Interpretation for Biological Insights. Biology (Basel).2020 Oct 28; 9(11): 365. doi: 10.3390/biology9110365.
32.
Vazquez-GuillametMCVazquezRMicekST, et al. Predicting Resistance to Piperacillin-Tazobactam, Cefepime and Meropenem in Septic Patients With Bloodstream Infection Due to Gram-Negative Bacteria. Clin Infect Dis.2017 Oct 30; 65(10): 1607-1614. doi: 10.1093/cid/cix612.
33.
VisonàGDurouxDMirandaL, et al. Multimodal learning in clinical proteomics: enhancing antimicrobial resistance prediction models with chemical information. Bioinformatics.2023 Dec 1; 39(12): btad717. doi: 10.1093/bioinformatics/btad717.
34.
WeisCCuénodARieckB, et al. Direct antimicrobial resistance prediction from clinical MALDI-TOF mass spectra using machine learning. Nat Med.2022 Jan; 28(1): 164-174. doi: 10.1038/s41591-021-01619-9.
35.
YasirMKarimAMMalikSK, et al. Application of Decision-Tree-Based Machine Learning Algorithms for Prediction of Antimicrobial Resistance. Antibiotics (Basel).2022 Nov 10; 11(11): 1593. doi: 10.3390/antibiotics11111593.
36.
YelinISnitserONovichGKatzRTalOParizadeMChodickGKorenGShalevVKishonyR. Personal clinical history predicts antibiotic resistance of urinary tract infections. Nat Med.2019 Jul; 25(7): 1143-1152. doi: 10.1038/s41591-019-0503-6.
37.
FabreVCarrollKCCosgroveSE. Blood Culture Utilization in the Hospital Setting: a Call for Diagnostic Stewardship. J Clin Microbiol.2022 Mar 16; 60(3): e0100521. doi: 10.1128/JCM.01005-21.
38.
FarhatFAtharMTAhmadS, et al. Antimicrobial resistance and machine learning: past, present, and future. Front Microbiol.2023 May 26; 14: 1179312. doi: 10.3389/fmicb.2023.1179312.
39.
KhalediAWeimannASchniederjansM, et al. Predicting antimicrobial resistance in Pseudomonas aeruginosa with machine learning-enabled molecular diagnostics. EMBO Mol Med.2020 Mar 6; 12(3): e10264. doi: 10.15252/emmm.201910264.
40.
HuangJXuYXueY, et al. Identification of potent antimicrobial peptides via a machine-learning pipeline that mines the entire space of peptide sequences. Nat Biomed Eng.2023 Jun; 7(6): 797-810. doi: 10.1038/s41551-022-00991-2.
41.
WijnbergeMGeertsBFHolL, et al. Effect of a Machine Learning-Derived Early Warning System for Intraoperative Hypotension vs Standard Care on Depth and Duration of Intraoperative Hypotension During Elective Noncardiac Surgery: The HYPE Randomized Clinical Trial. JAMA.2020 Mar 17; 323(11): 1052-1060. doi: 10.1001/jama.2020.0592.
42.
StrömbladCTBaxter-KingRGMeisamiA, et al. Effect of a Predictive Model on Planned Surgical Duration Accuracy, Patient Wait Time, and Use of Presurgical Resources: A Randomized Clinical Trial. JAMA Surg.2021 Apr 1; 156(4): 315-321. doi: 10.1001/jamasurg.2020.6361.
43.
CollinsGSReitsmaJBAltmanDG, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ.2015 Jan 7; 350: g7594. doi: 10.1136/bmj.g7594.
