Abstract
Objective
Probiotics may be efficacious in preventing ventilator-associated pneumonia (VAP). The aim of this network meta-analysis (NMA) was to clarify the efficacy of different types of probiotics for preventing VAP.
Methods
This systematic review and NMA was conducted according to the updated preferred reporting items for systematic review and meta-analysis. A systematic literature search of public databases from inception to 17 June 2018 was performed.
Results
NMA showed that “Bifidobacterium longum + Lactobacillus bulgaricus + Streptococcus thermophiles” was more efficacious than “Ergyphilus” in preventing VAP (odds ratio: 0.15, 95% confidence interval: 0.03–0.94). According to pairwise meta-analysis, “B. longum + L. bulgaricus + S. thermophiles” and “Lactobacillus rhamnosus” were superior to placebo in preventing VAP. Treatment rank based on surface under the cumulative ranking curves revealed that the most efficacious treatment for preventing VAP was “B. longum + L. bulgaricus + S. thermophiles” (66%). In terms of reducing hospital mortality and ICU mortality, the most efficacious treatment was Synbiotic 2000FORTE (34% and 46%, respectively).
Conclusions
Based on efficacy ranking, “B. longum + L. bulgaricus + S. thermophiles” should be the first choice for prevention of VAP, while Synbiotic 2000FORTE has the potential to reduce in-hospital mortality and ICU mortality.
Keywords
Introduction
Ventilator-associated pneumonia (VAP) remains an important cause of morbidity and mortality in mechanically ventilated patients and is the most commonly occurring nosocomial bacterial infection in the intensive care unit (ICU). It has been estimated that VAP may be responsible for 27% to 47% of infections in patients receiving mechanical ventilation in the ICU. 1 Although VAP increases the economic and clinical burden, the application of existing VAP prevention strategies has been variable, with inadequate outcomes. 2
The pathogenesis of VAP is complex but mostly involves two important processes: bacterial colonization of the upper digestive tract and aspiration of contaminated secretions into the lower airway. 3 The endogenous flora plays an important role in the development of VAP, given that translocation of and abnormal colonization of the upper digestive tract with potentially pathogenic bacteria is believed to be the prime mechanism responsible for VAP. Colonization of an endotracheal tube with biofilm-forming bacteria results in embolization into the alveoli at some stage during suctioning or bronchoscopy; however, inhalation of pathogens from infected aerosols and direct inoculation are also common.4,5
Numerous studies have assessed various strategies to prevent VAP, including non-pharmacological and pharmacological interventions.6,7 Current efficacious non-pharmacological interventions to prevent VAP target modifiable risk factors that are relevant to aspiration and colonization, including bed head elevation, subglottic secretion draining or silver-coated endotracheal tubes, intensive oral care, and shortening of the duration of mechanical ventilation. 1 Pharmacological interventions to prevent VAP aim to attenuate the burden of bacterial colonization of the upper digestive tract. Several studies have reported that the incidence of VAP can be decreased by using non-absorbable antibiotics and systemic antibiotic prophylaxis, applied topically to the gastrointestinal tract.8,9 However, there are some limitations to the widespread use of selective decontamination of the digestive tract, such as the overgrowth of Gram-positive bacteria and the development of antibiotic resistance by both Gram-negative and Gram-positive bacteria. 10
Given this background, probiotic therapy has emerged as an intriguing alternative to antibiotics. Probiotics are defined by the World Health Organization and the Food and Agriculture Organization as living non-pathogenic microorganisms that are able to tolerate the hostile gastrointestinal environment and have demonstrated well-documented beneficial health effects in the host. Their use may be beneficial in regaining the stability of the endogenous flora and in preventing VAP.
In recent years, several reports have suggested that oral probiotic therapy may indeed prevent VAP.11,12 However, the outcomes of such studies remain controversial.13–15 Accordingly, several meta-analyses have been published in this field, but have yielded different results. In 2010, Siempos et al. 16 performed a meta-analysis that included five randomized controlled trials (RCTs) and concluded that the use of probiotics was associated with a lower incidence of VAP. This result was confirmed by a Cochrane systematic review of eight RCTs. 17 However, two other meta-analyses, carried out by Gu et al. and Wang et al.,18,19 concluded that probiotics were not beneficial in patients undergoing mechanical ventilation. In all of these meta-analyses, the experimental treatment group was formed by pooling the extensive variety of varying probiotic strains that were used in the original clinical trials. However, this approach does not provide a meaningful answer to clinicians as to which specific probiotic strain or product has evidence-based efficacy in preventing VAP.
To resolve this issue, we used a network meta-analysis (NMA) to determine the efficacy of different probiotic strains for preventing VAP and their effects on in-hospital mortality, ICU mortality, ICU length of stay, and diarrhea rate. By using NMA of data from RCTs of probiotics for the prevention of VAP, we sought to develop a clinically meaningful and updated understanding of the relative efficacy of different probiotic product treatments.
Methods
Search strategy and study selection
A systematic review and NMA were conducted according to the updated preferred reporting items for systematic reviews and meta-analysis (PRISMA) guidelines (
Selection criteria
Eligible studies were those in which comparative outcomes including VAP rate, in-hospital mortality rate, ICU mortality rate, ICU length of stay, and diarrhea rate were reported for patients undergoing mechanical ventilation who were treated with placebo or probiotics (including synbiotics, which contain both probiotics and prebiotics). The following inclusion criteria were used: (1) participants were patients who underwent mechanical ventilation and whose treatment procedure included probiotics, either alone or in combination with other interventions; (2) study design was restricted to RCTs; and (3) at least one of the following outcomes were included: VAP rate, in-hospital mortality rate, ICU mortality rate, ICU length of stay, or diarrhea rate. The following types of manuscript were excluded: letters to the editor, studies published in a book, reviews, and studies not published in Chinese or English. In the event of duplicate trials with accumulating numbers of patients or prolonged follow-up periods, the most informative manuscript for qualitative evaluation was included in the meta-analysis.
Data extraction and outcome measures
From the eligible studies, information on inclusion criteria, experimental groups, key features, and outcomes was extracted independently by the two reviewers using a standardized information collection sheet. Where data were not provided in the article, an attempt was made to contact the author via email. From the included studies, we extracted the first author, publication year, study design, number of patients, intervention (including type of probiotic agent, dose, and route and duration of administration), patient characteristics, and clinical outcomes. The primary outcome measure was the VAP rate. The secondary outcome measures were in-hospital mortality rate, ICU mortality rate, ICU length of stay, and diarrhea rate.
Assessment quality and publication bias
To assess the methodological quality of the included studies, quality assessment was performed by two authors independently using the risk of bias assessment tool described in the Cochrane Handbook for Systematic Reviews. 21 The tool’s features of interest are adequacy of outcome assessment, personnel and outcome assessors, blinding of contributors, allocation concealment, selective outcome reporting, incomplete outcome data, and other biases. Funnel plots were used to evaluating publication bias for each outcome. The quality of all selected articles was ranked according to the Jadad composite scale. 22 According to this scale, extremely high-quality research has a score of ≥3 and low-quality research has a score of ≤2.
Statistical analyses
Based on a Bayesian theorem, a comprehensive NMA was used to compare studies for every probiotic strain or combinations of strains. 23 In addition, based on the extracted data, we also performed pairwise meta-analyses on comparative studies using RevMan 5.2.9 software (Cochrane Collaboration, Oxford, UK). The data extracted from the relevant trials were combined and dichotomous results were expressed as risk ratios (RRs) with their 95% confidence intervals (CIs), while continuous outcome measures were expressed as mean differences (MDs) with their 95% CIs. Statistical heterogeneity among trials was evaluated using Cochran’s Q statistic (χ2 test) and the Higgins I2 statistic to determine the percentage of total variation across studies resulting from heterogeneity. Heterogeneity was predefined as high, moderate, or low with I2 values above 75%, 50%, and 25%, respectively. A fixed effects model was used to pool studies where the I2 statistic was ≤50%; otherwise, a random effects model was used.
NMA was performed to compare the efficacy among treatments with different probiotics. Network graphs were constructed using STATA (version 13.0; StataCorp LP, College Station, TX, USA) for each outcome variable and were composed of nodes and edges. Nodes represented competing interventions, while edges between the nodes illustrated the comparison of interventions between the included studies. The number of participants receiving the intervention was represented by node size. The number of studies that were compared between the respective nodes was represented by edge thickness. The geometry of networks summarized how the evidence base was built up and whether different probiotic strains were compared directly or were only indirectly compared using network evidence. The analysis of network comparison was performed using ADDIS software v1.16.8, an online open-source application based on R statistical software (http://drugis.org/addis). 24 The pooled estimates were obtained using the Markov chain Monte Carlo method. 2 Markov chains were run simultaneously with different, arbitrarily chosen preliminary values.
To test for convergence, the Brooks–Gelman–Rubin method was used. A common heterogeneity parameter was assumed for all comparisons and global heterogeneity was assessed using the I2 statistic with the GeMTC R package (version 3.2.2; http://CRAN.R-project.org). 25 To rank the treatments for all outcomes, surface under the cumulative ranking curves (SUCRAs) were generated to express the efficacy or safety of each treatment as a percentage relative to an imaginary treatment that is always optimal, without uncertainty. 26
Results
Characteristics and risk of bias assessment of the included trials
A total of 348 citations were identified in the literature search, and the full text of 18 potentially eligible articles was retrieved. Four reports were excluded because they were duplicates or did not include VAP as an outcome measure. Finally, 14 parallel RCTs (2036 patients), published between 2006 and 2016 and comparing eight types of placebo or probiotic strains, were included in this NMA. A flowchart of the literature search according to the PRISMA statement is shown in Figure 1. 27 In this NMA, 990 participants were randomly assigned to a probiotic treatment group and 1046 to a placebo group. Table 1 shows the details for each study, including the baseline characteristics of patients, study publication year, strain of probiotics or intervention used, definition of VAP, and study design.13–15,28–38 In the majority of studies, the included patients presented with severe multiple organ injuries necessitating emergency tracheal intubation and ventilation support. Additionally, most patients were older than 18 years, with only one study including children. In the probiotic group, Synbiotic 2000 FORTE contained probiotics as well as the fibers beta-glucan, inulin, pectin, and resistant starch as prebiotics, which may have affected efficacy. Therefore “Synbiotic 2000 FORTE” was treated as an entire product and not a specific strain or multi-strain treatment. The results of risk of bias assessment of the included trials according to the Jadad composite scale are displayed in Figure 2.

Flowchart of the literature search according to the preferred reporting items for systematic reviews and meta-analysis (PRISMA) statement.

Risk of bias assessment for the included trials.
Characteristics of included studies.
CFU, colony-forming unit; ICU, intensive care unit; VAP, ventilator-associated pneumonia; WBC, white blood cell.
Primary outcome measures
VAP
The risk of bias in studies that contributed to the primary outcomes was generally low (Figure 2). The network of the VAP rate included nine arms, 14 studies, and 2036 patients (Figure 3a). The actual number of patients in the probiotics and placebo groups with VAP is shown in Table 2. In pairwise comparisons between probiotics and placebo for the VAP rate, we analyzed subgroups based on strain type. Fourteen articles were included, and there were 995 patients in the probiotic group and 1049 patients in the placebo group. Overall, there was a clear benefit associated with intervention with probiotics compared with placebo in terms of preventing VAP (OR: 0.62, 95% CI: 0.46–0.84, P = 0.002) (Figure 4). Based on subgroup analysis, both the probiotic strain type “Lactobacillus rhamnosus” and “Bacillus subtilis + Enterococcus faecalis” were superior to placebo (OR: 0.37, 95% CI: 0.18–0.77, P = 0.008 and OR: 0.54, 95% CI: 0.36–0.82, P = 0.003, respectively). Only one study analyzed the effect of “L. rhamnosus” (probiotic group n = 68 and placebo group n = 70) and two studies compared “B. subtilis + E. faecalis” (n = 200) versus placebo (n = 200).

a–e: Evidence network of eligible comparisons for network meta-analysis. Width of the lines is proportional to the number of trials, comparing every pair of treatments, and the size of each circle is proportional to the number of randomly assigned participants (sample size).

Forest plot for ventilator-associated pneumonia (VAP), including subgroup analysis of eight different probiotic strains. Fourteen studies were included.
Outcome data of included studies in the meta-analysis of probiotics for VAP prevention (probiotics vs control).
NA = not available; VAP = ventilator-associated pneumonia, ICU = intensive care unit.
The NMA results for the primary outcome are illustrated in a league table in Figure 5. In terms of efficacy, the head-to-head comparison between different probiotic strain types showed that only the “Bifidobacterium longum + Lactobacillus bulgaricus + Streptococcus thermophiles” combination was superior to Ergyphilus (OR: 0.15, 95% CI: 0.03–0.94). In addition, we compared the estimated rank probabilities of different probiotics using SUCRAs. In terms of efficacy for preventing VAP, the most efficacious treatment was “B. longum + L. bulgaricus + S. thermophiles” (66%) and the least efficacious was Ergyphilus (60%). The top-ranking candidates for efficacious treatment in terms of different outcomes are listed in Table 3.

Network meta-analysis of ventilator-associated pneumonia (VAP) outcome. Comparisons should be read from left to right. The efficacy estimate is located at the intersection of the column-defining treatment and the row-defining treatment. For efficacy, an odds ratio (OR) <1 favors the column-defining treatment.
Relative ranking of eight probiotic strains assessed using SUCRA values.
P-values in bold and underlined are significant; Lac.pla = Lactobacillus plantarum, Lac.rha = Lactobacillus rhamnosus, Lac.cas = Lactobacillus casei, Bif + Lac + Str = Bifidobacterium longum + Lactobacillus bulgaricus + Streptococcus thermophilus, Bac + Ent = Bacillus subtilis + Enterococcus faecalis, Bif + Lac + Ent = Bifidobacterium + Lactobacillus + Enterococcus, NA = Not available.
Hospital and ICU mortality
Using the available data in the existing literature, we also performed an NMA between probiotics and placebo to compare the outcomes of in-hospital mortality and ICU mortality. Detailed results of pairwise meta-analyses and subgroup analyses based on probiotic strains are shown in Figure 6a and b. There were eight studies included for the outcome of hospital mortality, with 558 patients in the probiotic group and 556 patients in the control group. Nine studies were included for the outcome of ICU mortality, with 643 patients in the probiotic group and 679 patients in the control group. In the pooled analysis, there was no significant difference in either in-hospital mortality or ICU mortality between the two groups (OR: 0.81, 95% CI: 0.61–1.06, P = 0.13; and OR: 0.89, 95% CI: 0.67–1.17, P = 0.39, respectively). This result was consistent with those from the pairwise subgroup comparisons. Figure 3b and c shows a comparison of probiotic strains or combinations of strains used in the original trials in terms of reduction of in-hospital mortality and ICU mortality, respectively. The network of in-hospital mortality rate (Figure 3b) included six arms, eight studies, and 1114 patients, while the network of ICU mortality (Figure 3c) included six arms, nine studies, and 1322 patients.

a–b: Forest plot for in-hospital and intensive care unit (ICU) mortality. In subgroup analysis, six different probiotic strains were included for in-hospital mortality and five different probiotic strains for ICU mortality.
The NMA results for in-hospital mortality and ICU mortality outcomes are shown in Figure 7a and b. There was no significant difference in the head-to-head comparisons of different probiotic types. Treatments were also ranked based on SUCRAs and cumulative probability plots; the top-ranking candidate efficacious probiotics are presented in Table 3. In terms of reducing hospital mortality, the most efficacious probiotic type was Synbiotic 2000FORTE (34%) and the least efficacious probiotic strain was Lactobacillus plantarum (52%). Furthermore, for reducing ICU mortality, the most efficacious probiotic strain was Synbiotic 2000FORTE (46%) and the least efficacious probiotic type was “B. subtilis + E. faecalis” (61%).

a–b: Network meta-analysis of hospital and intensive care unit (ICU) mortality outcome. Comparisons should be read from left to right. The efficacy estimate is located at the intersection of the column-defining treatment and the row-defining treatment. For efficacy, an odds ratio (OR) below 1 favors the column-defining treatment.
Secondary outcome measures
ICU length of stay
Data on ICU length of stay were reported in five studies (538 participants), with 274 patients in the probiotic group and 264 patients in the control group. The corresponding results of pairwise meta-analysis and subgroup analyses are shown in Figure 8. No significant difference was detected in ICU length of stay between probiotics and placebo interventions (MD: −3.89, 95% CI: −8.36–0.57, P = 0.09). Networks of eligible comparisons for ICU length of stay are presented in Figure 3d, showing five arms.

Forest plot for intensive care unit (ICU) length of stay, including subgroup analysis of five probiotic strains. Five studies were included.
NMA results for the ICU length of stay are shown in Figure 9. There was no significant difference between different probiotics in reducing the length of ICU stay. However, Synbiotic 2000FORTE was shown to be significantly more efficacious than placebo in reducing the length of ICU stay (MD 13.70, 95% CI 2.03–24.88). Based on SUCRAs and cumulative probability plots, the ranking of probiotics by efficacy in reducing ICU length of stay revealed that the most efficacious probiotic type was Synbiotic 2000FORTE (72%) and the least efficacious was L. plantarum (48%).

Network meta-analysis of intensive care unit (ICU) length of stay as outcome.
Diarrhea
Six studies reported the incidence of diarrhea for patients who received mechanical ventilation and either probiotics (505 participants) or placebo (498 participants). The results of pairwise meta-analyses are given in Figure 10. No significant difference was observed in the incidence of diarrhea following treatment with probiotics compared with placebo (OR: 0.75, 95% CI: 0.51–1.10, P = 0.14). However, subgroup analysis showed that “B. subtilis + E. faecalis” was significantly superior to placebo in terms of preventing diarrhea (OR: 0.56, 95% CI: 0.33–0.95, P = 0.03).

Forest plot for diarrhea, including subgroup analysis of five probiotic strains. Six studies were included.
Networks of eligible comparisons for diarrhea prevention are shown in Figure 3e. NMA results for the incidence of diarrhea are shown in Figure 11. There was no significant difference between different interventions, including all types of probiotics and placebo. The ranking of treatments based on cumulative probability plots and SUCRAs showed that for preventing diarrhea, the most efficacious treatment was L. rhamnosus (45%) and the least efficacious was L. casei (55%).

Network meta-analysis of diarrhea as outcome.
Discussion
Probiotic therapy may represent an effective strategy for preventing VAP, which is a costly, and currently the most prevalent, ICU-acquired infection worldwide.11,29,39 Probiotics have several important advantages over antibiotics, such as a good safety profile and few contraindications for clinical application. Nevertheless, previous meta-analyses have reported conflicting data on the use of probiotics for preventing VAP in mechanically ventilated patients.16–19 These previous meta-analyses pooled data related to all probiotic strains used in treatment across the included studies, without considering the different efficiencies of specific stains. In contrast, our comprehensive and up-to-date meta-analysis of 14 trials and 2036 patients is the first to use an NMA to compare the eight probiotic strains available for the prevention of VAP in mechanically ventilated patients. Based on pairwise analysis, our results can be considered conclusive and are consistent with the results of previous studies.17,39,40 As Weng et al. 40 reported in their meta-analysis involving 1969 patients, probiotics may be effective compared with placebo in preventing VAP, but do not reduce the risk of hospital mortality, ICU mortality, or diarrhea. Instead of combining all probiotic strains, as in standard meta-analyses, different probiotics were compared head-to-head using NMA. We were therefore able to determine the most efficacious strains for preventing VAP in mechanically ventilated patients, based on the current literature. We found that only “B. longum + L. bulgaricus + S. thermophiles” was significantly more efficacious than “Ergyphilus” in preventing VAP. In pairwise meta-analysis, subgroup analysis was performed based on probiotic strain types. The results of this direct comparison between probiotics and placebo were similar to the NMA results, but there were also some inconsistences such as the finding that Synbiotic 2000FORTE was more efficacious than placebo in reducing ICU length of stay in NMA but not according to pairwise analysis. Although there were no significant differences in preventing VAP among different probiotic strains, ranking analyses were performed based on cumulative probability plots and cumulative ranking curves. The results showed that “B. longum + L. bulgaricus + S. thermophiles” was the most efficacious probiotic type for preventing VAP, while “Ergyphilus” was the least efficacious.
The present study had several strengths and limitations. First, there were inconsistencies in the included literature. As shown in Figure 2, although most of the trials adequately reported the methodology, several domains remained unclear because of insufficient information. Second, the wide range of daily doses and length of administration of probiotic therapy among the different trials may limit the ability to draw robust clinical conclusions and make recommendations. Third, considering the diversity in protocols of the included studies, significant heterogeneity was present. It is therefore arguable whether the consequences of special protocols should be merged for the calculation of pooled ORs. Fourth, because “Synbiotic 2000 FORTE” was not a specific strain or multi-strain but contained 4 fibers, the efficacy of this product cannot be attributed only to the probiotics. Despite these limitations, the results of this NMA provided important evidence about the efficacy of probiotics for preventing VAP, by comparing the outcomes of VAP between interventions involving different probiotics.
Conclusions
The present NMA disclosed three important findings. (1) The most efficacious probiotics for preventing VAP was “B. longum + L. bulgaricus + S. thermophiles”. (2) Accounting for the results of efficacy ranking based on cumulative probability plots and SUCRAs, Synbiotic 2000FORTE has the potential to be superior to other probiotics for reducing in-hospital mortality and ICU mortality. (3) Among the eight types of probiotics, L. rhamnosus was associated with the lowest diarrhea rate while L. casei was associated with the highest diarrhea rate. No report to date has used NMA to assess probiotic strain-specific effects on the development of VAP in mechanically ventilated patients. Our study may provide guidance to physicians regarding the selection of probiotics in the ICU. However, further rigorous clinical trials with direct comparisons between different types of probiotics are warranted.
Supplemental Material
IMR876753 Supplemental Material - Supplemental material for Synbiotics for prevention of ventilator-associated pneumonia: a probiotics strain-specific network meta-analysis
Supplemental material, IMR876753 Supplemental Material for Synbiotics for prevention of ventilator-associated pneumonia: a probiotics strain-specific network meta-analysis by Qiong-Li Fan, Xiu-Mei Yu, Quan-Xing Liu, Wang Yang, Qin Chang and Yu-Ping Zhang in Journal of International Medical Research
Footnotes
List of abbreviations
Bac + Ent = Bacillus subtilis + Enterococcus faecalis Bif + Lac + Ent = Bifidobacterium + Lactobacillus + Enterococcus Bif + Lac + Str = Bifidobacterium longum + Lactobacillus bulgaricus + Streptococcus thermophilus ICU = intensive care unit Lac.cas = Lactobacillus casei Lac.pla = Lactobacillus plantarum Lac.rha = Lactobacillus rhamnosus NA = not available VAP = ventilator-associated pneumonia.
Acknowledgements
The authors thank the study participants as well as current and past researchers and staff for their contribution to this research.
Authors’ contributions
Qiong-Li Fan and Xiu-Mei Yu are co-first authors; they wrote the main manuscript text and prepared Figures 1–11 and Tables 1–
. Qin Chang and Yu-Ping Zhang contributed substantially to the study conception and the design, and gave their final approval of the manuscript version to be published. Wang Yang, Qiong-Li Fan, and Xiu-Mei Yu contributed to the analysis and interpretation of all data, and drafted the manuscript. Qin Chang and Yu-Ping Zhang critically revised the manuscript for important intellectual content.
Declaration of conflicting interest
The authors declare that there is no conflict of interest.
Funding
The work was supported by the clinical research foundation of the Army Military Medical University (2018XLC3026 and 2014D307).
Role of the funding source
The funders had no role in the design and conduct of the study; the collection, management, analysis and interpretation of the data; the preparation, review or approval of the manuscript; or the decision to submit the manuscript for peer review.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
