Abstract
Introduction
Clinical decision support systems (CDSSs) play an important role in summarizing the best clinical practices, thereby promoting high standards of care in specific medical fields. These systems can serve as tools for gaining knowledge and mediating between clinical guidelines and physicians thereby providing the right information to the right person at the right time.
Objective
This review aims to evaluate the effect of CDSSs on adherence to guidelines for venous thromboembolism (VTE) prophylaxis and VTE events compared to routine care without CDSSs in non-surgical patients.
Methods
In order to conduct a systematic literature review, the published studies were identified through screening EMBASE, the international clinical trials registry, OVID, Cochrane database, PubMed, ISI Web of Science, and Scopus databases, from 1982 to March 2021. The included studies were reviewed by two independent reviewers; the proportion of patients that correctly received VTE prophylaxis has been next extracted for further analysis. Additionally, patients were divided into two groups: CDSS-recommended VTE prophylaxis and routine care without using a CDSS.
Results
Twelve articles (three randomized controlled trials, seven prospective cohort trials, and two retrospective cohort trials) were in fine analyzed. The use of CDSSs is found to be associated with a significant increase in the rate of using the appropriate prophylaxis for VTE (p < 0.05) and a significant decrease in the incidence of VTE (p < 0.05).
Conclusion
Implementation of CDSSs can help improving the appropriate use of VTE prophylaxis in non-surgical patients. Further, evidence-based and interventional studies on the development of CDSSs can provide more in-depth knowledge on both this tool design and efficiency.
Introduction
Deep vein thrombosis (DVT) and pulmonary embolism (PE) known as venous thromboembolism (VTE) are adverse events among hospitalized patients and are the leading causes of mortality during and after hospitalization due to acute medical illnesses or surgery.1,2 Inappropriate VTE prophylaxis leads to adverse consequences, such as symptomatic DVT, PE, chronic post-thrombotic syndrome, and an increased risk of recurrent VTE. There are mechanical and pharmacological methods for VTE prevention in hospitalized patients. 3
Although numerous guidelines for VTE prophylaxis are developed, several recent clinical studies have shown that appropriate VTE prophylaxis is sometimes not utilized in hospitalized patients.4,5 Sometimes, physicians use risk classification tools inconsistently or incorrectly. As a result, patients do not receive proper prophylaxis for VTE, thereby increasing their VTE risk. The existence of such evidence suggests that the problem of VTE in hospitalized patients has not been given sufficient attention. In other words, evidence-based guidelines and recommendations are clearly underused.6,7
Up to now, various methods have been applied to improve prophylaxis recommendations for hospitalized patients. To this end, many hospital systems use clinical decision support systems (CDSSs), which help physicians assess VTE risk levels and provide appropriate VTE prophylaxis. 8 CDSSs use algorithms to analyze patients’ data and provide a variety of services in patient care including disease prevention, chronic disease management, healthcare screening, appropriate recommendations for diagnosis, and treatment.9,10 Borab et al. 7 show that CDSS improve VTE prophylaxis in surgical patients. 7 Additionally, Tooher et al. 11 in the systematically reviewed study show that CDSS is the most effective strategy for improve VTE prophylaxis in hospitalized patients.
CDSSs differentiate between surgical and non-surgical VTE patients, and their effects on these two groups are not the same. 12 Because, risk assessment model of VTE in two group was different, also have different recommendation. 12 Hence, the present systematic review and meta-analysis aim to determine whether the implementation of a CDSSs for VTE prophylaxis will increase adherence to VTE prophylaxis guidelines and reduce the incidence of VTE, compared to routine care without any CDSS in non-surgical patients.
Methods
This systematic review and meta-analysis were conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA). 13 Additionally, the study protocol was registered in the PROSPERO database (registration No. CRD42021225093).
Eligibility criteria
The analysis includes original peer-reviewed studies that quantitatively reported the effects of CDSSs on adherence to VTE prophylaxis guidelines among non-surgical patients. These studies provided VTE prophylaxis recommendations after CDSS implementation, regardless of the CDSS software utility, VTE risk level, and prevention of thrombosis among non-surgical patients. Language did not constitute a restriction.
We excluded studies that assessed VTE prevention in pregnant and surgical patients, did not assess prophylaxis's outcome, or did not include a non-surgical cohort.
Data sources and search strategy
We searched EMBASE, the international clinical trials registry, OVID, Cochrane database, PubMed, ISI Web of Science, and Scopus (1982-March 2021) for studies analyzing the effect of CDSSs, against no-CDSS routine care, on VTE incidence (Table 1). As the terminology for CDSS and VTE interventions has not been standardized yet, we used broad search terms. We conducted a nested search, in which we reviewed also the sources referred to in the articles we have selected for our study.
Search strategies used in the different databases.
Study selection
The studies identified during the database search were downloaded from the corresponding journals. The titles and abstracts of the studies were screened, mainly by one of the co-authors (FT). Afterward, their full texts were independently screened by two experts (MK and RSH), in order to include the studies that used a CDSS to aid physicians through the recommendation of appropriate VTE prophylaxis in non-surgical patients. In case of the exclusion of reports, the reasons are reported.
Data extraction
The following data were extracted from each study, independently by two co-authors: the authors’ names, studies year, country, methods used (patient population, study design, and sample size), and an approach to VTE prevention. We also extracted primary outcomes, that is, the rate of appropriate prophylaxis for VTE before and after the CDSS implementation, and the rate of VTE events.
Statistical analysis
We analyzed studies in which patients were divided into two groups based on the type of intervention: CDSS-guided care for VTE prophylaxis, and routine care without the use of a CDSS. Data were pooled using the fixed effect model for meta-analysis when CDSS and appropriate VTE prophylaxis were sufficiently similar to compare. Between-study heterogeneity was tested using the chi-square test and I2 statistics. 14 Additionally, the potential for studies bias for subcategory meta-analysis was assessed by Cochrane collaboration risk of bias tools. 15 Sensitivity analyses were performed to use different measurements for dichotomous outcomes. 16 Hypotheses were tested using two-sided tests, at a significance level of 0.05.
Quality assessment
We assessed the quality of the studied papers using the Newcastle-Ottawa Scale (NOS) to evaluate the computerized decision support systems. The scale consists of three dimensions: the selection of study groups (four scores for cohort and five scores for cross-sectional studies), comparability of study groups (maximum two scores), and ascertainment of either the exposure (maximum three scores) or outcome of interest for non-randomized studies. Accordingly, risk assessment of VTE, age, and sex was considered for comparability items in this study.
Results
A PRISMA flow diagram, summarizing study screening (Figure 1), shows that the primary search resulted in a total of 219 potentially relevant papers. After reviewing their titles and abstracts, 191 articles were excluded. We read the full texts of the remaining 28 papers to determine if they met the inclusion criteria. The references of the eligible studies yielded no additional articles. Eventually, the screening procedure resulted in 12 papers: three randomized controlled trials, seven prospective cohort trials, and two retrospective cohort trials (Tables 2 and 3).

Summary of results of search and screening of the studies.
Newcastle–Ottawa scale (NOS) scores and risk of bias of the studies.
Characteristics of the randomized control trial.
Study quality and risk of bias
Based on thresholds for converting the Newcastle-Ottawa scale (NOS) to AHRQ standards, the overall quality of the study was good. The NOS scores for the included articles are provided in Table 2. Owing to the utilized interventions, the risk of total bias was not present in the included studies. However, four studies had a moderate risk of sampling bias, because of an unbalanced patient population.
Thresholds for converting the Newcastle-Ottawa Scale to AHRQ standards (good, fair, and poor):
Good quality: 3 or 4 stars in the selection domain and 1 or 2 stars in the comparability domain and 2 or 3 stars in the outcome/exposure domain. Fair quality: 2 stars in the selection domain and 1 or 2 stars in the comparability domain and 2 or 3 stars in the outcome/exposure domain. Poor quality: 0 or 1 star in the selection domain or 0 stars in the comparability domain OR 0 or 1 star in the outcome/exposure domain.
Study characteristics
Among the studies, 12 utilized pre-post designs, but retrospective pre-post designs and randomized controlled trials were used, too. Nine studies were conducted in the United States; the remaining studies were performed in Brazil, the Netherlands, and Switzerland. The characteristics of the studies are presented in Table 2 and Table 3.
Sensitivity analysis
Initially, we conducted sensitivity analysis to evaluate how each study affected the 95% CI. The results of sensitivity analysis showed that the pooled effect size was 95% CI. In other words, removal of each study caused no significant change in the pooled studies. Sensitivity analysis was also performed in order to evaluate the impact of heterogeneous studies on the pooled estimates. For this purpose, the studies were excluded serially and pooled estimates were obtained from the remaining studies. This helped determining whether single studies with highly heterogeneous results affected the overall pooled estimates. Overall, there is no bias. Studies bias was assessed in the meta-analysis by performing Egger's rank correlation test to statistically assess the symmetries of the diagram. 17
Intervention with CDSS and control group details
Data points were pooled by the CDSSs in all the studies to risk-stratify the patients. In other words, the CDSS algorithm would risk-stratify based on the data provided. In 10 studies, control groups were determined based on the implementation of the CDSS. In the two other studies, a time series experiment was conducted and the CDSS was for the intervention periods.
VTE prophylaxis recommendation in non-surgical patients
Based on the results of this meta-analysis, risk assessment of VTE in non-surgical patients was applied in all the studies and CDSS algorithms suggested appropriate prevention based on the VTE risk scores.
Appropriateness of prophylaxis recommendation to prevent VTE in non-surgical patients
Out of the nine studies, three revealed the effect of the VTE prophylaxis recommendation system on the appropriateness of prophylaxis for VTE in the non-surgical population (Table 5). Accordingly, the pooled meta-analysis (two of these three studies) of 2675 patients who received the CDSS intervention and 3214 controls showed that the CDSSs significantly increased the appropriate prophylaxis for VTE compared to the controls (OR = 1.69, 95% CI: 1.25–2.28, p = 0.001; I2 = 59.3%, p = 0.085). Additionally, the results of the sensitivity analysis of each study indicated that no single study contributed to a significant part of the measured I2 statistics. The largest contribution was made by the study carried out by Mitchell et al., 18 which, when excluded, comprised only 5% of the heterogeneity (Figure 2).

Appropriateness of venous thromboembolism prophylaxis in non-surgical patients.
Characteristics of the observational studies.
Appropriateness of venous thromboembolism prophylaxis in non-surgical patients.
Receive VTE prophylaxis in non-surgical patients
Seven out of the nine studies reported the effect of the prophylaxis recommendation system on receiving VTE prophylaxis in the non-surgical population (Table 6). These studies were conducted on 55,258 patients receiving the CDSS intervention and 60,664 control patients; the results demonstrated the effect of CDSSs on the reception of VTE prophylaxis in non-surgical patients. Accordingly, the use of a CDSS was associated with significantly increased rates of receiving VTE prophylaxis (six out of these seven studies) among the non-surgical patients compared to the controls (OR = 2.02, 95% CI: 1.66–2.45, p < 0.001; I2 = 97.1%, p < 0.001) (Figure 3).

Receive venous thromboembolism prophylaxis in non-surgical patients.
Receive venous thromboembolism prophylaxis in non-surgical patients.
Incidence of VTE in non-surgical patients
Three out of the nine studies referred to the effect of the VTE prophylaxis recommendation system on the VTE incidence in the non-surgical population (Table 7). These studies were conducted on 243,530 patients receiving the CDSS intervention and 242,973 control patients; the results showed the effect of CDSSs on the number of VTE events experienced. Accordingly, the use of a CDSS was associated with significantly decreased rates of VTE events among the patients compared to the controls (OR = 0.68, 95% CI: 0.54–0.85, p = 0.001; I2 = 31.5%, p = 0.211) (Figure 4).

The incidence of venous thromboembolism in non-surgical patients.
The incidence of venous thromboembolism in non-surgical patients.
Discussion
This systematic review and meta-analysis included 12 studies to determine the impact of the computerized CDSSs on appropriate VTE prophylaxis orders in non-surgical patients. According to this systematic review and meta-analysis results, the use of CDSSs among non-surgical patients is associated with a considerable increase in the proportion of patients who received appropriate VTE prophylaxis recommendation, especially if the CDSS could auto-populate patient’s prescriptions. Additionally, using CDSSs is associated with a considerable reduction in the risk of developing VTE.
According to the findings of this review, for any intervention to significantly improve the prevention of VTE, it is necessary to have at least two basic factors: the intervention should assist clinicians in assessing patients’ risk status for VTE, and it should assist clinicians in prescribing the appropriate prophylaxis for risk classification.30,31
Several studies have evaluated computer alerts to improve thromboprophylaxis in surgical and non-surgical patients. For instance, Kucher et al. conducted a randomized clinical trial using a computer program including risk factors and special diagnostic codes and identified both surgical and non-surgical patients who were at risk of VTE. Accordingly, the hospital's VTE-prevention guidelines were linked to this computer-alert system. The authors also found that using CDSSs reduced the incidence of DVT and PE. 28 The use of computerized alerts for appropriate VTE prophylaxis was also studied in large-scale research in Switzerland (1593 non-surgical patients divided into an alert group (804) and a control group (789)). 19 Therefore, the alert was considered a support system for clinical decision-making, which played an important role in helping physicians comply with the current international consensus guidelines. 19
Computerized CDSSs have been used successfully to provide preventive care services to non-surgical patients. 26 In this context, CDSSs have been shown to increase adherence to guidelines based on the overall VTE prevention medical services. 7 Bhalla et al. disclosed that the VTE preventive medical services increased from 61.9% to 82.1% (p < 0.001), and pharmacological VTE prophylaxis increased from 59.0% to 74.5% (p < 0.001). 24 Moreover, Fuzinatto et al. conducted a research on a specific population of cancer patients and revealed a significant increase in the use of appropriate VTE prophylaxis (from 18.1% to 44.1%; p = 0.002). 23 In contrast, the results of the study by Eijgenraam et al. showed no improvements in the adherence to antithrombotic prophylaxis guidelines in medical patients. 21 These positive results indicated CDSSs to be a powerful tool for implementing current evidence-based medicine as a standard of care.
From the present meta-analysis, it follows that an increase in the appropriate prophylaxis rate for VTE with the implementation of CDSSs was associated with a reduction in the incidence of VTE events. Previous studies demonstrated that using CDSSs resulted in an increase in the rate of VTE prevention. Nonetheless, there is still insufficient evidence to link the increased rate of prophylaxis with the clinical endpoint of decline in the VTE rate. 6
Among the 12 studies analyzed here, five used the American College of Chest Physicians (ACCP) guideline to prevent thrombosis. In the other studies, the guidelines were developed by local experts. 32 Overall, more efficient and powerful CDSSs are associated with electronic medical records. This strategy significantly improves the prevention of VTE, which may lead to a significant reduction in VTE incidents, especially in non-surgical patients. 11 Since many hospitals under investigation in the analyzed studies did not have the necessary IT resources, most studies were limited to individual centers, whence their results could not be generalized to other institutions. 33
To address the fatigue symptoms, the staff had direct relationships with together and made decisions in the presence of the physician. 34 In a large randomized multicenter study (n = 2493), in the alert group, the physician was informed by another staff member that the patient was at a high risk for VTE but was not receiving VTE prophylaxis. Then, prophylaxis was recommended for the patient. Based on the previous study findings, the patients who were warned by their physicians were more than twice as likely to be prevented from VTE compared to the control patients who were not warned (p < 0.0001). Additionally, a decrease was found in the VTE rate in the intervention group at 90 days. However, no significant difference was observed between the human alert trial and the computer alert trial. Yet, the slightly less prominent reduction in VTE in the human alert trial suggested the higher effectiveness of the computer alerting system. 5
Although our analysis indicates that the CDSS-guided prevention was associated with a reduction in VTE incidents in non-surgical patients, no sufficient data were provided regarding the side effects of prophylaxis. These risks include hematoma formation, bleeding events, and thrombocytopenia. Therefore, it is vitally important to further evaluate the advantages and disadvantages of prescribing additional anticoagulants for VTE patients.
Strengths of the review
This review provides readers with a comprehensive overview of the range of approaches taken to date to evaluate the effectiveness of computerized CDSSs in the improvement of using appropriate VTE prophylaxis in non-surgical patients. The information presented in Table 2 and Table 3 provides a useful basis for other researchers to evaluate their intervention elements in relation to previous approaches to designing interventions. Our overall goal was to help future researchers to improve these efforts by highlighting the strengths and weaknesses of the previous studies and to consider appropriate measures and methods, if possible.
Limitations of the review
One of the limitations of this study was that only the evaluation of quantitative studies was focused and qualitative studies were excluded. Moreover, our review only includes the studies that assessed the CDSS implementation process associated with the prescription of VTE prophylaxis such as those describing successful implementation strategies. Since most studies reported demographic information without separating surgical and non-surgical patients, this information as well as patients’ risk levels could not be extracted. Besides, each individual study did not have sufficient power to detect changes in the VTE incidence; however, this limitation was softened by pooling the data. Furthermore, considering the 90-day follow-up, the incidence of VTE could be potentially underestimated. Finally, the results might be context-dependent since most studies were conducted in the United States. This could affect the validity of the CDSS system and its impact on appropriate VTE prophylaxis orders in non-surgical patients.
Conclusion
This study showed that CDSS interventions could be effective in improving the use of VTE prophylaxis in non-surgical patients. Nonetheless, higher-quality studies are required to confirm the results. Currently, little evidence is available to assist physicians in consciously selecting CDSSs for VTE prescription. This will inevitably lead to many choices, each of which can make CDSSs easier to use. This suggests the need for higher-quality systematic comparative studies.
Footnotes
Acknowledgments
The authors would like to thank all the professors and staff of Shiraz Medical Sciences University for their contributions to this study. Also, the authors would like to acknowledge Marcel Ausloos from the University of Leicester in the UK for proofreading and improving the language.
Conflict of interest:
The authors have no conflicts of interest to declare.
Contributorship:
M.K. was responsible for the study's conception and design. F.T. searched the relevant databases and included the appropriate articles according to the study objective. At the same time, R.S. supervised the whole thesis. H.R.S. preparing the first draft of the manuscript and revise the manuscript. H.R.S. and S.H. did the analysis of the results, made critical revisions to the paper for important intellectual content, and supervised the study. All authors have read and approved the final manuscript.
Ethical approval:
CRD42021225093 is the study protocol number registered in PROSPERO.
Funding:
The authors received no financial support for the research, authorship, and/or publication of this article.
Guarantor:
MK.
