Abstract
Improving the productivity and relative efficiency of traditional Chinese medicine (TCM) hospitals is pivotal for hospital managers and policymakers to optimize the utilization of TCM resources in China. This study aimed to measure the productivity and relative efficiency of public tertiary TCM hospitals in Hubei Province. The input and output indicators data were extracted from the Health Commission of Hubei Province (HCHP) from 2019 to 2021. The Bootstrap-Malmquist-DEA model was employed to measure the productivity and relative efficiency of the hospitals. The statistical significance was set at P < .05. The numbers of total diagnostic patients and discharged patients declined by 23.44% and 28.34% from 2019 to 2020, and then increased by 25.76% and 20.44% respectively from 2020 to 2021. The average bias-corrected technical efficiency (TE) scores of the TCM hospitals from 2019 to 2021 were 0.8391, 0.8048, and 0.8559, indicating good efficiency. The average total factor productivity (TFP) in 2020 and 2021 decreased compared to that in 2019, with scores of 0.7479 and 0.8996, respectively. Between 2019 and 2020, the TFP changes among 19 out of 21 (90.48%) TCM hospitals and the technological changes (TC) among 20 out of 21 (95.24%) were less than 1.0000 (P < .05). The TFP changes of 17 out of 21 (80.95%) TCM hospitals and the TC of 20 out of 21 (95.24%) were less than 1.0000 (P < .05) between 2019 and 2021. COVID-19 might have constrained the provision of healthcare services by the public tertiary TCM hospitals in Hubei Province. Priority should be given to the utilization of healthcare resources, performance evaluation, information system strengthening, and internal hospital management to boost technical efficiency. TCM hospitals need to focus further on technology innovation to improve their technological progress.
Keywords
Several studies have been conducted using classical DEA models to measure the productivity and relative efficiency of TCM hospitals in China. However, incorporating all levels of TCM hospitals simultaneously, including primary, secondary and tertiary TCM hospitals, can lead to biased results due to heterogeneity. The scores generated from the classical models need to be adjusted using a Bootstrapping approach.
The COVID-19 pandemic might have constrained the provision of healthcare services by the public tertiary TCM hospitals in Hubei Province of China over the study period. It might also affect their productivity and relative efficiency. In terms of the total factor productivity changes for the TCM hospitals, the technological changes were the main driver, indicating an imperative need for innovation in technology.
Priority should be given to the utilization of healthcare resources, performance evaluation, information system strengthening, and internal hospital management to boost technical efficiency. TCM hospitals need to focus on further innovating technology to improve their technological progress.
Introduction
The Healthy China 2030 Planning Outline, approved by China’s Party Committee and the State Council, has proposed 2 important goals: providing efficient and high-quality medical services and fully leveraging the potential of Traditional Chinese Medicine (TCM). 1 TCM development has been significantly improved as a crucial aspect of Chinese healthcare since the implementation of the new medical reform, due to numerous TCM-focused policies released by the Chinese government. Consequently, TCM services have become more accessible and affordable, thereby alleviating the medical burden. 2 To be noteworthy, TCM has made valuable contributions to the prevention and treatment of COVID-19, a challenging global health issue. Gajewski et al conducted a literature review and reported that over 85% of COVID-19 patients in China used TCM, and the most common herb (Glycyrrhiza glabra), when combined with standard therapies, significantly reduced hospitalization rates and COVID-19 symptom occurrence. 3
TCM hospitals paly a dominant role in providing TCM services in China. 4 However, these hospitals face various challenges, such as lower pricing of TCM outpatient services compared to Western medical services, 5 significant loss of human resources, and an imbalanced structure of health professionals. 6 Moreover, a majority of TCM programs are not covered by public health insurance schemes, which further discourages patients from choosing TCM as their primary option. 7 Hence, it is critical for TCM hospitals to provide high-quality TCM services. One key aspect of improving TCM service quality is to promote the operational efficiency of TCM hospitals. 8 However, TCM resources are often limited. Therefore, it is pivotal for hospital managers and policymakers to prioritize enhancing the productivity and efficiency of TCM hospitals in order to optimize the utilization of TCM resources in China.
Data Envelopment Analysis (DEA) has been widely applied to calculate the productivity and relative efficiency of healthcare institutions due to its ability to handle multiple inputs and outputs. 9 The Malmquist Productivity Index (MPI) model is also employed to assess the dynamic changes in productivity and relative efficiency of healthcare institutions or health systems.10,11 Several studies have used the DEA/MPI models to measure the productivity and relative efficiency of TCM hospitals in China.12-15 However, one limitation is that they incorporated all levels of TCM hospitals simultaneously, including primary, secondary and tertiary TCM hospitals, which resulted in biased results due to the heterogeneity across these different levels. Based on the Hospital Classification Management Measures in China, tertiary TCM hospitals represent the highest level and vary in capacity, structure of health professionals, and hospital settings. 14 Besides, the scores generated by classical DEA/MPI models were not adjusted, further contributing to bias. To address these limitations, Simar and Wilson suggest combining the classical DEA/MPI models with a Bootstrapping strategy to account for environmental and random factors.16,17 Therefore, this study aimed to measure the productivity and relative efficiency of public tertiary TCM hospitals in Hubei Province of China, using the Bootstrap-Malmquist-DEA model from both horizontal and longitudinal perspectives. The findings can provide empirical evidence for hospital managers and policymakers to improve the management and quality of TCM medical services.
Methods
Study Design
Figure 1 demonstrates the design to measure the productivity and relative efficiency scores of public tertiary TCM hospitals in Hubei Province. A horizontal analysis and a longitudinal analysis were undertaken using a Bootstrap-DEA model and a Bootstrap-Malmquist-DEA model, respectively. Technical efficiency scores were obtained from the Bootstrap-DEA model for the cross-sectional comparisons, while total factor productivity changes (TFPC) were generated from the Bootstrap-Malmquist-DEA model for longitudinal comparisons.

Flow chart of measuring the productivity and relative efficiency of public tertiary TCM hospitals.
Input and Output Indicators
A systematic review on relative efficiency and productivity research of Chinese hospitals using DEA models conducted by Dong et al, 9 suggested that there is often a misconception regarding technical efficiency and allocative efficiency due to the inappropriate combination of monetary and volume indicators. This review, along with a previous study published by our research team, 18 also highlighted the challenge of accessing price information compared to volume information in hospitals. Therefore, in this study, we selected input and output indicators based on their frequency of use in current studies and data feasibility. The input indicators chosen were the number of health professionals and the number of beds, while the output indicators included the number of total diagnostic patients, and the number of discharged patients.
Bootstrap-Malmquist-DEA Model
In a horizontal analysis, the Bootstrap-DEA model was used to estimate the relative technical efficiency (TE) of public tertiary TCM hospital in Hubei Province. In a longitudinal analysis, the Bootstrap-Malmquist-DEA model was employed to measure the dynamic changes in productivity and relative efficiency. Specifically, the TFPC and its decomposition index, including technical efficiency changes (TEC) and technological changes (TC), assuming that all decision-making units (DMUs), that is, TCM hospitals, are operating on the frontier. 19 Additionally, TC can be further decomposed into pure technical efficiency changes (PTEC) and scale efficiency changes (SEC). The basic formula is as follows: TFPC=TEC×TC= (PTEC×SEC) ×TC. Generally, if the productivity and relative efficiency scores are greater than 1.0000, it indicates an increase; if the scores are equal to 1.0000, it implies stability; and if the scores are less than 1.0000, it suggests a decrease.
Considering the productivity and relative efficiency of all DMUs, their operations are actually affected by environmental and random factors, the Bootstrap method was introduced as an approach to further address this issue based on classical DEA models.9,16,17,19 Its basic idea is to simulate the data-generating process (DGP) through repeated sample selection, thereby generating bias-corrected productivity and relative efficiency scores with 95% confidence intervals (CIs). In result, the obtained scores are much closer to the actual productivity and relative efficiency of TCM hospitals. Furthermore, the Bootstrap-Malmquist-DEA model is able to infer whether changes in productivity and relative efficiency are statistically significant.
Data Sources, Extraction and Processing
The data for the input and output indicators were extracted from the Health Commission of Hubei Province (HCHP) from 2019 to 2021. The respective number of the public tertiary TCM hospitals was 21, 23, and 24 from 2019 to 2021. Besides, in this study, the public tertiary TCM hospitals were labeled with the sequence T1, T2, and T3 and so on for each year. According to the classification of bias-corrected TE scores, 5 categories were created, including excellent efficiency [0.9000, 1.0000], good efficiency [0.8000, 0.9000], average efficiency [0.7000, 0.8000], poor efficiency [0.6000, 0.7000], and failing efficiency [0.000, 0.6000].18,20 Besides, the ranking orders were determined based on the bias-corrected TE scores.
Statistical Analysis
Descriptive analysis of the input and output indicators, including mean and standard deviation (SD), was conducted using SPSS 23.0 version statistical. The productivity and relative efficiency of the public tertiary TCM hospitals were measured using R 3.2.1 version statistical software, specifically employing FEAR package with 95% CIs. 21 The geometric mean was used to represent the average scores of productivity and relative efficiency. A statistical significance was determined if the 95% CIs did not contain the value of 1.0000. The number of repeated sample selection was set at 2000. The statistical significance was set at P < .05.
Results
Characteristics of the Input and Output Indicators for the Public Tertiary TCM Hospitals From 2019 to 2021
Table 1 shows that regarding the input indicators, the numbers of health professionals and beds varied slightly from 2019 to 2021. The highest numbers of health professionals and beds in 2021 were 856 and 790, respectively. As to the output indicators, the numbers of total diagnostic patients and discharged patients experienced a decline of 23.44% and 28.34% from 2019 to 2020. However, the numbers of total diagnostic patients and discharged patients increased by 25.76% and 20.44% from 2020 to 2021.
Summary of the Input and Output Indicators for the Public Tertiary TCM Hospitals From 2019 to 2021.
Technical Efficiency Scores and Ranking After Bias-Correction Among the Public Tertiary TCM Hospitals From 2019 to 2021
As displayed in Table 2, the average bias-corrected TE scores of the public tertiary TCM hospitals from 2019 to 2021 were 0.8391, 0.8048, and 0.8559, belonging to good efficiency. The highest bias-corrected TE scores were 0.9590, 0.9691, and 0.9794, while the lowest bias-corrected TE scores were 0.5519, 0.4682, and 0.6224 for each respective year. Specifically, in 2019 and 2020, only 2 TCM hospitals had failing efficiency scores, accounting for 9.52% and 8.70% of the total, respectively. The numbers of TCM hospitals with excellent and good efficiency scores from 2019 to 2021 were 17 (80.95%), 18 (78.26%) and 18 (75.00%), respectively.
Technical Efficiency Scores and Ranking After Bias-Correction Among the Public Tertiary TCM Hospitals From 2019 to 2021.
Trends of Changes on the TFP and Its Decomposition Scores Among the Public Tertiary TCM Hospitals From 2019 to 2021
As presented in Table 3, compared with the average TFP in 2019, both in 2020 and 2021 decreased, with scores of 0.7479 and 0.8996, respectively. However, the average TFP in 2021 increased slightly compared to that in 2020, reaching 1.1856. Particularly, between 2019 and 2020, the TFP changes among 19 out of 21 (90.48%) TCM hospitals and the TC among 20 out of 21 (95.24%) were less than 1.0000 with a statistical significance (P < .05). Similarly, the TFP changes of 17 out of 21 (80.95%) TCM hospitals and the TC of 20 out of 21 (95.24%) were also statistically significant and less than 1.0000 (P < .05) between 2019 and 2021. In contrast, between 2020 and 2021, the TFP changes of 20 out of 23 (86.96%) TCM hospitals were statistically significant and more than 1.0000 (P < .05).
Changes of the TFP and Its Decomposition Scores of the Public Tertiary TCM Hospitals From 2019 to 2021.
Means the changes of the TFP and it composition index were statistically significant at P < .05.
Discussion
Potential Impact of the COVID-19 Pandemic on the Inputs and Outputs of the Public Tertiary TCM Hospitals
Our study found that the inputs of the TCM hospitals had been relatively stable, while the numbers of both total diganostic patients and discharged patients from the public tertiary TCM hospitals in Hubei Province declined by 23.44% and 28.34% from 2019 to 2020, and then increased by 25.76% and 20.44% from 2020 to 2021. These findings indicate that the COVID-19 pandemic might have contrained on healthcare services provided by the TCM hospitals. The COVID-19 epidemic first broke out in Wuhan, the capital city of Hubei Province, China, in December 2019.22,23 In March 2020, the World Health Organization (WHO) declared it a pandemic. 24 During the early stage and the peak of the COVID-19 pandemic in 2020, many hospitals, including TCM hospitals, were designated to exclusively treat patients infected with COVID-19 due to the high contagion and rapid spread of the virus. 25 Moreover, the availability of hospital beds was limited. 26 In result, many patients, especially those with chronic diseases, were unable to access healthcare from hospitals as they had before the COVID-19 pandemic. Instead, patients turned to internet hospitals for healthcare services. 27 Hence, it led to the decreasing numbers of total diagnostic patients and discharged patients from 2019 to 2020. However, it is encouraging to note that these numbers showed a rise from 2020 to 2021, although they remained lower than those in 2019 in our study. These evidences indicate that the public tertiary TCM hospitals were gradually recovering from the impact of the COVID-19 pandemic by implementing regular and stringent prevention and control measures to prevent the occurrence of COVID-19 infections.
Implications of the Overall Technical Efficiency for the Public Tertiary TCM Hospitals
Our study found that the public tertiary TCM hospitals in Hubei Province demonstrated good TE from 2019 to 2021, as observed from the horizontal perspective. Moreover, only 2 TCM hospitals exhibited failing efficiency in both 2019 and 2020, while the majority of TCM hospitals achieved excellent and good efficiency scores throughout the study period. These findings suggest that the overall performance of the public tertiary TCM hospitals in Hubei Province was commendable from 2019 to 2021. According to a longitudinal study among county-level TCM hospitals in Hubei Province from 2001 to 2017, the average TE score was 0.686, which was much lower than the scores (0.8391, 0.8048, and 0.8559) in our study. 14 Moreover, compared with another productivity and efficiency analysis study among municipal-level TCM hospitals in Gansu Province, the TE of tertiary TCM hospitals was reported to be 0.868, 0.926, and 0.935 from 2017 to 2019, slightly higher than those in our study. 28 One possible reason for this disparity could be the difference in the classification of TCM hospitals. Our study solely focused on tertiary TCM hospitals, while the county-level/municipal-level TCM hospitals encompassed primary, secondary, and tertiary hospitals. Different levels of TCM hospitals have varying capacities, with the tertiary hospitals representing highest level. Another contributing factor may be associated with the application of the DEA model. Our study used the Bootstrap-DEA model to estimate the adjusted TE of TCM hospitals, which is considered more accurate than the calculation derived from the classical DEA model used in the county-level/municipal-level TCM hospitals. Despite the overall good efficiency observed in public tertiary TCM hospitals, a small number of hospitals still exhibited failing or poor efficiency in our study. This indicates the need for immediate measures and actions to improve their technical efficiency. Utilization of healthcare resources, performance evaluation, strengthening information systems and internal hospital management can be prioritized to further to enhance technical efficiency. 20 It is worth noting that external factors related to regional healthcare resource disparities in Hubei Province may also contribute to the varying efficiency levels observed. Addressing these external factors and implementing effective internal management strategies will be crucial for improving the overall performance of TCM hospitals.
Technological Progress as the Main Driver of the Total Factor Productivity Changes for the Public Tertiary TCM Hospitals
Our study also revealed a decrease in the average TFP of public tertiary TCM hospitals in Hubei Province in 2020 and 2021 compared to 2019, with a slight improvement in TFP observed from 2020 to 2021. This further supports the point that the COVID-19 pandemic might affect the operation of the TCM hospitals in Hubei Province. Previous reports have highlighted the loss of healthcare services in many Chinese hospitals during the late January to March 2020 period due to the COVID-19 pandemic. 29 Following the lifting of the lockdown in April, 2020, people in Wuhan and Hubei gradually returned to normal life, and hospitals had to recover regular healthcare services. 25 Besides, in our study, the technological progress was found to be the main driver causing the changes of the TFP among the public tertiary TCM hospitals. High medical technology is one prominent component of high-quality healthcare services. It is important to note that TCM hospitals cannot be directly compared to general hospitals, which primarily concentrate on Western medical services in China. 5 Hence, the TCM hospitals especially need to prioritize the innovation of technology, thereby improving their technological progress. Moreover, TCM has demonstrated effectiveness in the prevention and treatment of patients with COVID-19. 30 As TCM is increasingly accepted worldwide, the experience in China may be referential to other countries that possess their own complementary or alternative medicine practices. 31
Other Implications for Policy and Practice
High productivity and relative efficiency of public tertiary TCM hospitals are strongly linked to the optimal use of healthcare resources. 32 Moreover, the optimal use of healthcare resources, in turn, is dependent on a well-structured health professionals. However, the loss of human resources is still a challenge for TCM hospitals. Hence, implementing an advanced performance and salary system can be able to improve the motivation of the TCM health professionals and reduce job turnover. It is also imperative for TCM hospitals to actively participate in the hierarchical diagnosis and treatment system to optimize the utilization of healthcare resources.
Limitations
Our study has some limitations. First, our study only analyzed the productivity and relative efficiency of the public tertiary TCM hospitals in Hubei Province. It did not explain the relationship between the quality and the productivity and relative efficiency, as well as the relationship between the cost and the productivity and relative efficiency. Further study needs to be conducted to explore these relationships. Second, we did not investigate the impact of environmental factors, such as market competition, location, economic development levels, etc. on the productivity and relative efficiency of the hospitals. Future research is necessary to be undertaken using a 3-stage or 4-stage Bootstrap-DEA model. Besides, as WHO declares that the COVID-19 pandemic was no longer a global health emergency in May, 2023, a follow-up study is needed to again specifically measure how COVID-19 continues to affect the productivity and relative efficiency of the TCM hospitals.
Conclusions
The numbers of total diagnostic patients and discharged patients from the public tertiary TCM hospitals in Hubei Province were declined from 2019 to 2020, and then increased from 2020 to 2021. Besides, the average TFP in 2020 and 2021 was decreased compared with that in 2019, and it was slightly higher in 2021 than that in 2020. Our findings indicate that the COVID-19 pandemic might have an impact on patients’ healthcare-seeking behaviors and the operation of the public tertiary TCM hospitals in Hubei Province. A small number of the public tertiary TCM hospitals demonstrated poor or failing technical efficiency. It is suggested that the priority should be given to the utilization of healthcare resources, performance evaluation, information system strengthening, and internal hospital management to boost technical efficiency. TCM hospitals need to focus on technology innovation, thereby improving the technological progress.
Footnotes
Availability of Data and Materials
Data and materials will be accessible with the permission from the research team.
Declaration of Conflicting Interests
Hao Li is a section editor of INQUIRY. He was not involved in the review of decision related to this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This research has been funded by Primary Public Health Services Performance Evaluation in Hubei Province (2020)/grant number: 2305010205.
Ethics Approval and Consent to Participate
Data were all from the official report and did not include the personal information of humans. Therefore, there were no needs to ask for ethics approval and consent to participate.
Consent for Publication
All the authors listed in this paper have already read this manuscript and agreed to submit the paper and for later publication.
