Abstract
Introduction
Breast cancer is the most common cancer affecting women. Furthermore, it is the overall leading cause of death for women in the world, the second in Africa and Southeast Asia after cervical cancer, and the fifth in the West Pacific. Globally, breast cancer was the most common cancer type, representing 13.8% of all cancer cases. A study in China, India, and Russia, showed that breast cancer was the second cause of death among women after lung cancer in 2014. 1
The side effects of breast cancer therapy represent a major public health concern. 2 The prevalence of psychoneurological cluster symptoms in these patients varies across studies from 25% to 100%, depending on the type and stage of breast cancer and treatment modality.3-6 Furthermore, adverse effects have been associated with postoperative symptoms (eg, fatigue, pain, limb stiffness, and immunity reaction to psychological stress). Hormone therapy–related symptoms can be classified due to the therapy’s antiestrogenic actions (eg, hot flashes, vaginal bleeding, discharge, or dryness) or as more general effects (eg, nausea, vomiting, and wide range of physical and mental symptoms). Severe surgical trauma, hormone-associated treatment, and psychosomatic stress were the main causes of postoperative complications, especially breast cancer hormone–associated symptoms, which are reported in up to 50% of women. 7
Acupuncture is widely accepted as beneficial for breast cancer survivors, both on and off treatment. There is growing evidence for complementary and integrative medicine for the treatment of psychoneurological cluster symptoms and overall quality of life (QOL) improvements.8-10 Alternative medicines have gained increasing attention for use in the management of adverse postoperative reactions and symptoms.11-14 Previous research in the United States has been unclear in determining whether acupuncture reduces postoperative symptoms in breast cancer patients.15-19
Bias due to selective inclusion and reporting of outcomes and analyses in systematic reviews of randomized acupuncture interventions trials is common. Acupuncture recommendations, the criteria which randomized controlled trials (RCTs) consider, and the evidence used to reach their final conclusions are often equivocal. Systematic and transparent systems for decision making can help ensure that all important criteria are considered and that the best available evidence informs decisions. The results of previous studies were inconsistent and controversial.14,18 Therefore, assessing the effectiveness of acupuncture in the management of hormone therapy–related side effects in breast cancer by conducting a systematic review is valuable.
To explore this issue further, we used a Cochrane systematic review and the GRADE approach (Grading of Recommendations Assessment, Development, and Evaluation) to conduct a comprehensive evaluation and generate recommendations on the basis of the relevant evidence regarding the use of acupuncture in managing the hormone therapy–related side effects of breast cancer.
Methods
Search Strategy and Selection Criteria
We included reports of placebo or controlled RCTs on acupuncture for side effect management in postoperative hormone therapy–related breast cancer patients. Only English-language literature was searched; no publication date or status restrictions were imposed. Female participants were included if they were (1) aged 18 years or older; (2) patients diagnosed with breast cancer by pathology or cytology 20 ; or (3) were actively undergoing breast cancer treatment and/or hormone therapy. All types, doses, and regimens of acupuncture and electroacupuncture were included, as were placebo and control groups. Primary outcome measures were breast cancer therapy–related side effects, and a secondary outcome measure was physical well-being. Participants were excluded if they (1) did not meet the diagnostic criteria of breast cancer; (2) had postoperative lymphatic drainage of breast cancer; (3) the body function could not tolerate acupuncture therapy; (4) had mental disorders or taking psychoactive drugs with a definite clinical diagnosis; (5) receiving blood transfusion or steroid treatment; (6) with a second solid tumor; (7) with contraindications of acupuncture therapy: those with bleeding tendency, severe allergic and infectious skin diseases, thyroid dysfunction, epilepsy, cerebral cortex damage, and a cardiac pacemaker installed.
Data Sources and Search Strategy
PubMed (1966 to April 2020), EMBASE (1974 to April 2020), the Cochrane Library (issue 4 through 2020), and the Web of Science (1974 to April 2020) were searched through April 2020 using the following terms: (“breast neoplasms”[MeSH Terms] OR “breast neoplasm”[Title/Abstract] OR “breast cancer”[Title/Abstract] OR “breast tumor”[Title/Abstract] OR “breast neoplasms”[Title/Abstract] OR “breast cancers”[Title/Abstract] OR “breast tumors”[Title/Abstract]) AND “electro-acupuncture” [MeSH Terms] OR “electro-acupuncture”[Title/Abstract] OR “Electroacupuncture” [MeSH Terms] OR “Electroacupuncture”[Title/Abstract] OR (“Acupunc-ture”[MeSH Terms] OR “Acupuncture”[Title/Abstract]) AND (random* OR “Clinical Trials as Topic”[Mesh] OR “Clinical Trial” [Publication Type]). Reference lists were reviewed to identify additional studies, and the final bibliography was distributed to experts to identify missing studies.
Data Abstraction and Assessment of Bias Risk
The titles and abstracts that matched the criteria of our meta-analysis were independently read by 2 professional appraisers (Tang Yong and Xiping Shen), and the full texts of the RCTs determined to have met the criteria were obtained. Final decisions on inclusion were made after examination of the full manuscripts. Data points from the included reports were individually extracted at least twice by 4 independent reviewers. Data included the number of participants, their characteristics, the intervention setting, placebo/control group, underlying participant disease status, study design, and acupuncture treatment characteristics.
The methodological quality of all studies was assessed using the criteria stated in the Cochrane Handbook version 5.2, with all results reported according to the PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines.21,22
All studies were assessed for risk of bias by at least 2 reviewers using the Cochrane Collaboration risk of bias tool on the basis of sequence generation, allocation concealment, blinding of the study participants and investigators, whether incomplete outcome data were addressed, selective outcome reporting, and other sources of bias. Final assessments were based on a selection consensus, data extraction, and the quality of inter-reviewer assessments. 21
Data Analyses
For continuous outcomes, standardized mean differences (SMDs) or mean difference (MD) and 95% confidence intervals (CIs) were calculated. Binary outcomes were pooled using an odds ratio (OR) and 95% CI. A subgroup analysis was conducted according to the endpoint measurement methods and evaluated subjects. The meta-analysis was performed with Stata software (version 10.0, Stata Corp) 23 and Review Manager Software (RevMan, version 5.2). 24 A meta-regression and subgroup analysis approach was adopted to explore the possible sources of heterogeneity among the RCTs 21 ; heterogeneities were estimated using Cochran’s Q test, with P < .05 indicating a statistically significant heterogeneity.
Grading of the Evidence
We used the GRADE approach to assess the certainty of our estimates and produce evidence profiles using GRADE proGDT (GRADE pro Guideline Development Tool software, McMaster University, Hamilton, Ontario, Canada, 2015). Evidence was graded as high, moderate, low, or very low quality. All controlled intervention studies that were included were graded as high-quality evidence by default and then downgraded on the basis of prespecified criteria, including risk of bias (assessed by the Cochrane risk of bias tool), inconsistency (substantial unexplained heterogeneity, I2 > 50%, P < .10), indirectness (presence of factors that limit result generalizability), imprecision (whether the 95% CI for pooled effect estimates and crossed a minimally important difference for benefit or harm), and publication bias (significant evidence of publication bias). 25
Results
Description of Studies
Twenty RCTs with a total of 2001 patients were included in the present review. In total, 12 studies from North America,16,18,19,25-32 9 from the European Union countries,17,33-39 and 1 each from Australia 32 and Korea 40 were included. All studies were from English databases (Figure 1).

A flowchart of the results of the literature search.
Study Characteristics
All RCTs included patients with breast cancer (stages 0 to III). The mean age of participants ranged from 30 to 65 years, and all were female. Various controls were compared among the 20 RCTs examined, using 7 sham needles as controls,16,26,30,31,35,36,38 4 using no control treatment,19,33,35,38 and 2 using routine health education.17,18 One study used progressive relaxation programs 32 and one used gabapentin 41 as a comparison treatment.
Participants were treated with hormone therapy, postoperative radiation, and chemotherapy during the acupuncture intervention.16,17,28,29,34-36 Participants in 6 RCTs28,38,40,41 underwent postoperative radiation and chemotherapy with acupuncture. Participants in 3 RCTs19,26,39 were administered tamoxifen concurrent with acupuncture. Program intensities varied, ranging from twice weekly for 20 to 50 minutes each, with follow-up durations ranging from 6 weeks to 6 months. Acupuncture needling protocols, points, and meridian systems varied, with outcomes including pain-related functional interference, fatigue, gastrointestinal symptoms, postoperative upper limb stiffness, hot flashes, and sleep and mood disorder symptoms (Table 1).
Characteristics of the Included Studies.
Abbreviations: HAQ–DI, Health Assessment Questionnaire Disability Index; VAS, Visual Analogue Scale; IL 17, interleukin 17; HADS–A, Hospital Anxiety and Depression Scale–Anxiety; HADS–D, Hospital Anxiety and Depression Scale–Depression; PSS, Perceived Stress Scale; WOMAC, Western Ontario and McMaster Universities Osteoarthritis Index; BPI, Brief Pain Inventory; FACT–B, Functional Assessment of Cancer Therapy–breast Cancer; KI, Kupperman Index; FACT–ES, Functional Assessment of Cancer Therapy–endocrine Symptoms; PSQI, Pittsburgh Sleep Quality Index; GCS, Greene Climacteric Scale; PPT, Physical Performance Test; BFI, Brief Fatigue Inventory; HFCS, high fructose corn syrup; MFI, Multidimensional Fatigue Inventory; SCL, Symptom Checklist; MS, Mood Scale; BPI–SF, Brief Pain Inventory–Short Form; MYCaW, Measure Yourself Concerns and Wellbeing questionnaire.
Acupuncture Treatment Characteristics
One RCT 28 used the National Acupuncture Detoxification Association protocol, 3 RCTs17,18,27 adopted the Revised Standards for Reporting Interventions in Clinical Trials of Acupuncture, 1 RCT used 28 traditional Chinese medicine textbooks, 2 RCTs19,30 manualized traditional Chinese medicine theory protocols, and the others utilized published literature. All RCTs used full-body or auricular needles, varying in size from 0.18 mm × 13 mm to 0.20 mm × 40 mm, and fixed-point selection.
In 7 RCTs,16,26,30,31,35,36,38 participants in the control group were administered sham acupuncture. Control group participants underwent progressive relaxation programs,32,39 no treatment, observation at baselinem27,28,34,37 normal practice including pharmacologic and nonpharmacologic treatments,32,40 health education, 17 and waitlist controls. 19 With the exception of 2 RCTs, which used electroacupuncture 32 and thermoacupuncture, 40 all patients in the treatment groups were treated with manual acupuncture.
Study Methodological Quality
Of the 20 RCTs examined, 15 utilized randomization.16,18,19,26-29,31,32,34,37-40 The most common randomization method used was computer-generated random numbers. The other 5 did not clearly report a randomization process. In 8 RCTs, blocks were concealed and sequences were stored (in sealed, opaque, numbered envelopes) or otherwise concealed.17-19,28,30,33,35,38 Blinding protocols were described in 17 studies. Blinding was most often imposed by a statistician on instructors and evaluators (Tables 2 and 3).
Methodological Quality of Included Studies a .
Each item can be categorized based on the answer “yes,” “unclear,” or “no” depending on the appropriateness of the reported information of included randomized controlled trials.
Effect Sizes of Acupuncture Versus Control Interventions.
Abbreviations: TNF, tumor necrosis factor; IL, interleukin,
The remaining RCTs did not mention whether other sources of bias were present. Overall, the Cochrane risk of bias generally revealed a high methodological quality among the RCTs included in this analysis (Figure 2A). The RCTs had an overall low risk of bias (Figure 2B).

Risk of bias summary A. Risk of bias summary B.
Outcome Analysis
The pooled results suggested that acupuncture led to moderate improvements in hot flashes (SMD = −0.28; 95% CI = −0.45 to −0.11; P = .00), fatigue (SMD = −1.19; 95% CI = −2.25 to 0.12; P = .02), pain (SMD = −1.05; 95% CI = −1.89 to −0.21; P = .01), and stiffness (SMD = −0.06; 95% CI = −1.15 to −0.05; P = .03). No significant differences were observed in gastrointestinal symptoms, Kupperman index scores, physical well-being, social well-being, emotional well-being, tumor necrosis factor levels, or interleukin levels (Table 3; Figure 3A-K).

(A) Hot flashes. (B) Fatigue. (C) Pain. (D) Stiffness. (E) Gastrointestinal symptoms. (F) Kupperman index. (G) Physical well-being. (H) Social well-being. (I) Emotional well-being. (J) TNF. (K) Interleukin-1.
Meta-Regression and Subgroup Analyses
Heterogeneity was present in the comparison of fatigue (I2 = 86.7%), pain (I2 = 82.7%), stiffness (I2 = 62.8%), physical well-being (I2 = 86.5%), emotional well-being (I2 = 53.8%), tumor necrosis factor (TNF) levels (I2 = 77.1%), and interleukin (IL) levels (I2 = 85%). A meta-regression revealed that the effect of the age, clinical stage, intervention, hormone therapy, acupuncture protocol, acupuncture points, control group, indications, and duration of acupuncture administration on physical well-being and gastrointestinal symptoms explained heterogeneity (Supplementary file table, available online).
Further subgroup analyses indicated that acupuncture >6 weeks had potential advantages for improvement in physical well-being (SMD = 0.66; 95% CI = 0.44 to 0.88; P = .00) when compared with <6 weeks of treatment (Figure 4).

Subgroup forest plots.
GRADE Assessment
Table 4 shows a summary of the overall quality of evidence assessment for the effect of acupuncture on the relevant outcome measures. Certainty in the evidence was variable for hot flashes (low), fatigue (moderate), pain (low), stiffness (low), Kupperman index scores (low), physical well-being (low), TNF levels (low), and IL levels (low). Evidence for all outcomes was downgraded due to inconsistency and imprecision.
GRADE Quality of Evidence Assessment for Acupuncture on Symptom Management of Postoperative Side Effects of Breast Cancer.
Abbreviations: GRADE, grading of recommendations assessment, development, and evaluation; CI, confidence interval; MD, mean differences; TNF, tumor necrosis factor; IL-1, interleukin-1; RCT, randomized controlled trial..
RCTs did not mention or not use the blinding method and randomized grouping.
Evidence of significant interstudy heterogeneity.
Confidence in estimates of effect is poor; RCTs do not calculate the number for optimal information size, and small sample size.
Similarity of point estimates, extent of overlap of CIs is poor.
Discussion
Previous studies have suggested that a substantial proportion of patients with breast cancer use acupuncture and that acupuncture may relieve cancer treatment-related side effects.42-44 The present meta-analysis and systematic review provides preliminary support for the feasibility and safety of acupuncture for breast cancer patients.
The pooled results in the present meta-analysis of 7 relevant RCTs suggest that acupuncture had a small effect on symptom (hot flashes, fatigue, and stiffness) frequency and severity in breast cancer survivors after 6 to 8 weeks of treatment. Subgroup effects of acupuncture on physical well-being over 6 weeks revealed a significant effect of acupuncture compared with a sham treatment. However, it did not find statistically significant differences in treatment-related physical functioning damage, pain, and inflammatory markers (TNF and IL) between the control and real acupuncture groups.
Pathology Parameters
The existing literature often lacks specifics concerning the precise acupuncture methods used. The specific effects of acupuncture are not well understood, and there is clearly a strong placebo component, especially in the management of hot flashes and upper limb stiffness among patients with cancer. Despite the consensus recommendations of the National Institutes of Health, implementation of acupuncture protocols has not been ideal and is still not accepted as a standard treatment. This is in part because acupuncture’s putative mechanisms (including the placebo response) are not well understood. Regardless of the specific molecular basis of these effects, acupuncture for hot flashes and upper limb stiffness is safe and inexpensive, relieves considerable suffering, and may be especially valuable for patients lacking pharmacological symptom control. Although further research is needed, the present review supports the use of acupuncture as an adjunctive treatment for psychosomatic symptoms in breast cancer.32,39
Hormone therapy (eg, letrozole, anastrozole, and exemestane) was particularly prominent across the RCTs included here and has become one of the most common methods for preoperative and postoperative breast cancer treatment. As estrogen deprivation affects tissues beyond the breast, including bone, uterine, and cardiovascular tissues, tamoxifen’s estrogen agonist activity may lead to harmful effects. 43 Shah et al 17 evaluated the estrogen level decline caused by decreased cerebral cortex endorphin levels, which causes secondary vasomotor and psychological symptoms, including increased endometrial carcinoma, irritability, hot flashes, vaginal dryness, loss of libido, menstrual disorders, fatigue, and musculoskeletal side effects. 44
The present meta-analysis included 4 studies on the treatment of stiffness by acupuncture. To address this, 1 RCT used a percutaneous electroacupuncture stimulation treatment mode, 28 whereas 3 studies utilized body acupuncture,33,35,36 including 24 points. Pseudo-acupuncture sites deviated from true points by 0.5 inches.
Due to some variability in application, the results of these studies are unclear, regarding the efficacy of acupuncture in the treatment of hot flashes in breast cancer patients taking hormone therapy. Whether the average treatment effect across these studies was clinically significant is complicated by the risk of syndrome differentiation and complex intervention bias, which require careful consideration. The forest plot depicts a wide 95% CI, indicating that the samples included in the present study were small and the follow-up times insufficient, yielding poor accuracy and test efficiency. These results should thus be interpreted with caution.
Physical Parameters
Emotional stress and declines in QOL measures are highly prevalent among postoperative breast cancer patients. The present meta-analysis does not allow for conclusions about how to improve the overall multidimensional physiological and the emotional and social functioning of these patients, however. For example, in 1 RCT, 34 patients were administered antidepressants (serotonin reuptake inhibitors such as venlafaxine, paroxetine, sertraline, and fluoxetine) for their vasoconstrictive symptoms (eg, hot flashes). In another, 35 gabapentin was used with acupuncture to treat anxiety attacks and sleep disturbances. While antidepressants reduced the frequency and severity of hot flashes, antidepressants and gabapentin relieved some symptoms of anxiety, depression, and pain. Given this, the present meta-analysis could not accurately determine the efficacy of consolidated test validity on the overall QOL measures in the patients assessed.
The variability of physical well-being was assessed based only on the postoperative treatment cycle. The difference in sensitivity between the primary outcome (eg, hot flashes, stiffness) and secondary outcome (general QOL) reports may contribute to the inconsistency between the body function and the overall QOL assessment.
The present meta-analysis included 5 studies14,17,27,29,34 in which all patients underwent different postoperative chemotherapy regimens (CMF regimens, anthracyclines + paclitaxel or CMF + anthracyclines + paclitaxel) within 1 to 6 months of their recruitment. Critically, cytotoxic reactions to chemotherapeutic agents and somatic immune damage may affect appetite and intestinal motility to varying degrees. These agents also cause nausea, bone marrow depression, and ovarian dysfunction. Within 2 to 4 weeks of each adjuvant chemotherapy course, there is also a mild to moderate decrease in the number of white blood cells per serology, which leads to changed levels of ILs and TNF, physical fatigue, and mental exhaustion, in addition to digestive tract changes. High levels of cytokines can increase cell migration, which is dependent on both signal transducers and activators of transcription and nuclear factor κ-light-chain-enhancer of activated B cells. Local in vivo inflammation caused by tumor growth results in elevated inflammatory cytokines such as IL-6 and TNF-α in the tumor microenvironment, which may lead to tumor cell migration and metastasis.45,46 The results of the present study revealed no significant changes in the levels of ILs, as shown previously.40,47
This systematic review has presented an updated view on the clinical applicability of acupuncture, and related therapies for symptom management, the small sample size effect of partial outcome (gastrointestinal symptoms, Kupperman index, physical well-being, social well-being, emotional well-being, TNF, and IL) exists due to the influence of the small sample size. Regardless, the pooled results and meta-analysis still needs to be objectively evaluated.
External and Internal Validity
The present study included a comprehensive and reproducible search of the literature examining the effect of acupuncture on the management of the postoperative side effects of breast cancer, as well as a transparent study selection process. Collation and synthesis of all the available evidence from a large body (20 RCTs, n = 2124) of controlled intervention RCTs was performed, providing for the maximum safeguards against bias. We also included an assessment of the overall quality of evidence using the GRADE assessment approach.
Despite our inclusion of many RCTs, a limited number of studies reported particular indications of acupuncture, and many analyses also had only 2 outcomes available for inclusion: social well-being, emotional well-being, TNF, and IL (2 RCTs). In spite of this, we elected to utilize the GRADE assessment for all outcomes.
Substantial unexplained heterogeneity was present in all substitution study analyses. Furthermore, we saw substantial heterogeneity among subtraction studies for fatigue, pain, gastrointestinal symptoms, Kupperman index scores, physical well-being, emotional well-being, TNF levels, and IL levels. Subgroup analyses did not explain this heterogeneity, so we downgraded these studies due to inconsistency. Inconsistency was not excluded entirely, however, as we were unable to test for heterogeneity with this small number of RCTs. Furthermore, bias was not excluded as we were unable to test for funnel plot asymmetry due to a lack of sufficient power (<10 studies included in the analysis).
Furthermore, no indirectness was present in the RCTs assessed here, as common postoperative treatment symptoms and adverse reactions and side effects were available in all analyses. However, small sample sizes (median = 21 participants) were another potential source of indirectness among the studies assessed here. Ultimately, we did not downgrade the evidence due to indirectness because of the large number of included studies, which represented a diverse range of study conditions and symptoms/phenotypes across participants. We also did not downgrade for indirectness because of the relatively short duration of follow-up (median = 4-12 weeks). We suggest that this follow-up was sufficient to assess the question of applicability and generalizability.
The effects of the duration of acupuncture practice were observed to be heterogeneous. Subgroup analysis showed that physical well-being improved significantly over the 10-week period of acupuncture practice and revealed a linear relationship between positive effects and duration of practice, suggesting that intervention over a relatively long time period (over 2 months) had a potential impact on psychosomatic function.
The major problems in the clinical application of this technique include factors such as the inconsistency of evidence of its effect, the lack of clinical recommendations because of physician attitudes, internal inconsistency of each acupuncture style, diversity of the population of breast cancer patients, and practical concerns from senior instructors. Diversity and biological characteristics of breast cancer with different acupuncture prescription phenomena have widely existed in published RCTs evaluating acupuncture for improving the overall well-being in postoperative breast cancer patients. This causes poor consistency between the systematic reviews of acupuncture interventions in the original studies; the measures of comparison were not uniform. To reduce potential clinical heterogeneity in acupuncture-treatment-related RCTs, the selected setting in acupuncture therapy should be specific, that is, it must identify the population intervention comparison outcome (PICO). In addition, based on GRADE, included RCTs did not calculate the number for optimal information size and the sample size of RCTs was insufficient. This inconsistency and imprecision are major reasons for the downgrade of the level of evidence and strength of recommendation for using acupuncture in breast cancer research and underlies insignificant clinical efficacy. Future RCTs should focus on an adequately large sample size to explore the standardized protocols and detect the interaction between the different biological and sociological characteristics of acupuncture intervention and breast cancer patients.
Finally, we revealed evidence for serious imprecision in all of the analyses included here. The 95% CIs for fatigue, pain, stiffness, gastrointestinal symptoms, Kupperman index scores, physical well-being, TNF levels, and IL levels crossed minimally important differences. Given this, these analyses were downgraded due to serious imprecision. Weighing the strengths and limitations of the RCTs included in the present study, we assessed the quality of the evidence using the GRADE guidelines as low for fatigue and stiffness, low for pain, gastrointestinal symptoms, Kupperman index scores, TNF, IL levels, and general psychosomatic well-being.
Two studies were excluded because of the use of anticonvulsants and opioids as treatment strategies.48,49 There were some concerns around serious methodological defects found in the retrieved original RCTs of acupuncture for therapy-related side effects management with breast cancer patients in the regional language database. Randomization was merely mentioned without any specific methodologies provided. These studies were therefore excluded because they did not meet our research inclusion criteria.
In summary, we systematically assessed current evidence regarding the use of acupuncture in patients suffering from hormone therapy–related side effects. The overall body of evidence was found to be of low-moderate quality. Our critical appraisal of the evidence using the GRADE approach resulted in the formulation of a weak recommendation regarding the use of acupuncture in the hormone therapy–related side effects in breast cancer patients. Nonetheless, the results of this meta-analysis revealed that acupuncture is a moderately appropriate complementary and alternative therapy for hormone therapy–related side effects in breast cancer patients. However, it still lacks large-sample, multicenter, prospective RCTs. Future research should focus on standardizing comparison groups and treatment methods, be at least single-blinded, assess biologic mechanisms, have adequate statistical power, and involve multiple acupuncturists.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: We are indebted to the following education and research institutions for financial support. (1) Undergraduate teaching reform project of Guangxi higher education in 2020: exploration on the cultivation of undergraduates’ preclinical research reserve ability based on evidence-based medicine. (2) Guangxi science and technology plan project (Guangxi science and technology base and special talent program): an evidence-based evaluation study of the GRADE system in the evidence system of non-drug complementary alternative medicine.
