Abstract
Background:
Previous meta-analyses have compared bone–patellar tendon–bone (BPTB) with hamstring tendon (HT) autografts for primary anterior cruciate ligament reconstruction (ACLR).
Purpose:
To conduct a systematic review of overlapping meta-analyses comparing BPTB with HT autografts for ACLR to determine which meta-analyses provide the best available evidence.
Study Design:
Systematic review; Level of evidence, 4.
Methods:
A systematic review was performed by searching the PubMed and Cochrane Library databases. Search words included “anterior cruciate ligament” AND “patellar tendon” AND “hamstring tendon” AND “meta-analysis.” Results were reviewed to determine study eligibility. Patient outcomes and postoperative complications were extracted from the included meta-analyses. Meta-analysis quality was assessed using the Oxman-Guyatt and Quality of Reporting of Meta-analyses (QUOROM) scores. The Jadad decision algorithm was then utilized to determine which meta-analyses provided the best level of evidence.
Results:
Sixteen meta-analyses containing an average of 1396 patients met the eligibility criteria. Most studies found BPTB autografts to provide superior stability but more postoperative complications, such as anterior knee pain and kneeling pain. Studies by Gabler et al (2016), Mohtadi et al (2011), and Xie et al (2015) received the highest Oxman-Guyatt and QUOROM scores, and therefore, these meta-analyses proved to provide the highest level of evidence. Additionally, Xie et al was selected as the highest-quality study in this systematic review based on the Jadad decision algorithm.
Conclusion:
The current best evidence suggests that ACLR with BPTB autografts provides superior static knee stability and that there are fewer postoperative complications in ACLR with HT autografts.
Keywords
There are several options when considering anterior cruciate ligament reconstruction (ACLR), including graft choice. A recent review of meta-analyses concluded that the current best evidence suggests no difference in rerupture rates or clinical outcomes between autografts or allografts. 20 However, this review did not specify patient demographics. 20 This same study found that lower evidence level suggest lower rerupture rates and better clinical outcomes with autografts. 20 Regarding autografts, the decision between using a bone–patellar tendon–bone (BPTB) or hamstring tendon (HT) autograft remains controversial. Potential drawbacks of a BPTB autograft include the risk of patellar fractures, patellar tendon ruptures, quadriceps weakness, and donor site morbidity, 12,13,21 while disadvantages of an HT autograft include decreased hamstring strength, increased joint laxity, and delayed graft-tunnel healing. 4,21 In addition to graft choice, the surgeon must also decide which surgical technique to use. Anteromedial and transtibial techniques are the most commonly used, with most orthopaedic surgeons using the anteromedial technique, as it allows for unconstrained anatomic placement of the femoral tunnel. 14 Regardless of the technique, surgeons must be careful to avoid a vertical or low femoral tunnel because of increased anterior translation and less rotational resistance compared with more anatomically oriented grafts. 14
There are currently multiple meta-analyses evaluating BPTB versus HT autografts. A recent review of these meta-analyses 15 evaluated their methodological rigor and credibility. However, no conclusion was made as to which type of autograft was superior according to the best available evidence. In addition, a systematic review of overlapping meta-analyses from 2007 compared BPTB versus HT autografts for primary ACLR and concluded that HT autografts are superior for preventing anterior knee pain and that there is limited evidence supporting the claim that BPTB autografts provide better stability. 26 However, this study is now 10 years old, and several new meta-analyses have been published since.
The purpose of this study was to perform an updated systematic review of overlapping meta-analyses comparing primary ACLR with BPTB versus HT autografts to determine which meta-analyses provide the best available evidence. We hypothesized that ACLR with a BPTB autograft would demonstrate superior results when accounting for knee stability but that ACLR with an HT autograft would lead to fewer postoperative complications.
Methods
The methods of this study were similar to those of previous systematic reviews of overlapping meta-analyses. 9,20 Two independent reviewers searched the PubMed and Cochrane Library databases up to December 19, 2016. The following search words were used: “anterior cruciate ligament” AND “patellar tendon” AND “hamstring tendon” AND “meta-analysis.” Inclusion criteria consisted of meta-analyses that were written in English and that compared BPTB versus HT autografts for primary ACLR. Exclusion criteria included (1) meta-analyses not including both autografts, (2) systematic reviews that did not perform a meta-analysis, and (3) cadaveric, animal, or other laboratory studies. The full articles of all studies that satisfied the inclusion and exclusion criteria were then collected. A thorough review of the articles was performed to ensure that all relevant studies were included in this systematic review.
After selecting studies to be included in this review, the following data were collected from each study: primary author, year of publication, levels of evidence included, number and publication dates of primary studies included, inclusion and exclusion criteria, performance of heterogeneity analytics, patient sample size, patient-reported outcomes, objective outcomes, surgical technique, and postoperative complications. The following outcome scores were identified as being reported or not reported by each meta-analysis: Lysholm score, 18 Tegner score, 31 Cincinnati score, 24 subjective International Knee Documentation Committee (IKDC) score, 10 objective IKDC score, 8 Knee injury and Osteoarthritis Outcome Score (KOOS), 29 range of motion, strength testing, radiographic evaluation, patient satisfaction, instrumental laxity, Lachman test, pivot-shift test, and single-legged hop test.
The number of “possible” previous meta-analyses cited relative to the number “actually” cited was recorded for each meta-analysis as well as the databases used in each literature search. The primary studies included in each meta-analysis were recorded in addition to study type (randomized controlled trials, prospective comparative studies, retrospective comparative studies, noncomparative prospective and retrospective studies). We then recorded which studies included the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). The quality of each meta-analysis was scored using the Quality of Reporting of Meta-analyses (QUOROM) system 22 and the Oxman-Guyatt quality-appraisal tool. 25 The QUOROM system evaluates meta-analyses based on the quality of their methodology and reporting in 18 different categories. A perfect score of 18 is obtained if each category is met. The Oxman-Guyatt quality-appraisal tool scores meta-analyses on a scale of 1 to 7 based on 9 different questions.
Because of the discordance among meta-analyses, the Jadad decision algorithm was used to guide appropriate interpretation. According to Jadad et al, 11 discordance among meta-analyses is caused by the following 6 factors: clinical question, study selection and inclusion, data extraction, assessment of study quality, assessment of the ability to combine studies, and statistical methods for data synthesis. Two authors (H.B.S., D.A.H.) independently applied the Jadad decision algorithm to determine which meta-analyses provided the current best evidence. When discrepancies were present, the 2 reviewers discussed the results and came to an agreement.
Results
The initial search strategy resulted in a total of 37 results. After a review, 16 meta-analyses § were found to meet inclusion and exclusion criteria. These studies were published between 2001 34 and 2016. 6 The number of primary studies included in these meta-analyses ranged from 4 25 to 64. 28 The number of patients analyzed ranged from 361 30 to 3402, 28 with an average of 1396 patients per study. Twelve of the studies || reported the sample size of patients undergoing ACLR with a BPTB autograft, with an average of 677 patients, as well as the sample size of patients with an HT autograft, with an average of 738 patients.
Assessment of Previous Meta-analysis Literature
Fourteen of the meta-analyses cited some of the previously published meta-analyses, ¶ while at the time of their publication, 2 meta-analyses 5,34 had no other published meta-analyses to cite (Table 1). Only 2 studies 7,23 cited all meta-analyses possible at the time of their last literature search. Three studies 1,27,28 did not report the date of their last literature search; therefore, no conclusions could be made regarding the number of possible meta-analyses available for citation.
Number of Systematic Reviews or Meta-analyses Actually Cited Compared With Maximum Number That Could Possibly Have Been Cited a
a NR, not reported.
Outcome Measures
Table 2 shows the wide variety of clinical outcomes assessed by each of the meta-analyses. The Lachman test was the most commonly analyzed outcome and was reported by 12 of the 16 studies. Other commonly analyzed outcomes included instrumental laxity, graft failure, and the pivot-shift test.
Outcomes Reported by Each of the Included Studies a
a “+” or “–” indicates that an outcome measure was/was not reported, respectively. IKDC, International Knee Documentation Committee; KOOS, Knee Injury and Osteoarthritis Outcome Score.
Search Methodology
Thirteen of the 16 meta-analyses used PubMed/MEDLINE as part of the literature search (Table 3). There was significant variability in the use of other databases, including the Cochrane Library, EMBASE, and other sources.
Search Methodology Used by Each of the Included Studies a
a “+” or “–” indicates that a search method was/was not used in the designated meta-analysis, respectively. PRISMA, Preferred Reporting Items for Systematic Reviews and Meta-Analyses; QUOROM, Quality of Reporting of Meta-analyses; RCT, randomized controlled trial.
b Study included both RCTs and pseudo-RCTs.
Study Quality and Validity
The QUOROM and Oxman-Guyatt scores for each study are depicted in Table 3. QUOROM scores ranged from 12 27 to 17, 3,6,16,32,33 with 18 being the maximum possible score. 22 The average score was 15.6. Oxman-Guyatt scores ranged from 1 27 to 7, 23 with 7 being the maximum possible score and representing “minimal flaws” in the study methodology. 25 The average score was 4.25. Five studies 1,27,28,30,34 had Oxman-Guyatt scores of ≤3, which is generally reflective of “major flaws” in the study methodology. 25
Among the 16 meta-analyses, a total of 69 prospective comparative studies and 2 retrospective comparative studies were included. Table 4 shows the primary studies used in each meta-analysis.
Primary Studies Included in Meta-analyses a
a “+” or “–” indicates that a primary study was/was not used in the designated meta-analysis, respectively.
Findings
Eleven studies 3,5 –7,16,17,19,23,32 –34 reported graft failure outcomes. Only 1 study 5 found a statistically significant increase in graft failure for patients with an HT autograft. Eight of the studies 3,7,16,17,19,23,32,34 reported higher rates of failure for patients undergoing ACLR with an HT autograft; however, these findings were not significant. Eleven studies # analyzed knee stability via instrumental testing. Five studies 3,5,17,23,34 found that those undergoing ACLR with a BPTB autograft had a significantly increased chance of attaining a statically stable knee, while 1 study 28 found increased stability with an HT autograft. Five studies 7,19,30,32,33 found no significant difference in instrumental stability between BPTB and HT autografts. Eleven studies** evaluated knee stability with the pivot-shift test. Six of these studies 1,16,17,23,32,34 found that patients with a BPTB autograft had a significantly lower rate of positive pivot-shift test findings. While 5 studies 3,5,7,19,33 found no significant difference between BPTB and HT autografts, all results still favored lower rates of positive pivot-shift test findings with a BPTB autograft.
Anterior knee pain and kneeling pain were the most frequently analyzed patient-reported outcomes. Ten studies †† analyzed anterior knee pain. Nine of these studies ‡‡ found a significantly increased rate of anterior knee pain when undergoing ACLR with a BPTB autograft. One study 8 found a nonsignificantly higher rate of anterior knee pain with a BPTB autograft. Nine studies §§ analyzed kneeling pain. Eight studies 3,7,16,17,19,23,32,33 found a significantly increased rate of kneeling pain with a BPTB autograft, while only 1 study 30 found a significantly increased rate of kneeling pain with an HT autograft.
Heterogeneity Assessment
Of the 16 meta-analyses included in this study, 14 |||| tested for heterogeneity. All 16 meta-analyses ¶¶ performed a subgroup or sensitivity analysis to compare study designs, interventions, and outcomes (Table 5). Other parameters, such as sex, age, surgical procedure, and postoperative protocols, were reviewed without performing a subgroup or sensitivity analysis.
Heterogeneity or Subgroup Analyses of Primary Studies a
a “+” or “–” indicates that formal sensitivity or subgroup analysis was/was not performed, respectively; “0” indicates that descriptive data were performed or discussed but that no analysis was performed. IKDC, International Knee Documentation Committee; ROM, range of motion.
Results of Jadad Decision Algorithm
The Jadad decision algorithm 11 was used to determine which of the 16 included meta-analyses provided the best available evidence. Figure 1 depicts all outcomes of the included meta-analyses. Because of the variety of selection criteria among included meta-analyses, the Jadad decision algorithm was used to select the highest-quality review based on the publication characteristics of the primary trials, the methodology of the primary trials, language restrictions, and whether an analysis of data on individual patients was included in the study. Xie et al 32 provided the best available evidence in accordance with the Jadad decision algorithm for having the largest number of randomized controlled trials included as well as its more thorough methodology assessment of included randomized controlled trials.

Flow diagram of Jadad decision algorithm. 11
Discussion
The purpose of this study was to conduct a systematic review of overlapping meta-analyses comparing the outcomes of BPTB versus HT autografts for primary ACLR and to determine which meta-analyses provide the best available evidence. We hypothesized that ACLR with a BPTB autograft would produce superior results when accounting for knee stability but that ACLR with an HT autograft would lead to fewer postoperative complications. Our hypothesis that ACLR with a BPTB autograft would lead to superior knee stability results was supported. 1,3,5,16,17,23,33,34 Also, our hypothesis that ACLR with an HT autograft would result in fewer complications was supported. ## While 9 studies 3,5,7,16,17,19,23,32,34 found an increase in graft failure after ACLR with an HT autograft, only 1 of these studies 6 found a significant difference. Therefore, current evidence is not strong enough to support a significant difference of graft failure between BPTB and HT autografts.
In evaluating the 16 meta-analyses included in this review with the Oxman-Guyatt and QUOROM scores, 3 studies 6,23,32 were found to have the highest combination of scores. Two studies 6,32 had a QUOROM score of 17 and an Oxman-Guyatt score of 6, while 1 study 23 had a QUOROM score of 16 and an Oxman-Guyatt score of 7. According to these 2 evaluation scores, these 3 meta-analyses 6,23,32 appear to provide the highest level of evidence. According to the Jadad decision algorithm, Xie et al 32 was selected as the highest-quality study in this systematic review. Mohtadi et al 23 found significant evidence that ACLR with a BPTB autograft results in a more statically stable knee compared with an HT autograft. They also found a significant increase in postoperative complications after ACLR with a BPTB autograft. These authors concluded that there was insufficient evidence to make a conclusion regarding the long-term functional outcome differences between the 2 graft types. Xie et al 32 found no difference between BPTB and HT autografts in terms of instrumental laxity and the Lachman test. However, they did find significant differences in the pivot-shift test in favor of BPTB autografts. They found that the risk ratio for a positive pivot-shift test finding was 0.7 (95% CI, 0.53-0.93; P = .01) in favor of BPTB autografts. 32 There was a significant increase in postoperative complications after ACLR with a BPTB autograft. They found that the risk ratio for anterior knee pain was 1.71 (95% CI, 1.35-2.16; P = .01) in favor of HT autografts and that the risk ratio for kneeling pain was 2.05 (95% CI, 1.51-2.77; P < .01) in favor of HT autografts. 32 While Xie et al acknowledged the possible benefits of each graft, they were unable to conclude which of the 2 grafts provided a significantly better overall option when undergoing ACLR. Last, Gabler et al 6 found no significant difference in graft failure rates or the odds of graft failure between BPTB and HT autografts. Additionally, no significant difference in returning to preinjury activity levels was found. While Gabler et al concluded that both BPTB and HT autografts demonstrated a low risk of graft failure and a moderately high rate of return to preinjury activity levels, no conclusions were made with regard to which graft provided superior results.
In addition to the issues discussed in this study, other factors must be considered when deciding between BPTB and HT autografts for primary ACLR. These include the risk of patellar fractures during harvesting as well as a fixed graft length with a BPTB autograft and graft slippage with an HT autograft. 14
One of the strengths of this systematic review included the use of multiple quality-assessment tools 11,22,25 to evaluate which meta-analyses provided the best available evidence. The limitations of this systematic review should also be noted. These included variations in the surgical procedure used, or lack of reporting the surgical procedure, and patients lost to follow-up in each of the meta-analyses included. We also believe that the minimum follow-up time of 24 months is a limitation of this study. In addition, variations in subjective outcomes such as anterior knee pain and kneeling pain must be considered. It is also possible that variations in surgical techniques and rehabilitation protocols between studies played a role in the different clinical outcomes observed between these studies. Finally, there exist limitations inherent to a systematic review of overlapping meta-analyses, which include the lack of pooling of data as well as the potential heterogeneity among the 16 included meta-analyses.
While there are multiple meta-analyses evaluating ACLR with BPTB versus HT autografts, further research is necessary to investigate which autograft choice provides superior overall results, specifically within different demographics such as athletes, adults, and adolescents.
Conclusion
This systematic review determined which meta-analyses provide the best available evidence when comparing ACLR with BPTB versus HT autografts. The results of this review suggest that ACLR with a BPTB autograft provides superior static knee stability but an increased postoperative complication rate when compared with an HT autograft. When considering ACLR autograft options, Xie et al, 32 Mohtadi et al, 23 and Gabler et al 6 have provided the highest-quality meta-analyses.
Footnotes
Notes
The authors declared that they have no conflicts of interest in the authorship and publication of this contribution.
