Abstract
Background:
Molecular tests have contributed to reducing the mortality rate through early and accurate diagnosis of tuberculosis (TB). This is due to their low processing complexity and diagnostic accuracy superior to conventional methods.
Objective:
To evaluate the diagnostic performance of Cobas MTB and Logix Smart MTB compared to Xpert MTB/RIF Ultra for pulmonary tuberculosis (PTB) and extrapulmonary tuberculosis (EPTB).
Design:
A cross-sectional study of diagnostic tests was carried out in a clinical laboratory in Lima, Peru.
Methods:
All pulmonary and extrapulmonary samples from patients with presumptive TB who had been subjected to smear microscopy, Xpert MTB/RIF Ultra, Cobas MTB, Logix Smart MTB, and mycobacteria culture were included to determine their diagnostic performance.
Results:
A total of 175 samples were included, 102 (58.3%) of pulmonary origin and 73 (41.7%) of extrapulmonary origin. Among the total samples, 19 (10.9%) had positive cultures (all were pulmonary samples), 48 (27.4%) had positive Xpert MTB/RIF Ultra results, 45 (25.7%) had positive Cobas MTB results, and 36 (20.6%) had positive Logix Smart MTB results. The agreement between Cobas MTB and Logix Smart with the Xpert MTB/RIF Ultra was 97.1% and 93.8%, respectively. Compared to Xpert MTB/RIF Ultra, the area under the curve/receiver operating characteristic and sensitivity of the Cobas MTB and Logix Smart methods were 0.95 and 91.7%, and 0.90 and 81.0%, respectively.
Conclusion:
Cobas MTB and Logix Smart presented adequate performance for diagnosing pulmonary and extrapulmonary tuberculosis comparable to the Xpert MTB/RIF Ultra.
Introduction
At the level of the Americas, Peru is the second country with the highest number of estimated tuberculosis (TB) cases. 1 The use of molecular tests to diagnose TB has contributed to a 3.4% reduction in the global mortality rate per year and a 1.9% reduction in the incidence of new cases per year. 2 TB control requires early and timely diagnosis. Currently, the World Health Organization (WHO) recommends molecular tests such as Xpert MTB/RIF Ultra and Truenat MTB. 3 This is due to its low processing complexity and sensitivity and specificity superior to smear microscopy and culture for the rapid diagnosis of TB. 4
Molecular tests have good diagnostic performance for the detection of TB. Xpert MTB/RIF Ultra has the highest sensitivity (91%) for pulmonary tuberculosis (PTB). 5 However, its diagnostic performance is variable in extrapulmonary tuberculosis (EPTB), with a sensitivity of 50%–95.8% for lymph node samples,6,7 71.4%–90.9% for cerebrospinal fluid,8,9 and 47.6%–84.2% for pleural fluid.10–12
It is necessary to identify new diagnostic methods that allow infections to be identified earlier than conventional methods, mainly in groups that are difficult to diagnose (such as patients with EPTB and HIV coinfections), enabling early diagnosis of resistance to anti-TB drugs and with lower costs, for universal implementation.
It is unknown whether there are differences in the molecular diagnosis platforms for TB, specifically the three molecular methods marketed in our country: Xpert MTB/Rif Ultra, Cobas MTB, and Logix Smart MTB. Therefore, the objective of the present study was to determine the diagnostic performance of Cobas MTB and Logix Smart MTB compared to Xpert MTB/RIF Ultra for the rapid diagnosis of PTB and EPTB.
Materials and methods
Research setting and design
A cross-sectional study of diagnostic tests was carried out. To write the manuscript, we followed the guidelines of the Standards for Reporting of Diagnostic Accuracy Studies (STARD) for diagnostic tests (Supplemental File). 13 The study was carried out in the private clinical laboratory ROE, at its locations in the metropolitan city of Lima, Peru.
Population and eligibility criteria
All pulmonary samples (sputum, bronchial aspirate, and bronchoalveolar lavage) and extrapulmonary samples (pleural fluid, urine, cerebrospinal fluid, breast biopsy, soft tissue abscess, ascitic fluid, pericardial fluid, serum, bone biopsy, and bone marrow) were collected from patients with presumptive TB who underwent smear microscopy, Xpert MTB/RIF Ultra and mycobacterial culture in Löwenstein–Jensen media, which were stored in a biobank at −70°C and subsequently and simultaneously subjected to Cobas MTB and Logix Smart MTB to determine their diagnostic performance.
Reference standard
For this study, we used the Xpert MTB/RIF Ultra (Cepheid, Sunnyvale, CA, USA) as the reference standard. This automated, nested polymerase chain reaction (PCR) test runs on the GeneXpert platform, detecting
Index test
The first index test was the Cobas MTB test (Roche Diagnostics, Mannheim, Germany) is performed on the Cobas 5800/6800/8800 systems and is designed to detect
The second index test, Logix Smart MTB (Co-Diagnostics, Inc., South Salt Lake, UT, USA), is a qualitative real-time PCR test that detects
The details of the analytical process used for the detection of Logix Smart MTB, Cobas MTB, and Xpert MTB/RIF Ultra are described in Table 1.
Characteristics of three molecular methods (Logix Smart MTB, Cobas MTB, and Xpert MTB/RIF Ultra) and their processing for the diagnosis of tuberculosis.
If positive samples exist another detection kit for rifampicin and isoniazid that meets the same parameters would be run.
Components on the HollySys plate are Guanidine Hydrochloride, Sodium Chloride, SDS, Tris-HCl, Isopropanolol, and absolute ethanol.
BAL, bronchoalveolar lavage; H, isoniazid; MIS, Cobas® Microbial Inactivating Solution; MTB,
Statistical analysis
The data were entered into a Microsoft Excel v.2016 spreadsheet and subsequently exported for analysis in Stata v17 software (StataCorp, College Station, TX, USA) and R studio v2023.03.1 (Posi Software, PBC, MA, USA).
The performance of the reference tests for diagnosing pulmonary and extrapulmonary TB was calculated using the area under the curve (AUC) of the receiver operating characteristic (ROC), sensitivity, specificity, positive and negative likelihood ratios, and positive and negative predictive values. Finally, we measured the proportion of absolute agreement using Cohen’s Kappa coefficient.
Ethics
The protocol was approved by the research ethics committee of the Faculty of Health Sciences at the Private University of Tacna (code: 94/FAC). The ethics committee waived the requirement for informed consent due to the nature of the study, which prevented contacting patients from thawed samples stored for laboratory quality control purposes. Similarly, confidentiality of the database was ensured, which was used exclusively for research purposes.
Results
One hundred seventy-five samples from patients with presumptive TB were included, of which 58.3% (
Main characteristics of the sample origin according to type and result of Xpert MTB/RIF Ultra.
Median and interquartile range.
Laboratory results of conventional and molecular tests for the diagnosis of pulmonary and extrapulmonary tuberculosis.
Median and interquartile range.
Logix Smart presented 15 samples with indeterminate results, which were excluded for this analysis.
Ct, cycle threshold; MTB,
Accuracy of Cobas MTB and Logix Smart for TB diagnosis compared to positive molecular result of Xpert MTB/RIF Ultra
In pulmonary samples, smear microscopy presented an AUC/ROC of 0.70, with a sensitivity of 40.0% and specificity of 100.0% for the diagnosis of TB. Mycobacterial culture presented an AUC/ROC of 0.72, with a sensitivity of 45.2% and specificity of 100%. In comparison, the Cobas MTB molecular test showed better performance with an AUC/ROC of 0.96, presenting a sensitivity and specificity of 92.9% and 100.0%, respectively. In contrast, the Logix Smart MTB showed an AUC/ROC of 0.89, with a sensitivity of 78.4% and a specificity of 100.0%. Regarding the performance of molecular tests in extrapulmonary samples, Logix Smart MTB showed the best performance with a sensitivity and specificity of 100.0%, while Cobas MTB presented an AUC/ROC of 0.91, with a sensitivity and specificity of 83.3% and 97.7%, respectively (Table 4; Figure 1). Of the seven extrapulmonary samples that tested positive by Xpert MTB/RIF Ultra (three urine, one ascitic fluid, one bone biopsy, one soft tissue abscess, and one intrathoracic abscess), Logix Smart MTB was positive in 100% of them, while Cobas MTB was positive in 83.3% (failing to detect one positive urine sample), while none of them were positive in culture or smear (Table 4; Figure 1).
The area under the ROC curve and cut-off points of conventional and molecular tests compared to Xpert MTB/RIF Ultra.
AUC, area under the curve; MTB,

Radar graph summarizing the diagnostic performance of conventional and molecular tests in pulmonary and extrapulmonary samples compared to Xpert MTB/RIF Ultra.
Concordance of molecular tests for the diagnosis of pulmonary and extrapulmonary TB
The percentage of agreement between the Cobas MTB and the Xpert MTB/RIF Ultra was 97.6% for pulmonary samples and 95.9% for extrapulmonary samples, with Cohen’s Kappa index of 0.95 and 0.81, respectively. On the other hand, the Logix Smart MTB presented agreement of 93.1% for pulmonary samples and 95.5% for extrapulmonary samples, with Cohen’s Kappa index of 0.83 and 0.81, respectively (Table 5).
Percentage of agreement of the Cobas MTB and Logix Smart MTB test with the Xpert MTB/RIF Ultra.
95% CI, 95% confidence interval; MTB,
We also analyzed the positive molecular results, in which the mycobacterial culture was negative (Table 6). Thirty-one samples were positive according to molecular methods but negative according to mycobacterial culture, of which 23/31 were pulmonary, and 8/31 were extrapulmonary. Among these 23 pulmonary samples, 23/23 were detected by Xpert MTB/RIF Ultra (Ct range: 16–26), while Cobas MTB detected 20/23 samples (Ct range: 19–35) and Logix Smart 19/31 samples (Ct range: 24–37) with five samples with indeterminate results. Among the eight extrapulmonary samples, 7/8 were detected by Logix Smart MTB (Ct range: 25–37), 6/8 were positive by Cobas MTB (Ct range: 24–38), and 6/8 were positive by Xpert MTB/ RIF Ultra (Ct range: 16–26) (Table 6).
List of patients in whom MTB was identified by some molecular method, but not by culture.
Ct, cycle threshold; MTB,
Finally, 100% of samples positive by smear microscopy were also positive by Xpert MTB/RIF Ultra, Cobas MTB, and Logix Smart MTB methods. While 100%, 100%, and 94.7% of samples were positive by mycobacterial culture, they were also positive by Xpert MTB/RIF Ultra, Cobas MTB, and Logix Smart MTB, respectively.
Discussion
The study evaluated the diagnostic performance of Cobas MTB and Logix Smart MTB for the diagnosis of PTB and EPTB. We observed that both molecular tests had adequate diagnostic performance on total samples when compared to the Xpert MTB/RIF Ultra. We also observed that the performance of Logix Smart was superior (AUC/ROC: 0.97) to Cobas MTB for the diagnosis of EPTB, although it was inferior for the diagnosis of PTB (AUC/ROC: 0.91). These findings demonstrate that both tests meet the minimum diagnostic performance requirements for PTB and EPTB proposed by the WHO. 17
The use of molecular tests such as Xpert MTB/RIF for the initial diagnosis of PTB has been shown to reduce mortality compared with smear microscopy, although not statistically significant. 4 Currently, this test is recommended by the WHO because it has the best diagnostic performance, so we decided to compare its performance with the Cobas MTB and the Logix Smart MTB. It should also be noted that according to the WHO, a defined case of TB is through the identification of MTB either by culture or by some molecular method. 18
Xpert MTB/RIF Ultra has the advantage over Xpert MTB/RIF of slightly higher sensitivity (88% vs 83%), especially when smear microscopy is negative (63% vs 43%).18,19 It also has a lower detection limit of 16 CFU per milliliter (compared to 114 CFU/mL with Xpert MTB/RIF), and it offers better precision in detecting rifampicin resistance due to the incorporation of a melting temperature analysis using four probes that identify mutations in the rpoB gene. 19
Cobas MTB showed a sensitivity of 89.2% (95% CI: 81.7%–93.9%) and specificity of 98.6%, compared to respiratory samples with positive cultures. 20 At the same time, the reported sensitivity of Cobas MTB in smear-negative samples was 63.0%–81.8%.
Unlike Xpert MTB-RIF Ultra, Cobas MTB-RIF/INH has the advantage of being able to confirm true MDR-TB since Xpert MTB-RIF Ultra only estimates MDR based on rifampicin resistance. A study evaluated its performance for this objective, showing a sensitivity of 77.8% and 90% for detecting resistance to isoniazid and rifampicin, respectively. 21 The cases of false susceptibility to isoniazid in the Cobas MTB-RIF/INH were due to nontarget cobas mutations. Nevertheless, in terms of performance, Cobas MTB has shown greater analytical sensitivity than Xpert MTB/RIF and is similar to Genotype MTBDR plus for resistance to rifampicin and isoniazid. 22
According to the manufacturer’s instructions, Cobas MTB-RIF/INH is only validated for respiratory samples; however, in our study, we observed adequate performance for extrapulmonary samples, similar to the Xpert, although inferior to the Logix Smart MTB.
Compared to other medium-complexity molecular methods supported by the WHO, the Cobas MTB-RIF/INH assay requires 3.7 h to process 94 samples and has the advantage of being able to simultaneously analyze 384 samples on the Cobas 6800 and 960 samples on the Cobas 8000. In addition, PCR can be used for MTB, hepatitis B, hepatitis C, and HIV simultaneously. One of its main limitations in sample preparation with Cobas MTB was sonication, which was the reason why it received a lower score regarding sample preparation by users (86% approval).23,24 Another disadvantage is that DNA extraction must be repeated if resistance testing is required, which can lead to increased costs and time, mainly in settings with high incidences of DR-TB. In addition, this technique requires more space and has special electrical requirements than the Xpert MTB/RIF Ultra.
In our study, we observed that Logix Smart MTB presented the best diagnostic performance for extrapulmonary samples, although according to the supplier, this method has only validated for pulmonary samples. 16 To our knowledge, there are no studies that have evaluated the diagnostic performance of Logix Smart MTB in this context; however, in pulmonary samples, it presented a lower performance, with a significant proportion of indeterminate or false negative results, most of which were detected using Xpert MTB/RIF Ultra or Cobas MTB, possibly due to a lower mycobacterial load, since some of these discordant results presented high Ct in the Cobas MTB. As a limitation, Logix Smart has only been validated with the QIAGEN and with the CoDx Box thermal cycler. Although it can provide results in less than 2 h, it is a method of moderate complexity and is not completely automated as is the case for the Xpert MTB/RIF Ultra. Furthermore, this test does not detect resistance to anti-TB drugs, which may be a major limitation.
This research is part of the third pillar of “The End TB strategy” 25 since although Xpert MTB/RIF Ultra is a test with high sensitivity and specificity for the diagnosis of TB, its implementation has not yet been universal, probably due to associated costs; Cobas MTB and Logix Smart MTB could be approximately 30–50% less expensive, and have the advantage of being able to be mass-processed, and with comparable performance. Likewise, although conventional tests like smear microscopy are more economical, they have low sensitivity in identifying TB cases. 26
This study has some strengths. It is the only study that compares the performance of the Xpert MTB/RIF Ultra, Cobas MTB, and Logix Smart MTB for diagnosing PTB and EPTB, even though some of these methods are out of license. In addition to being developed in a high-performance reference laboratory in a country with high TB endemicity, such as Peru, the generalizability of the results is further supported by the inclusion of a diverse range of samples (both pulmonary and extrapulmonary) and the use of different molecular methods. These factors provide a broader context that enhances the applicability of the results to different clinical and geographical settings.
Some of the limitations of this study are the following. Sample processing was carried out after freezing and thawing a limited volume of samples, and it is unknown whether this process could have affected the performance of the tests. It was also not possible to know relevant clinical information such as sex, the presence of symptoms, clinical evolution, history of TB, and HIV infection or treatment with antiretrovirals because we did not have access to medical records and were unable to interview the patients to collect this information. Furthermore, the limited number of samples, due to the limited budget available, could lead to inaccuracy in the reported results. More studies with a greater number of samples analyzed are needed, especially in specific scenarios and with clinical information at the time of diagnosis and its outcomes. Additionally, a sample size calculation was not performed, which could also affect the precision of the results. Future studies should ensure proper sample size calculations to strengthen statistical validity and the detection of significant diagnostic differences.
Conclusion
We found that the Cobas MTB and Logix Smart MTB tests demonstrated adequate performance for tuberculosis diagnosis when compared to the Xpert MTB/RIF Ultra. For pulmonary samples, Cobas MTB showed a higher diagnostic yield, while for extrapulmonary samples, the Logix Smart MTB test was the most suitable. Based on our results, we conclude that molecular tests complement each other, and their selection should be guided by the type of sample being analyzed rather than a one-size-fits-all approach.
Supplemental Material
sj-docx-1-tai-10.1177_20499361241304516 – Supplemental material for Diagnostic performance of the Cobas MTB and Logix Smart MTB for diagnosing pulmonary and extrapulmonary tuberculosis: a cross-sectional study of diagnostic tests
Supplemental material, sj-docx-1-tai-10.1177_20499361241304516 for Diagnostic performance of the Cobas MTB and Logix Smart MTB for diagnosing pulmonary and extrapulmonary tuberculosis: a cross-sectional study of diagnostic tests by Miguel Hueda-Zavaleta, Juan Carlos Gomez de la Torre, Diana Minchón-Vizconde, Claudia Barletta-Carrillo, Cesar Copaja-Corzo, Gustavo Tapia-Sequeiros, Cinthya Flores, Cristian Piscoche, Cecilia Miranda, Ada Mendoza and Vicente A. Benites-Zapata in Therapeutic Advances in Infectious Disease
Footnotes
Acknowledgements
None.
Declarations
ORCID iDs
Supplemental material
Supplemental material for this article is available online.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
