Bayesian estimation of ELISA and gamma interferon test accuracy for the detection of bovine tuberculosis in caudal fold test–negative dairy cattle in Kuwait

Abstract

Bovine tuberculosis (TB) is endemic in Kuwait; cattle identified as TB-positive using the caudal fold test (CFT) are culled. We used a Bayesian approach to estimate the sensitivity (Se) and specificity (Sp) of the IFNγ assay and ELISA, which are not routinely used in Kuwait in CFT-negative dairy cattle. Blood samples from CFT-negative cattle (n = 384) collected from 38 dairy farms were tested by IFNγ assay and ELISA. The Se and Sp (95% CI) of the IFNγ were 85.0% (67.6–95.3%) and 90.4% (86.7–95.3%), respectively, whereas estimates for the ELISA were 61.1% (33.1–84.6%) and 85.4% (81.7–88.8%). TB prevalence (95 CI%) in CFT-negative cattle was estimated as 2.6% (0.5–9.5%). The IFNγ assay may play a role as an ancillary test for the identification of Mycobacterium bovis–infected cattle that are undetected by CFT.

Mycobacterium bovis infection causes bovine tuberculosis (TB), a zoonotic disease of cattle and other domestic and wild mammals. Bovine TB is still endemic in Kuwait, where there are no commercial beef operations and 393 dairy farms with a total population of 25,000 cattle of which, it has been estimated, ~1% are M. bovis–infected as determined by caudal fold testing (CFT; Public Authority for Agriculture Affairs and Fish Resources, PAAFR, unpublished data). Because the sensitivity (Se) of the CFT is believed to be relatively low (50–80%), ⁵ , ⁶ , ¹⁰ , ¹³ it is possible that TB maintenance in the country is associated with under-detection of infection by the CFT. Although the gamma interferon (IFNγ) assay ¹⁸ and ELISA ¹⁶ for the detection of specific antibodies may serve as ancillary tests to increase diagnostic Se, those techniques have never been tested in Kuwait. We estimated TB prevalence, and the Se and specificity (Sp) of the IFNγ assay and ELISA, in CFT-negative cattle of Kuwait.

Between May 2014, and November 2016, blood samples (10 mL) from 38 dairy farms were collected into heparinized tubes immediately before cattle were tested by CFT. Samples were collected and transported to the laboratory to avoid the extremely hot temperatures of Kuwait. Immediately upon arrival at the laboratory, within 4–6 h after collection, blood samples were divided into 3 aliquots that were stimulated using bovine and avian purified protein derivative (PPD) and phosphate-buffered saline (PBS), and incubated overnight at 37ºC in a humidified atmosphere as described elsewhere. ¹⁸ Samples were then centrifuged, and plasma was recovered and stored until the CFT-negative status of the animals was demonstrated, which was the case for 384 animals. Subsequently the IFNγ assay (Prionics, Schlieren, Switzerland) and ELISA (IDEXX Laboratories, Westbrook, ME) were performed according to manufacturers’ instructions. Although this was a convenience sample, and the number of samples that would be CFT-negative was unknown at the time of collection, the number of CFT-negative cattle (n = 384) approximates the maximum sample size required to estimate disease prevalence in a population of unknown size with a 95% confidence interval (CI) and assuming an error level of 5%.

A Bayesian approach was used to estimate the Se and Sp of the ELISA and the IFNγ test. ² , ³ , ⁸ , ¹⁴ Bayesian approaches have been used previously to estimate the accuracy of TB tests in endemic settings ¹ given the lack of a reliable gold standard test for the disease. Model parameters (including test Se and Sp and disease prevalence [p]) were initially approximated using prior information on the expected values and uncertainty around that expectation, using data reported in the peer-reviewed literature. Subsequently, prior beta distributions of those test parameters (Table 1) were estimated using BetaBuster (https://goo.gl/K4obsV). Field data were then used to modify the prior distributions and estimate posterior distributions in a Bayesian framework.

Table 1.

Prior distributions and source of data used to estimate the accuracy of 2 bovine tuberculosis tests in caudal fold test–negative cattle of Kuwait using a Bayesian latent class model and in the absence of a gold standard. Uncertainty was measured as the 95% confidence level that the parameter was higher (>) or lower (<) than a certain value.

Parameter	Most likely value	Uncertainty	Parameterization of the beta distribution	Reference(s)
Prevalence (p)	0.05	<0.2	2.0633, 21.2018	5,6,10,13
ELISA
Sensitivity	0.7	<0.85	10.5603, 5.0973	4,7,9,12,15,17
Specificity	0.9	>0.8	42.5732, 5.6192
Gamma interferon
Sensitivity	0.88	>0.73	23.4504, 4.0614	13
Specificity	0.97	>0.85	26.7427, 1.7962

Because Kuwait is a small country, no TB testing occurs prior to animal movement, and most farms are small (<5 cattle per farm), a single population was assumed. Results from the IFNγ assay and the ELISA may be independent because they are based on the detection of cellular and humoral immune responses, respectively. However, IFNγ and ELISA results may still be correlated and, thus, we preferred to explicitly assess the correlation between test results. ² , ³ Robustness of the model to the definition of the prior distributions was evaluated by alternatively assuming uniform (0, 1) prior distributions for the parameter values. All calculations were performed using WinBUGS software, ⁸ and results were computed for 200,000 iterations of the model after the initial 500 iterations were discarded. The autocorrelation and trace plots of the simulations were visually assessed, and the Gelman–Rubin statistic was computed to evaluate model convergence.

There were 55 (14.3%) IFNγ assay–positive, 40 (10.4%) ELISA-positive, and 5 (1.3%) IFNγ-and-ELISA–positive samples among CFT-negative dairy cattle of Kuwait. The remaining 284 (74.0%) samples were negative to both tests. The estimated (posterior) Se and Sp of the IFNγ assay were 85.0% (95% CI: 67.6–95.3%) and 90.4% (86.7–95.3%), respectively. Results are similar to those reported elsewhere, with Se and Sp of the IFNγ assay estimated to be 73.0–100% and 85.0–99.6%, respectively. ⁶ , ¹³ Slightly lower values were estimated for the Se (61.1%; 95% CI: 33.1–84.6%) and Sp (85.4%; 81.7–88.8%) of the ELISA, compared to the IFNγ assay, in agreement with a number of studies that reported a substantial variation in ELISA results. ⁴ , ⁷ , ⁹ , ¹² , ¹³ , ¹⁵ , ¹⁷ Disease prevalence (95% CI) in CFT-negative cattle was estimated as 2.6% (0.5–9.5%). Different PPDs were used for the IFNγ assay (Tuberculin, Prionics, Lelystad, The Netherlands) and the CFT (Bovituber, Synbiotics, Lyon, France), which may explain, at least in part, the differences in the test results. Furthermore, extreme weather conditions of Kuwait challenged the requirement of keeping samples at room temperature. Samples were refrigerated to resemble conditions observed in countries where the IFNγ assay was standardized; however, it is unclear how temperature and storage conditions may have affected our results. As expected, the correlation between the ELISA and IFNγ assay was nil, with median values approximating 0 for both infected and uninfected animals. Such findings may be related to detection of infection status at different stages, ¹¹ leading to an opportunity for in-parallel use and interpretation of those tests, particularly the IFNγ assay, to increase TB diagnostic sensitivity in Kuwait. Results were sensitive to the prior parameterization of the model, and thus, validity of the model is conditional to the values assumed for the prior distributions, which is an assumption of Bayesian analysis. In alignment with World Organization for Animal Health recommendations, ¹⁹ combined and systematic application of CFT and IFNγ may improve bovine TB control in Kuwait.