Abstract
A comprehensive laboratory evaluation of the Tetracore RedLine Alert test, a lateral flow immunoassay (LFA) for the rapid presumptive identification of Bacillus anthracis, was conducted at 2 different test sites. The study evaluated the sensitivity of this assay using 16 diverse strains of B. anthracis grown on sheep blood agar (SBA) plates. In addition, 83 clinically relevant microorganisms were tested to assess the specificity of the RedLine Alert test. The results indicated that the RedLine Alert test for the presumptive identification of B. anthracis is highly robust, specific, and sensitive. RedLine Alert is a rapid test that has applicability for use in a clinical setting for ruling-in or ruling-out nonhemolytic colonies of Bacillus spp. grown on SBA medium as presumptive isolates of B. anthracis.
A comprehensive laboratory evaluation of the Tetracore RedLine Alert test, a lateral flow immunoassay (LFA) for the rapid presumptive identification of Bacillus anthracis, was conducted at 2 different test sites. The study evaluated the sensitivity of this assay using 16 diverse strains of B. anthracis grown on sheep blood agar plates. In addition, 83 clinically relevant microorganisms were tested to assess the specificity of the RedLine Alert test.
Anthrax is an acute infection caused by the gram-positive, rod-shaped, spore-forming facultative anaerobic bacterium Bacillus anthracis.1-5 Cells of B. anthracis are nonmotile, nonhemolytic, encapsulated, and arranged in chains. The vegetative form of this bacterium is not easily transmitted to humans, but the spores, which are the infectious form, are resistant to harsh environmental conditions, including ultraviolet light, ionizing radiation, heat, and various chemicals.4,6-8 Cutaneous anthrax infections make up the vast majority of reported human cases worldwide, accounting for more than 95% of human anthrax cases; if left untreated, up to 20% of cases can be fatal.3,9,10 Oropharyngeal or gastrointestinal anthrax is the second most common form of the disease, characterized by lesions in the oral cavity or stomach/intestinal tract due to consumption of contaminated meat or by swallowing aerosolized spores. 11 Lesions cause massive swelling and blockage of the airway, stomach or intestinal perforation, or hemorrhage, and, if left untreated, 25% to 60% of cases are fatal.10,11 Inhalation anthrax, which is the most dangerous form of B. anthracis infection, with untreated fatality rates close to 100%, can be acquired through occupational exposure (eg, mill workers) or from an intentional release of spores, as happened in the anthrax attacks in 2001.3,9,12-16 In recent years, a fourth form, injection/septicemic anthrax, has emerged among intravenous drug users in western Europe. 17 The most recent outbreak of injectional anthrax was believed to be the result of contaminated heroin that originated in Pakistan or Iran. 18
B. anthracis ranks high on the list of potential agents of bioterrorism, as mortality rates can be significant when illness results from the inhalation of aerosolized spores.19-21 Experts consistently rank anthrax spores as a potential bioweapon when taking into consideration characteristics such as stability and ease of dissemination.20,21 Bioterrorism events and planning scenarios have emphasized the need for rapid and accurate detection and diagnostics to protect public health. Various tests have been developed to detect and/or identify B. anthracis in clinical specimens. Many of these tests have a high sensitivity and/or high specificity, such as real-time PCR, antigen detection tests, gamma phage susceptibility, and direct fluorescent antibody tests.22,23 However, these tests have limitations or high complexity testing.24,25 Because of these limitations, the time to obtain results may be delayed, which can hinder timely and critical treatment decisions.
Lateral flow immunochromatographic assays (LFAs) were commercially introduced for pregnancy testing in 1988. 26 Simple to use and requiring minimal training, 27 these LFAs are ideal for use by first responders and law enforcement officers to test suspicious materials in field settings. LFAs such as the BioThreat Alert® assays have previously been evaluated for the detection of several biothreat agents including orthopoxviruses, 28 ricin, 29 abrin, 30 B. anthracis, 31 and Yersinia pestis. 32
The purpose of this study was to conduct a comprehensive test and evaluation of the FDA cleared RedLine Alert LFA (Tetracore, Inc., Rockville, MD) (510K Approval No. K030370) for presumptive identification of B. anthracis from nonhemolytic bacillus colonies grown on sheep blood agar (SBA) plates. The RedLine Alert LFA uses a combination of a polyclonal and a monoclonal antibody directed against extractable antigen 1 (EA1). The presence of EA1 in the sample forms a complex with the colloidal gold-labeled monoclonal antibody that migrates along the membrane. An immobilized rabbit capture antibody binds the colloidal gold-labeled antibody-antigen complex to form a colored line in the results window. An internal control line is also present in the results window to ensure that the test has been performed correctly.33,34 The evaluation included the likelihood of false-negative results (assay is negative but the analyte is present at a concentration below the limit of detection, or LOD), false-positive results (assay is positive but the target analyte is not present in the sample), and robustness and reproducibility of an assay that can be incorporated into the Level A protocol for B. anthracis. 25 This will enable local hospital and commercial clinical laboratories to obtain a rapid presumptive diagnosis of anthrax infections, including those resulting from an intentional biological attack, so that appropriate notification and clinical intervention can be initiated in a timely manner to save lives.
This study was designed and executed through an interagency collaboration with participation from subject matter experts from the Department of Homeland Security (DHS) Science and Technology Directorate (S&T) Chemical and Biological Defense Division (CBD) and First Responders Group (FRG); Health and Human Services (HHS) Office of the Assistant Secretary for Preparedness and Response/Biomedical Advanced Research and Development Authority (ASPR/BARDA); HHS Centers for Disease Control and Prevention (CDC); HHS Food and Drug Administration (FDA), Office of Laboratory Science and Safety; FDA Center for Food Safety and Applied Nutrition (CSFAN); Department of Justice (DOJ) Federal Bureau of Investigation (FBI); the US Department of Agriculture (USDA); and others.
Materials and Methods
The Level A protocol for the sentinel level clinical laboratory for the presumptive identification of B. anthracis is to inoculate the specimen onto an SBA plate (and chocolate agar, and MacConkey or eosin methylene blue agar, depending on the type of specimen). After incubation at 35°C to 37°C in 5% to 10% CO2 for 18 to 24 hours (growth of B. anthracis may be observed as early as 8 hours), γ-hemolytic (no hemolysis) nonpigmented colonies with a ground glass appearance on the blood agar plate are gram stained. Those consisting of large, gram-positive rods are tested for the presence of catalase and motility. Cultures of γ-hemolytic, nonmotile, catalase positive, and gram-positive rods are considered as presumptive B. anthracis and sent to a CDC Laboratory Response Network (LRN) reference laboratory for confirmatory testing and further characterization. 25 B. anthracis can be ruled out if the colonies are α- or β-hemolytic or if the organism is catalase negative and/or motile. 25 RedLine Alert test strips (catalog number TC-5123-001) were obtained from Tetracore, Inc., in Rockville, MD. In Phase 1, the sensitivity of the assay was determined using the virulent B. anthracis Ames strain and an inclusivity panel of 15 additional strains. The virulent B. anthracis strains were grown, samples prepared, and 4 replicates tested at the Zoonoses and Select Agent Laboratory, Bacterial Special Pathogens Branch, National Center for Emerging and Zoonotic Infectious Diseases, CDC, Atlanta, GA. In Phase 2, assay specificity was determined using the avirulent Sterne strain of B. anthracis (positive control) and a panel composed of 81 clinically relevant strains. Most of the testing was done at Omni Array Biotechnology, Rockville, MD, by 4 different operators from DHS S&T and FDA CFSAN according to manufacturers' recommendations. Select agent organisms in the clinical panel were grown, samples prepared, and 4 replicates tested at Tetracore, Inc., Rockville, MD.
Phase 1: Inclusivity Panel
All inclusivity strains of B. anthracis (N = 16) representing clades A1.a, A1.b, A3, A3.a, A3.b, A4, B1, B2, and C were typed using Multiple Locus Variable-number Tandem Repeat Analysis (MLVA) and characterized by plasmid profile analysis and 16S typing at CDC (Table 1).
Inclusivity Strains of B. anthracis
Strain K5135 received as GT29, but the allele size for vrrC1 does not match (should be 520 but is an unusual size of 548).
Prior to testing, the inclusivity panel strains were inoculated onto SBA plates and incubated at 37°C under aerobic conditions until visible colonies (2-4 mm in diameter) were observed. A colony was removed using a sterile loop and resuspended in 200 μL of colony isolation buffer (CIB) in a vial. To facilitate transfer, the loop was twirled in the buffer for 5 seconds to dislodge the colony. The tube was vortexed for 5 seconds to resuspend and to evenly distribute the cells in the buffer and then allowed to sit at room temperature for about 2 minutes. Next, the vials were gently vortexed, and 150 μL of the test sample was transferred to the sample well of the RedLine Alert test strip. Four replicates of each strain were tested, and visual readings were noted between 15 and 30 minutes after the addition of the sample.
Phase 2: Clinical Panel
After consultation with subject matter experts, a clinical panel consisting of 81 human pathogens was assembled (Table 2). The panel of bacteria consisted of agents known to cause dermal, pulmonary, gastrointestinal, and septicemic infections.
List of Clinically Relevant Background Organisms (Route of infection – Red color cell)
This panel was used to evaluate the specificity of the RedLine Alert LFA assay. Strains were grown either on selective medium or SBA by Lawrence Livermore National Laboratory, Livermore, CA, or Tetracore, Inc., Rockville, MD, and shipped to Omni Array, where they were subcultured onto SBA plates and incubated for 16 to 24 hours at 37°C to ensure purity. For long-term storage, individual bacterial seeds were prepared using MICROBANK™ (Pro-Lab, Ontario, Canada), based on manufacturer's guidelines and stored at −80°C. Two days prior to testing, the frozen stocks were retrieved, inoculated onto SBA plates, and incubated overnight at 37°C. The following day, cultures were examined for purity, and a single isolated colony was selected and streaked onto a new SBA plate. On the day of testing, the medium surrounding the colonies was examined. Cultures showing a darkening or discoloration of the medium surrounding the colonies demonstrated alpha-hemolysis. Cultures showing clear halos around and under the colonies exhibited beta-hemolysis. An isolated colony measuring 2 to 4 mm in diameter was removed with a sterile inoculating loop and transferred to a vial containing 200 μL colony isolation buffer. Vials were vortexed for 5 seconds to suspend and evenly distribute the cells in the buffer and allowed to stand at room temperature for at least 2 minutes prior to testing. The vials were gently vortexed, and 150 μL of cell suspension was added to the sample well of each strip. Strips were read visually 15 to 30 minutes following sample addition. Strips on which the control line did not appear were discarded. Each organism was tested by 4 different operators and visual observations recorded.
Phase 3: Informational Panel
Bacillus cereus biovar anthracis strains CA and CI were obtained from the Center for Biological Threats and Special Pathogens, Robert Koch Institute, Berlin Germany. 35 Strains were grown and suspensions prepared for testing as described above for the inclusivity panel (Table 3).
Informational Panel Organisms (Route of infection – Red color cell)
Biosafety Considerations
The virulent B. anthracis and B. cereus biovar anthracis strains used in this study were handled with appropriate biosafety conditions at the CDC according to institutional biosafety guidelines. Virulent B. anthracis strains were handled in a BSL-3 laboratory. All other organisms, including low-risk bacterial strains, were handled, processed, and tested under safety protocols in accordance with Biosafety in Microbiological and Biomedical Laboratories (BMBL). 36 To minimize risk of aerosols, cultures were handled using BSL-2 practices that also required personal protective equipment and procedures such as gowning, use of gloves, protective eyewear, and working in a certified Class II biosafety cabinet (BSC). All work areas before and after the testing were cleansed with 10% bleach, while disposal of stock cultures or biomedical waste was done in accordance with institutional guidelines.
Statistical Analysis
The performance of the lateral flow assay was assessed by calculating its sensitivity, specificity, and accuracy based on the results from all the testing done in this study. Sensitivity is defined as the proportion of true positives that are correctly identified by the test and is calculated as:
Specificity is defined as the proportion of true negatives that are correctly identified by the test and is calculated as:
Accuracy is defined as the proportion of true positives and true negatives correctly identified by the test, the overall probability that the test correctly classifies the presence of the analyte (Bacillus anthracis in this instance), and is calculated as:
Sensitivity, specificity, and accuracy from the visual results of the lateral flow assay were calculated using MedCalc Statistical Software version 18.11.3 (MedCalc Software bvba, Ostend, Belgium; http://www. medcalc.org; 2019).
Results
RedLine Alert test results of all 3 phases of testing—Phase 1, inclusivity panel; Phase 2, clinical panel; and Phase 3, informational panel—microorganisms are shown in Table 4. Number of samples tested as positive controls and negative controls in each phase are also given in the table.
RedLine Alert test results of 3 phase testing comprising B. anthracis Phase 1 inclusivity panel, Phase 2 clinical panel, and Phase 3 informational panel microorganisms
Phase 1: Inclusivity Panel Testing
Four replicates of 16 geographically diverse B. anthracis strains that comprised the inclusivity panel were tested. A combined total of 64 tests were performed in this phase. B. anthracis Sterne strain was used as a positive control, and the manufacturer-supplied CIB was used as a negative control. Forty-eight negative controls and 16 positive controls were also tested in Phase 1 in addition to the inclusivity panel organism testing. All samples containing B. anthracis produced positive visual results; no reactivity was observed for any of the negative controls.
Phase 2: Clinical Panel Testing
The clinical panel used in the current study consisted of 40 (49.4%) γ-hemolytic organisms, 8 (9.9%) β-hemolytic microorganisms, and 33 (40.7%) α-hemolytic organisms (Table 2). As in Phase 1 testing, a combined total of 324 tests were performed in Phase 2 along with 44 negative controls and 20 positive controls.
Testing of the clinical panel by 4 operators yielded negative results for 80 of 81 (98.76%) organisms shown in Table 2 by visual inspection. The only positive result occurred with a β-hemolytic Bacillus cereus strain. When evaluating the assay using data from all organisms regardless of hemolytic activity, the sensitivity of the RedLine Alert assay was 100% and its specificity was 98.76% (Table 5). The sensitivity and specificity of the assay using results from only the nonhemolytic organisms in the clinical panel (40 out of 81) were 100% and 100%, respectively (Table 6). The data show that the assay is robust and does not cross-react with other clinically relevant organisms tested based on the testing algorithm. Nevertheless, the manufacturer's product disclosure notes that the RedLine Alert test may cross-react with B. cereus and B. thuringiensis; however, these organisms are β-hemolytic, so the predefined algorithm would exclude them for testing.
2 x 2 Contingency table and statistical analysis assessing the accuracy of RedLine Alert Assay based on the data from Phase 1 testing and all clinical panel microorganisms in Phase 2
2 x 2 Contingency table and statistical analysis assessing the accuracy of RedLine Alert assay based on the data from Phase 1 testing and Phase 2 testing of only nonhemolytic strains
Phase 3: Informational Panel Testing
B. cereus biovar anthracis is an emerging pathogen that has caused fatal anthrax-like infections in nonhuman primates such as chimpanzees and gorillas in West Africa. 35 Human infections with this organism have not been reported but cannot be ruled out due to the paucity of clinical laboratories in areas where this organism has been found. These organisms possess some phenotypic properties of B. anthracis (γ-hemolytic, colony morphology), which may make them difficult to identify in a clinical laboratory. However, B. cereus biovar anthracis is motile, which would rule out B. anthracis prior to testing with the RedLine Alert assay. In a study limited by the availability of strains, B. cereus biovar anthracis strains CA and CI were tested 4 times each; 4 replicates of negative controls and 4 replicates of positive controls were also tested during the informational panel testing. Strain CA gave negative results, but strain CI gave positive results in the RedLine Alert test. Results of the informational panel testing were not included in the sensitivity, specificity, and accuracy calculations shown in Table 5. While these results are interesting, additional strains need to be tested before we can state with certainty that this organism can occasionally produce false-positive test results if the manufacturer's algorithm is not followed.
Analytical Sensitivity, Specificity, and Accuracy
Calculation of the analytical sensitivity, specificity, and accuracy of the RedLine Alert test is shown in Table 5 using the results from testing organisms in the inclusivity panel and the clinical panel; Table 6 uses the results from testing of clinically relevant nonhemolytic organisms (40) from the clinical panel and the inclusivity panel. Results of positive controls and negative controls tested in each phase were not included in the statistical analysis and calculations.
Of the 388 RedLine Alert tests performed in this study, 64 tests were positive (ie, “B. anthracis present in sample”), while 320 were negative (ie, “B. anthracis absent from sample”), and 1 negative sample “Bacillus cereus” yielded a false-positive result which equates to 4 tests. Based on these data, the assay sensitivity was calculated to be 100% and specificity at 98.76%, with an area under the curve value of 0.99. Since the test is FDA cleared for use in a clinical setting for testing unidentified γ-hemolytic bacterial colonies for presence of B. anthracis, analysis using data from only the γ-hemolytic organisms produced a sensitivity and specificity of 100% and 100%, respectively, with an area under the curve value of 1.
Discussion
B. anthracis is high on the list of potential bioterrorism agents because of its ease of dissemination, stability and hardiness of the spore in the environment, high morbidity and mortality rate, and past development as a biowarfare agent. One key to saving lives is rapid diagnosis and clinical intervention with appropriate antibiotics. The current Level A protocol used in clinical laboratories in the United States involves the identification of gram-positive, rod-shaped bacteria, which grow as γ-hemolytic (nonhemolytic) colonies on SBA plates, produce catalase, and are nonmotile. 25 However, there are some drawbacks to relying solely on these methods. Laboratory personnel require additional training and certification to accurately identify these uncommon agents, using the appropriate biosafety practices, and to package and transfer the agents to a nearby LRN laboratory for secondary analysis and confirmation. 24 The ability to rapidly identify B. anthracis in a clinical laboratory will greatly benefit the workflow and support timely therapeutic decisions.
The results of this extensive evaluation led us to conclude that the FDA-cleared RedLine Alert is a highly robust, sensitive, and specific test for the presumptive identification of B. anthracis from γ-hemolytic (nonhemolytic) colonies on SBA. It is important to emphasize that a motility test should be performed to differentiate B. anthracis (nonmotile) from B. cereus biovar anthracis (motile), as some strains of the latter organism may give a positive result with the RedLine Alert test.
The diagnostic methods used for the presumptive identification of B. anthracis by Level A LRN laboratories include culture on 5% SBA plates to determine colony morphology and gram stain characteristics, hemolysis (B. anthracis is γ-hemolytic), motility (B. anthracis is nonmotile), and microscopic observation for spores. 37 The RedLine Alert test can reduce the time required for a presumptive identification of B. anthracis in the absence of a confirmed outbreak or biological attack. During an outbreak or biological attack, the assay can be used to confirm the presence of B. anthracis in order that appropriate antibiotic treatment can be started as quickly as possible.
This test may also support timely diagnosis in resource-limited endemic regions where there is a high prevalence of anthrax. For use in a low-prevalence region such as the United States, this test can serve as an important diagnostic tool in the event of an outbreak or biological attack. The 2001 anthrax incident in the United States prompted an extensive review of how clinical and public health laboratories should respond to bioterrorism. The LRN, which is capable of detecting, confirming, and reporting potential bioterrorism agents, was established prior to 2001. 24 The LRN consists of 3 tiers of laboratories: (1) sentinel laboratories (Level A), which use Level A protocols developed by the American Society for Microbiology (ASM)—these laboratories generally function as a first line of defense for detecting possible outbreaks or infections caused by biothreat agents and alerting state and federal agencies; 25 (2) reference laboratories, which are generally public health laboratories that perform confirmatory tests to produce high-confidence test results for threat analysis and intervention by public health and public safety authorities; and (3) national laboratories (eg, CDC) for definitive characterization. 24 Figure 1 indicates that up to 31 hours may elapse between the time a symptomatic patient arrives at a clinic, an initial diagnosis is made, and presumptive and confirmatory testing are completed. Therefore, it is vital that a simple, rapid method be incorporated to rule in the presence of B. anthracis in a clinical sample as quickly as possible so that proper treatment can be started. Equally important, the 100% Negative Predictive Value (NPV, Table 6) of the RedLine Alert assay suggests that it can be used to rapidly rule out γ-hemolytic colonies of gram-positive bacilli as potential B. anthracis.

Concept of operation for use of RedLine Alert™ test
The RedLine Alert kit is a very simple, easy-to-use, objective test for the presumptive identification of B. anthracis. This test can reduce the diagnostic time by several hours. Additionally, the RedLine Alert lateral flow assay has been approved by the FDA since 2003 for identifying B. anthracis in specimens from symptomatic patients cultured on SBA. However, it is critical that non–select agent registered laboratories (such as most hospital and commercial labs) promptly notify the CDC Select Agent Program and forward all samples and specimens to the closest LRN laboratory for further characterization to avoid violating the select agent regulation prohibiting possession of a select agent by an unregistered laboratory. Once testing has been completed and cultures/specimens forwarded to an LRN laboratory, remaining samples associated with the patient should be destroyed by the unregistered laboratory using appropriate methods within the time period stated in the select agent regulations.
Footnotes
Acknowledgments
This work was funded by US Department of Homeland Security Science and Technology Directorate Contract #HSHQDC-12-C-00071. The article reflects the views of the authors and should not be construed to represent the views or policies of DHS or HHS.
