|
|
||||||||
Brief Communication |
Correspondence: 1Corresponding Author: Juan Kruze, Microbiology Department, Faculty of Sciences, Universidad Austral de Chile, PO Box 167, Valdivia, Chile, e-mail: jkruze{at}uach.cl
| Abstract |
|---|
|
|
|---|
values ranging from 0.84 to 0.95. Receiver operating characteristic (ROC) curve analysis and the corresponding area under the ROC curves indicate that kit B had the highest overall accuracy. Thus, all 4 ELISA kits for bovine paratuberculosis had comparable accuracy when tested on Chilean dairy cattle, with kit B having a slight statistical advantage based on ROC area under the curve analysis. This suggests that any of the 4 kits could be appropriate for herd certification and for paratuberculosis control programs on Chilean dairy cattle.
Key Words: Bovines diagnosis enzyme-linked immunosorbent assay Johne's disease Mycobacterium paratuberculosis Mycobacterium avium subsp. paratuberculosis paratuberculosis
Johne's disease, or paratuberculosis, is a chronic, infectious disease caused by Mycobacterium avium subsp. paratuberculosis (MAP). The disease occurs worldwide, affecting many domestic and wild animal species, especially ruminants. Clinical paratuberculosis is characterized by chronic granulomatous enteritis with clinical signs of diarrhea, weight loss, decreased milk production, and mortality; however, most infected cattle show no clinical signs during the prolonged incubation stage of infection. Although cattle generally become infected as young calves, fecal shedding of MAP starts after 2 years and clinical symptoms appear after an incubation period of 2–10 years.20 The economic impact and possible link to Crohn's disease have motivated development of control programs at the herd, regional, and national levels.3,4,8,11 These programs are based on avoiding or limiting cow–calf transmission by changes in herd management and identifying and removing infected, or at least the most infectious, adult cattle. Diagnosis of MAP infection in these animals can be made by methods based on either detection of the organism in fecal samples or detection of antibodies in serum or milk samples.2,11 Fecal culture for MAP is considered the most commonly used reference test for evaluation of serological tests because it is widely available and the most sensitive and specific test for paratuberculosis. However, it is expensive and slow, requiring 8–16 weeks for completion of testing.2 Among tests for serum antibody to MAP, enzyme-linked immunosorbent assay (ELISA)–based methods are the most widely used. Several commercial ELISA kits for bovine paratuberculosis are currently available, and multiple studies have compared their accuracy.5,12,14,19 The purpose of the present study was to evaluate the accuracy of 4 commercial ELISA kits using bovine sera from Chilean dairy cattle herds.
Serum samples from lactating cows >2 years old from dairy herds in southern Chile collected during 2003–2005 for a previous paratuberculosis test validation study were used for test comparison (Kruze J: 2003, Validación de una prueba de ELISA para detectar infección por Mycobacterium avium subsp paratuberculosis en rebaños lecheros de la Décima Región, Chile [Validation of a commercial ELISA kit to detect Mycobacterium avium subsp. paratuberculosis infection in dairy herds of the Tenth Region, Chile]; Fondo de Mejoramiento del Patrimonio Sanitario, Servicio Agrícola y Ganadero, Ministerio de Agricultura, Chile; Proyecto C3-70-10-21). Fifty-three cows from 9 herds were fecal culture–positive, and the remaining 345 cows from 11 dairy herds were fecal culture–negative on 2 consecutive occasions 2 years apart. Fecal samples were collected from the rectum of each animal using individual, disposable, polyethylene sleeves, and cultured on homemade Herrold egg yolk (HEY) medium with mycobactin Ja, following the processing protocol developed at Cornell University.18 Decontamination before culture with hexadecylpyridinium chloride (HPC)b and an antibiotic brew (nalidixic acid, vancomycin, amphotericin B)b was carried out following the procedure recommended by the National Animal Disease Center as described elsewhere.18 An aliquot (0.15 ml) of the final suspension of each fecal sample was used to inoculate 3 HEY tubes with mycobactin and 1 HEY tube without mycobactin. All tubes were incubated at 37°C for up to 16 weeks and examined weekly for bacterial growth. Colonies resembling MAP and showing mycobactin-dependence were tested by IS900 polymerase chain reaction (PCR).10 Blood samples were collected in 10-ml Vacutainer Tubesc from the coccygeal vein, and the sera was harvested and frozen at –80°C until retested for ELISA kit comparison. All sera were tested in duplicate wells using 4 commercial ELISA kits designated as kits A,d B,e C,f and D,g and performed according to manufacturer's recommendations. All 4 kits have a preabsorption step with Mycobacterium phlei antigens to enhance assay specificity by limiting cross-reactions with mycobacteria other than MAP. Cutoff values recommended for each kit were used according to kit instructions. Positive and negative control sera provided by the manufacturers were included on each plate. Test results were interpreted as negative or positive. Results classified as suspect or inconclusive were considered negative. Assays with a between-well coefficient of variation of
10% were repeated, and the second result was used for data analysis. The case definition for a MAP-infected herd was any herd with 1 or more fecal culture–positive cows. A noninfected herd was a herd in which all cattle were fecal culture–negative on 2 whole-herd tests at least 1 year apart. Sensitivity was defined as the percentage of fecal culture–positive cows testing ELISA-positive. Specificity was defined as the percentage of non-MAP–infected cows testing ELISA-negative. A z-statistic for comparison of independent proportions was used to determine sensitivity and specificity differences among ELISA kits. McNemar's chi-square analysis and
calculation were used to evaluate agreement between pairs of assays.13 Differences were considered significant at P < 0.05. Receiver operating characteristic (ROC) curves were constructed by plotting the true positive rate (sensitivity) versus 1-specificity (false-positive rate) using GraphPad Prism version 4.00 for Windows.h The area under the ROC curve (AUC) ranges between 0.5 and 1.0, where an AUC of 1.0 represents a test with perfect accuracy (sensitivity = 100%, and specificity = 100%). Low, moderate, and high overall assay accuracy was defined as AUCs of 0.5–0.7, 0.7–0.9, and 0.9–1.0, repectively.10
Sensitivity and specificity of kits A, B, and D were evaluated based on sera from 53 cases and 345 controls. Kit C was evaluated using all 53 cases but only 299 controls because of failure of positive controls on 2 ELISA plates in 1 kit. Diagnostic sensitivities of the 4 ELISAs ranged from 30.2% (95% confidence interval [CI]: 18.3–44.3) for kit A to 41.5% (95% CI: 28.1–55.9) for kit B and were not significantly different (Table 1). Specificities ranged from 99% (95% CI: 97.10–99.79) for kit C to 99.71% (95% CI: 98.40–99.99) for kit A and were not significantly different (Table 1). Assay agreement was done by pairwise analysis of results among results for all 4 ELISA kits. More than 98% of all assays were in agreement with
values ranging between 0.84 and 0.95. The lowest agreement (98.29%) was between kits A and C, and the highest agreement (99.43%) was between kits B and C (
value: 0.95). No significant differences among kits were found by McNemar's chi-square analysis (Table 2). Receiver operating characteristic curves for all 4 ELISA kits were plotted, and AUC was calculated (Fig. 1). The AUCs were 0.899 (95% CI: 0.864–0.935), 0.944 (95% CI: 0.915–0.972), 0.853 (95% CI: 0.790–0.916), and 0.815 (95% CI: 0.743–0.887) for kits A, B, C, and D, respectively.
|
|
|
values (>0.84; Table 2). The ROC curve "depicts the trade-off between correctly identifying diseased animals and falsely identifying nondiseased animals for a given test, for all possible values of the test result."9 Such curves are used universally for test comparisons even when the tests have different cutoff values or different units of measurement. The AUC is a measure of overall test performance with a perfect test having an AUC of 1.0, and a nondiscriminating test an area of 0.5.9 In the present study, kit B had the highest overall accuracy (AUC = 0.944). The other 3 kits had a moderate accuracy with AUC values of 0.899, 0.853, and 0.815 for kits A, C, and D, respectively. Based on the results of the present study on Chilean dairy cattle, it was concluded that there were no significant differences among the 4 commercial ELISA kits for bovine paratuberculosis. This suggests that any of the 4 kits could be appropriate for herd certification and for paratuberculosis control programs on Chilean dairy cattle. Other important considerations in kit selection include, but are not limited to, kit versatility (e.g., ability to test for antibodies in serum and milk), cost, availability, and frequency of use in other laboratories in the same country or around the world.
| Acknowledgments |
|---|
| Sources and manufacturers |
|---|
|
|
|---|
a. Allied Monitor, Inc., Fayette, MO. ![]()
b. Sigma-Aldrich Co., St. Louis, MO. ![]()
d. IDEXX Mycobacterium paratuberculosis Antibody Test Kit, IDEXX Laboratories, Inc., Westbrook, ME. ![]()
e. ID Screen Paratuberculosis Indirect, ID Vet, Montpellier, France. ![]()
f. Monocupule Kit, Institut Pourquier, Montpellier, France. ![]()
g. Parachek Johne's Absorbed EIA, Biocor Animal Health, Omaha, NE. ![]()
h. GraphPad Software, San Diego, CA. ![]()
| References |
|---|
|
|
|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |