JVDI Advertisement
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


Journal of Veterinary Diagnostic Investigation Vol. 21 Issue 2, 240-243
Copyright © 2009 by the American Association of Veterinary Laboratory Diagnosticians
This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Muñoz-Zanzi, C.
Right arrow Articles by Lauer, D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Muñoz-Zanzi, C.
Right arrow Articles by Lauer, D.

Brief Research Reports

Field estimation of the flock-level diagnostic specificity of an enzyme-linked immunosorbent assay for Avian metapneumovirus antibodies in turkeys

Claudia Muñoz-Zanzi1, Darrell Trampel, Tim Hanson, Kristen Harrison, Sagar Goyal, Roberto Cortinas and Dale Lauer

Correspondence: 1Corresponding Author: Claudia Muñoz-Zanzi, 1300 S Second Street, Suite 300, Minneapolis, MN 55454, e-mail: munozzan{at}umn.edu


    Abstract
 TOP
 Sources and manufacturers
 Abstract
 References
 
Routine serologic testing for Avian metapneumovirus (AMPV) infection of turkey flocks at slaughter is currently being used to monitor changes in the occurrence of AMPV infection in endemic areas and can also be used to detect the emergence of infection in currently unaffected areas. Because of the costs associated with false-positive results, particularly in areas that are free of AMPV infection, there is a need to obtain improved estimates of flock-level specificity (SP). The objective of this study was to estimate flock-level SP of a program to monitor AMPV infection in turkey flocks at processing using a standard enzyme-linked immunosorbent assay (ELISA). A study was carried out in which 37 AMPV-free flocks from 7 Midwest operations were followed serologically. Six percent, 3%, and 0.2% of total samples tested AMPV positive at 8 weeks, 12 weeks, and at processing, respectively. Overall, flock-level SP increased as the cutoff increased and as age increased. Flock-level SP at processing was 97%, if a cutoff of 1 was used (the flock was classified as positive if at least 1 sample tested positive), and 100%, if any other cutoff was used. Administration of antibiotics (P = 0.02) and vaccination for Bordetella avium (P = 0.08) were positively associated with the probability of (false) positive test results. These findings suggest possible cross-reactions with other infections and highlight the need to consider variable diagnostic performance depending on farm conditions.

Key Words: Avian metapneumovirus • diagnostics • enzyme-linked immunosorbent assay • specificity • turkeys

Avian metapneumovirus (AMPV; order Mononegavirales; family Paramyxoviridae; subfamily Pneumovirinae; genus Metapneumovirus)11 is an RNA virus that was first identified in the United States in 1996 from a commercial turkey flock in Colorado following an outbreak of upper respiratory disease.14 In 1997, the virus was detected in Minnesota, where it became endemic in subsequent years8 with a flock seroprevalence ranging from 14% to 65%.9 The virus was later detected in other states, including North Dakota, South Dakota, and Wisconsin.2,13 The incidence of AMPV outbreaks in domestic turkeys in Minnesota has shown a seasonal trend, with most outbreaks occurring in spring and fall. It has been speculated that this pattern could be explained by migrations of wild birds, which may serve as reservoirs for AMPV.2 Impact of AMPV infection on flock health includes decreased egg production, morbidity up to 100% in flocks showing clinical disease, and mortality that can be a low as 0.4% or as high as 50%.7

Routine serologic testing for AMPV infection of turkey flocks at slaughter is currently being used to monitor changes in the occurrence of AMPV infection in endemic areas and can also be used to detect the emergence of infection in currently unaffected areas. The goal of a monitoring program at slaughter is to identify infected flocks through detection of AMPV antibodies. However, serologic assays are not perfect, and false-positive and false-negative results are expected. Consequently, knowledge of the accuracy of the diagnostic test is needed to interpret the observed results appropriately. Avian metapneumovirus serologic testing is commonly done using an enzyme-linked immunosorbent assay (ELISA), which has been evaluated to some extent. Accuracy evaluations have been performed using samples from individual birds under experimental infection settings. Reported estimates of diagnostic sensitivity (SE) for ELISA include 98%12 and 99%,10 and estimates of 98%12 and 99.5%10 for diagnostic specificity (SP). Because the interest of a monitoring program is to identify infected flocks as accurately as possible, and not necessarily individual infected birds, the parameters of diagnostic performance needed are flock-level SE and SP. Flock-level SE is defined as the probability that an infected flock is classified as infected, and flock-level SP is defined as the probability that an uninfected flocks is classified as uninfected. Because of the costs associated with false-positive results, particularly in areas that are free of AMPV infection, there is a need to obtain improved estimates of flock-level SP. The objective of the current study was to estimate flock-level SP of a program to monitor AMPV infection in turkeys at processing using a standard ELISA and to describe possible factors associated with false-positive results.

The objective was accomplished through a prospective study of AMPV-free flocks, which were tested for AMPV antibodies at various times. Turkey producers from a geographic area of Iowa known to be free of AMPV, based on historical evidence of no infection, were invited to participate in the study. A total of 7 farms were enrolled in the study based on their willingness to collaborate by enrolling flocks in the prospective study. Farms can be considered representative of independent, family-owned turkey production facilities in the Midwest. The target sample size for number of flocks was based on an expected value for flock-level SP of 80%, 95% confidence level, margin of error of 20%, and a 50% increase beyond the recommended sample size to allow further statistical analysis. A questionnaire was administered to the farm owner to request information associated with each flock enrolled in the prospective study, including hatch date, placement date, flock size, mortality, vaccinations, treatments, clinical disease, sampling dates, and processing date.

Blood samples were obtained by venipuncture in collaboration with the farm owner at 8 weeks and 12 weeks of age and immediately before processing for slaughter. At each sampling, 20 birds were randomly selected from each flock and bled to obtain 2 ml of blood, which was sent to the Iowa Veterinary Diagnostic Laboratory (Ames, IA) for processing. Sera were stored at –20°C until testing at the Minnesota Poultry Testing Laboratory (Willmar, MN). The current AMPV surveillance protocol in Minnesota involves sampling10 birds per flock; however, based on the known negative correlation between sample size and population-level SP,5 the number of birds per flock was doubled to obtain a more conservative estimate of flock-level SP.

Samples were tested for AMPV using the same ELISA procedure that is used as part of the routine AMPV monitoring program in Minnesota.4 Briefly, serum samples were diluted 1:40 in dilution:blocking buffer and added to 2 virus antigen-coated wells (antigen prepared in Vero [African green monkey kidney] cells) and 2 control antigen-coated wells (equally processed uninfected Vero cells) at 50 µl/well. Known positive and negative control sera were included in each plate. The plates were covered, incubated at room temperature for 1 hr, washed 5 times, and blotted dry. The conjugate was diluted in diluting-blocking buffer and added to each well at 50 µl/well. After incubation at room temperature for 1 hr, the conjugate was removed, and the plates were washed 5 times and blotted dry. Substrate solution was added to each well at 100 µl/well. After incubation in the dark for 10 min, the reaction was stopped by adding 25 µl of 2.5 mol sulfuric acid to each well, and the optical density (OD) was read at 490/405 nm. The results were expressed as the average OD difference (ODD) between virus antigen-coated and control wells of each serum. A sample with ODD of ≥0.2 was considered positive. Additionally, samples were tested for Newcastle disease virus (NDV), Avian influenza virus (AIV), and Bordetella avium, as a predetermined respiratory disease panel using commercially available ELISA diagnostic test kits.a

Descriptive statistics (means, proportions, and standard deviations) were used to characterize the management and sanitary conditions of the farms and flocks enrolled in this study. Traditionally, monitoring programs assume that a flock is infected if at least 1 sample tested positive; however, sometimes this flock-level cutoff is arbitrarily increased because of concern with false-positive results. For a given sampling, flocks in the current study were classified based on AMPV infection status using flock-level cutoffs from 1 through 4 positive samples. Flock-level, diagnostic SP for a monitoring program based on testing 20 birds per flock was defined as the proportion of these AMPV-free flocks that were correctly classified as AMPV negative. To account for the correlation of flocks within farms, population-averaged estimates of flock-level SP and 95% confidence intervals (CI) were calculated using a generalized estimating equation model for binomial data and a exchangeable correlation structure.1 The same model was used to assess the potential effect of flock factors, including flock size, mortality, clinical disease, vaccination, treatments, and serostatus for other infections on the probability of (false) positive AMPV results. The assumption of linearity in the ln(odds) for continuous variables (mortality proportion, proportion positive for NDV, AIV, and B. avium) was assessed by categorizing each variable and visually inspecting a plot of the estimates of ln(odds) against the midpoint of the categories.6 Because of limited sample size for the statistical analysis, a P-value of <0.1 was considered statistically significant. All statistical analysis was performed using available computer packages.b,c

A total of 37 flocks from 7 different farms were followed prospectively from 8 weeks of age until processing at approximately 21 weeks of age. Between 1 and 13 flocks per farm were enrolled. Avian metapneumovirus test results were available for 732 birds at 8 weeks of age, 721 birds at 12 weeks of age, and 465 birds at processing. Questionnaire information was available for 28 flocks, which was used to describe the characteristics of the farms and flocks (Table 1). The majority of the flocks had ≥10,000 birds and were administered routine vaccinations for B. avium and Hemorrhagic enteritis virus. Observation of the distributions of the bird-level crude ODD values showed a shift to the left as age increased (Fig. 1) and, therefore, the number of samples that yielded a positive AMPV ELISA (ODD ≥0.2) decreased with time. A total of 42 of 732 (6%) samples tested AMPV positive at the first sampling, 20 of 721 (3%) at the second sampling, and 1 of 465 (0.2%) at processing.


View this table:
[in this window]
[in a new window]

 
Table 1 Description of Avian metapneumovirus–free turkey flocks (n = 28) used for the estimation of diagnostic specificity of a monitoring program based on enzyme-linked immunosorbent assay testing at processing.

 

Figure 01
View larger version (15K):
[in this window]
[in a new window]

 
Figure 1 Distribution of enzyme-linked immunosorbent assay (ELISA) titers for Avian metapneumovirus (AMPV) in turkeys from known AMPV-free flocks from Iowa at 8 weeks of age, 12 weeks of age, and at processing. OD = optical density.

 
Flock-level AMPV results are shown in Table 2. As expected, increasing the cutoff for classifying a flock as AMPV-infected resulted in a decrease in the number of flocks classified as positive. Using a cutoff of 1 (the flock was classified as positive if at least 1 sample tested positive), resulted in 6, 5, and 1 flock(s) classified as positive at first sampling, second sampling, and at processing, respectively. This decrease in the number of flocks classified as positive as age increased was observed for each classification cutoff. Among flocks that were classified as positive using a cutoff of 1, the proportion of positive samples ranged from 5% to 55% at the first sampling and from 5% to 25% at the second sampling. The single flock that was classified as positive at processing had 6.7% of positive samples. Overall, flock-level SP increased as the cutoff increased and as age increased. For example, flock-level SP with a cutoff of 1 was 79% and increased to 89% when a cutoff of 4 positive samples was used. Because of the decrease in the number of AMPV-positive samples as age increased, by the time of the sampling at processing, flock-level SP was 97%, if a cutoff of 1 was used, and 100%, if any other cutoff was used (Table 2). Consequently, results from the current study indicate that serologic monitoring at processing for the prevalence of AMPV-infected turkey flocks would have high SP, particularly if cutoffs of >1 positive sample are used to classify flocks as positive.


View this table:
[in this window]
[in a new window]

 
Table 2 Results of a field study to estimate the diagnostic specificity of an enzyme-linked immunosorbent assay for Avian metapneumovirus (AMPV) in turkey flocks at various ages based on individual testing of 20 samples per flock.*

 
It is important to note that increasing the cutoff to >1 positive sample to maximize flock-level SP could potentially decrease the flock-level SE of the program, leading to infected flocks being incorrectly classified as not infected. Investigation of flock-level SE was not the aim of the present study; however, based on reportedly high values of bird-level diagnostic SE12 and likely high proportion of seropositive birds in infected flocks (within-flock prevalence) by processing time, high values for flock-level SE can be expected. Theoretically, flock-level SE for a monitoring program based on testing 20 birds/flock can be as high as 100%, when assuming a within-flock prevalence of infection of >40%, a cutoff of 1, and a test with a bird-level SE of 98%12 and a bird-level SP of 99.8% (obtained from the current study).6 Estimates of the diagnostic accuracy of an AMPV monitoring program (flock-level SE and SP) can be used to calculate the predictive values of test results5 and to help with their epidemiologic interpretation. For example, assuming a scenario where 15% of the flocks are truly infected, the flock-level SP of 97% obtained here, and a flock-level SE of 100%, would result in a predictive-value positive of 85% (85% probability that a flock classified as infected is truly AMPV infected) and a predictive-value negative of 100% (100% probability that a flock classified as not infected is truly not infected). Knowledge of these diagnostic performance parameters is crucial to design effective AMPV monitoring programs and to interpret results appropriately.

An interesting finding of the present study was that the likelihood of (false) positive results decreased as age increased (Table 2). This could be explained by potential cross-reactions with maternal immunity, which wanes gradually over time; however, it commonly disappears by 4 weeks after hatch.3 Statistical analysis of the factors associated with the probability of a (false) AMPV-positive flock was performed with data from the first sampling and a cutoff of 1. Results suggested that administration of antibiotics any time before the first sampling (P = 0.02) and vaccination for B. avium <14 days before the first sampling (P = 0.08) were positively associated with the probability of (false) positive test results. These associations are indicative of possible cross-reactions of the AMPV test with immune responses to the vaccines and/or other infections that were not examined in this study. The fact that 77% of the vaccinations or treatments occurred before the first sampling may help explain the decrease over time in the number of false positive results that was observed. The potential effect of cross-reactions highlights the need to consider variable performance of diagnostic depending on farm conditions. Overall, findings from this study suggest that monitoring for AMPV at processing is highly specific; however, estimates of SP cannot be extrapolated to other poultry farming systems, such as backyard flocks, or large, vertically integrated commercial farms, or farms from different geographical areas.


    Acknowledgments
 
The authors thank the turkey producers that participated in the study and the laboratory personnel at the Iowa and Minnesota Veterinary Diagnostic Laboratories and the Minnesota Poultry Testing Laboratory for sample processing and testing. This study was funded by Minnesota Turkey Research and Promotion Council (Project 2005-05) and a U.S. Department of Agriculture–Cooperative State Research, Education, and Extension Service Special Research Grant to the Midwest Poultry Consortium.


    Sources and manufacturers
 TOP
 Sources and manufacturers
 Abstract
 References
 
From the Divisions of Epidemiology and Community Health (Muñoz-Zanzi, Harrison) and Biostatistics (Hanson), School of Public Health, University of Minnesota, Minneapolis, MN; the Departments of Veterinary and Biomedical Sciences (Cortinas) and Veterinary Population Medicine (Goyal), College of Veterinary Medicine, University of Minnesota, St. Paul, MN; the Department of Veterinary Diagnostic and Production Animal Medicine, College of Veterinary Medicine, Iowa State University, Ames, IA (Trampel); and the Minnesota Poultry Testing Laboratory, University of Minnesota, Minnesota Board of Animal Health, Willmar, MN (Lauer). Back

Synbiotics Corporation, San Diego, CA. Back

R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing, Vienna, Austria. Back

Excel® 2007, Microsoft Corporation, Seattle, WA. Back


    References
 TOP
 Sources and manufacturers
 Abstract
 References
 

  1. Agresti A. 2002 Categorical data analysis Wiley-Interscience New York, NY.
  2. Bennett R.S., Nezworski J., Velayudhan B.T., et al. 2004 Evidence of avian pneumovirus spread beyond Minnesota among wild and domestic birds in Central North America. Avian Dis 48 902 908.[Medline]
  3. Bermudez A.J., Stewart-Brown B. 2003 Disease prevention and diagnosis. In: Diseases of poultry Saif Y.M. 11th ed. 17 54 Iowa State Press Ames, IA.
  4. Chiang S., Dar A.M., Goyal S.M., et al. 2000 A modified enzyme-linked immunosorbent assay for the detection of avian pneumovirus antibodies. J Vet Diagn Invest 12 381 384.[Abstract/Free Full Text]
  5. Christensen J., Gardner I.A. 2000 Herd-level interpretation of test results for epidemiologic studies of animal diseases. Prev Vet Med 45 83 106.[Medline]
  6. Dohoo I., Martin W., Stryhn H. 2003 Veterinary epidemiologic research AVC Inc Prince Edward Island, Canada.
  7. Gough R.E. 2003 Avian pneumoviruses. In: Diseases of poultry Saif Y.M. 11th ed. 92 100 Iowa State Press Ames, IA.
  8. Goyal S.M., Chiang S.J., Dar A.M., et al. 2000 Isolation of avian pneumovirus from an outbreak of respiratory illness in Minnesota turkeys. J Vet Diagn Invest 12 166 168.[Abstract/Free Full Text]
  9. Goyal S.M., Lauer D., Friendshuh K., Halvorson D.A. 2003 Seroprevalence of avian pneumovirus in Minnesota turkeys. Avian Dis 47 700 706.[Medline]
  10. Heckert R.A., Myers D.J., Afshar A., Riva J. 1994 Development and evaluation of an enzyme-linked immunosorbent assay for the detection of antibodies to avian pneumovirus. Avian Dis 38 694 700.[Medline]
  11. International Committee on Taxonomy of Viruses 2000 Virus taxonomy: seventh report of the International Committee on Taxonomy of Viruses Academic Press San Diego, CA.
  12. Maherchandani S., Patnayak D.P., Munoz-Zanzi C.A., et al. 2005 Evaluation of five different antigens in enzyme-linked immunosorbent assay for the detection of avian pneumovirus antibodies. J Vet Diagn Invest 17 16 22.[Abstract/Free Full Text]
  13. Panigrahy B., Senne D.A., Pedersen J.C., et al. 2000 Experimental and serologic observations on avian pneumovirus (APV/turkey/Colorado/97) infection in turkeys. Avian Dis 44 17 22.[Medline]
  14. Senne D., Edson R.K., Pederson J.C., et al. 1997 Avian pneumovirus update. Proc Ann Am Vet Med Assoc 134 190 pp.




This Article
Right arrow Abstract Freely available
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Muñoz-Zanzi, C.
Right arrow Articles by Lauer, D.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Muñoz-Zanzi, C.
Right arrow Articles by Lauer, D.


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS