Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 14, Number 6—June 2008

Validation of Syndromic Surveillance for Respiratory Pathogen Activity

Cees van den Wijngaard*Comments to Author , Liselotte van Asten*, Wilfrid van Pelt*, Nico J.D. Nagelkerke†, Robert Verheij‡, Albert J. de Neeling*, Arnold Dekkers*, Marianne A.B. van der Sande*, Hans van Vliet*, and Marion P.G. Koopmans*
Author affiliations: *National Institute for Public Health and the Environment, Bilthoven, the Netherlands; †United Arab Emirates University, Al-Ain, United Arab Emirates; ‡Netherlands Institute of Health Services Research, Utrecht, the Netherlands;

Main Article

Table 1

Registries from which syndrome data were obtained, the Netherlands, 1999–2004*

Data type Period % Coverage† Respiratory syndrome definitions‡ Analyzed data International code system Registry
Absenteeism 2002–2003 80§ Reported sick employees; no further medical information Sick leave reports of employees Statistics Netherlands (CBS),
General practice consultations 2001–2004 1–2 Symptoms and diagnoses indicating respiratory infectious disease Symptoms and diagnoses recorded in practice or telephone consultations and in home visits ICPC Netherlands Information Network of General Practice (LINH),
Pharmacy dispensations 2001–2003 85 Prescribed medications indicative for respiratory infectious disease Prescription medications dispensed in Dutch pharmacies, coded according to the WHO ATC classification ATC Foundation for Pharmaceutical Statistics,
Hospitalization 1999–2004 99 General respiratory symptoms/diagnoses; specific respiratory biologic agent diagnoses Discharge and secondary diagnoses, date of hospitalization ICD-9-CM Dutch National Medical Register (LMR)
Laboratory submissions¶ 2001–2004 (1999–2000 excluded due to unstable coverage) 16 All submissions for microbiologic diagnostic tests on respiratory materials; all submissions for serologic testing on known specific respiratory pathogens; all submissions for Legionella or Streptococcus pneumoniae antigen tests on urine Laboratory submission requests for diagnostic testing National Infectious Diseases Information System (ISIS) (13)
Mortality 1999–2004 100 General respiratory symptoms/diagnoses; specific respiratory biologic agent diagnoses Date of death, primary cause of death, complicating factors, other additional causes of death ICD-10 CBS

*ICPC, International Classification of Primary Care; WHO, World Health Organization; ATC, Anatomic Therapeutic Chemical Classification System; ICD-9-CM, International Classification of Diseases, 9th revision, Clinical Modification; ICD-10, International Classification of Diseases, 10th revision.
†Percentage of total population, 16.3 million.
‡For detailed syndrome definitions and codes, see Technical Appendix.
§Percentage of working population, 8 million.
¶Diagnostic test requests with both negative and positive results.

Main Article

  1. Buehler  JW, Berkelman  RL, Hartley  DM, Peters  CJ. Syndromic surveillance and bioterrorism-related epidemics. Emerg Infect Dis. 2003;9:1197204.PubMedGoogle Scholar
  2. Lazarus  R, Kleinman  KP, Dashevsky  I, DeMaria  A, Platt  R. Using automated medical records for rapid identification of illness syndromes (syndromic surveillance): the example of lower respiratory infection. BMC Public Health. 2001;1:9. DOIPubMedGoogle Scholar
  3. Fleming  DM, Barley  MA, Chapman  RS. Surveillance of the bioterrorist threat: a primary care response. Commun Dis Public Health. 2004;7:6872.PubMedGoogle Scholar
  4. Miller  M, Roche  P, Spencer  J, Deeble  M. Evaluation of Australia’s National Notifiable Disease Surveillance System. Commun Dis Intell. 2004;28:31123.PubMedGoogle Scholar
  5. Ohkusa  Y, Shigematsu  M, Taniguchi  K, Okabe  N. Experimental surveillance using data on sales of over-the-counter medications—Japan, November 2003–April 2004. MMWR Morb Mortal Wkly Rep. 2005;54(Suppl):4752.PubMedGoogle Scholar
  6. Heffernan  R, Mostashari  F, Das  D, Karpati  A, Kuldorff  M, Weiss  D. Syndromic surveillance in public health practice, New York City. Emerg Infect Dis. 2004;10:85864.PubMedGoogle Scholar
  7. Mostashari  F, Fine  A, Das  D, Adams  J, Layton  M. Use of ambulance dispatch data as an early warning system for communitywide influenzalike illness, New York City. J Urban Health. 2003;80:1i9. DOIPubMedGoogle Scholar
  8. Rotz  LD, Khan  AS, Lillibridge  SR, Ostroff  SM, Hughes  JM. Public health assessment of potential biological terrorism agents. Emerg Infect Dis. 2002;8:22530.PubMedGoogle Scholar
  9. Lazarus  R, Kleinman  K, Dashevsky  I, Adams  C, Kludt  P, DeMaria  A Jr, Use of automated ambulatory-care encounter records for detection of acute illness clusters, including potential bioterrorism events. Emerg Infect Dis. 2002;8:75360.PubMedGoogle Scholar
  10. Buckeridge  DL. Outbreak detection through automated surveillance: a review of the determinants of detection. J Biomed Inform. 2007;40:3709. DOIPubMedGoogle Scholar
  11. Heijnen  ML, Dorigo-Zetsma  JW, Bartelds  AI, Wilbrink  B, Sprenger  MJ. Surveillance of respiratory pathogens and influenza-like illnesses in general practices—the Netherlands, winter 1997–98. Euro Surveill. 1999;4:814.PubMedGoogle Scholar
  12. Hertzberger  LI, Huisman  J, Wilterdink  JB. The global eradication of polio by the year 2000 [in Dutch]. Ned Tijdschr Geneeskd. 1998;142:9723.PubMedGoogle Scholar
  13. Widdowson  MA, Bosman  A, van Straten  E, Tinga  M, Chaves  S, van Eerden  L, Automated, laboratory-based system using the Internet for disease outbreak detection, the Netherlands. Emerg Infect Dis. 2003;9:104652.PubMedGoogle Scholar
  14. Van den Brandhof  WE, Kroes  ACM, Bosman  A, Peeters  MF, Heijnen  MLA. Reporting virus diagnostics in the Netherlands: representativeness of the virological weekly reports [in Dutch]. Infectieziekten Bulletin. 2002;13:110–3 [cited 2008 Apr 8]. Available from
  15. Akaike  H. A new look at statistical model identification. IEEE Trans Automat Contr. 1974;19:71623. DOIGoogle Scholar
  16. Avadhanula  V, Rodriguez  CA, Devincenzo  JP, Wang  Y, Webby  RJ, Ulett  GC, Respiratory viruses augment the adhesion of bacterial pathogens to respiratory epithelium in a viral species– and cell type–dependent manner. J Virol. 2006;80:162936. DOIPubMedGoogle Scholar
  17. Hament  JM, Aerts  PC, Fleer  A, Van Dijk  H, Harmsen  T, Kimpen  JL, Enhanced adherence of Streptococcus pneumoniae to human epithelial cells infected with respiratory syncytial virus. Pediatr Res. 2004;55:9728. DOIPubMedGoogle Scholar
  18. Kim  PE, Musher  DM, Glezen  WP, Rodriguez-Barradas  MC, Nahm  WK, Wright  CE. Association of invasive pneumococcal disease with season, atmospheric conditions, air pollution, and the isolation of respiratory viruses. Clin Infect Dis. 1996;22:1006.PubMedGoogle Scholar
  19. Hament  JM, Kimpen  JL, Fleer  A, Wolfs  TF. Respiratory viral infection predisposing for bacterial disease: a concise review. FEMS Immunol Med Microbiol. 1999;26:18995. DOIPubMedGoogle Scholar
  20. Heisterkamp  SH, Dekkers  AL, Heijne  JC. Automated detection of infectious disease outbreaks: hierarchical time series models. Stat Med. 2006;25:417996. DOIPubMedGoogle Scholar
  21. Dekkers  ALM, Heisterkamp  SH. NPBats, Bayesian statistical instrument for trend detection and time-series modelling [in Dutch]. National Institute for Public Health and the Environment (RIVM), 2004; internal report 550002006 [cited 2008 Apr 15]. Available from
  22. Miller  B, Kassenborg  H, Dunsmuir  W, Griffith  J, Hadidi  M, Nordin  JD, Syndromic surveillance for influenzalike illness in ambulatory care network. Emerg Infect Dis. 2004;10:180611.PubMedGoogle Scholar
  23. Brillman  JC, Burr  T, Forslund  D, Joyce  E, Picard  R, Umland  ET. Modeling emergency department visit patterns for infectious disease complaints: results and application to disease surveillance. BMC Med Inform Decis Mak. 2005;5:4. DOIPubMedGoogle Scholar
  24. Bourgeois  FT, Olson  KL, Brownstein  JS, McAdam  AJ, Mandl  KD. Validation of syndromic surveillance for respiratory infections. Ann Emerg Med. 2006;47:265.e1.
  25. Smith  G, Hippisley-Cox  J, Harcourt  S, Heaps  M, Painter  M, Porter  A, Developing a national primary care-based early warning system for health protection—a surveillance tool for the future? Analysis of routinely collected data. J Public Health (Oxf). 2007;29:7582. DOIPubMedGoogle Scholar
  26. Vergu  E, Grais  RF, Sarter  H, Fagot  JP, Lambert  B, Valleron  AJ, Medication sales and syndromic surveillance, France. Emerg Infect Dis. 2006;12:41621.PubMedGoogle Scholar
  27. Cooper  DL, Smith  GE, Edmunds  WJ, Joseph  C, Gerard  E, George  RC. The contribution of respiratory pathogens to the seasonality of NHS Direct calls. J Infect. 2007;55:2408. DOIPubMedGoogle Scholar
  28. Fisman  DN. Seasonality of infectious diseases. Annu Rev Public Health. 2007;28:12743. DOIPubMedGoogle Scholar
  29. van Rossum  CT, Shipley  MJ, Hemingway  H, Grobbee  DE, Mackenbach  JP, Marmot  MG. Seasonal variation in cause-specific mortality: are there high-risk groups? 25-year follow-up of civil servants from the first Whitehall study. Int J Epidemiol. 2001;30:110916. DOIPubMedGoogle Scholar
  30. Den Boer  JW, Yzerman  EP, Schellekens  J, Lettinga  KD, Boshuizen  HC, Van Steenbergen  JE, A large outbreak of Legionnaires’ disease at a flower show, the Netherlands, 1999. Emerg Infect Dis. 2002;8:3743.PubMedGoogle Scholar
  31. Gwaltney  JM Jr, Hendley  JO, Simon  G, Jordan  WS Jr. Rhinovirus infections in an industrial population. I. The occurrence of illness. N Engl J Med. 1966;275:12618.PubMedGoogle Scholar
  32. Dales  RE, Schweitzer  I, Toogood  JH, Drouin  M, Yang  W, Dolovich  J, Respiratory infections and the autumn increase in asthma morbidity. Eur Respir J. 1996;9:727. DOIPubMedGoogle Scholar
  33. Gageldonk-Lafeber  AB, Heijnen  ML, Bartelds  AI, Peters  MF, van der Plas  SM, Wilbrink  B. A case-control study of acute respiratory tract infection in general practice patients in the Netherlands. Clin Infect Dis. 2005;41:4907. DOIPubMedGoogle Scholar
  34. Allander  T, Tammi  MT, Eriksson  M, Bjerkner  A, Tiveljung-Lindell  A, Andersson  B. Cloning of a human parvovirus by molecular screening of respiratory tract samples. Proc Natl Acad Sci U S A. 2005;102:128916. DOIPubMedGoogle Scholar
  35. Drosten  C, Gunther  S, Preiser  W, van der Werf  S, Brodt  HR, Becker  S, Identification of a novel coronavirus in patients with severe acute respiratory syndrome. N Engl J Med. 2003;348:196776. DOIPubMedGoogle Scholar
  36. Van der Hoek  L, Pyrc  K, Jebbink  MF, Vermeulen-Oost  W, Berkhout  RJ, Wolthers  KC, Identification of a new human coronavirus. Nat Med. 2004;10:36873. DOIPubMedGoogle Scholar
  37. Cooper  DL, Smith  GE, Chinemana  F, Joseph  C, Loveridge  P, Sebastionpillai  P, Linking syndromic surveillance with virological self-sampling. Epidemiol Infect. 2008;136:2224. DOIPubMedGoogle Scholar
  38. Bravata  DM, McDonald  KM, Smith  WM, Rydzak  C, Szeto  H, Buckeridge  DL, Systematic review: surveillance systems for early detection of bioterrorism-related diseases. Ann Intern Med. 2004;140:91022.PubMedGoogle Scholar

Main Article

Page created: July 09, 2010
Page updated: July 09, 2010
Page reviewed: July 09, 2010
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.