Volume 18, Number 7—July 2012
Timeliness of Nongovernmental versus Governmental Global Outbreak Communications
To compare the timeliness of nongovernmental and governmental communications of infectious disease outbreaks and evaluate trends for each over time, we investigated the time elapsed from the beginning of an outbreak to public reporting of the event. We found that governmental sources improved the timeliness of public reporting of infectious disease outbreaks during the study period.
Rapid public communication of incipient disease threats, even with incomplete information, might enable quicker response measures, including enhanced disease surveillance and initiation of protective measures, for those at risk (1). Traditionally, public notifications are communicated through a hierarchical infrastructure from which local, provincial or state, and national health authorities obtain information by interacting with health care providers and diagnostic laboratories (2). However, many health authorities now rely on informal outbreak-reporting systems, such as ProMED-mail, for timely signals of infectious threats (3,4), as encouraged by the revised WHO International Health Regulations (5). Research has suggested that globally, informal sources provide outbreak warnings faster than traditional governmental reporting mechanisms (6). However, existing research of this assertion has been limited to disease-specific evaluations (7) or descriptive summaries (8). We compared the timeliness of initial outbreak communications cited by nongovernmental sources to those of governmental sources and examined temporal trends in the time from outbreak onset to public communication for outbreaks communicated by each source, independently.
The study database consisted of 398 unique human infectious disease outbreak events collected from Disease Outbreak News, published online by the World Health Organization during 1996–2009 (9). For each outbreak, we defined the initial source or sources of the first public communication as the individual, organization, or website that first publicly communicated information regarding the disease threat (locally or internationally, orally or in writing). The corresponding date of communication was identified by using outbreak reports disseminated by ProMED-mail (10). All outbreaks were categorized as having been first communicated by >1 nongovernmental or governmental source, or simultaneously by both types of sources. When an outbreak was simultaneously first communicated by nongovernmental and governmental sources (n = 5), the outbreak was repeated in the dataset and each source was given credit. This adjustment increased the number of outbreak events to 403.
To characterize the timeliness of outbreak communications, for each reporting source of an event, we calculated the median time in days, and bootstrapped 95% CI, from outbreak start to public communication (Table 1). Median reporting times were calculated for the entire study period (1996–2009), before and after public recognition of severe acute respiratory syndrome (SARS) (March 12, 2003), and for each WHO-defined geographic region. The effect of the initial reporting source on the timeliness of outbreak communication was quantified by using negative binomial regression after adjusting for geographic region and whether the outbreak occurred before or after SARS. These variables were included in the model on the basis of a priori assumptions that public health infrastructure can vary by geographic and political region and that new pandemic preparedness strategies, including use of informal information to initiate public health responses, were developed in response to the SARS epidemic (11). Interaction terms between each variable were examined but were not included in the final model because none reached statistical significance (p>0.05). Temporal trends were assessed by using univariate negative binomial regression models, stratified by source category. These models included 1 covariate for the year of outbreak start.
Of all initial outbreak reports identified, 137 were excluded from analysis for ≥1 of the following reasons (Figure 1): 117 (85%) of the excluded reports were missing information on the estimated outbreak start date; 20 (15%) were not found in the ProMED-mail archives; and 1 (1%) outbreak estimated start date occurred after the date of public communication of the outbreak. Of the 266 (66%) outbreaks included in analysis, 163 (61%) were first publicly communicated by governmental sources, and 103 (39%) were first communicated by nongovernmental sources. Chi-square tests showed no significant differences in the proportions of governmental and nongovernmental sources included in the analysis versus those excluded (p = 0.315).
The median time from estimated outbreak start to initial public communication was 10 days shorter for nongovernmental sources (23 days, 95% CI 20–32) than for governmental sources (33 days, 95% CI 30–45), although this difference was not significant according to the Wilcoxon rank-sum test (p = 0.200) (Table 1). Additionally, multivariate modeling showed no significant difference after covariates were adjusted for (incidence rate ratio [IRR] 0.95, 95% CI 0.77–1.18) (Table 2). The effect of missing data was assessed in sensitivity analyses for all outbreaks for which we had an estimated outbreak start date (17 of 20). When we used the WHO Disease Outbreak News communication date, our results did not change when crediting either governmental sources (IRR = 0.88, 95% CI 0.71–1.09) or nongovernmental sources (IRR = 1.086, 95% CI 0.882–1.336).
Examination of temporal trends over the study period (Figure 2) showed that nongovernmental sources generally communicated outbreak signals to the public faster after 1996, although the trend did not reach statistical significance (IRR = 0.96, 95% CI 0.91–1.01). Governmental sources, in contrast, made significant improvements in lessening the time in which they publicly communicated initial outbreak signals (IRR = 0.94, 95% CI 0.91–0.97).
Our data suggest that, from 1996 through 2006, outbreaks reported initially by nongovernmental sources were communicated publicly an average of 10 days earlier than those reported initially by governmental sources. Though the differences varied, nongovernmental sources tended to report outbreaks faster than governmental sources when we compared outbreaks before and after SARS, or by WHO-defined region. The lack of statistically significant differences in initial communication timeliness by source is probably attributable to a lack of statistical power rather than a lack of effect.
Our results also provide support for the International Health Regulations 2005 revisions that allow WHO to use unofficial information to request verification from member states. Slightly more than one-third of all unique infectious disease outbreaks in the WHO Disease Outbreak News during this 14-year period were initially reported by informal information sources.
Traditional governmental public health reporting mechanisms remain an integral source for outbreak information, accounting for almost two-thirds of all initial reports over this period. Our results also show that these sources made statistically significant improvements in reporting early warnings of outbreak threats more rapidly to the public, which might result in part from a shift toward automated, electronic methods that improve the timeliness of communication (12,13). It is possible that enhancements in nongovernmental outbreak reporting systems also contributed to improvements in governmental outbreak reporting timeliness over the study period, but we were unable to test this assumption with the current data.
This study has potential limitations. We encountered difficulty in selecting and consistently applying criteria to determine the initial source of public communication from ProMED-mail reports, which could have resulted in misclassification bias. Although other reporting systems that use informal information exist, they either lack a publicly available archive (for example, Global Public Health Intelligence Network) (14) or their database did not cover the entire study period (for example, HealthMap) (15). According to Heymann, et al., 65% of outbreaks recognized by WHO are first identified by informal sources (4), a proportion we did not find. Some outbreak reports were excluded because of missing data. We were able to internally validate the data that remained, but these exclusions limited the study’s statistical power. Finally, use of outbreak reports collected from the WHO Disease Outbreak News might limit the generalizability of our findings to all infectious disease outbreaks. Despite these limitations, our data highlight the value of nongovernmental sources as an integral resource for providing timely information about global infectious disease threats, and demonstrate the significant improvements in the timeliness of outbreak reporting made by governmental sources.
Mr Mondor is a research assistant in The Surveillance Lab at McGill University’s Clinical and Health Informatics Research Group. His research interests include timely disease detection, infectious disease epidemiology, and health care data analysis.
This research was supported by a grant from Google.org and by the National Institutes of Health grants R01 LM010812 and G08 LM009776.
- World Health Organization. The world health report—a safer future: global public health in the 21st century. Geneva: The Organization; 2007. p. 1–96.
- Jajosky RA, Groseclose SL. Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health. 2004;4:29.
- Brownstein JS, Freifeld CC, Madoff LC. Digital disease detection—harnessing the Web for public health surveillance. N Engl J Med. 2009;360:2153–7.
- Heymann DL, Rodier GR; WHO Operational Support Team to the Global Outbreak Alert and Response Network. Hot spots in a wired world: WHO surveillance of emerging and re-emerging infectious diseases. Lancet Infect Dis. 2001;1:345–53.
- World Health Organization. International Health Regulations, 2nd ed. Geneva: The Organization; 2005.
- Wilson K, Brownstein JS. Early detection of disease outbreaks using the Internet. CMAJ. 2009;180:829–31.
- Brownstein JS, Freifeld CC, Chan EH, Keller M, Sonricker AL, Mekaru SR, Information technology and global surveillance of cases of 2009 H1N1 influenza. N Engl J Med. 2010;362:1731–5.
- Grein TW, Kamara KB, Rodier G, Plant AJ, Bovier P, Ryan MJ, Rumors of disease in the global village: outbreak verification. Emerg Infect Dis. 2000;6:97–102.
- Chan EH, Brewer TF, Madoff LC, Pollack MP, Sonricker AL, Keller M, Global capacity for emerging infectious disease detection. Proc Natl Acad Sci U S A. 2010;107:21701–6.
- Madoff LC. ProMED-mail: an early warning system for emerging diseases. Clin Infect Dis. 2004;39:227–32.
- Heymann DL, Rodier G. Global surveillance, national surveillance, and SARS. Emerg Infect Dis. 2004;10:173–5.
- Overhage JM, Grannis S, McDonald CJ. A comparison of the completeness and timeliness of automated electronic laboratory reporting and spontaneous reporting of notifiable conditions. Am J Public Health. 2008;98:344–50.
- Ward M, Brandsema P, van Straten E, Bosman A. Electronic reporting improves timeliness and completeness of infectious disease notification, the Netherlands, 2003. Euro Surveill. 2005;10:27–30.
- Mykhalovskiy E, Weir L. The Global Public Health Intelligence Network and early warning outbreak detection: a Canadian contribution to global public health. Can J Public Health. 2006;97:42–4.
- Freifeld CC, Mandl KD, Reis BY, Brownstein JS. HealthMap: global infectious disease monitoring through automated classification and visualization of Internet media reports. J Am Med Inform Assoc. 2008;15:150–7.