Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 25, Number 10—October 2019
Research

Economic Burden of West Nile Virus Disease, Quebec, Canada, 2012–2013

Najwa Ouhoummane, Eric Tchouaket, Anne-Marie Lowe, Ann Fortin, Dahlia Kairy, Anne Vibien, Jessica Kovitz-Lensch, Terry-Nan Tannenbaum1, and François MilordComments to Author 
Author affiliations: Institut National de Santé Publique du Quebec, Quebec City, Canada (N. Ouhoummane, A. Fortin, F. Milord); Université du Quebec en Outaouais, Gatineau, Quebec, Canada (E. Tchouaket); Public Health Agency of Canada, Montreal, Quebec, Canada (A.-M. Lowe); Université de Montreal, Montreal, Quebec, Canada (D. Kairy); Centre de Recherche Interdisciplinaire en Réadaptation du Montreal Métropolitain, Montreal (D. Kairy); Centre Intégré de Santé et de Services Sociaux de la Montérégie Est-Hôpital Honoré Mercier, St.-Hyacinthe, Quebec, Canada (A. Vibien, J. Kovitz-Lensch); Institut National de Santé Publique de Montreal, Montreal (T.-N. Tannenbaum); Université de Sherbrooke, Sherbrooke, Quebec, Canada (F. Milord)

Cite This Article

Abstract

The economic burden of West Nile virus (WNV) infection is not known for Canada. We sought to describe the direct and indirect costs of WNV infection in the province of Quebec, Canada, up to 2 years after onset of signs and symptoms. We conducted a retrospective cohort study that included WNV cases reported during 2012 and 2013. For 90 persons infected with WNV, persons with encephalitis accounted for the largest proportion of total cost: a median cost of $21,332 per patient compared with $8,124 for West Nile meningitis (p = 0.0004) and $192 for West Nile fever (p<0.0001). When results were extrapolated to all reported WNV patients, the estimated total cost for 124 symptomatic cases was ≈$1.7 million for 2012 and that for 31 symptomatic cases was ≈$430,000 for 2013. Our study provides information for the government to make informed decisions regarding public health policies and infectious diseases prevention and control programs.

West Nile virus (WNV) infection is endemic to North America. More than 41,000 cases of WNV-related illnesses and 2,000 deaths were reported in the United States between the introduction of the virus in 1999 and 2015 (1). During the same period, 5,310 cases were reported in Canada (2). In Quebec, the first cases were documented in 2002. After a quiet period (2004–2010), this province experienced an outbreak in 2012 (124 symptomatic cases); since 2013, the number of cases has remained stable (average of 30 cases/year) (3).

WNV causes an asymptomatic infection in 80% of cases, but in <1% of cases, a severe illness occurs with neurologic involvement, such as aseptic meningitis, encephalitis, or acute flaccid paralysis (4,5). WNV infection and particularly neurologic disease have been associated with mild to severe clinical manifestations, might require hospitalization, and lead to long-term sequelae and death (6).

To date, 3 studies in the United States have estimated the economic burden of WNV disease (79). These estimates can be used in assessing the cost-effectiveness of various interventions designed to decrease WNV disease risk (8). In the province of Quebec, Canada, a cost-effectiveness analysis was conducted during 2006 (10). However, this study was based on a hypothetical simulation of 2 scenarios (high activity of the virus versus low-activity season); therefore, the cost estimations could be speculative. Thus, in Canada, no data are available on the actual costs of WNV disease, and results from the United States cannot be extrapolated because of differences in the organization of the heathcare systems and costs, WNV disease prevention programs, mean income, and standards of living. Furthermore, exchange rate differences do not accurately reflect real differences in purchasing power (11). The objective of this study was to estimate direct and indirect costs of WNV disease cases in the province of Quebec, Canada, up to 2 years after symptom onset.

Materials and Methods

Study Population

WNV infection is a reportable disease in Quebec. Physicians and laboratories must report all WNV-positive cases to regional public health boards, conduct which epidemiologic investigations to document the infection; determine the likely place of acquisition; and collect sociodemographic and clinical information, such as date of illness onset and clinical syndrome (i.e., uncomplicated fever, meningitis, encephalitis, and acute flaccid paralysis). The data are entered into the integrated system for public health monitoring of West Nile virus, a provincial electronic surveillance system for WNV disease that includes information on humans, mosquitoes, and animals (12). During 2012–2013, a total of 155 symptomatic WNV cases were reported in Quebec.

We asked regional public health boards to contact each of the case-patients to see whether they were willing to participate in a study. A research nurse obtained written consent from all eligible case-patients to participate in a telephone interview and to enable access to their medical charts. Consent was obtained from parents or family of patients who were <18 years of age and for patients who had died. More details on the methods are available in a previous article (6). The study protocol was submitted to the public health research ethics board of the Institut National de Santé Publique du Quebec, which provided a favorable recommendation for the study (13).

Case Definitions

A WNV-positive case includes a laboratory diagnosis of WNV infection by IgM capture enzyme immunoassays for either serum or cerebrospinal fluid samples. In Quebec, after a first IgM-positive case has been confirmed by using a plaque reduction neutralization test, all other IgM-positive cases in the same season are considered to be laboratory confirmed. Cases are further classified according to their clinical manifestations: West Nile fever (WNF, an acute systemic febrile illness), West Nile meningitis (WNM, with stiff neck and cerebrospinal fluid pleocytosis), West Nile encephalitis (WNE, with altered mental status), West Nile meningoencephalitis, and acute flaccid paralysis (AFP, polio-like myelitis, or Guillain-Barré syndrome) (14).

Data Collection

For all eligible patients, we administered a telephone questionnaire 24 months after sign or symptom onset to document medical service, productivity losses, and expenses up to 2 years after the acute phase of WNV disease. We developed the questionnaire on the basis of the study by Staples et al. (8). Participants were asked to document the following items related to their WNV disease after initial hospitalization or consultation: subsequent hospitalization, stay in a rehabilitation center, physiotherapy, occupational therapy, speech therapy, home care, primary care physician consultations, neurologist consultations, medications, medical equipment, recruitment for household chores, and all other personal expenses incurred by the WNV disease. We also considered time off from work for the patient and for family members (to care for the patient). For hospitalized patients, we obtained data for hospital stay, intensive care unit admission, and inpatient rehabilitation from medical records.

Costs Estimation

We based the estimation of costs on the principle of human capital and a societal perspective (relevant costs regardless of who paid) (15). For their initial care, eligible patients either were hospitalized (n = 71), were seen in an emergency department but not hospitalized (n = 10), or consulted with doctor in a clinic (n = 12). For the third group, we did not collect any costs associated with their initial care.

Hospitalization

We obtained costs for initial hospitalization (no subsequent hospitalization was reported) by using the All Patient Refined–Diagnosis-Related Groups (APR-DRG) and the relative use of resources. The APR-DRG provides average costs incurred for inpatient services. These costs include all inpatient allied healthcare, surgical and medical procedures, medication, and laboratory tests. Because permission to access individual costs data was not obtained, we created 19 groups of patients on the basis of 4 criteria: the principal diagnosis of each patient (by using the International Classification of Diseases, 10th Revision), patient’s age (<60 vs. >60 years of age), admission to intensive care unit (yes or no), and diagnostic year (2012 or 2013). Nearly 60% of hospitalized participants had specific principal International Classification of Diseases, 10th Revision, diagnosis code of WNV (A923) (Table 1). For other participants with no specific principal diagnosis code of WNV, WNV infection had to be coded as secondary diagnosis in the APR-DRG database to ensure specificity. The mean and median costs in the APR-DRG for each group were attributed to each patient in the group.

Inpatient Rehabilitation

Cost for inpatient rehabilitation was based on the average daily cost of services in a rehabilitation center for physical disabilities in 2012–2013. This factor was multiplied by the number of days spent in a center, which was obtained from the medical record.

Emergency Department Consultations

For patients seen in an emergency department, the physician service claims database was used to estimate the cost of medical consultations in the emergency department (Canadian $109.90) (16). This rate includes only the physician remuneration. Costs associated with emergency department stays and laboratory examinations and accommodations were not included.

Medical and Paramedical Care up to 2 Years after Sign/Symptom Onset

During the telephone interview, patients were asked to provide information on types and numbers and duration of outpatient medical and paramedical services that they sought after the acute-care period. We obtained estimated costs for these services by multiplying type-specific cost estimates by the number of visits reported (Table 2) (16). The number of follow-up physician visits was missing for 2 participants; a minimum of 1 visit was used for those case-patients.

Medical Equipment

Patients were asked about the acquisition of specific equipment and associated costs. Costs were assigned a value of 0 if the equipment was provided by government or was borrowed.

Recruitment for Household Chores

We obtained information for patients who needed aids for household chores. We also asked them to provide associated costs.

Absence from Work

We obtained information about missed workdays by patients or family members to care for a patient. Patients or family members having a job at their time of their WNV infection were asked to provide the occupation, the number of days they worked per week, and the number of days they missed work (including hospital stay). Income data for each patient or family member were obtained from the wage guide by occupation in Quebec according to their occupation. Productivity losses were estimated by multiplying the time taken off work by a weekly wage.

Occupation data were missing for 2 patients and 2 family members. For these 4 persons, we used the minimum wage. One patient reported stopping work because of his WNV infection. For this patient, we estimated the associated cost as the number of potential years of lost employment (65 minus age at infection). All persons (n = 11) who died during their initial hospitalization were >65 years of age. Therefore, productivity losses caused by death were not taken into account.

Other Personal Expenses

Patients were asked about other costs that they had to assume. For ambulance transportation, the basic cost of Canadian $125 was used.

Data Analysis

For data analysis, we combined West Nile meningoencephalitis cases (n = 18) and AFP cases (n = 2) with WNE cases (n = 28) because of similar clinical manifestations; 1 case with missing information about clinical syndrome was excluded. All analyses were performed according to 3 clinical categories (WNF, WNM, and WNE). We compared proportions by using the χ2 test or Fisher exact test when appropriate. We compared distributions of age and hospital stay by using nonparametric tests (Wilcoxon rank-sum or Kruskal-Wallis tests).

Because cost distributions were not normal, we calculated mean and median values with the interquartile range (IQR). In this study, participants and nonparticipants were comparable with regard to demographic and illness severity (see Results). Thus, we assumed that participants were representative of the total number of WNV cases during 2012 and 2013, and we extrapolated estimated costs to all reported WNV cases according to clinical syndrome, cost category, and year. For each category, we estimated total number of cases (except for hospitalization, for which the exact number of cases was known) and total cost. For example, the total number of WNE case-patients admitted to inpatient rehabilitation (Nt) = total number of WNE case-patients × proportion of WNE case-patients admitted to inpatient rehabilitation. The total cost for this category = Nt × Cp, in which Cp is the inpatient rehabilitation median costs per WNE case-patient.

We performed analyses by using SAS version 9.1 (SAS Institute Inc., https://www.sas.com). A 2-sided p<0.05 was considered statistically significant.

Results

Of the 155 symptomatic WNV patients during 2012–2013, a total of 93 (60%) agreed to participate in the study, but 2 of them could not be reached for the telephone interview and 1 with missing information about clinical syndrome was excluded from analyses. Medical records were available for 81 (87%) patients (71 hospitalizatons and 10 emergency department visits). Participants and nonparticipants were comparable with regard to demographics (except for sex; more women agreed to participate [54% vs. 36%; p = 0.026]) and illness severity (hospitalization, clinical syndrome, and death).

Demographic and Clinical Characteristics

We obtained demographic and clinical characteristics of patients (Table 3). For 90 patients, WNF accounted for 27%, WNM 20%, and WNE 53%. Patients with WNE were significantly older than patients with WNM or WNF; 71% of WNE patients were >60 years of age compared with 22% of WNM patients and 29% of WNF patients (p<0.0001). Most patients with neurologic syndrome were hospitalized. The median hospital stay was longer for WNE patients than for WNM patients (p<0.0001) or WNF patients (p = 0.010). Ten (21%) WNE patients and 1 (6%) WNM patient died during hospitalization. In addition, 3 WNE patients, 2 who were discharged to home with support and 1 requiring rehabilitation services, died during the follow-up period, but their deaths were not considered to be directly related to WNV infection.

Use of Medical and Paramedical Services and Absence of Work

We obtained data for use of medical and paramedical services up to 2 years after the acute phase of WNV disease (Table 4). When we excluded in-hospital deaths, the most common services used by participants were physician visits (66%), followed by medications (41%) and neurologist visits (26%). In general, WNE and WNM patients used more services and WNM participants needed more physician (p = 0.016) and neurologist (p = 0.029) visits. Six WNE patients were admitted to rehabilitation (median length of stay 75 days, range 30–120 days). Most patients who had a job missed work because of their infection (median absence 60 days, range 5–365 days).

Although 41% of patients reported outpatient medication expenses, they could not accurately recall the names and amounts of medication taken. Therefore, we did not compute medication costs.

Direct and Indirect Costs

We determined direct and indirect costs according to illness severity (Table 5). WNE patients accounted for the largest proportion of total cost (median cost $21,332, IQR $12,131–$28,101) per participant compared with $8,124 (IQR $4,025–$13,631) for WNM patients (p = 0.0004) and $192 (IQR $20–$5,359) for WNF patients (p<0.0001). For WNE patients, costs were attributable mostly to hospitalization, which accounted for 65% of the total cost, followed by inpatient rehabilitation (20%). For WNM patients, indirect costs (47%), followed by hospitalization (38%), contributed to the largest proportion of total costs. For WNF patients, hospitalization (44%) and indirect costs (44%) contributed to the same proportion of total cost. Median indirect costs were significantly higher for WNM patients than for WNE (p = 0.004) or WNF (p = 0.0005) patients. Physician visit costs were also significantly higher for WNM patients than for WNE (p = 0.041) or WNF (p = 0.038) patients.

During 2012, a total of 124 symptomatic WNV patients were reported in the province of Quebec, and during 2013, a total of 31 symptomatic WNV patients were reported. Based on our study, the estimated total cost of these cases was ≈$1.7 million for 2012 and ≈$430,000 for 2012. We determined the estimated total cost by category (Table 6). For both years, WNF accounted for <5% of the total, and WNM accounted <10% of the total and WNE accounted for >85% of extrapolated costs.

Discussion

In this study, we estimated direct and indirect costs of WNV disease cases in Quebec, Canada, up to 2 years after the acute phase of WNV disease. We found that costs varied considerably according to disease manifestations. Patients with WNE accounted for the largest proportion of the total cost, which could be attributable mainly to their worse hospital course, including severe clinical manifestations, longer stay in the hospital, admission to the intensive care unit, and complications (6). When we compared WNM with WNE patients, we found that WNE patients had lower indirect costs (absence from work), which could be explained by their older age (≈70% were retired at the time of their WNV infection vs. only 17% of patients with WNM).

Although most WNM patients were hospitalized, hospital costs accounted for only 38% of the total cost. WNM is generally associated with a favorable outcome and shorter hospital stay. However, in our study, WNM patients required more physician visits after hospitalization than patients with WNE or WNF. WNF patients accounted for only 3% of the total cost, which was mostly associated with the 5 hospitalized case-patients. For these patients, the median cost of hospitalization was similar to that for the 17 hospitalized WNM patients (p = 0.901) (Table 7). In our previous study (6), we showed that hospitalized WNF patients had similar demographic and clinical profiles as WNE patients, and we assumed that some of them could have undetected mild neuroinvasive disease because 3 of 5 hospitalized WNF patients did not have a lumbar puncture. However, half of WNF patients had consulted only a clinic, and costs associated with their initial care were not available. Thus, the total WNF costs could be underestimated.

These results are similar to those reported by Staples et al. (8), who estimated the initial and 5 years post-WNV infection costs among hospitalized patients in Colorado, USA, during 2003. These authors reported that initial costs were higher for AFP and WNE patients, and long-term costs were higher for AFP and WNM patients. However, this study focused on hospitalized case-patients and might not be a true reflection of all reported WNV patients. Two other studies have evaluated the economic burden of WNV outbreaks in the United States, but both evaluated only initial costs (7,9).

When we extrapolated our results to all reported WNV cases in the province of Quebec, we estimated that WNV infections could cost ≈$1.7 million during an epidemic, such as during 2012; during a low activity year, such as 2013, the cost could be ≈$430,000. These results are consistent with those of the cost-effectiveness simulation study of Bonneau et al. (10), which estimated total direct and indirect cost of ≈$400,000 during a hypothetical year of low activity (25 cases of WNV infection) and >$13 million during a hypothetical year of high activity (840 cases of WNV infection). In that analysis, direct costs included hospitalization, rehabilitation, and outpatient consultations, and indirect costs included productivity losses caused by absence from work and death.

Our study had several limitations. Although participation rate was high and participants were similar to nonparticipants, analyses by clinical categories were based on a small number of cases. However, this number is similar to those for 3 studies in the United States (79). Some costs, such as initial consultations in private practice and medication expenses during follow-up, were not included because they were unavailable or they lacked precision. However, these costs accounted for a small proportion of total cost. Recall biases were also possible for costs incurred during follow-up.

Calculation of productivity losses varies between studies. Because of ethical issues related to the evaluation of productivity losses for a dead person (e.g., is an old person less worthy than a young person because of the fact that he or she is retired or less productive?) (15), we decided not to include the indirect costs associated with death in our results. This decision resulted in an underestimation of the WNV economic burden, particularly for WNE patients, because 10 of them plus 1 WNM patient died during their initial hospitalization. Grosse et al. (17) estimated for the United States the productivity value by age and sex on a daily, annual, and lifetime basis (in 2007 US dollars). Such productivity tables are not available for Canada and Quebec. However, when we used daily production values and age and sex distribution of Grosse et al. (17) for our cases, we estimated the loss of productivity caused by WNV deaths over a 2-year period after the infection. To take into account time preference, we applied a discount rate of 3%, 5%, and 8% and converted the results to 2013 Canadian dollars on the basis of methods suggested by Montmarquette and Scott (18) and Tchouaket et al. (19). These estimates ranged from $467,000 (3% discount rate) to $589,000 (8% discount rate) and would represent a 35% increase over costs we calculated (Table 5).

In comparison, Zohrabian et al. (7) calculated lifetime lost productivity for persons who died, and this productivity loss represented half of the total costs of illness. Staples et al. (8) valued productivity losses for those who died but not for older persons who were retired at the time of their illness, and evaluation led to lower indirect costs for WNE than for WNM. In their simulation study, Bonneau et al. (10) showed that nearly 70% of total costs were attributable to indirect costs (deaths and absence from work).

In summary, we found that the overall cost of WNV infection in Quebec was ≈1.7 million for 2012 (24 symptomatic cases) and ≈430,000 for 2013 (31 symptomatic cases) and that costs were significantly higher for patients who had more severe forms of disease. Our study provides information to government and public health organizations to make informed decisions regarding preventive and intervention programs for WNV infection. Public health monitoring of costs, both direct and indirect, associated with different clinical manifestations of infectious diseases is essential to enable adequate planning for public health policies and infectious diseases prevention and control programs.

Dr. Ouhoummane is an epidemiologist at the Institut National de Santé Publique du Quebec, Montreal, Quebec, Canada. Her research interests include vectorborne diseases, such as Lyme disease and West Nile virus infection.

Top

Acknowledgment

We thank the regional public health boards for contacting patients, research nurses for collecting data, Melissa Trudeau for performing data entry, and all patients for agreeing to participate in the study.

Top

References

  1. Centers for Disease Control and Prevention. West Nile virus: statistics and maps [cited 2017 May 15]. https://www.cdc.gov/westnile/statsmaps/index.html
  2. Public Health Agency of Canada. Surveillance of West Nile virus [cited 2017 May 15]. https://www.canada.ca/en/public-health/services/diseases/west-nile-virus/surveillance-west-nile-virus.html
  3. Ouhoummane  N, Turcotte  ME, Irace-Cima  A, et al. Report on surveillance of the West Nile Virus and other arboviruses in Québec: 2016 season. Montreal: Institut National de Santé Publique du Québec; 2018. p. 11.
  4. Carson  PJ, Borchardt  SM, Custer  B, Prince  HE, Dunn-Williams  J, Winkelman  V, et al. Neuroinvasive disease and West Nile virus infection, North Dakota, USA, 1999-2008. Emerg Infect Dis. 2012;18:6846. DOIPubMed
  5. Mostashari  F, Bunning  ML, Kitsutani  PT, Singer  DA, Nash  D, Cooper  MJ, et al. Epidemic West Nile encephalitis, New York, 1999: results of a household-based seroepidemiological survey. Lancet. 2001;358:2614. DOIPubMed
  6. Ouhoumanne  N, Lowe  A-M, Fortin  A, Kairy  D, Vibien  A, K-Lensch  J, et al. Morbidity, mortality and long-term sequelae of West Nile virus disease in Québec. Epidemiol Infect. 2018;146:86774. DOIPubMed
  7. Zohrabian  A, Meltzer  MI, Ratard  R, Billah  K, Molinari  NA, Roy  K, et al. West Nile virus economic impact, Louisiana, 2002. Emerg Infect Dis. 2004;10:173644. DOIPubMed
  8. Staples  JE, Shankar  MB, Sejvar  JJ, Meltzer  MI, Fischer  M. Initial and long-term costs of patients hospitalized with West Nile virus disease. Am J Trop Med Hyg. 2014;90:4029. DOIPubMed
  9. Barber  LM, Schleier  JJ III, Peterson  RKD. Economic cost analysis of West Nile virus outbreak, Sacramento County, California, USA, 2005. Emerg Infect Dis. 2010;16:4806. DOIPubMed
  10. Bonneau  V. Strategic impact assessment of the government response plan for public health protection against West Nile virus: sector report 10: cost-benefit analysis [in French]. Institut National de Santé Publique du Québec; 2008 [cited 2109 Jul 3]. http://www.inspq.qc.ca/publications/498
  11. De Wals  P, Blackburn  M, Guay  M, Bravo  G, Blanchette  D, Douville-Fradet  M. Burden of chickenpox on families: A study in Quebec. Can J Infect Dis. 2001;12:2732. DOIPubMed
  12. Gosselin  P, Lebel  G, Rivest  S, Douville-Fradet  M. The Integrated System for Public Health Monitoring of West Nile Virus (ISPHM-WNV): a real-time GIS for surveillance and decision-making. Int J Health Geogr. 2005;4:21. DOIPubMed
  13. Public Health Ethics Committee. Opinion on the proposed study of the burden of WNV infection in Quebec: cohorts 2012 and 2013 [in French]. Quebec City (Canada): Institut National de Santé Publique du Québec; 2014. p. 2 [cited 2019 Jul 3]. https://www.inspq.qc.ca/publications/1751
  14. Ministry of Health and Social Services of Quebec. Surveillance of notifiable diseases in Québec – diseases of infectious origin: case definitions, 11th ed. [in French] Québec City: Ministry of Health; 2018. p. 116 [cited 2019 Jul 9] http://publications.msss.gouv.qc.ca/msss/document-000480
  15. Drummond  MF, Sculpher  MJ, Claxton  K, Stoddart  GL, Torrance  GW. Methods for the economic evaluation of health care programmes. 4th ed. Oxford: Oxford University Press; 2015.
  16. Régie de l’Assurance maladie du Québec. Pricing of visits; 2016 [in French] [cited 2019 Jul 3]. http://www.ramq.gouv.qc.ca/SiteCollectionDocuments/professionnels/manuels/150-facturation-specialistes/012_b_tarif_visites_acte_spec.pdf
  17. Grosse  SD, Krueger  KV, Mvundura  M. Economic productivity by age and sex: 2007 estimates for the United States. Med Care. 2009;47(Suppl 1):S94103. DOIPubMed
  18. Montmarquette  C, Scott  I. Discount rate for the valuation of public investments in Quebec [in French]. Montreal: Centre for Interuniversity Research and Analysis on Organizations; 2007.
  19. Tchouaket  E, Dubois  CA, D’Amour  D. The economic burden of nurse-sensitive adverse events in 22 medical-surgical units: retrospective and matching analysis. J Adv Nurs. 2017;73:1696711. DOIPubMed

Top

Tables

Top

Cite This Article

DOI: 10.3201/eid2510.181608

Original Publication Date: 8/30/2019

1Deceased.

Table of Contents – Volume 25, Number 10—October 2019

Comments

Please use the form below to submit correspondence to the authors or contact them at the following address:

François Milord, Centre Intégré de Santé et de Services Sociaux Montérégie-Centre, 1255 Beauregard, Longueuil QC, Canada J4K 2M3

Send To

character(s) remaining.

Comment submitted successfully, thank you for your feedback.

Top

Page created: September 17, 2019
Page updated: September 17, 2019
Page reviewed: September 17, 2019
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external