Skip directly to site content Skip directly to page options Skip directly to A-Z link Skip directly to A-Z link Skip directly to A-Z link
Volume 13, Number 1—January 2007
Research

Vaccine Effectiveness Estimates, 2004–2005 Mumps Outbreak, England

Author affiliations: *London School of Hygiene and Tropical Medicine, London, United Kingdom; †Health Protection Agency Centre for Infections, London, United Kingdom; 1Current affiliations: National Institute for Communicable Diseases, Johannesburg, South Africa, and University of the Witwatersrand School of Public Health, Parktown, South Africa

Cite This Article

Abstract

The United Kingdom and United States have recently experienced large outbreaks of mumps, which raises concerns about vaccine effectiveness. The effectiveness of the mumps component of the measles, mumps, rubella (MMR) vaccine was estimated using the screening method. In England from January 2004 through March 2005, 312 cases of mumps were reported in children eligible to have received 2 doses of MMR vaccine. Of these children, 52 (16.7%) had received 1 dose of MMR vaccine, and 97 (31.1%) had received 2 doses. Vaccine effectiveness was 88% (95% confidence interval [CI] 83%–91%) for 1 dose and 95% (95% CI 93%–96%) for 2 doses. The effectiveness of 1 dose declined from 96% (95% CI 81%–99%) in 2-year-olds to 66% (95% CI 30%–83%) in 11- to 12-year-olds, and the effectiveness of 2 doses declined from 99% (95% CI 97%–99.5%) in 5- to 6-year-olds to 86% (95% CI 74%–93%) in 11- to 12-year-olds (p<0.001 for 1 or 2 doses). Waning immunity may contribute to mumps outbreaks in older vaccinated populations.

In October 1988, immunization against mumps was introduced in the United Kingdom as a single dose of measles, mumps, rubella (MMR) vaccine offered to all children 12–15 months of age (1). Reports of disease declined 79% in the first year, from 20,713 in 1989 to 4,277 in 1990. In 1996, a second dose of MMR was introduced at school entry (2). From 1990 through 2003, the number of reported cases remained <5,000 per year (3), and since 1995, a high proportion of clinically diagnosed cases were shown by laboratory investigation not to be genuine mumps (4).

During 2004–2005, a major increase in reported and confirmed cases occurred in all regions of England and Wales. In 2005, >56,000 clinical cases were reported, most in patients 19–23 years of age (5). Of the confirmed cases, <3% occurred in children eligible to have received 2 doses of MMR vaccine routinely (i.e., those born from 1993 through 1999) (5,6).

During 2005–2006, a large outbreak of mumps involving >2,500 possible cases from 11 states was reported in the United States (7). The reemergence of mumps in countries that had high levels of vaccine coverage for many years raises questions about the effectiveness of the mumps component of the MMR vaccine and the possible contribution of waning immunity.

In early clinical trials, the efficacy of a single dose of mumps vaccine was >95%, but estimates of the effectiveness in field evaluations have been 62%–85% (818). The possibility of waning immunity has been suggested in several studies but not conclusively demonstrated (1113,19). The UK outbreak offered the opportunity to evaluate the effectiveness of 1 or 2 doses of MMR vaccine and to investigate the presence of waning immunity by using routinely collected data.

Methods

We reviewed clinically reported mumps cases in England from January 1, 2004, through March 31, 2005, that were confirmed by oral fluid mumps-specific immunoglobulin M testing within 6 weeks of symptom onset (20). Only case-patients eligible to have received 2 doses of MMR vaccine through the routine program (i.e., those born after 1992) were included. Case-patients 3–5 years of age were excluded because children receive the second dose of MMR between these ages and, therefore, reliable population coverage data are not available for comparison. Possible vaccine-associated cases (i.e., symptom onset within 6 weeks after vaccination) were also excluded. Vaccination histories were obtained from physician records or child health computerized recordkeeping systems.

Quarterly population vaccine coverage data for children 2 and 5 years of age were obtained from the Cover of Vaccination Evaluated Rapidly program (21,22). Because of changes in health service boundaries and child health computerized recordkeeping systems, data for a small number of areas were missing for some quarterly periods. In addition, 5-year coverage data have been shown to underestimate the true coverage in some areas (23). To compensate for this, coverage data were adjusted. Missing values were estimated using linear interpolation from the values submitted in previous and subsequent quarters. When coverage of first-dose MMR for the same birth cohort was lower at 5 than at 2 years of age, the coverage at 5 years of age was assumed to be 3% higher than the value at 2 years of age (based on data from a sentinel surveillance scheme) (22). The adjusted data were used to approximate population coverage for school-year cohorts (born from October 1 through September 30 of the following year) to allow for similar levels of exposure within school years. Coverage data at 5 years of age for children born in 2000 were not yet available, so values were estimated from the previous cohort and data from the first 2 quarters. Coverage data were divided into 2 categories, within and outside London, because coverage estimates are lower in London but fairly similar in the rest of the country (24).

Statistical Analysis

Vaccine effectiveness was calculated from the proportion of confirmed mumps cases vaccinated (PCV) and the proportion of the population vaccinated (PPV) using the following formula (25): formula image

The data were grouped by school year, age, sex, and area of residence (within or outside London) and were analyzed by using logistic regression with an offset (incorporating expected PPV by area and birth cohort) for vaccine coverage. When estimating vaccine effectiveness for 1 dose, those who had received 2 doses were excluded from the calculation of PPV. Similarly, those with only 1 dose were excluded when estimating vaccine effectiveness for 2 doses. To estimate overall effectiveness, a model including only a constant was fitted. Effectiveness in different subgroups was estimated from univariable models. If >1 variable was statistically significant on univariable analysis, multivariable analysis was performed.

Data from computerized child health systems, used for scheduling and recording vaccinations given, have consistently been shown to underestimate vaccine coverage (26,27). Sensitivity analyses explored the effects of possible underestimation of vaccine coverage by repeating calculations assuming that PPV was 1%, 2%, and 5% higher than that reported. Vaccine effectiveness estimates were also calculated using the unadjusted coverage data to examine the effect of data cleaning.

Estimating coverage in older children from a measurement at 5 years of age could lead to an underestimate of effectiveness if there were a subsequent increase in coverage. Therefore, we obtained data on children vaccinated with MMR after 5 years of age from the child health computer system in the former South Thames region in 2000. Analyses explored the effect of an increase in coverage of 0.04%–0.4% per year of age after 5 years of age. The proportion of persons predicted to be susceptible to mumps, by age in England in 2005, was calculated by multiplying age-specific estimates of vaccine effectiveness by annual birth cohort coverage data.

Results

Vaccine Effectiveness

We found 312 confirmed cases of mumps that were eligible for inclusion. Vaccination history was obtained for all case-patients. The proportion of unvaccinated case-patients decreased with increasing age and was higher in younger birth cohorts (Table 1). The proportion of vaccinated case-patients did not differ according to area of residence or sex.

Age at first dose of MMR vaccine ranged from 10 months to 5 years 9 months and at second dose from 16 months to 6 years. Of those who had received MMR, >90% received the first dose at 12–24 months of age and the second dose at 3–5 years of age.

Adjusted population vaccine coverage declined during the study period (Table 2). Outside London, the percentage of children who received 1 dose of MMR by their second birthday declined from 92.7% to 82.7% from the 1993 to the 2002 birth cohort. The percentage who received 2 doses by their fifth birthday was more stable, declining from 78.1% to 76.4% from 1993 to 2000. In London, estimates of coverage were lower and also declined over time.

Figure 1

Thumbnail of Estimates of the proportion of the population susceptible to mumps by age in 2005, applying study estimates of vaccine effectiveness to population coverage data.

Figure 1. . Estimates of the proportion of the population susceptible to mumps by age in 2005, applying study estimates of vaccine effectiveness to population coverage data.

Overall estimates of vaccine effectiveness were 87.8% (95% confidence interval [CI] 83.1%–91.1%) for 1 dose and 94.6% (95% CI 92.9%–95.9%) for 2 doses. There was no statistically significant variation in vaccine effectiveness for 1 or 2 doses by area of residence (p = 0.3 for 1 dose, p = 0.7 for 2 doses) or sex (p = 0.7 for 1 dose, p = 0.2 for 2 doses). Vaccine effectiveness decreased with increasing age for those who received either 1 or 2 doses (p<0.001) (Table 3). Vaccine effectiveness also varied with birth cohort (p = 0.02 for 1 dose, p = 0.003 for 2 doses). As birth cohort and age were correlated, it was not possible to separate the effects of age group and birth cohort for 1-dose effectiveness; the effect of birth cohort on 2-dose effectiveness was lost when adjusted for age. Application of our estimates of vaccine effectiveness to UK coverage data (Figure 1) predicts that >20% of children 11–12 years of age are not protected against mumps.

Sensitivity Analysis

Estimates of vaccine effectiveness using raw coverage data were 86.5% (95% CI 81.5%–90.3%) for 1 dose and 96.8% (95% CI 95.6%–97.7%) for 2 doses. Estimates of vaccine effectiveness increased from 87.8% to 90.8% for 1 dose and from 94.6% to 99.3% for 2 doses, for an increase in PPV of 1%–5% (Table 4).

Figure 2

Thumbnail of Estimates of 1-dose vaccine effectiveness for cases in 2004–05, assuming an increase in coverage of 0.04%–0.4% per year of age, which represents vaccination of approximately 1%–10% of unvaccinated persons per year of age. Values are offset on the x-axis so that 95% confidence intervals (CIs) are visible.

Figure 2. . Estimates of 1-dose vaccine effectiveness for cases in 2004–05, assuming an increase in coverage of 0.04%–0.4% per year of age, which represents vaccination of approximately 1%–10% of unvaccinated persons per...

Age at first MMR vaccination was available for 148,525 children registered on the South Thames child health computer system. In each birth cohort, 3–45 children per year received the first MMR dose at >5 years of age, most between 5 and 6 years of age. On average, an additional 0.04% (95% CI 0.036%–0.045%) of children received MMR vaccine per year of age after their fifth birthday. In the sensitivity analysis (Figure 2), a fixed increase in coverage per year of age did not abolish the statistically significant decline in vaccine effectiveness until coverage increased by at least 0.4% per year, 10× greater than that estimated from children in the South Thames region.

Discussion

Our estimate of 87.8% effectiveness for 1-dose mumps vaccine is lower than efficacy estimates from clinical trials (8,9) but higher than those from most published field evaluations (1014). Lower estimates in field studies could result from problems with vaccine storage or administration, errors in case definition (i.e., clinical instead of laboratory-confirmed cases) or ascertainment, inaccurate determination of vaccination status, and bias from conducting studies during outbreaks (10,28,29). Because clinical trials have relatively short follow-up periods, waning immunity may also produce lower observed effectiveness in field evaluations. We observed a decline in protection with increasing age, which suggests that waning immunity may occur. After 2 doses, the magnitude of this decline is small, and effectiveness remains above 85% even 6–7 years after the second vaccination.

Research on whether protection from mumps vaccine declines with time since vaccination is contradictory. In 2 US outbreaks, children vaccinated >5 (12) or >3 (19) years before each outbreak were at higher risk for mumps. In 2 other US outbreaks, no evidence was found for increased infection rate with time since vaccination (11,16). A study from Belgium found increasing risk for disease with time since vaccination (13). In the presence of natural boosting, neutralizing antibodies have been demonstrated up to 12 years after vaccination (30). However, duration of antibody persistence in a high-coverage setting where mumps circulation has declined is not known. In Finland, a decline in mumps antibody titers was demonstrated in vaccinated children (31), and the proportion of children seropositive for mumps antibodies some years after MMR vaccination was lower than expected in Sweden and the United Kingdom (32,33).

Our estimates may be affected by several biases. Unvaccinated children may mix with other unvaccinated children and exposure may be more common than in vaccinated children, which would lead to an overestimation of vaccine effectiveness. Because most cases occurred in age groups not eligible for vaccination, however, it is likely that exposure to mumps was fairly uniform.

In addition, those who do not access healthcare for vaccination may be less likely to seek care for mumps disease. Consequently, these cases may be less likely to be reported, which would lead to an underestimation of vaccine effectiveness. The availability of free universal primary care, however, means that persons with mumps should not have difficulty accessing medical care in the United Kingdom. Studies during local outbreaks may also underestimate vaccine effectiveness, as a chance cluster of cases is more likely to be reported (29). The 2004–2005 outbreak of mumps was a national outbreak affecting all regions of the United Kingdom and is therefore unlikely to be subject to this bias (6).

The screening method relies on accurate estimates of population vaccine coverage (25). Estimates of vaccine effectiveness were similar using raw and adjusted coverage values, which suggests that our adjustments had not introduced any major bias. Sensitivity analyses that explore the effects of underestimation of vaccine coverage demonstrate that overall effectiveness could be as high as 90% for 1 dose, but this would require true coverage to be >5% higher than recorded.

If mumps cases had occurred before the period of our investigation, a false impression of waning immunity could have resulted because these cases would have affected proportionately more unvaccinated than vaccinated children (34). Immunity develops in children who have had mumps, so unvaccinated children would be preferentially removed from the population at risk. Therefore, with increasing age, the proportion of mumps cases diagnosed in vaccinated children would increase. From 1990 through 2003, however, UK mumps incidence was extremely low, so past infection is unlikely to be responsible for the observed decline in vaccine effectiveness with increasing age.

The possible effect of migration to and from the United Kingdom on these estimates is difficult to assess. Of immigrants to the United Kingdom, ≈80% arrive from commonwealth countries or the European Union each year, and ≈40,000 are children <15 years of age (35). Some of these countries do not use routine mumps vaccine; therefore, our estimates of vaccine coverage in older children may be too high. This would lead to an apparent increase in effectiveness with age, rather than the effect observed.

The use of vaccine coverage at the fifth birthday assumes that no further mumps vaccines are given after this age. If coverage gradually increased after this age, effectiveness would be underestimated for older age groups. Children 5–12 years of age, however, have generally not been targeted by MMR catch-up campaigns, and the target payment incentive in primary care does not apply after 6 years of age (36). From the South Thames data, most MMR given after the fifth birthday is given to children 5–6 years of age, and the numbers vaccinated are too low to produce the observed decline in effectiveness. We therefore conclude that an increase in coverage after 5 years of age is unlikely to fully explain the decline.

No evidence has shown that vaccine quality and handling changed over time. All cohorts >6 years of age were only eligible for MMR-II (Sanofi Pasteur MSD, Berkshire, UK) for the first dose, so a change in product cannot be responsible for the decline in first-dose effectiveness after this age. Priorix (GlaxoSmithKline, Uxbridge, UK) became available in 1998, but as population coverage by vaccine manufacturer is not available, we are unable to show any differences between vaccines.

According to this study, <80% of children 11–12 years of age are protected against mumps, less than the suggested threshold of 90%–92% to interrupt transmission (37). The true proportion of those with immunity may now be higher than this because many unvaccinated persons will have acquired natural infection and vaccinated persons may have been boosted by exposure during the outbreak.

Our estimates of vaccine effectiveness suggest that the mumps component of MMR provides excellent protection through routine administration in the United Kingdom. The observation of waning immunity is, however, a cause for concern because the proportion of susceptible adolescents may increase, which could lead to future outbreaks in this age group. Because most recent cases have occurred in persons too old to have been vaccinated, the contribution of waning immunity to the current UK outbreak is small (6). To minimize the risk of future outbreaks, MMR vaccine coverage with both doses must be improved and maintained.

Dr Cohen is a clinical microbiologist/epidemiologist, Epidemiology Unit, National Institute for Communicable Diseases, National Health Laboratory Service, Johannesburg, South Africa. Her research interests include vaccine-preventable diseases, surveillance, HIV, and opportunistic infections.

Top

References

  1. Jones AG, White JM, Begg NT. The impact of MMR vaccine on mumps infection in England and Wales.CDR (Lond Engl Rev). 1991;1:R936.PubMedGoogle Scholar
  2. Gay N, Miller E, Hesketh L, Morgan-Capner P, Ramsay M, Cohen B, Mumps surveillance in England and Wales supports introduction of two dose vaccination schedule.Commun Dis Rep CDR Rev. 1997;7:R216.PubMedGoogle Scholar
  3. Health Protection Agency. Mumps notifications, by age group, 1989–2005. 2006 [cited 11 April 2006]. Available from http://www.hpa.org.uk/infections/topics_az/mumps/data_not_age.htm
  4. Health Protection Agency. Mumps notifications (confirmed cases), England and Wales, 1995–2006 by quarter. 2006 [cited 11 April 2006]. Available from http://www.hpa.org.uk/infections/topics_az/mumps/data_quarter.htm
  5. Centers for Disease Control and Prevention. Mumps epidemic—United Kingdom, 2004–2005.MMWR Morb Mortal Wkly Rep. 2006;55:1735.PubMedGoogle Scholar
  6. Savage E, Ramsay M, White J, Beard S, Lawson H, Hunjan R, Mumps outbreaks across England and Wales in 2004: observational study.BMJ. 2005;330:111920. DOIPubMedGoogle Scholar
  7. Centers for Disease Control and Prevention. Update: multistate outbreak of mumps—United States, January 1–May 2, 2006.MMWR Morb Mortal Wkly Rep. 2006;55:55963.PubMedGoogle Scholar
  8. Hilleman MR, Weibel RE, Buynak EB, Stokes JJr, Whitman JEJr. Live attenuated mumps-virus vaccine. IV. Protective efficacy as measured in a field evaluation.N Engl J Med. 1967;276:2528.PubMedGoogle Scholar
  9. Sugg WC, Finger JA, Levine RH, Pagano JS. Field evaluation of live virus mumps vaccine.J Pediatr. 1968;72:4616. DOIPubMedGoogle Scholar
  10. Kim-Farley R, Bart S, Stetler H, Orenstein W, Bart K, Sullivan K, Clinical mumps vaccine efficacy.Am J Epidemiol. 1985;121:5937.PubMedGoogle Scholar
  11. Wharton M, Cochi SL, Hutcheson RH, Bistowish JM, Schaffner W. A large outbreak of mumps in the postvaccine era.J Infect Dis. 1988;158:125360.PubMedGoogle Scholar
  12. Hersh BS, Fine PE, Kent WK, Cochi SL, Kahn LH, Zell ER, Mumps outbreak in a highly vaccinated population.J Pediatr. 1991;119:18793. DOIPubMedGoogle Scholar
  13. Vandermeulen C, Roelants M, Vermoere M, Roseeuw K, Goubau P, Hoppenbrouwers K. Outbreak of mumps in a vaccinated child population: a question of vaccine failure?Vaccine. 2004;22:27136. DOIPubMedGoogle Scholar
  14. Harling R, White JM, Ramsay ME, Macsween KF, Bosch C. The effectiveness of the mumps component of the MMR vaccine: a case control study.Vaccine. 2005;23:40704. DOIPubMedGoogle Scholar
  15. Sullivan KM, Halpin TJ, Marks JS, Kim-Farley R. Effectiveness of mumps vaccine in a school outbreak.Am J Dis Child. 1985;139:90912.PubMedGoogle Scholar
  16. Cheek JE, Baron R, Atlas H, Wilson DL, Crider RDJr. Mumps outbreak in a highly vaccinated school population. Evidence for large-scale vaccination failure.Arch Pediatr Adolesc Med. 1995;149:7748.PubMedGoogle Scholar
  17. Chamot E, Toscani L, Egger P, Germann D, Bourquin C. [Estimation of the efficacy of three strains of mumps vaccines during an epidemic of mumps in the Geneva canton (Switzerland)]. Rev Epidemiol Sante Publique. 1998;46:1007.PubMedGoogle Scholar
  18. Schlegel M, Osterwalder JJ, Galeazzi RL, Vernazza PL. Comparative efficacy of three mumps vaccines during disease outbreak in Eastern Switzerland: cohort study.BMJ. 1999;319:352.PubMedGoogle Scholar
  19. Briss PA, Fehrs LJ, Parker RA, Wright PF, Sannella EC, Hutcheson RH, Sustained transmission of mumps in a highly vaccinated population: assessment of primary vaccine failure and waning vaccine-induced immunity.J Infect Dis. 1994;169:7782.PubMedGoogle Scholar
  20. Warrener L, Samuel D. Evaluation of a commercial assay for the detection of mumps specific IgM antibodies in oral fluid and serum specimens.J Clin Virol. 2006;35:1304. DOIPubMedGoogle Scholar
  21. COVER/Körner. April to June 1998. Vaccination coverage statistics for children up to five years of age in the United Kingdom.Commun Dis Rep CDR Wkly. 1998;8:3456.
  22. Health Protection Agency. COVER programme: July to September 2001. Vaccination coverage statistics for children up to five years of age in the United Kingdom.Commun Dis Rep CDR Wkly. 2002;12:710.
  23. Department of Health. Statistical Bulletin NHS Immunization Statistics, England : 2000-01. Department of Health. 2001 [cited 22 Nov 2006]. Available from http://www.dh.gov.uk/PublicationsAndStatistics/Statistics/StatisticalWorkAreas/StatisticalHealthCare/StatisticalHealthCareArticle/fs/en?CONTENT_ID=4016228&chk=WaYjtZ
  24. Health Protection Agency. Laboratory confirmed cases of measles, mumps, and rubella, England and Wales: January to March 2003.Commun Dis Rep CDR Wkly. 2003;13:114.
  25. Farrington CP. Estimation of vaccine effectiveness using the screening method.Int J Epidemiol. 1993;22:7426. DOIPubMedGoogle Scholar
  26. Ramsay M, White J, Crowcroft N. MMR uptake data are unlikely to be subject to manipulation.BMJ. 2002;324:1394. DOIPubMedGoogle Scholar
  27. Ghebrehewet S, Falconer M, McDonald P, Schlecht B. MMR vaccine uptake rates: a data validation study.Commun Dis Public Health. 2003;6:1446.PubMedGoogle Scholar
  28. Orenstein WA, Bernier RH, Hinman AR. Assessing vaccine efficacy in the field. Further observations.Epidemiol Rev. 1988;10:21241.PubMedGoogle Scholar
  29. Fine PE, Zell ER. Outbreaks in highly vaccinated populations: implications for studies of vaccine performance.Am J Epidemiol. 1994;139:7790.PubMedGoogle Scholar
  30. Weibel RE, Buynak EB, McLean AA, Roehm RR, Hilleman MR. Persistence of antibody in human subjects for 7 to 10 years following administration of combined live attenuated measles, mumps, and rubella virus vaccines.Proc Soc Exp Biol Med. 1980;165:2603.PubMedGoogle Scholar
  31. Davidkin I, Valle M. Vaccine-induced measles virus antibodies after two doses of combined measles, mumps and rubella vaccine: a 12-year follow-up in two cohorts.Vaccine. 1998;16:20527. DOIPubMedGoogle Scholar
  32. Miller E, Hill A, Morgan-Capner P, Forsey T, Rush M. Antibodies to measles, mumps and rubella in UK children 4 years after vaccination with different MMR vaccines.Vaccine. 1995;13:799802. DOIPubMedGoogle Scholar
  33. Broliden K, Abreu ER, Arneborn M, Bottiger M. Immunity to mumps before and after MMR vaccination at 12 years of age in the first generation offered the two-dose immunization programme.Vaccine. 1998;16:3237. DOIPubMedGoogle Scholar
  34. Farrington CP. The measurement and interpretation of age-specific vaccine efficacy.Int J Epidemiol. 1992;21:101420. DOIPubMedGoogle Scholar
  35. International Migration. Migrants entering or leaving the United Kingdom and England and Wales, 2003. London: Crown Copyright; 2005.
  36. Kassianos GC. Immunization childhood and travel health. 4th ed. Oxford: Blackwell Science Ltd; 2001.
  37. Anderson RM, May RM. Immunization and herd immunity.Lancet. 1990;335:6415. DOIPubMedGoogle Scholar

Top

Figures
Tables

Top

Cite This Article

DOI: 10.3201/eid1301.060649

1Current affiliations: National Institute for Communicable Diseases, Johannesburg, South Africa, and University of the Witwatersrand School of Public Health, Parktown, South Africa

Table of Contents – Volume 13, Number 1—January 2007

EID Search Options
presentation_01 Advanced Article Search – Search articles by author and/or keyword.
presentation_01 Articles by Country Search – Search articles by the topic country.
presentation_01 Article Type Search – Search articles by article type and issue.

Top

Comments

Please use the form below to submit correspondence to the authors or contact them at the following address:

Cheryl Cohen, National Institute for Communicable Diseases, Private Bag X4, Sandringham, 2131, Johannesburg, South Africa

Send To

10000 character(s) remaining.

Top

Page created: January 22, 2013
Page updated: January 22, 2013
Page reviewed: January 22, 2013
The conclusions, findings, and opinions expressed by authors contributing to this journal do not necessarily reflect the official position of the U.S. Department of Health and Human Services, the Public Health Service, the Centers for Disease Control and Prevention, or the authors' affiliated institutions. Use of trade names is for identification only and does not imply endorsement by any of the groups named above.
file_external