Information distributed to laboratories asking for assistance with CHIKV RT-PCR included reaction chemistry setup, cycling profile, and primer and probe sequences. A quantified CHIKV in vitro RNA transcript containing 9 × 10¹⁰ subgenomic RNA copies/μL was used as a noninfectious positive control. Additional measures were taken to provide proper primers and probes because these components are most vulnerable to variation when assays are adapted from protocols, e.g., because of synthesis errors or poor purification. Primers and probes were synthesized in large reference lots and stored centrally at an oligonucleotide factory. Samples of these lots were validated by the reference laboratory and confirmed to provide full sensitivity as achieved with the original primers used in developing the prototype assay (3). Recipients of protocols were invited to order and use aliquots of primers directly from the validated reference lot.

To receive feedback on performance of this method and other methods of CHIKV detection, a proficiency study was organized among ENIVD members. All participants were informed about the option of obtaining the preformulated assay. Laboratories in Europe (22), Asia (6), South America (2), and Africa (1) participated.

Inactivated and stable testing material was generated from cell culture supernatants of 4 CHIKV strains from the epidemic in the Indian Ocean area (1 each from Seychelles, Mauritius, Réunion Island, and India) and 1 East/Central Africa strain (S27). Virus solutions were inactivated by heating at 56°C for 1 h and gamma irradiation with 30 kGy. Residual infectivity was excluded by 3 blind passages of a sample of each solution on Vero cells. Solutions were diluted in human fresh-frozen plasma, aliquoted (100 μL), and lyophilized. Test aliquots were reconstituted in 100 μL of water, and CHIKV RNA was quantified by RT-PCR (3). Lyophilized samples were shipped at ambient temperature to participating laboratories. Each shipment contained a coded panel of 9 CHIKV RNA positive– and 3 CHIKV RNA–negative lyophilized samples with virus concentrations shown in Table 1. Participants were asked to test the material with any molecular assay routinely used for detecting CHIKV in human plasma or with the preformulated test. We requested test results and assay details (PCR formulations and extraction methods). A total of 36 sets of results were received by the study coordinator, including 3 double sets from 3 laboratories that used 2 methods each. One laboratory provided triple sets of results from 3 tests.

We used 2 criteria to define successful participation in the external quality assessment study. First, those samples containing >7,040 RNA copies/mL should be correctly identified. Analogous to previous external quality assessments (8–11), we chose this threshold because it is ≈5–10× above the limit of detection of current CHIKV RT-PCR protocols (3,12). Second, no false-positive results were allowed in virus-free samples.

Samples containing 10,487,171 RNA copies/mL were correctly detected by all participating laboratories (Table 1). Fifteen (48%) of the laboratories were able to detect samples containing >7,040 RNA copies/mL. Only 22.6% correctly detected the sample with 1,076 copies/mL. Of 31 laboratories, 14 (45.2%) met all proficiency criteria. Seventeen laboratories missed the proficiency criteria because of a lack of sensitivity. Two of these laboratories reported >1 false-positive result. Both laboratories had used a nested RT-PCR, which likely indicated cross-contamination during RT-PCR procedures. No other laboratories reported false-positive results.

Figure

Figure. Probit analysis of laboratories with a positive result (y axes) for chikungunya virus in relation to viral RNA concentration in positive samples (x axes). A) Laboratories using in-house reverse transcription–PCRs (RT-PCRs)...

To project performance of a hypothetical average laboratory, cumulative fractions of positive results reported for each test sample were correlated against RNA concentrations in samples and subjected to probit analysis. This procedure used a dose-response model, which predicted for the average laboratory that a 50% certainty of detection was achieved for CHIKV plasma concentrations >10,000 RNA copies/mL (95% confidence interval [CI] 3,162–19,952 copies/mL) (Figure). A 95% certainty of detection was achieved for CHIKV plasma concentrations >7,943,282 copies/mL (95% CI 2,511,886–39,810,717 copies/mL).

To evaluate critical criteria in laboratory practice, we determined whether particular components of laboratory procedures had any systematic influence on laboratory performance. Selection of criteria was based on experiences from earlier external quality assessment studies (8,9,11). We evaluated automated versus manual RNA extraction methods, 1 widely distributed procedure for RNA extraction (viral RNA mini kit; QIAGEN, Hilden, Germany), any real-time RT-PCR, any nested RT-PCR, or the preformulated RT-PCR distributed with this study. Cumulative fractional positive results of all low- and medium-concentration samples (<86,197 copies/mL) were subjected to multifactor analysis of variance, which eliminated influence of other defined factors in each analysis. The only technical factor that increased sensitivity was the preformulated RT-PCR (Table 2). Thirteen (42%) of 31 participants used this assay. Another factor with nonsignificant benefit (p = 0.08) was use of automated RNA extraction.

Because of little disease activity before the epidemic, laboratories inside and outside epidemic regions were not prepared to detect CHIKV when the epidemic occurred. In a similar situation during the SARS epidemic in 2003, we demonstrated that rapid provision of a commercial test kit could greatly assist laboratories worldwide, enabling them to perform state-of-the art molecular diagnostics during the epidemic (7,9). However, for chikungunya fever, commercial firms did not rapidly prioritize development of CHIKV test kits. ENIVD attempted to assist implementation of molecular diagnostics on an ad hoc basis by distributing a validated CHIKV RT-PCR and all required reagents.

Our proficiency study showed surprisingly good overall performance of participating laboratories than most of our previous external quality assessments (8,10). Analysis of factors identified that this success was primarily due to the preformulated assay. In our earlier external quality assessments on detection of emerging viruses, many participants used diagnostic methods reported in the literature, which did not provide technical features such as real-time PCR (8,9,11). The assay distributed in this study was technically advanced, and its efficient adaptation was supported by providing quality-controlled oligonucleotides and controls. This in-house assay was readily implemented by a large number of laboratories. It improved diagnostic proficiency similar to the commercial assay distributed during the SARS epidemic (9). We showed that novel PCR diagnostics for emerging diseases can be implemented on an international scale. However, enhanced support by reference laboratories through efficient collaborative networks of laboratories is indispensable. Public health organizations should be encouraged by these data to strengthen and extend networking between diagnostic laboratory facilities.