Volume 25, Number 11—November 2019
Clinical REsearch During Outbreaks (CREDO) Training for Low- and Middle-Income Countries
We describe a pilot of the Clinical REsearch During Outbreaks (CREDO) initiative, a training curriculum for researchers in epidemic-prone low- and middle-income countries who may respond to disease outbreaks. Participants reported improved confidence in their ability to conduct such research and overall satisfaction with the course structure, content, and training.
Clinical research is an essential component of outbreak response because it underpins clinical management and public health measures (1). However, conducting clinical research during epidemics is challenging (2,3). The Ebola epidemic in West Africa underscored the need for improved research infrastructure and capacity in epidemic-prone vulnerable low- and middle-income countries (LMICs) (4). To address this need, a training curriculum, Clinical REsearch During Outbreaks (CREDO), was jointly developed by the Special Programme for Research and Training in Tropical Diseases (TDR), hosted by the World Health Organization, the International Severe Acute Respiratory and Emerging Infections Consortium, and the United Kingdom Public Health Rapid Support Team. The main objective of the CREDO training curriculum is to strengthen the national capacities of LMICs to design and implement clinical research during outbreaks of infectious diseases and to improve team capacity and team effort. We describe the development and piloting of the CREDO training curriculum and present the results of the formal evaluation.
The learning objectives for the CREDO curriculum (Table 1) were developed using the TDR Global Competency Framework for Clinical Research (5,6), which describes all areas of competency required to conduct clinical research (6). The content of the modules addressed both observational studies and clinical trials. Observational studies were included because they are essential for understanding the etiology, natural history, and pathophysiology of epidemic infectious diseases, many of which are poorly understood. Clinical trials address questions on therapeutics, diagnostics, and other topics, and CREDO covers a range of trial designs including adaptive designs, which may be better suited to the evolving nature of outbreaks.
CREDO is structured as a blended-learning format, with face-to-face sessions (workshops) and asynchronous, downloadable online sessions (e-learning). Our training model was designed with the workshops occurring before and after the e-learning component to introduce and then solidify knowledge gained in the online component. Our assessment model combined multiple-choice questions in the e-learning sessions with simulation exercises in the workshop sessions to provide a balance in testing between recall and critical or creative thinking (7).
The curriculum has 12 modules (Table 2): 1 workshop and 11 e-learning modules, 2 of which are prerequisites that must be completed before the workshop date. Modules are freely available online through a digital platform suited to the low bandwidths found in LMICs. The e-learning component is hosted on the Global Health Network website (https://isaric.tghn.org/credo). It is self-paced over a period of 5–6 months, and each module takes an average of 1–2 hours, with some taking as many as 4–5 hours, to complete. The e-learning is completed individually; participants complete the final assessment during the second workshop as a team, each team member actively using the knowledge learned from the online modules to contribute to the design of a clinical trial during a hypothetical outbreak. Each participant who successfully completes all course components earns a CREDO certificate.
We designed the curriculum for team training with multidisciplinary and intact teams (8); that is, teams that are already working together to develop and implement clinical studies. Team training refers to the training of an entire team and has resulted in improved patient outcomes in various areas of medicine, such as trauma (8,9).
During March–August 2017, we conducted a pilot of the CREDO training curriculum. An informal call invited team applications from sub-Saharan Africa, targeted because populations in the region are at risk for outbreaks from high-threat infectious diseases (10). We selected 19 participants from 4 multidisciplinary teams in 4 countries (Ethiopia, Ghana, Côte d’Ivoire, and Uganda) on the basis of their clinical research experience and team diversity. Of the selected participants, 8 were female and 11 male. Teams consisted of 11 medical doctors, 2 research nurses, 2 data managers, 1 clinical trial manager, and 3 biomedical scientists.
We conducted the first workshop in Entebbe, Uganda. Its purpose was to appraise the challenges of outbreak research; describe the fundamental concepts of generating clinical evidence; introduce the online component of the training; and assess, using simulated team-based exercises, the participants’ confidence in planning and conducting clinical research during an outbreak. After the workshop, participants had time to complete the e-learning modules.
The closing workshop was conducted in Addis Ababa, Ethiopia. Two weeks before this workshop, we gave participants an assignment to develop a clinical trial protocol for a hypothetical outbreak (available on the course website, https://isaric.tghn.org/credo/credo-overall-assignment). This workshop increased and assessed the participants’ knowledge and understanding of observational research and clinical trials. The clinical trial protocols in the assignment were assessed using role play; facilitators played the roles of statisticians, community representatives, scientific experts, ethical reviewers, and government representatives. The teams then incorporated suggestions made by the faculty. The revised protocols then underwent review by peers using an adapted scoring tool (Appendix).
Pilot participants completed an online pre-course and post-course evaluation form anonymously. The questions were based on the learning objectives (Table 1) and sought the participants’ views on the training received, the structure and the content of the individual course modules, and their ability to conduct clinical research during an outbreak. The responses were structured on a Likert scale from strongly agree to strongly disagree or not confident to very confident, with free-text space to clarify any responses (Appendix).
Of the 19 participants, 16 (84.2%) completed the precourse questionnaire and 17 (89.5%) completed the postcourse questionnaire. Most participants were satisfied with the course; 16 participants rated their level of satisfaction as satisfied or very satisfied. Self-assessed levels of confidence increased after the course; 16 participants rated their level of confidence in implementing the course objectives as confident or very confident after the course, compared with only 3 participants before the course (Figure 1). However, another evaluation is required during or after an outbreak to better assess the effectiveness of the course.
An assessment of the content of CREDO showed largely positive reviews, particularly with respect to the relevance and adequacy of the material covered in each of the course modules (Figure 2). Time for completion of each module was generally sufficient except in the rapid evidence appraisal module, for which 3 participants indicated time was inadequate. Some of the major strengths of CREDO were its structure and content, which most participants considered “holistic” and “comprehensive.”
Although clinical research is becoming recognized as an important component of outbreak management (1,11), few resources exist to assess or build capacity in this area. Most of the available outbreak training programs or courses focus on surveillance, epidemiology, outbreak investigation, or laboratory investigation (12–15). CREDO offers a unique perspective with its focus on clinical research and clinical trials.
The strengths of the CREDO training curriculum lie in its format of blended learning, team-based approach, and content tailored to outbreak conditions. Its combination of training in observational studies and clinical trials builds capacity for collecting the much-needed information on pathophysiology and natural history of poorly known conditions, essential components to identify the right interventions to test and the design of the intervention trials.
In addition, CREDO, as an open-access resource, lends itself to adoption and adaptation by interested sites and to creating a community of science by sharing additional or modified materials through the Global Health Network website. CREDO resources can be incorporated into medical or public health training curricula or used as a standalone course for continuous professional development. Some ways in which CREDO will become sustainable are by broadening the number of trainers from among course participants, supporting country ownership, and franchising the course through a variety of providers.
Dr. Kayem is a physician and a UK Commonwealth Scholar at the University of Oxford studying for a DPhil in clinical medicine. Her research interests are emerging infectious diseases and their effects on vulnerable populations, and improving the response to disease outbreaks in Africa.
We thank the Global Health Network for the use of and assistance with their online platform; the entire CREDO faculty (https://isaric.tghn.org/credo) for developing the online modules and workshop exercises; the participants from the 4 country teams who took part in the pilot course; and the CREDO core development team (Katherine Littler, Nikki Shindo, Michael Mawanda, Bin Cao, Fernando Bozza, Proochista Ariana, and Daniel Bausch) who advised on the development of the curriculum.
Funding for this work was provided by the UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases and the UK Public Health Rapid Support Team (funded by the government of the United Kingdom). The funders had no role in the decision to publish or preparation of the manuscript. N.D.K. is a Commonwealth Scholar funded by the UK Department for International Development. P.O. is a previous staff member of the World Health Organization and the UNICEF/UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases.
- Lurie N, Manolio T, Patterson AP, Collins F, Frieden T. Research as a part of public health emergency response. N Engl J Med. 2013;368:1251–5. DOIPubMedGoogle Scholar
- Rojek AM, Horby PW. Modernising epidemic science: enabling patient-centred research during epidemics. BMC Med. 2016;14:212. DOIPubMedGoogle Scholar
- Rojek AM, Horby PW. Offering patients more: how the West Africa Ebola outbreak can shape innovation in therapeutic research for emerging and epidemic infections. Philos Trans R Soc Lond B Biol Sci. 2017;372:
20160294. DOIPubMedGoogle Scholar
- Koita OA, Murphy RL, Fongoro S, Diallo B, Doumbia SO, Traoré M, et al. Clinical research and the training of host country investigators: essential health priorities for disease-endemic regions. Am J Trop Med Hyg. 2016;94:253–7. DOIPubMedGoogle Scholar
- Julé A, Furtado T, Boggs L, van Loggerenberg F, Ewing V, Vahedi M, et al. Developing a globally applicable evidence-informed competency framework to support capacity strengthening in clinical research. BMJ Glob Health. 2017;2:
e000229. DOIPubMedGoogle Scholar
- World Health Organization Special Programme for Research and Training in Tropical Diseases. Using the TDR global competency framework for clinical research: a set of tools to help develop clinical researchers. 2016 [cited 2019 Aug 19]. https://www.who.int/tdr/publications/year/2016/competency-framework-clinical-res
- Hift RJ. Should essays and other “open-ended”-type questions retain a place in written summative assessment in clinical medicine? BMC Med Educ. 2014;14:249. DOIPubMedGoogle Scholar
- Salas E. DiazGranados D, Klein C, Burke CS, Stagl KC, Goodwin GF, et al. Does team training improve team performance? A meta-analysis. Hum Factors. 2008;50:903–33.
- Capella J, Smith S, Philp A, Putnam T, Gilbert C, Fry W, et al. Teamwork training improves the clinical care of trauma patients. J Surg Educ. 2010;67:439–43. DOIPubMedGoogle Scholar
- Pigott DM, Deshpande A, Letourneau I, Morozoff C, Reiner RC Jr, Kraemer MUG, et al. Local, national, and regional viral haemorrhagic fever pandemic potential in Africa: a multistage analysis. Lancet. 2017;390:2662–72. DOIPubMedGoogle Scholar
- National Academies of Sciences, Engineering, and Medicine. Integrating clinical research into epidemic response: the Ebola experience. Washington, DC: The National Academies Press; 2017.
- Public Health England. United Kingdom Field Epidemiology Training Programme prospectus. 2019 [cited 2019 July 8]. https://www.gov.uk/guidance/field-epidemiology-training-programme-fetp
- Lescano AG, Salmon-Mulanovich G, Pedroni E, Blazes DL. Epidemiology. Outbreak investigation and response training. Science. 2007;318:574–5. DOIPubMedGoogle Scholar
- Centers for Disease Control and Prevention. Field Epidemiology Training Program (FETP) training modules and resources. 2019 [cited 2019 July 8]. https://www.cdc.gov/globalhealth/healthprotection/fetp/training_modules/index.html
- Centers for Disease Control and Prevention; Society for Healthcare Epidemiology of America. CDC/SHEA Outbreak Response Training Program (ORTP). 2019 [cited 2019 July 8]. http://ortp.shea-online.org/
TablesCite This Article
Original Publication Date: September 26, 2019
Table of Contents – Volume 25, Number 11—November 2019
|EID Search Options|
|Advanced Article Search – Search articles by author and/or keyword.|
|Articles by Country Search – Search articles by the topic country.|
|Article Type Search – Search articles by article type and issue.|
Please use the form below to submit correspondence to the authors or contact them at the following address:
Nzelle Delphine Kayem, University of Oxford—Centre for Tropical Medicine and Global Health, Wellcome Centre for Human Genetics, Roosevelt Dr, Oxford OX3 7BN, UK