Volume 4, 2018
|Number of page(s)||9|
|Section||Wrist & Hand|
|Published online||03 September 2018|
Low Pass-rate in postgraduate surgical examination in Nigeria and its contribution to the low surgeon workforce in the country; a review article
Specialty Registrar in Surgery, Jos University Teaching Hospital,
* Corresponding author: email@example.com
Accepted: 24 February 2018
Surgical postgraduate examiners and examinees in Nigeria complain of the low pass rate at all levels of the postgraduate surgical training examinations to which several factors are contributing. For several years there has been being a persistently low surgeon workforce in the country despite having two surgeon producing institutions been for at least 37 years. A review of the probable causes was carried out to shed more light on the matter. At the time of writing there are 52 National Postgraduate Medical College of Nigeria (NPMCN) and 46 West African College of Surgeons (WACS) accredited post graduate surgery training programs in Nigeria compared with 99 in the United Kingdom (UK) and 1056 in the United States (US). Based on available data Nigeria has approximately 572 surgery residency training slots yearly compared with approximately 646 in the UK and 4225 in the US. Examination pass rate was less than 40% for primary WACS compared with 98% pass rate in USMLE (United States Medical Licensing Examination) 3, pass rate at part I was 28.8% for WACS compared with 37% at MRCS (Membership Royal College of Surgeons) part A and 57% for MRCS part B. For the exit examination or part II WACS pass rate was 31.5% (general surgery) while it was 64% for Fellowship Royal College of Surgeons (FRCS) cumulative and 70% in the American board of surgery (ABS). Surgeon per 100 000 population was 0.69 for Nigeria compared with 11.7 and 25.6 for the UK and US respectively. In the last 35 years WACS has produced 1638 surgeons (2.8 times more than NPMCN) in surgery and NPMCN has produced 572. The frequency of examination were twice per year for both WACS and NPMCN examinations, 3 times per year for the USMLE step 3, MRCS (A & B) and Fellowship Royal College of Surgeons (FRCS) general surgery. The American Board of Surgery (ABS) is once per year for Qualifying Examination (QE) and 5 times per year for Certifying Examination (CE).
Key words: Post graduate surgical examination / Examination pass rate / Workforce and surgeon.
© The Authors, published by EDP Sciences, 2018
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
In Nigeria residency training started formally over 36 years ago with the formation of the West African College of surgeons (WACS) and the National Postgraduate medical college of Nigeria (NPMCN) [1,2]. The West African College of Surgeons grew from the Association of Surgeons of West Africa, which was founded in 1960. The decision to transform into a college was made in Accra, Ghana, in 1969. The association ceased to exist in 1973, when it transferred its assets and liabilities to the college in Benin city, Nigeria. Today residency training in surgery is well established in Nigeria in most specialties however currently areas like vascular surgery and hand surgery are not available WACS and NPMCN together with their accredited training institutions handle training, qualifying and certifying examinations. The Medical and Dental Council of Nigeria (MDCN) handles licensure for all surgical specialties. For both colleges there are three examinations to becoming a fellow of the respective college; primary, part I and part II and each is a pre-requisite for the other. Only the primary examination can be written outside a training position. In the United States (US) and United Kingdom (UK) there is currently no equivalent of the primary fellowship examination. The UK MRCS (A & B) is technically a combination of primary and part I. There is a lot of research on attraction and retention on surgeon workforce in Nigeria, but not so much on the production of surgeons, however works by Yusuf et al., Clement et al. and Yawe et al. did focus on factors that affect surgeons in training [3–7]. There is currently few if any study that considers the low surgeon production and its contribution to the low surgeon workforce in Nigeria. Suprisingly success rate in each stage of the examination varies widely between these three countries with that of Nigeria being the lowest and that of the US the highest even though surgeons trained and licensed to practice in the UK & US are less required to re-license when they go abroad compared to surgeons trained in Nigeria. These calls to question the standard setting used to assess trainee surgeons in Nigeria. West Africa and Nigeria have severe shortage of surgeon workforce, despite having surgeon producing institutions for over 36 years, mindful of other attraction and retention of surgeon factors which play their own role. I believe the examining bodies in Nigeria may be under producing surgeons. There are a number of studies and arguments that buttress this assertion and a few argument that refute this claim [3,4,8]. My paper is the first to my knowledge to review this.
Below is a flow chart depicting the pathway towards becoming a surgeon in Nigeria (Fig. 1). Regarding language of communication in training, the official language in Nigeria is English which is the language used to train and assess candidates in Nigeria for all undergraduate and postgraduate medical education. Since July 2011 the WACS faculty of Surgery has a published curriculum for all its examination available free online while the faculty of Surgery, NPMCN has a syllabus published as a book available on purchase for a fee. It is important to state that there is a national undergraduate syllabus for orthopedics which is provided to medical schools by the National Universities Commission of Nigeria and the Medical and Dental Council of Nigeria, while for postgraduate the WACS has its own orthopedic training curriculum for the part II unlike the NPMCN which has for all parts of the fellowship examination i.e. primaries, part I & II. The faculty of surgery has a faculty board of examiners headed by the faculty chairman who are appointed to a two-year term, the board are responsible for appointment of the court of examiners for each diet of examination. The criteria for the appointing examiners is not generally available to the public domain. At present there is no limit to the number of attempts a candidate can have at any of the examinations of the WACS or NPMCN, hence candidates that fail to pass an examination will in most cases apply to retake the examination after every six months until they are successful. Unfortunately, there is no data in the public domain that looks at the number of attempts by candidates for both or either examination.
The aim of this study is to draw attention to the fact the low success rate in post graduate surgical examinations may be a major contributing factor, in that it attracts a large enough pool of prospective surgeons but graduates only a small number.
The data set was gotten from published research and official information on post graduate surgical training and related statistics from the official website of examining bodies like WACS, NPMCN, Joint Commission on Intercollegiate Examinations (JCIE), ABS, Royal College of Surgeons (RCS) and their affiliates, other bodies like National Health Service (NHS) UK, Accreditation Council of Graduate Medical Education (ACCGME), American Association of Medical Colleges (AAMC), Federation of State Medical Boards (FSMB), General Medical Council (GMC) were used as well. The following questions and answers will serve as a window to explore and discuss the information.
In 1999 the Journal of the American Medical Association published “Surgery in Nigeria” by Ajayi and Adebamowo which revealed that at best the trend of the outcome of the results of the WACS examination has been haphazard with a tendency more towards underproduction . This is further depicted by Table 1 and Figures 2–4.
Pass rate of the WACS examination from 1979 to 1997.
Trend of WACS passrate_Primaries.
Trend of WACS passrate_Part I.
Trend of WACS passrate_Part II.
A review of recent data of the WACS examination was done to understand how candidates were performing in recent times (see the Supplemental Material for full details such as number of participating candidates from each training centre, etc.)
A review of WACS primaries examination conducted biannually from 2015–2017 revealed passrate for the three years that ranged from 16–36% with a median of 20%.
A review of WACS part I examination conducted biannually from 2012–2013 revealed passrate for the two years that ranged from 21–36% with a median of 29%.
A review of WACS part I examination by regional location of training centre conducted biannually for 2016 & 2017 revealed passrate that showed marked variability by location of training centre.
For 2016 here is the summary:
Passrate of all training centres located in the north central ranged from 6–22%.
Passrate of all training centres located in the north east ranged from 0–17%.
Passrate of all training centres located in the north west ranged from 0–33%.
Passrate of all training centres located in the south west ranged from 0–43%.
Passrate of all training centres located in the south east ranged from 0–67%.
Passrate of all training centres located in the south south ranged from 0–22%.
For 2017 here is the summary:
Passrate of all training centres located in the north central ranged from 0–50% with an overall regional passrate of 16%.
Passrate of all training centres located in the north east ranged from 20–100% with overall regional passrate of 41%.
Passrate of all training centres located in the north west ranged from 0–67% with overall regional passrate of 19%.
Passrate of all training centres located in the south west ranged from 17–50% with overall regional passrate of 36%.
Passrate of all training centres located in the south east ranged from 0–57% with overall regional passrate of 22%.
Passrate of all training centres located in the south south ranged from 0–50% with overall regional passrate of 18%.
A review of WACS part II examination by conducted biannually for 2016 & 2017 revealed passrate that showed marked variability by location of training centre.
A review of WACS part II examination conducted biannually from 2012–2013 revealed passrate for the two years that ranged from 17–37% with a median of 32%.
A review of WACS part II examination by regional location of training centre conducted biannually for 2016 & 2017 revealed passrate that showed marked variability by location of training centre for all specialties available in the WACS program namely cardiothoracic, general, neuro, orthopaedic, paediatric, plastic and urologic surgery (the details of these will require too much space to even summarize here so I will refer the reader to Table S.8 of the Supplemental Material).
Does surgery attract higher quality trainees and how does passrate in surgery (including orthopaedics) compare with other faculties?
Regarding the quality of Nigerian doctors that chose to train in surgery or orthopaedics, it is hard to pin point any objective predictor of the quality of candidates entering surgical training in the country. Nigeria does not use a single national examination to license its doctors as for instance the USMLE. Rather different medical schools are left to conduct their own examinations which is used by the medical and dental council to give the newly graduated doctor a license to practice under supervision. Therefore, there is a general lack of an objective predictor that can be used to infer that surgery takes in candidates that are any less in quality compared to other disciplines. An interesting paper by Ohwovoriole et al. in 1987 “A Review of the Fellowship Examination of the Nigerian Postgraduate Medical College (1972–84)”  compared the passrate of candidates in all twelve faculties of the college at that time. Surgery (including orthopaedics) lagged obstetrics and gynaecology, anaesthesia, dental surgery, public health and psychiatry in all phases of the examination. For the exit examination surgery lagged all the faculties except paediatrics and internal medicine. This is depicted in Table 2 and Figures 5–7
Passrate National Postgraduate Medical College of Nigeria 1972–84.
How surgery & orthopaedics average cuumulative primaries % passrate compared to other specialities from 1972 to 1984.
How surgery & orthopaedics average cuumulative part I % passrate compared to other specialities from 1972 to 1984.
How surgery & orthopaedics average cuumulative part II % passrate compared to other specialities from 1972 to 1984.
Some WACS examiners like Ajao and Ugwu made some empirical association which in their opinion is which responsible for failure in majority of cases; poor preparation, error in case presentation, incomplete answers to questions, poor knowledge of basic medical sciences, poor knowledge and practice of evidence based medicine and critical appraisal skills .
For each of the reasons a number of solution exist which is backed by some level of evidence; better preparation has been shown by researchers to be a significant predictor of candidates passing surgery and orthopaedics examinations [10–12] training on examination process which relates to errors in long and short case is supported by studies by Paula et al., Scrimgeour and Chipp and colleagues [10,13–15]. Revision with model answers will prevent candidates making the error of incomplete answers to questions while better preparation with structured revision in basic medical sciences will prevent candidates from gross deficiency in the knowledge of basic medical science relevant to surgery and orthopaedic are supported by the fact that higher scores in preceding examination is generally associated with a higher chance of passing the subsequent examination on first attempt [11–13]. Providing free or subsidized access to journals will help candidates demonstrate good knowledge of evidence based practice was associated with higher success rate by orthopaedic surgical trainees .
How does local surgery training factors including training slots and recruitment compare with other countries?
Information on the volume of surgeons Nigeria as of 2014 according to MDCN was gotten from a journal article published by African Centre for Global Health And Social Transformation (ACHEST) from which the surgeon per 100 000 was calculated . While the volume of surgeons in the UK was gotten from RCS and that of the US from AAMC and the surgeon per 100 000 calculated and results displayed as follows [1,17].
The WACS information did not state which fellows where by examination while NPMCN's list of dissertations was used and hence it is likely to be purely by examination. A sizable number of surgeons have dual fellowship however it was not possible to disaggregate mainly due to lack of access to the data.
There are no data on the general or disaggregated dropout rate for surgical or orthopaedic trainees in Nigeria. Therefore, it is it is difficult to objectively answer the question of how many trainees leave the training due to failure to pass an examination after one or more attempts. According to the guidelines of the WACS and NPMCN, training in orthopaedics and surgery takes about 5.5 to 6 years. In Nigeria trainees are given a period of six year with an opportunity for a year extension under certain strict circumstances by training institutions to finish or withdraw from the training. Again, there is no data on the number of surgeons and orthopaedic surgeons leaving the country after completion of training but a recent publication in 2017 reveals the information below. See Table 6 for more information.
Statistics on Nigerian Doctors.
As regards frequency of examination, WACS and NPMCN holds all stages of its examination twice per year, while USMLE step 3, the MRCS (A and B) and FRCS (all specialty) are held thrice per year [1,2,16]. The general surgery ABS QE is held once yearly while the ABS CE is held 5 times per year . Regarding frequency of assessing candidates UK examining bodies clearly examine candidates more frequently and the General ABS CE is also clearly more frequent.
The above results buttress the popular believe that surgical training examining institutions and programs are better funded and given more attention in the UK and US compared to Nigeria, it also shows that the standard setting used by these foreign bodies may be better. This is sad considering the high unmet need for surgical care in Nigeria and Africa. Structurally there are fewer accredited training programs, fewer training slots yearly for doctors seeking to train in surgery. In Nigeria the examining bodies combine the dual role of examining and accrediting institutions for post graduate surgical training [1,2]. In the UK, examining role is handled by the royal colleges, while the GMC handles accreditation of training programs [16,19]. Similarly, in the US the American board of surgery handles examination of trainees while ACGME handles accreditation of training programs [18,20]. This may suggest that the roles may be best handled by two different bodies, however further research needs to be done to better clarify this. The pass rate which is a very important factor for all stakeholders; trainees, training programs as well as examining and accrediting bodies was analyzed for the three postgraduate surgical examinations i.e. primary, part I and II and compared to its equivalent where applicable in the US and UK. The primary examination which is comparable with the step 3 USMLE which has a aggregated passrate of 98%, one article written by WACS examiners states an average pass rate of less than 40% [3,21]. This exam which serves as the entry point to postgraduate surgical training in Nigeria with such a low pass rate may be making surgery less attractive to medical students and fresh medical graduates; however more research needs to be done to shed more light to this statement. The part I (written and clinical) with its counterparts the MRCS part A and B are in-training examination, hence a lot more factors have being shown to influence the ability of candidates' pass rate by several studies [3,6]. Again in this examination the average aggregated pass rate for WACS is 28.8% while that of the MRCS A is 36.6% and MRCS B is 57.5% again Nigeria falling behind [3,16]. For the exit or part II the average general surgery pass rate was used, because it is more feasible to compare pass rate in general surgery for all three countries. That of WACS was 31.5% and of its counterparts was 51% for FRCS general surgery and 76% QE and 80% CE for ABS general surgery. Again Nigeria falls behind [3,17,18]. The frequency to which candidate where being examined yearly was less for examining bodies in Nigeria compared to the UK and US. The surgeon per 100 000 population of the year just following average of aggregated passrate was 0.69 for Nigeria, 11.6 for the UK and 25.7 for the US further buttressing the link of low surgeon workforce and success in postgraduate surgical training. The results also showed that when the two main post graduate surgical colleges were compared WACS has produced 2.8 times more surgeons in the last 35 years compared to NPMCN. It is important to note that however a good number of surgeons hold dual fellowship. The reason for this wide disparity is most likely associated with the lower pass rate of NPMCN examinations as well as a lesser volume of candidates who sit for their exams yearly. Further insight into this difference requires more research.
It may be helpful to get assessors and examiners from some of the oldest organized surgical colleges from different continents of the world like the royal colleges from Europe, the American board from North America and the College of Medicine of South Africa to help in resetting the standard of the examinations. The various college of surgeons have a long history of helping in such standard setting around the world most especially the royal colleges.
Based on the findings above amongst other factors the low production of surgeons in Nigeria is likely a significant contributor to the low volume of surgeons in the country. A review of the way surgeons in training are trained and assessed, especially the standard setting used needs to be reviewed. Luckily the federal government just commissioned a committee to review residency program in Nigeria . An urgent review of the standard setting for postgraduate surgical examinations of the West African college of surgeons and the National postgraduate college may be required to reduce the attrition rate of surgical residents in the country.
No conflict of interest except that the author is a trainee surgeon.
Thanks to Dr Idowu Michael FWACSRad, FMCRad for providing me additional references for this article. This research did not receive any grant from funding agencies in public, commercial or not for profit sectors.
- College History [Internet]. Available from: http://www.wacscoac.org/index.php/about-us/college-history. [cited 2016 May 28] [Google Scholar]
- National Postgraduate Medical College of Nigeria Establishment and Functions [Internet]. Available from: http://npmcn.edu.ng/about-289us/establishment-and-functions/ [cited 2016 May 28] [Google Scholar]
- Ajao OG, Ajao OO, Ugwu BT, Yawe KDT, Ezeome ER (2014) Factors Determining the Results of the Examination of the West African College of Surgeons in General Surgery. JWACS 4, 26 [Google Scholar]
- Ajayi OO, Adebamowo CA (1999) Surgery in Nigeria. JAMA surgery 134, 6 [Google Scholar]
- Yusufu LMD, Ahmed A, Odigie VI, Delia IZ, Mohammed AA (2016) Residency training 291 program: perceptions of residents. Ann Afr Med 9, 4 [Google Scholar]
- Ajao O, Ugwu B (2011) Some factors responsible for failure in fellowship examinations in surgery − a view point. J West African Coll Surg 1, 12 [Google Scholar]
- Ojo EO, Chirdan OO, Ajape AA, et al. (2014) Post- graduate surgical training in Nigeria: The trainees' perspective. Niger Med J 55, 15 [Google Scholar]
- Ajao O, Ugwu B, Eke N (2012) Opinion: a case against the membership programme 300 proposal of the west african college of surgeons. J West African Coll Surg 2, 4 [Google Scholar]
- Ohwovoriole AE, Obembe A (1987) A review of the results of the examinations for Fellowship of the Nigerian Postgraduate Medical College (1972–84). Med Educ 21(3): 250–254 [CrossRef] [PubMed] [Google Scholar]
- de Virgilio C, Yaghoubian A, Kaji A, et al. (2010) Predicting Performance on the American Board of Surgery Qualifying and Certifying Examinations. Arch Surg 145(9), 852 [CrossRef] [Google Scholar]
- Milyamoto Ryan G, Klein Gregg R, Walsh Michael, Zuckermann DJ (2007) Orthopaedics Surgery Residents Study Habits and Performance on The Orthopaedic In-Training Examination. Am J Orthop 36(12), 185–188 [Google Scholar]
- Smith PJW, Wigmore SJ, Paisley A, et al. (2013) Distance Learning Improves Attainment of Professional Milestones in the Early Years of Surgical Training. Ann Surg 258(5): 838–843 [CrossRef] [PubMed] [Google Scholar]
- Scrimgeour DSG, Cleland J, Lee AJ, Brennan PA (2017) Which factors predict success in the mandatory UK postgraduate surgical exam: The Intercollegiate Membership of the Royal College of Surgeons (MRCS)? Surgeon, https://doi.org/10.1016/j.surge.2017.10.001 [Google Scholar]
- Scrimgeour DSG, Cleland J, Lee AJ, et al. (2017) Impact of performance in a mandatory postgraduate surgical examination on selection into specialty training. BJS Open 1(3), 67–74 [CrossRef] [Google Scholar]
- Chipp E, Srinivasan K (2011) Incorporating multi-source feedback into a new clinically based revision course for the FRCS (Plast) exam 33, 263–266 [Google Scholar]
- Intercollegiate Committee for Basic Surgical Examinations (2015) Annual report MRCS The Membership Examination of the Surgical Royal Colleges of Great Britain DO-HNS The Diploma of Otolaryngology. United Kingdom, ICBSE. Available from: http://www.intercollegiatemrcs.org.uk/new/pdf/annual_report_2011.pdf [Google Scholar]
- Joint Committee on Intercollegiate Examinations FRCS (Specialty) Examinations Cumulative Section 2 Statistics from January 2007 (2009) United Kingdom JCIE. Available from: https://www.jcie.org.uk/content/content.aspx?ID=9 [Google Scholar]
- ABS (2010) Program Summary of Performance on ABS Examinations: 2005–2010 First- Taker Examination Pass Rates General Surgery Qualifying and Certifying Examinations (QE & CE) United States, ABS. Available from: https://www.absurgery.org/xfer/5yr_summary.pdf [Google Scholar]
- Education and training. General Medical Council. Available from: http://www.gmc-uk.org/education/index.asp [Google Scholar]
- ACGME (2015) Databook Document. Available from: file:///C:/Users/ACER%20USER/Downloads/2015–2016 [Google Scholar]
- USMLE (2015) Performance Data. Available from: http://www.usmle.org/performance-data/default.aspx#2015_step-3 [Google Scholar]
- FG sets up Ministerial Committee on Restructuring of Residency. Available from: http://npmcn.edu.ng/fg-sets-up-ministerial-committee-on-restructuring-of-residency-programme/ [Google Scholar]
- Intercollegiate Committee for Basic Surgical Examinations (2015) Annual report MRCS. United Kingdom, ICBSE. Available from: http://www.intercollegiatemrcs.org.uk/new/annual_report_html [Google Scholar]
- Joint Committee on Intercollegiate Examinations (2016) FRCS (Specialty) Examinations Section 1 Statistics From 2009 Specialty Specific (CCT Trainees / Non CCT Trainees / Out of Training) United Kingdom, JCIE. Available from: https://www.jcie.org.uk/content/content.aspx?ID=9 [Google Scholar]
- NPMCN (2015) Accreditation Status As At December Lagos, NPMCN. Available from: 244 http://npmcn.edu.ng/downloads/Accreditationstatusasatdecember2015.pdf [Google Scholar]
- WACS (2013) Accreditation Status February 2012 Faculty Of Surgery Lagos, WACS. Available from: http://www.wacscoac.org/downloads/SURGERY%20ACCRED%20STATUS%20July%202013.pdf [Google Scholar]
- NHS (2015) Specialty Recruitment Applicant Handbook United Kingdom, NHS. Available from: https://www.nwpgmd.nhs.uk/sites/default/files/Applicant%20Handbook%202015.pdf [Google Scholar]
- ACGME (2017) Surgery Programs Academic Year 2017–2018 United States, ACGME. Available from: https://apps.acgme.org/ads/Public/Reports/ReportRun?ReportId=1&CurrentYear=2017&SpecialtyId=99&IncludePreAccreditation=false [Google Scholar]
- AAMC (2014) Physician Specialty Databook (November): 1–36 United States, AAMC. Available from: 258 https://members.aamc.org/eweb/upload/Physician%20Specialty%20Databook%202014.pdf [Google Scholar]
- Kennedy C, Howes J (2015) Specialty training applications for 2015: competition ratios and changes to the process BMJ Careers. Available from: http://careers.bmj.com/careers/advice/view-article.html?id=20019822 [Google Scholar]
- Eriki P, Oyo-Ita A, Odedo R, Udoh A, Omaswa F, Kadama P (2015) Surgical 303 Workforce in Nigeria Nigeria, African Centre For Global Health and Social Transformation (ACHEST). Available from: http://www.who.int/workforcealliance/031616NigeriaCaseStudyweb.pdf?ua=1 [Google Scholar]
- Surgery and the NHS in numbers. Available from: https://www.rcseng.ac.uk/media/media-background-briefings-and-statistics/surgery-and-/the-nhs-in-numbers [Google Scholar]
Cite this article as: Ajah JL (2018) Low Pass-rate in postgraduate surgical examination in Nigeria and its contribution to the low surgeon workforce in the country; a review article. SICOT-J, 4, 36.
Table S1 WACS primaries.
Table S2–S4 WACS part I.
Table S5–S8 WACS part II.(Access here)
How surgery & orthopaedics average cuumulative primaries % passrate compared to other specialities from 1972 to 1984.
|In the text|
How surgery & orthopaedics average cuumulative part I % passrate compared to other specialities from 1972 to 1984.
|In the text|
Current usage metrics show cumulative count of Article Views (full-text article views including HTML views, PDF and ePub downloads, according to the available data) and Abstracts Views on Vision4Press platform.
Data correspond to usage on the plateform after 2015. The current usage metrics is available 48-96 hours after online publication and is updated daily on week days.
Initial download of the metrics may take a while.