This is the Scientific Surgery Archive, which contains all randomized clinical trials in surgery that have been identified by searching the top 50 English language medical journal issues since January 1998. Compiled by Jonothan J. Earnshaw, former Editor-in-Chief, BJS

Setting pass scores for assessment of technical performance by surgical trainees. BJS 2016; 103: 300-306.

Published: 10th December 2015

Authors: S. de Montbrun, L. Satterthwaite, T. P. Grantcharov

Background

One of the major challenges of competency‐based training is defining a score representing a competent performance. The objective of this study was to set pass scores for the Objective Structured Assessment of Technical Skill.

Method

Pass scores for the examination were set using three standard setting methods applied to data collected prospectively from first‐year surgical residents (trainees). General surgery residents were then assigned an overall pass–fail status for each method. Using a compensatory model, residents passed the eight station examinations if they met the overall pass score; using a conjunctive model, residents passed if they met the overall pass score and passed at least 50 per cent of the stations. The consistency of the pass–fail decision across the three methods, and between a compensatory and conjunctive model, were compared.

Results

Pass scores were stable across all three methods using data from 513 residents, 133 of whom were general surgeons. Consistency of the pass–fail decision across the three methods was 95·5 and 93·2 per cent using compensatory and conjunctive models respectively. Consistency of the pass–fail status between compensatory and conjunctive models for all three methods was also very high (91·7, 95·5 and 96·2 per cent).

Conclusion

Consistency in pass–fail status between the various methods builds evidence of validity for the set scores. These methods can be applied and studied across a variety of assessment platforms, helping to increase the use of standard setting for competency‐based training.

Full text

You may also be interested in

Leading article

Network meta‐analysis of urinary retention and mortality after Lichtenstein repair of inguinal hernia under local, regional or general anaesthesia.

Authors: J. H. H. Olsen, S. Öberg, K. Andresen, T. W. Klausen, J. Rosenberg

Original article

Outcomes of surgery for benign and malignant adrenal disease from the British Association of Endocrine and Thyroid Surgeons’ national registry. BJS 2019; 106: 1495-1503.

Authors: N. Patel, R. J. Egan, B. R. Carter, D. M. Scott‐Coombes, M. J. Stechman, A. Afzaal et al.

Setting pass scores for assessment of technical performance by surgical trainees. BJS 2016; 103: 300-306.

Background

Method

Results

Conclusion

You may also be interested in

A good surgical death. BJS 2019; 106: 1427-1428.

Randomized controlled trial of plain English and visual abstracts for disseminating surgical research via social media.

Systematic review of the current status of cadaveric simulation for surgical training.

Network meta‐analysis of urinary retention and mortality after Lichtenstein repair of inguinal hernia under local, regional or general anaesthesia.

Effect of donor nephrectomy time during circulatory‐dead donor kidney retrieval on transplant graft failure.

Diagnostic performance of MRI and histology in assessment of deep lipomatous tumours.

Dysregulation of the actin scavenging system and inhibition of DNase activity following severe thermal injury.

Trauma models to identify major trauma and mortality in the prehospital setting.

5G‐assisted telementored surgery.

Validation of the Norwegian survival prediction model in trauma (NORMIT) in Swedish trauma populations.

Human model of burn injury that quantifies the benefit of cooling as a first aid measure. BJS 2019; 106: 1472-1479.

Outcomes of surgery for benign and malignant adrenal disease from the British Association of Endocrine and Thyroid Surgeons’ national registry. BJS 2019; 106: 1495-1503.