James Brewin

An update and review of simulation in urological training

Simulation, if appropriately integrated into surgical training, may provide a time efficient, cost effective and safe method of training. The use of simulation in urology training is supported by a growing evidence base for its use, leading many authors to call for it to be integrated into the curriculum. There is growing evidence for the utilisation of part task (technical skills) simulators to shorten the learning curve in an environment that does not compromise patient safety. There is also evidence that non-technical skills affect patient outcomes in the operating room and that high fidelity team based simulation training can improve non-technical skills and surgical team performance. This evidence has strengthened the argument of surgical educators who feel that simulation should be formally incorporated into the urology training curriculum to develop both technical and non-technical skills with the aim of optimising performance and patient safety.

Face, content and construct validation of the first virtual reality laparoscopic nephrectomy simulator

Study Type – Therapy (case series)
Level of Evidence 4

Full immersion simulation: validation of a distributed simulation environment for technical and non-technical skills training in Urology

To evaluate the face, content and construct validity of the distributed simulation (DS) environment for technical and non‐technical skills training in endourology. To evaluate the educational impact of DS for urology training.

The Relationship Between Technical And Nontechnical Skills Within A Simulation-Based Ureteroscopy Training Environment

OBJECTIVE Little integration of technical and nontechnical skills (e.g., situational awareness, communication, decision making, teamwork, and leadership) teaching exists within surgery. We therefore aimed to (1) evaluate the relationship between these 2 skill sets within a simulation-based environment and (2) assess if certain nontechnical skill components are of particular relevance to technical performance. DESIGN A prospective analysis of data acquired from a comparative study of simulation vs nonsimulation training was conducted. Half of the participants underwent training of technical and nontechnical skills within ureteroscopy, with the remaining half undergoing no training. All were assessed within a full immersion environment against both technical (time to completion, Objective Structured Assessment of Technical Skills, and task-specific checklist scores) and nontechnical parameters (Nontechnical Skills for Surgeons [NOTSS] rating scale). The data of whole and individual cohorts were analyzed using Pearson correlation coefficient. SETTING The trial took place within the Simulation and Interactive Learning Centre at Guys Hospital, London, UK. PARTICIPANTS In total, 32 novice participants with no prior practical ureteroscopy experience were included within the data analysis. RESULTS A correlation was found within all outcome measures analyzed. For the whole cohort, a strong negative correlation was found between time to completion and NOTSS scores (r = -0.75, p < 0.001), with strong positive correlations identified when NOTSS scores were compared with Objective Structured Assessment of Technical Skills (r = 0.89, p < 0.001) and task-specific checklist scores (r = 0.91, p < 0.001). Similar results were observed when each cohort was analyzed separately. Finally, all individual nontechnical skill components demonstrated a strong correlation with all technical skill parameters, regardless of training. CONCLUSIONS A strong correlation between technical and nontechnical performance exists, which was demonstrated to be irrespective of training received. This may suggest an inherent link between skill sets. Furthermore, all nontechnical skill sets are important in technical performance. This supports the notion that both of these skills should be trained and assessed together within 1 curriculum.

Face and Content Validation of the Prostatic Hyperplasia Model and Holmium Laser Surgery Simulator

OBJECTIVE Although a number of simulators have been introduced for prostate surgery, none have undergone validation for holmium laser enucleation of the prostate training. This study was carried out to assess the face and content validities as well as feasibility and acceptability of the new prostatic hyperplasia model and prostate surgery simulator for holmium laser enucleation of the prostate. DESIGN This is a prospective, observational, and comparative study. Participants were given a 30-minute video tutorial followed by a 45-minute simulation session, with one-to-one mentoring. A survey with qualitative and quantitative fields was used to evaluate their experience. SETTING This study was carried out in a 2-day modular teaching course hosted by the Holmium User Group at Cambridge University Hospitals, UK, and during the British Association of Urological Surgeons 2013 Annual Meeting. PARTICIPANTS A total of 36 participants comprising 13 urology trainees and 23 senior urologists of varying levels from all around the globe were recruited. RESULTS Overall, 87% of the participants believed that holmium laser enucleation of the prostate was an effective method of treatment, simulation-based training, and assessment essential for patient safety and 84% believed a validated simulator would be useful for training. Of the participants, 97% agreed that the simulation should be implemented into training programs and only 31% felt it should be part of accreditation. Participants ranked all components of the simulator greater than 7 of 10 on a global rating scale and believed it was a feasible and acceptable method of training and assessment. CONCLUSIONS The new simulator for holmium laser enucleation of the prostate has been demonstrated to be useful as a training tool. This study has established face and content validities of the simulator. Senior and trainee urologists believed the simulator was an acceptable tool for training and assessment and its use feasible for novice trainees to acquire skills and knowledge to a predetermined level of proficiency.

Face, Content, and Construct Validation of the Bristol TURP Trainer

INTRODUCTION Validation studies are an important part of simulator evaluation and are considered necessary to establish the effectiveness of simulation-based training. The widely used Bristol transurethral resection of prostate (TURP) simulator has not been formally validated. OBJECTIVES Evaluation of the face, content, and construct validities of the Bristol TURP simulator as an endourology training tool. DESIGN Using established validation methodology, face, content, and construct validities were evaluated. Face and content validities were assessed using a structured quantitative survey. Construct validity was assessed by comparing the performance of experts and novices using a validated performance scale and resection efficiency. PARTICIPANTS AND SETTING Overall, 8 novice urologists and 8 expert urologists participated in the study. The study was conducted in a dedicated surgical simulation training facility. RESULTS All 16 participants felt the model was a good training tool and should be used as an essential part of urology training (face validity). Content validity evaluation showed that most aspects of the simulator were adequately realistic (mean Likert scores 3.38-3.57/5); however, the model does not simulate bleeding. Experts significantly outperformed novices (p < 0.001) across all measures of performance, therefore establishing construct validity. CONCLUSIONS The Bristol TURP simulator shows face, content, and construct validities, although some aspects of the simulator were not very realistic (e.g., bleeding). This study provides evidence for the continuing use of this simulator in endourology training.