Ignacio Oropesa García

Face, content, and construct validity of the EndoViS training system for objective assessment of psychomotor skills of laparoscopic surgeons

AbstractBackground The aim of this study is to present face, content, and constructs validity of the endoscopic orthogonal video system (EndoViS) training system and determines its efficiency as a training and objective assessment tool of the surgeons’ psychomotor skills.MethodsThirty-five surgeons and medical students participated in this study: 11 medical students, 19 residents, and 5 experts. All participants performed four basic skill tasks using conventional laparoscopic instruments and EndoViS training system. Subsequently, participants filled out a questionnaire regarding the design, realism, overall functionality, and its capabilities to train hand–eye coordination and depth perception, rated on a 5-point Likert scale. Motion data of the instruments were obtained by means of two webcams built into a laparoscopic physical trainer. To identify the surgical instruments in the images, colored markers were placed in each instrument. Thirteen motion-related metrics were used to assess laparoscopic performance of the participants. Statistical analysis of performance was made between novice, intermediate, and expert groups. Internal consistency of all metrics was analyzed with Cronbach’s α test.ResultsOverall scores about features of the EndoViS system were positives. Participants agreed with the usefulness of tasks and the training capacities of EndoViS system (score >4). Results presented significant differences in the execution of three skill tasks performed by participants. Seven metrics showed construct validity for assessment of performance with high consistency levels.ConclusionsEndoViS training system has been successfully validated. Results showed that EndoViS was able to differentiate between participants of varying laparoscopic experience. This simulator is a useful and effective tool to objectively assess laparoscopic psychomotor skills of the surgeons.

Utilidad de un sistema de seguimiento óptico de instrumental en cirugía laparoscópica para evaluación de destrezas motoras

INTRODUCTION The objective of this study is to assess the usefulness of an evaluation system of surgical skills based on motion analysis of laparoscopic instruments. METHOD This system consists of a physical laparoscopic simulator and a tracking and assessment system of technical skills in laparoscopy. Six surgeons with intermediate experience (between 1 and 50 laparoscopic surgeries) and 5 experienced surgeons (more than 50 laparoscopic surgeries) took part in this study. All participants were right-handed. The subjects performed 3 repetitions of a cutting task on synthetic tissue with the right hand, dissection of a gastric serous layer, and a suturing task in the dissection previously done. Objective metrics such as time, path length, speed of movements, acceleration and motion smoothness were analyzed for the instruments of each hand. RESULTS In the cutting task, experienced surgeons show less acceleration (P=.014) and a smoother motion (P=.023) using the scissors. Regarding the dissection activity, experienced surgeons need less time (P=.006) and less length with both instruments (P=.006 for dissector and P=.01 for scissors). In the suturing task, experienced surgeons require less time (P=.037) and distance travelled (P=.041) by the dissector. CONCLUSIONS This study shows the usefulness of the evaluation system for the cutting, dissecting, and suturing tasks. It represents a significant step in the development of advanced systems for training and assessment of surgical skills in laparoscopic surgery.