Richard K. Reznick

A surgical safety checklist to reduce morbidity and mortality in a global population.

BACKGROUND Surgery has become an integral part of global health care, with an estimated 234 million operations performed yearly. Surgical complications are common and often preventable. We hypothesized that a program to implement a 19-item surgical safety checklist designed to improve team communication and consistency of care would reduce complications and deaths associated with surgery. METHODS Between October 2007 and September 2008, eight hospitals in eight cities (Toronto, Canada; New Delhi, India; Amman, Jordan; Auckland, New Zealand; Manila, Philippines; Ifakara, Tanzania; London, England; and Seattle, WA) representing a variety of economic circumstances and diverse populations of patients participated in the World Health Organizations Safe Surgery Saves Lives program. We prospectively collected data on clinical processes and outcomes from 3733 consecutively enrolled patients 16 years of age or older who were undergoing noncardiac surgery. We subsequently collected data on 3955 consecutively enrolled patients after the introduction of the Surgical Safety Checklist. The primary end point was the rate of complications, including death, during hospitalization within the first 30 days after the operation. RESULTS The rate of death was 1.5% before the checklist was introduced and declined to 0.8% afterward (P=0.003). Inpatient complications occurred in 11.0% of patients at baseline and in 7.0% after introduction of the checklist (P<0.001). CONCLUSIONS Implementation of the checklist was associated with concomitant reductions in the rates of death and complications among patients at least 16 years of age who were undergoing noncardiac surgery in a diverse group of hospitals.

Changes in safety attitude and relationship to decreased postoperative morbidity and mortality following implementation of a checklist-based surgical safety intervention

Objectives To assess the relationship between changes in clinician attitude and changes in postoperative outcomes following a checklist-based surgical safety intervention. Design Pre- and post intervention survey. Setting Eight hospitals participating in a trial of a WHO surgical safety checklist. Participants Clinicians actively working in the designated study operating rooms at the eight hospitals. Survey instrument Modified operating-room version Safety Attitudes Questionnaire (SAQ). Main outcome measures Change in mean safety attitude score and correlation between change in safety attitude score and change in postoperative outcomes, plus clinician opinion of checklist efficacy and usability. Results Clinicians in the preintervention phase (n=281) had a mean SAQ score of 3.91 (on a scale of 1 to 5, with 5 representing better safety attitude), while the postintervention group (n=257) had a mean of 4.01 (p=0.0127). The degree of improvement in mean SAQ score at each site correlated with a reduction in postoperative complication rate (r=0.7143, p=0.0381). The checklist was considered easy to use by 80.2% of respondents, while 19.8% felt that it took a long time to complete, and 78.6% felt that the programme prevented errors. Overall, 93.4% would want the checklist used if they were undergoing operation. Conclusions Improvements in postoperative outcomes were associated with improved perception of teamwork and safety climate among respondents, suggesting that changes in these may be partially responsible for the effect of the checklist. Clinicians held the checklist in high regard and the overwhelming majority would want it used if they were undergoing surgery themselves.

Teaching and testing technical skills.

Teaching technical skills is one of the most important tasks of a surgeon. This article discusses current issues in teaching and testing technical skills. For the most part, the level of technical skills cannot be predicted before a surgical resident starts a program. Different methods of teaching technical skills are reviewed (in and out of the operating room). For optimal effectiveness in teaching residents, we must apply principles of adult learning to the surgical domain. A methodologic framework for skill acquisition, adapted from the educational psychology literature, is discussed. Five methods of assessing technical skills are presented. Structuring the assessment process has resulted in higher levels of reliability and improved validity.

Assessment of technical skills transfer from the bench training model to the human model.

BACKGROUND This study examines whether technical skills learned on a bench model are transferable to the human cadaver model. METHODS Twenty-three first-year residents were randomly assigned to three groups receiving teaching on six procedures. For each procedure, one group received training on a cadaver model, one received training on a bench model, and one learned independently from a prepared text. Following training, all residents were assessed on their ability to perform the six procedures. RESULTS Repeated measures analysis of variance revealed a significant effect of training modality for both checklist scores (F(2,44) = 3.49, P <0.05) and global scores (F(2,44) = 7.48, P <0.01). Post-hoc tests indicated that both bench and cadaver training were superior to text learning and that bench and cadaver training were equivalent. CONCLUSIONS Training on a bench model transfers well to the human model, suggesting strong potential for transfer to the operating room.

Teaching surgical skills: What kind of practice makes perfect? : A randomized, controlled trial

Objective:Surgical skills laboratories have become an important venue for early skill acquisition. The principles that govern training in this novel educational environment remain largely unknown; the commonest method of training, especially for continuing medical education (CME), is a single multihour event. This study addresses the impact of an alternative method, where learning is distributed over a number of training sessions. The acquisition and transfer of a new skill to a life-like model is assessed. Methods:Thirty-eight junior surgical residents, randomly assigned to either massed (1 day) or distributed (weekly) practice regimens, were taught a new skill (microvascular anastomosis). Each group spent the same amount of time in practice. Performance was assessed pretraining, immediately post-training, and 1 month post-training. The ultimate test of anastomotic skill was assessed with a transfer test to a live, anesthetized rat. Previously validated computer-based and expert-based outcome measures were used. In addition, clinically relevant outcomes were assessed. Results:Both groups showed immediate improvement in performance, but the distributed group performed significantly better on the retention test in most outcome measures (time, number of hand movements, and expert global ratings; all P values <0.05). The distributed group also outperformed the massed group on the live rat anastomosis in all expert-based measures (global ratings, checklist score, final product analysis, competency for OR; all P values <0.05). Conclusions:Our current model of training surgical skills using short courses (for both CME and structured residency curricula) may be suboptimal. Residents retain and transfer skills better if taught in a distributed manner. Despite the greater logistical challenge, we need to restructure training schedules to allow for distributed practice.

The educational impact of bench model fidelity on the acquisition of technical skill: The use of clinically relevant outcome measures

Objective:To evaluate the impact of bench model fidelity on the acquisition of technical skill using clinically relevant outcome measures. Methods:Fifty junior surgery residents participated in a 1-day microsurgical training course. Participants were randomized to 1 of 3 groups: 1) high-fidelity model training (live rat vas deferens; n = 21); 2) low-fidelity model training (silicone tubing; n = 19); or 3) didactic training alone (n = 10). Following training, all participants were assessed on the high- and low-fidelity bench models. Immediate outcome measures included procedure times, blinded, expert assessment of videotaped performance using checklists and global rating scales, anastomotic patency, suture placement precision, and final product ratings. Delayed outcome measures (obtained from the live rat vas deferens 30 days following training) included anastomotic patency, presence of a sperm granuloma, and the presence of sperm on microscopy. Results:Following training, checklist (P < 0.001) and global rating scores (P < 0.001) on the bench model simulators were higher among subjects who received hands-on training, irrespective of model fidelity. Immediate anastomotic patency rates of the rat vas deferens were higher with increasing model fidelity training (P = 0.048). Delayed anastomotic patency rates were higher among subjects who received bench model training, irrespective of model fidelity (P = 0.02). Rates of sperm presence on microscopy were higher among subjects who received high-fidelity model training compared with subjects who received didactic training (P = 0.039) but did not differ among subjects in the high- and low-fidelity groups. Conclusions:Surgical skills training on low-fidelity bench models appears to be as effective as high-fidelity model training for the acquisition of technical skill among novice surgeons.

Team Communications in the Operating Room: Talk Patterns, Sites of Tension, and Implications for Novices

Purpose Although the communication that occurs within health care teams is important to both team function and the socialization of novices, the nature of team communication and its educational influence are not well documented. This study explored the nature of communications among operating room (OR) team members from surgery, nursing, and anesthesia to identify common communicative patterns, sites of tension, and their impact on novices. Method Paired researchers observed 128 hours of OR interactions during 35 procedures from four surgical divisions at one teaching hospital. Brief, unstructured interviews were conducted following each observation. Field notes were independently read by each researcher and coded for emergent themes in the grounded theory tradition. Coding consensus was achieved via regular discussion. Findings were returned to insider “experts” for their assessment of authenticity and adequacy. Results Patterns of communication were complex and socially motivated. Dominant themes were time, safety and sterility, resources, roles, and situation. Communicative tension arose regularly in relation to these themes. Each procedure had one to four “higher-tension” events, which often had a ripple effect, spreading tension to other participants and contexts. Surgical trainees responded to tension by withdrawing from the communication or mimicking the senior staff surgeon. Both responses had negative implications for their own team relations. Conclusions Team communications in the OR follow observable patterns and are influenced by recurrent themes that suggest sites of team tension. Tension in team communication affects novices, who respond with behaviors that may intensify rather than resolve interprofessional conflict.

Reliability and construct validity of a structured technical skills assessment form.

Current methods of evaluating technical competence of surgical residents are subjective and potentially unreliable. This study assesses the reliability and construct validity of a new format for the assessment of technical ability, the two part Structured Technical Skills Assessment Form (STSAF). Part I, which is completed while an operation is proceeding consists of approximately 120 essential components of the procedure. Part II, completed at the end of the operation, is a 10-point global rating form. Forty-one operations were evaluated using the STSAF, with multiple observers present at 26. Inter-rater reliability of both Parts I and II were high (.78 and .73, respectively). Statistically significant differences were noted between senior-resident and junior-resident performances, suggesting construct validity. The incorporation of structured guidelines to the assessment of technical skill leads to high inter-rater reliability and construct validity, which ultimately may result in improved and reproducible evaluations of surgical trainees.

Visual-spatial ability correlates with efficiency of hand motion and successful surgical performance

BACKGROUND This study examines the influence of visual-spatial ability and manual dexterity on surgical performance across 3 levels of expertise. METHODS Dental students, surgical residents, and staff surgeons completed standardized tests of manual dexterity and visual-spatial ability and were assessed objectively while performing the rigid fixation of an anterior mandible on bench model simulations. Outcome variables included expert assessment of technical performance and efficiency of hand motion during the procedure (recorded using electromagnetic sensors). RESULTS Visual-spatial scores correlated significantly with surgical performance scores within the group of dental students (r=.40 to.73), but this was not the case for residents or staff surgeons. For all groups, manual dexterity did not correlate with hand motion parameters. There were no differences between groups in visual-spatial ability or manual dexterity, but highly significant differences were seen in surgical performance scores (P<.001), in that surgeons outperformed residents, who in turn outperformed students. CONCLUSIONS Among novices, visual-spatial ability is associated with skilled performance on a spatially complex surgical procedure. However, advanced trainees and experts do not score any higher on carefully selected visual-spatial tests, suggesting that practice and surgical experience may supplant the influence of visual-spatial ability over time. Thus, the use of these tests for the selection of residents is not currently recommended; they may be of more use in identifying those novice trainees (ie, those with lower test scores) who might benefit most from brief supplementary instruction on specific technical tasks.

Faculty development in assessment: the missing link in competency-based medical education.

As the medical education community celebrates the 100th anniversary of the seminal Flexner Report, medical education is once again experiencing significant pressure to transform. Multiple reports from many of medicines specialties and external stakeholders highlight the inadequacies of current training models to prepare a physician workforce to meet the needs of an increasingly diverse and aging population. This transformation, driven by competency-based medical education (CBME) principles that emphasize the outcomes, will require more effective evaluation and feedback by faculty.Substantial evidence suggests, however, that current faculty are insufficiently prepared for this task across both the traditional competencies of medical knowledge, clinical skills, and professionalism and the newer competencies of evidence-based practice, quality improvement, interdisciplinary teamwork, and systems. The implication of these observations is that the medical education enterprise urgently needs an international initiative of faculty development around CBME and assessment. In this article, the authors outline the current challenges and provide suggestions on where faculty development efforts should be focused and how such an initiative might be accomplished. The public, patients, and trainees need the medical education enterprise to improve training and outcomes now.