Leonard D. Wade

Mastery Learning of Advanced Cardiac Life Support Skills by Internal Medicine Residents Using Simulation Technology and Deliberate Practice

AbstractBACKGROUND: Internal medicine residents must be competent in advanced cardiac life support (ACLS) for board certification. OBJECTIVE: To use a medical simulator to assess postgraduate year 2 (PGY-2) residents’ baseline proficiency in ACLS scenarios and evaluate the impact of an educational intervention grounded in deliberate practice on skill development to mastery standards. DESIGN: Pretest-posttest design without control group. After baseline evaluation, residents received 4, 2-hour ACLS education sessions using a medical simulator. Residents were then retested. Residents who did not achieve a research-derived minimum passing score (MPS) on each ACLS problem had more deliberate practice and were retested until the MPS was reached. PARTICIPANTS: Forty-one PGY-2 internal medicine residents in a university-affiliated program. MEASUREMENTS: Observational checklists based on American Heart Association (AHA) guidelines with interrater and internal consistency reliability estimates; deliberate practice time needed for residents to achieve minimum competency standards; demographics; United States Medical Licensing Examination Step 1 and Step 2 scores; and resident ratings of program quality and utility. RESULTS: Performance improved significantly after simulator training. All residents met or exceeded the mastery competency standard. The amount of practice time needed to reach the MPS was a powerful (negative) predictor of posttest performance. The education program was rated highly. CONCLUSIONS: A curriculum featuring deliberate practice dramatically increased the skills of residents in ACLS scenarios. Residents needed different amounts of training time to achieve minimum competency standards. Residents enjoy training, evaluation, and feedback in a simulated clinical environment. This mastery learning program and other competency-based efforts illustrate outcome-based medical education that is now prominent in accreditation reform of residency education.

Simulation-Based Training of Internal Medicine Residents in Advanced Cardiac Life Support Protocols: A Randomized Trial

Background: Internal medicine residents must be competent in Advanced Cardiac Life Support (ACLS) for board certification. Purpose: The purpose was to use a medical simulator to assess baseline proficiency in ACLS and determine the impact of an intervention on skill development. Method: This was a randomized trial with wait-list controls. After baseline evaluation in all residents, the intervention group received 4 education sessions using a medical simulator. All residents were then retested. After crossover, the wait-list group received the intervention, and residents were tested again. Performance was assessed by comparison to American Heart Association guidelines for treatment of ACLS conditions with interrater and internal consistency reliability estimates. Results: Performance improved significantly after simulator training. No improvement was detected as a function of clinical experience alone. The educational program was rated highly.

A longitudinal study of internal medicine residents' retention of advanced cardiac life support skills

Background Internal medicine residents must be competent in Advanced Cardiac Life Support (ACLS) for board certification. Traditional ACLS courses have limited ability to enable residents to achieve and maintain skills. Educational programs featuring reliable measurements and improved retention of skills would be useful for residency education. Method We developed a training program using a medical simulator, small-group teaching and deliberate practice. Residents received traditional ACLS education and subsequently participated in four two-hour educational sessions using the simulator. Resident performance in six simulated ACLS scenarios was assessed using a standardized checklist. Results After the program, resident ACLS skill improved significantly. The cohort was followed prospectively for 14 months and the skills did not decay. Conclusions Use of a simulation-based educational program enabled us to achieve and maintain high levels of resident performance in simulated ACLS events. Given the limitations of traditional methods to train, assess and maintain competence, simulation technology can be a useful adjunct in high-quality ACLS education.

Development of an Objective Scoring System for Measurement of Resident Performance on the Human Patient Simulator

Background:The decrease in the percentage of patients having cesarean delivery during general anesthesia has led some educators to advocate the increased use of simulation-based training for this anesthetic. The authors developed a scoring system to measure resident performance of this anesthetic on the human patient simulator and subjected the system to tests of validity and reliability. Methods:A modified Delphi technique was used to achieve a consensus among several experts regarding a standardized scoring system for evaluating resident performance of general anesthesia for emergency cesarean delivery on the human patient simulator. Eight third-year and eight first-year anesthesiology residents performed the scenario and were videotaped and scored by four attending obstetric anesthesiologists. Results:Third-year residents scored an average of 150.5 points, whereas first-year residents scored an average of 128 points (P = 0.004). The scoring instrument demonstrated high interrater reliability with an intraclass correlation coefficient of 0.97 (95% confidence interval, 0.94–0.99) compared with the average score. Conclusions:The developed scoring tool to measure resident performance of general anesthesia for emergency cesarean delivery on the patient simulator seems both valid and reliable in the context in which it was tested. This scoring system may prove useful for future studies such as those investigating the effect of simulator training on objective assessment of resident performance.

Comparison of two standard-setting methods for advanced cardiac life support training.

Background This study used the Angoff and Hofstee standard-setting methods to derive minimum passing scores for six advanced cardiac life support (ACLS) procedures. Method An expert panel provided item-based (Angoff) and group-based (Hofstee) judgments about six ACLS performance checklists on two occasions separated by ten weeks. Interrater reliabilities and test-retest reliability (stability) of the judgments were calculated. Derived ACLS passing standards are compared to historical ACLS performance data from two groups of ACLS-trained internal medicine residents. Results Both the Angoff and Hofstee standard-setting methods produced reliable and stable data. Hofstee minimum passing scores (MPSs) were uniformly more stringent than Angoff MPSs. Interpretation of historical ACLS performance data from medical residents shows the MPSs derived in this study would yield higher-than-expected failure rates. Conclusion Systematic standard setting for ACLS procedures is a necessary step toward the creation of mastery learning educational programs.

Graduating internal medicine residents' self-assessment and performance of advanced cardiac life support skills.

Internal medicine residents in the US must be competent to perform procedures including Advanced Cardiac Life Support (ACLS) to become board-eligible. Our aim was to determine if residents near graduation could assess their skills in ACLS procedures accurately. Participants were 40 residents in a university-based training program. Self-assessments of confidence in managing six ACLS scenarios were measured on a 0 (very low) to 100 (very high) scale. These were compared to reliable observational ratings of residents’ performance on a high-fidelity simulator using published treatment protocols. Residents expressed strong self-confidence about managing the scenarios. Residents’ simulator performance varied widely (range from 45% to 94%). Self-confidence assessments correlated poorly with performance (median r = 0.075). Self-assessment of performance by graduating internal medicine residents was not accurate in this study. The use of self-assessment to document resident competence in procedures such as ACLS is not a proxy for objective evaluation.

Coagulation tests, blood loss, and transfusion requirements in platelet- rich plasmapheresed versus nonpheresed cardiac surgery patients

The results of several studies suggest that acute platelet-rich plasmapheresis decreases blood loss and allogeneic blood product transfusion requirements in cardiac surgery patients. We designed a randomized, prospective study to determine whether acute platelet-rich plasmapheresis decreases blood loss and allogeneic transfusion requirements in primary cardiac surgery patients. Forty patients were randomized to a control or pheresis group. The pheresis group had platelet-rich plasmapheresis performed before cardiopulmonary bypass (CPB) and the platelet-rich plasma (PRP) was returned after CPB. The control group was managed in the normal fashion without pheresis. All patients had serial coagulation studies, hemoglobin, and platelet counts determined intra- and postoperatively. Chest tube drainage and transfusion requirements were recorded. There were no differences in the coagulation tests, platelet counts, chest tube drainage, or allogeneic blood product transfusion requirements between the two groups at any time. The authors conclude that the use of acute platelet-rich plasmapheresis in primary cardiac surgery patients does not decrease chest tube drainage or the need for allogeneic blood transfusions.

Respiratory management after cardiac surgery with inhalation anesthesia.

Improvements in cardiac surgery techniques and anesthetic management have given us cause to re-evaluate the necessity for postoperative mechanical ventilation and delayed extubation after open-heart surgery with inhalational anesthesia. One hundred consecutive patients undergoing various types of cardiac surgery were entered into this study; 94 patients met the requirements for spontaneous ventilation in the immediate postoperative time period and mechanical ventilation was not utilized. Of these 94 patients, 40 (45%) met extubation requirements within 90 min and were subsequently extubated. No patient required reintubation. Six (6%) patients failed to meet the requirements for spontaneous ventilation and, therefore, required mechanical ventilatory assistance postoperatively. In the majority of cardiac patients, the anesthetic technique determines postoperative ventilatory needs. Very poor preoperative physical status and unusually long procedures, however, will probably preclude early extubation or spontaneous ventilation and dictate the need for mechanical ventilation regardless of the anesthetic technique.

Small-dose dexamethasone improves quality of recovery scores after elective cardiac surgery: a randomized, double-blind, placebo-controlled study.

OBJECTIVES The use of steroid therapy in cardiac surgical patients remains controversial. The aim of this clinical investigation was to determine the effect of small-dose dexamethasone therapy on patient-perceived quality of recovery (QoR) scores in elective cardiac surgical patients. In addition, the authors assessed the impact of dexamethasone on the incidence of common adverse events after cardiopulmonary bypass (CPB). DESIGN A prospective, randomized study. SETTING University hospitals. PARTICIPANTS One hundred seventeen patients undergoing cardiac surgery with CPB and anticipated early tracheal extubation. INTERVENTIONS Subjects were randomized to receive either dexamethasone (dexamethasone group, 8 mg at the induction of anesthesia and at the initiation of CPB) or placebo (control group, saline). MEASUREMENTS AND MAIN RESULTS The QoR was assessed using the QoR-40 scoring system preoperatively and on postoperative days (PODs) 1 and 2. Secondary outcome measures assessed in the postoperative period included nausea, vomiting, fatigue, febrile responses, shivering, pulmonary gas exchange, and analgesic requirements. Global QoR-40 scores (median [range]) were higher in the dexamethasone group compared with the control group on POD 1 (167 [133-192] v 157 [108-195]; p < 0.0001) and POD 2 (173 [140-196] v 166 [122-196]; p = 0.001). In the dexamethasone group, improved QoR was observed in the QoR-40 dimensions of emotional state (p = 0.002), physical comfort (p = 0.0001-0.006), and pain (p < 0.0001). The incidences or severity of postoperative fatigue (p < 0.0001), febrile responses (p < 0.0001), and shivering (p = 0.001) were reduced in the dexamethasone group. CONCLUSIONS Patient-perceived postoperative QoR in cardiac surgical patients is enhanced significantly by small-dose dexamethasone treatment.

Dose-Related Prolongation of the Bleeding Time by Intravenous Nitroglycerin

The effects of intravenous nitroglycerin (NTG) upon the bleeding time, platelet aggregation response, and plasma 6-keto-PGF1α concentration were measured in 17 patients about to undergo coronary bypass grafting. NTG produced a dose-related prolongation of the bleeding time that correlated with the accompanying decrease in systolic blood pressure. Platelet aggregation was not affected and measurements of 6-keto-PGF1α Failed to reveal detectable levels (< 10 pg/ml) either before or after NTG infusion. This suggests that the prolonged bleeding time associated with NTG infusion may be due to vasodilation and increased venous capacitance, rather than altered vascular-platelet interaction.