Adam Cheng

Research Regarding Debriefing as Part of the Learning Process

Introduction: Debriefing is a process involving the active participation of learners, guided by a facilitator or instructor whose primary goal is to identify and close gaps in knowledge and skills. A review of existing research and a process for identifying future opportunities was undertaken. Methods: A selective critical review of the literature on debriefing in simulation-based education was done. An iterative process of analysis, gathering input from audience participants, and consensus-based synthesis was conducted. Results: Research is sparse and limited in presentation for all important topic areas where debriefing is a primary variable. The importance of a format for reporting data on debriefing in a research context was realized and a “who, when, where, what, why” approach was proposed. Also, a graphical representation of the characteristics of debriefing studies was developed (Sim-PICO) to help guide simulation researchers in appropriate experimental design and reporting. Conclusion: A few areas of debriefing practice where obvious gaps that deserve study were identified, such as comparing debriefing techniques, comparing trained versus untrained debriefers, and comparing the effect of different debriefing venues and times. A model for publication of research data was developed and presented which should help researchers clarify methodology in future work.

Part 7: CPR Techniques and Devices 2010 American Heart Association Guidelines for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care

A variety of CPR techniques and devices may improve hemodynamics or short-term survival when used by well-trained providers in selected patients. All of these techniques and devices have the potential to delay chest compressions and defibrillation. In order to prevent delays and maximize efficiency, initial training, ongoing monitoring, and retraining programs should be offered to providers on a frequent and ongoing basis. To date, no adjunct has consistently been shown to be superior to standard conventional (manual) CPR for out-of-hospital basic life support, and no device other than a defibrillator has consistently improved long-term survival from out-of-hospital cardiac arrest.

Debriefing for technology-enhanced simulation: A systematic review and meta-analysis

Debriefing is a common feature of technology‐enhanced simulation (TES) education. However, evidence for its effectiveness remains unclear. We sought to characterise how debriefing is reported in the TES literature, identify debriefing features that are associated with improved outcomes, and evaluate the effectiveness of debriefing when combined with TES.

Debriefing Assessment for Simulation in Healthcare: Development and Psychometric Properties

Introduction This study examined the reliability of the scores of an assessment instrument, the Debriefing Assessment for Simulation in Healthcare (DASH), in evaluating the quality of health care simulation debriefings. The secondary objective was to evaluate whether the instrument’s scores demonstrate evidence of validity. Methods Two aspects of reliability were examined, interrater reliability and internal consistency. To assess interrater reliability, intraclass correlations were calculated for 114 simulation instructors enrolled in webinar training courses in the use of the DASH. The instructors reviewed a series of 3 standardized debriefing sessions. To assess internal consistency, Cronbach &agr; was calculated for this cohort. Finally, 1 measure of validity was examined by comparing the scores across 3 debriefings of different quality. Results Intraclass correlation coefficients for the individual elements were predominantly greater than 0.6. The overall intraclass correlation coefficient for the combined elements was 0.74. Cronbach &agr; was 0.89 across the webinar raters. There were statistically significant differences among the ratings for the 3 standardized debriefings (P < 0.001). Conclusions The DASH scores showed evidence of good reliability and preliminary evidence of validity. Additional work will be needed to assess the generalizability of the DASH based on the psychometrics of DASH data from other settings.

Promoting Excellence and Reflective Learning in Simulation (pearls): Development and Rationale for a Blended Approach to Health Care Simulation Debriefing

Summary Statement We describe an integrated conceptual framework for a blended approach to debriefing called PEARLS [Promoting Excellence And Reflective Learning in Simulation]. We provide a rationale for scripted debriefing and introduce a PEARLS debriefing tool designed to facilitate implementation of the new framework. The PEARLS framework integrates 3 common educational strategies used during debriefing, namely, (1) learner self-assessment, (2) facilitating focused discussion, and (3) providing information in the form of directive feedback and/or teaching. The PEARLS debriefing tool incorporates scripted language to guide the debriefing, depending on the strategy chosen. The PEARLS framework and debriefing script fill a need for many health care educators learning to facilitate debriefings in simulation-based education. The PEARLS offers a structured framework adaptable for debriefing simulations with a variety in goals, including clinical decision making, improving technical skills, teamwork training, and interprofessional collaboration.

Technology-Enhanced Simulation and Pediatric Education: A Meta-analysis

BACKGROUND AND OBJECTIVE: Pediatrics has embraced technology-enhanced simulation (TES) as an educational modality, but its effectiveness for pediatric education remains unclear. The objective of this study was to describe the characteristics and evaluate the effectiveness of TES for pediatric education. METHODS: This review adhered to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) standards. A systematic search of Medline, Embase, CINAHL, ERIC, Web of Science, Scopus, key journals, and previous review bibliographies through May 2011 and an updated Medline search through October 2013 were conducted. Original research articles in any language evaluating the use of TES for educating health care providers at any stage, where the content solely focuses on patients 18 years or younger, were selected. Reviewers working in duplicate abstracted information on learners, clinical topic, instructional design, study quality, and outcomes. We coded skills (simulated setting) separately for time and nontime measures and similarly classified patient care behaviors and patient effects. RESULTS: We identified 57 studies (3666 learners) using TES to teach pediatrics. Effect sizes (ESs) were pooled by using a random-effects model. Among studies comparing TES with no intervention, pooled ESs were large for outcomes of knowledge, nontime skills (eg, performance in simulated setting), behaviors with patients, and time to task completion (ES = 0.80–1.91). Studies comparing the use of high versus low physical realism simulators showed small to moderate effects favoring high physical realism (ES = 0.31–0.70). CONCLUSIONS: TES for pediatric education is associated with large ESs in comparison with no intervention. Future research should include comparative studies that identify optimal instructional methods and incorporate pediatric-specific issues into educational interventions.

Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing: A Multicenter Randomized Trial

IMPORTANCE Resuscitation training programs use simulation and debriefing as an educational modality with limited standardization of debriefing format and content. Our study attempted to address this issue by using a debriefing script to standardize debriefings. OBJECTIVE To determine whether use of a scripted debriefing by novice instructors and/or simulator physical realism affects knowledge and performance in simulated cardiopulmonary arrests. DESIGN Prospective, randomized, factorial study design. SETTING The study was conducted from 2008 to 2011 at 14 Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing (EXPRESS) network simulation programs. Interprofessional health care teams participated in 2 simulated cardiopulmonary arrests, before and after debriefing. PARTICIPANTS We randomized 97 participants (23 teams) to nonscripted low-realism; 93 participants (22 teams) to scripted low-realism; 103 participants (23 teams) to nonscripted high-realism; and 94 participants (22 teams) to scripted high-realism groups. INTERVENTION Participants were randomized to 1 of 4 arms: permutations of scripted vs nonscripted debriefing and high-realism vs low-realism simulators. MAIN OUTCOMES AND MEASURES Percentage difference (0%-100%) in multiple choice question (MCQ) test (individual scores), Behavioral Assessment Tool (BAT) (team leader performance), and the Clinical Performance Tool (CPT) (team performance) scores postintervention vs preintervention comparison (PPC). RESULTS There was no significant difference at baseline in nonscripted vs scripted groups for MCQ (P = .87), BAT (P = .99), and CPT (P = .95) scores. Scripted debriefing showed greater improvement in knowledge (mean [95% CI] MCQ-PPC, 5.3% [4.1%-6.5%] vs 3.6% [2.3%-4.7%]; P = .04) and team leader behavioral performance (median [interquartile range (IQR)] BAT-PPC, 16% [7.4%-28.5%] vs 8% [0.2%-31.6%]; P = .03). Their improvement in clinical performance during simulated cardiopulmonary arrests was not significantly different (median [IQR] CPT-PPC, 7.9% [4.8%-15.1%] vs 6.7% [2.8%-12.7%], P = .18). Level of physical realism of the simulator had no independent effect on these outcomes. CONCLUSIONS AND RELEVANCE The use of a standardized script by novice instructors to facilitate team debriefings improves acquisition of knowledge and team leader behavioral performance during subsequent simulated cardiopulmonary arrests. Implementation of debriefing scripts in resuscitation courses may help to improve learning outcomes and standardize delivery of debriefing, particularly for novice instructors.

Designing and Conducting Simulation-Based Research

As simulation is increasingly used to study questions pertaining to pediatrics, it is important that investigators use rigorous methods to conduct their research. In this article, we discuss several important aspects of conducting simulation-based research in pediatrics. First, we describe, from a pediatric perspective, the 2 main types of simulation-based research: (1) studies that assess the efficacy of simulation as a training methodology and (2) studies where simulation is used as an investigative methodology. We provide a framework to help structure research questions for each type of research and describe illustrative examples of published research in pediatrics using these 2 frameworks. Second, we highlight the benefits of simulation-based research and how these apply to pediatrics. Third, we describe simulation-specific confounding variables that serve as threats to the internal validity of simulation studies and offer strategies to mitigate these confounders. Finally, we discuss the various types of outcome measures available for simulation research and offer a list of validated pediatric assessment tools that can be used in future simulation-based studies.

Part 14: Education 2015 American Heart Association Guidelines Update for Cardiopulmonary Resuscitation and Emergency Cardiovascular Care

Cardiac arrest is a major public health issue, with more than 500 000 deaths of children and adults per year in the United States.1–3 Despite significant scientific advances in the care of cardiac arrest victims, there remain striking disparities in survival rates for both out-of-hospital and in-hospital cardiac arrest. Survival can vary among geographic regions by as much as 6-fold for victims in the prehospital setting.4,5 Significant variability in survival outcomes also exists for cardiac arrest victims in the hospital setting, particularly when the time of day or the location of the cardiac arrest is considered.6 Inconsistencies in performance of both healthcare professionals and the systems in which they work likely contribute to these differences in outcome.7 For out-of-hospital cardiac arrest victims, the key determinants of survival are the timely performance of bystander cardiopulmonary resuscitation (CPR) and defibrillation for those in ventricular fibrillation or pulseless ventricular tachycardia. Only a minority of cardiac arrest victims receive potentially lifesaving bystander CPR, thus indicating room for improvement from a systems and educational point of view. For in-hospital cardiac arrest, the important provider-dependent determinants of survival are early defibrillation for shockable rhythms and high-quality CPR, along with recognition and response to deteriorating patients before an arrest. Defining the optimal means of delivering resuscitation education to address these critical determinants of survival may help to improve outcomes from cardiac arrest. Resuscitation education is primarily focused on ensuring widespread and uniform implementation of the science of resuscitation (eg, the Scientific Statements and Guidelines) into practice by lay and healthcare CPR providers. It aims to close the gap between actual and desired performance by providing lay providers with CPR skills and the self-efficacy to use them; supplementing training with in-the-moment support, such as dispatch-assisted CPR; improving healthcare professionals’ ability …

Simulation-based crisis resource management training for pediatric critical care medicine: A review for instructors*

Objective: To review the essential elements of crisis resource management and provide a resource for instructors by describing how to use simulation-based training to teach crisis resource management principles in pediatric acute care contexts. Data Source: A MEDLINE-based literature source. Outline of Review: This review is divided into three main sections: Background, Principles of Crisis Resource Management, and Tools and Resources. The background section provides the brief history and definition of crisis resource management. The next section describes all the essential elements of crisis resource management, including leadership and followership, communication, teamwork, resource use, and situational awareness. This is followed by a review of evidence supporting the use of simulation-based crisis resource management training in health care. The last section provides the resources necessary to develop crisis resource management training using a simulation-based approach. This includes a description of how to design pediatric simulation scenarios, how to effectively debrief, and a list of potential assessment tools that instructors can use to evaluate crisis resource management performance during simulation-based training. Conclusion: Crisis resource management principles form the foundation for efficient team functioning and subsequent error reduction in high-stakes environments such as acute care pediatrics. Effective instructor training is required for those programs wishing to teach these principles using simulation-based learning. Dissemination and integration of these principles into pediatric critical care practice has the potential for a tremendous impact on patient safety and outcomes.