Kimberly Stone

Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing: A Multicenter Randomized Trial

IMPORTANCE Resuscitation training programs use simulation and debriefing as an educational modality with limited standardization of debriefing format and content. Our study attempted to address this issue by using a debriefing script to standardize debriefings. OBJECTIVE To determine whether use of a scripted debriefing by novice instructors and/or simulator physical realism affects knowledge and performance in simulated cardiopulmonary arrests. DESIGN Prospective, randomized, factorial study design. SETTING The study was conducted from 2008 to 2011 at 14 Examining Pediatric Resuscitation Education Using Simulation and Scripted Debriefing (EXPRESS) network simulation programs. Interprofessional health care teams participated in 2 simulated cardiopulmonary arrests, before and after debriefing. PARTICIPANTS We randomized 97 participants (23 teams) to nonscripted low-realism; 93 participants (22 teams) to scripted low-realism; 103 participants (23 teams) to nonscripted high-realism; and 94 participants (22 teams) to scripted high-realism groups. INTERVENTION Participants were randomized to 1 of 4 arms: permutations of scripted vs nonscripted debriefing and high-realism vs low-realism simulators. MAIN OUTCOMES AND MEASURES Percentage difference (0%-100%) in multiple choice question (MCQ) test (individual scores), Behavioral Assessment Tool (BAT) (team leader performance), and the Clinical Performance Tool (CPT) (team performance) scores postintervention vs preintervention comparison (PPC). RESULTS There was no significant difference at baseline in nonscripted vs scripted groups for MCQ (P = .87), BAT (P = .99), and CPT (P = .95) scores. Scripted debriefing showed greater improvement in knowledge (mean [95% CI] MCQ-PPC, 5.3% [4.1%-6.5%] vs 3.6% [2.3%-4.7%]; P = .04) and team leader behavioral performance (median [interquartile range (IQR)] BAT-PPC, 16% [7.4%-28.5%] vs 8% [0.2%-31.6%]; P = .03). Their improvement in clinical performance during simulated cardiopulmonary arrests was not significantly different (median [IQR] CPT-PPC, 7.9% [4.8%-15.1%] vs 6.7% [2.8%-12.7%], P = .18). Level of physical realism of the simulator had no independent effect on these outcomes. CONCLUSIONS AND RELEVANCE The use of a standardized script by novice instructors to facilitate team debriefings improves acquisition of knowledge and team leader behavioral performance during subsequent simulated cardiopulmonary arrests. Implementation of debriefing scripts in resuscitation courses may help to improve learning outcomes and standardize delivery of debriefing, particularly for novice instructors.

Management of Febrile Neonates in US Pediatric Emergency Departments

BACKGROUND: Blood, urine, and cerebrospinal fluid cultures and admission for antibiotics are considered standard management of febrile neonates (0–28 days). We examined variation in adherence to these recommendations across US pediatric emergency departments (PEDs) and incidence of serious infections (SIs) in febrile neonates. METHODS: Cross-sectional study of neonates with a diagnosis of fever evaluated in 36 PEDs in the 2010 Pediatric Health Information System database. We analyzed performance of recommended management (laboratory testing, antibiotic use, admission to hospital), 48-hour return visits to PED, and diagnoses of SI. RESULTS: Of 2253 neonates meeting study criteria, 369 (16.4%) were evaluated and discharged from the PED; 1884 (83.6%) were admitted. Recommended management occurred in 1497 of 2253 (66.4%; 95% confidence interval, 64.5–68.4) febrile neonates. There was more than twofold variation across the 36 PEDs in adherence to recommended management, recommended testing, and recommended treatment of febrile neonates. There was significant variation in testing and treatment between admitted and discharged neonates (P < .001). A total of 269 in 2253 (11.9%) neonates had SI, of whom 223 (82.9%; 95% confidence interval, 77.9–86.9) received recommended management. CONCLUSIONS: There was wide variation across US PEDs in adherence to recommended management of febrile neonates. One in 6 febrile neonates was discharged from the PED; discharged patients were less likely to receive testing or antibiotic therapy than admitted patients. A majority of neonates with SI received recommended evaluation and management. High rates of SI in admitted patients but low return rates for missed infections in discharged patients suggest a need for additional studies to understand variation from the current recommendations.

The Simulation Team Assessment Tool (STAT): Development, reliability and validation

INTRODUCTION Simulation sessions prepare medical professionals for pediatric emergencies. No validated tools exist to evaluate overall team performance. Our objective was to develop and evaluate the inter-rater reliability and validity of a team performance assessment tool during simulated pediatric resuscitations. METHODS We developed the Simulation Team Assessment Tool (STAT) which evaluated 4 domains: basic assessment skills, airway/breathing, circulation, and human factors. Scoring of each element was behaviorally anchored from 0 to 2 points. Two teams of resuscitation experts and two teams of pediatric residents performed the same simulated pediatric resuscitation. Each team was scored by six raters using the STAT. Intraclass correlation coefficients (ICC) were calculated to assess inter-rater reliability. Overall performance and domain scores between expert and resident teams were compared using repeated measures of analysis of variance to assess construct validity. RESULTS ICCs for overall performance were 0.81. Domain ICCs were: basic skills 0.73, airway/breathing skills 0.30, circulation skills 0.76, human factors 0.68. Expert versus resident average scores were: overall performance 84% vs. 66% (p=0.02), basic skills 73% vs. 55% (p<0.01); airway 80% vs. 75% (p=0.25), circulation 90% vs. 69% (p=0.02), human factors 89% vs. 66% (p=0.02). CONCLUSIONS The STATs overall performance, basic skills, circulation, and human factors domains had good to excellent inter-rater reliability, discriminating well between expert and resident teams. Similar performance in the airway/breathing domain among all teams magnified the impact of a small number of rater disagreements on the ICC. Additional study is needed to better assess the airway/breathing domain.

Simulation in Pediatric Emergency Medicine Fellowships.

BACKGROUND AND OBJECTIVES: Graduate medical education faces challenges as programs transition to the next accreditation system. Evidence supports the effectiveness of simulation for training and assessment. This study aims to describe the current use of simulation and barriers to its implementation in pediatric emergency medicine (PEM) fellowship programs. METHODS: A survey was developed by consensus methods and distributed to PEM program directors via an anonymous online survey. RESULTS: Sixty-nine (95%) fellowship programs responded. Simulation-based training is provided by 97% of PEM fellowship programs; the remainder plan to within 2 years. Thirty-seven percent incorporate >20 simulation hours per year. Barriers include the following: lack of faculty time (49%) and faculty simulation experience (39%); limited support for learner attendance (35%); and lack of established curricula (32%). Of those with written simulation curricula, most focus on resuscitation (71%), procedures (63%), and teamwork/communication (38%). Thirty-seven percent use simulation to evaluate procedural competency and resuscitation management. PEM fellows use simulation to teach (77%) and have conducted simulation-based research (33%). Thirty percent participate in a fellows’ “boot camp”; however, finances (27%) and availability (15%) limit attendance. Programs receive simulation funding from hospitals (47%), academic institutions (22%), and PEM revenue (17%), with 22% reporting no direct simulation funding. CONCLUSIONS: PEM fellowships have rapidly integrated simulation into their curricula over the past 5 years. Current limitations primarily involve faculty and funding, with equipment and dedicated space less significant than previously reported. Shared curricula and assessment tools, increased faculty and financial support, and regionalization could ameliorate barriers to incorporating simulation into PEM fellowships.

Development and validation of a multiple choice examination assessing cognitive and behavioural knowledge of pediatric resuscitation: A report from the EXPRESS pediatric research collaborative

INTRODUCTION Assessing the knowledge of Pediatric Advanced Life Support (PALS) based learning objectives of medical trainees is an important evaluation component for both residency programs and for research studies. In this study, a multiple-choice question (MCQ) examination was developed and validated for use in a larger pediatric simulation resuscitation study (EXPRESS study). METHODS Experts in pediatric resuscitation developed two MCQ exams using a set of pre-determined learning objectives. After a single center pilot, the exam was used as an assessment of cognitive skills in the EXPRESS study, a multicenter trial examining the use of scripted debriefing and high-fidelity simulation in pediatric resuscitation education. Results from the MCQ in the pre-intervention phase of the EXPRESS study were used to assess the reliability and validity of the MCQ examination. In addition, an Exploratory Factor Analysis (EFA) was carried to assess the underlying structure of the PALS-based learning objectives. RESULTS 435 health care professionals completed the MCQ examination with an average score of 69.3%. Significantly higher examination results were seen in physicians vs. non-physicians, senior vs. junior physicians and participants with up-to-date PALS certification. The EFA results indicated four distinct categories of items were assessed. CONCLUSION This short MCQ examination demonstrated reasonable reliability and construct validity. It may be useful to assess pediatric resuscitation knowledge in future studies or courses.

Improving Patient Flow Using Lean Methodology: an Emergency Medicine Experience

Opinion statementIn today’s rapidly changing health care milieu, organizations are expected to continuously improve the quality of care delivered to an expanding population of patients. To do so, they need a framework for developing, testing and implementing changes. Lean provides a methodology to engage workers and leaders to identify waste in a process, develop standards, implement a change, assess the results of that change, review next steps, and repeat the process. This can be successfully accomplished in the highly variable world of emergency medicine and can help health care providers be more productive, engaged, and satisfied while enabling patients to receive the value-added care they want and expect. Successful implementation of Lean or any other improvement framework requires that the hospital and medical leadership are all strong supporters of the methodology, speak the same process improvement language and are able to generate support and resources for operation-wide forward movement.

Simulation to Assist in the Selection Process of New Airway Equipment in a Children's Hospital

Introduction: To provide an informed choice of equipment purchase, we sought to use simulation to allow medical providers an opportunity to evaluate two potential laryngoscopes. Methods: The study followed a prospective, blinded comparison design. Participants were blinded to the laryngoscope brands by using alphabetic labels on the handles (“A” and “B”). Participants included a convenience sample of healthcare providers who perform intubation. Participants were allowed to perform intubation with the two laryngoscope brands on neonatal, child, and adolescent/adult airway simulators. After practicing with each of the two different laryngoscopes, participants completed an evaluation indicating their preference for one laryngoscope versus the other for each patient age group. Results: Thirty-four healthcare providers participated in the study, including attendings, fellows, nurse practitioners, and transport team members from Neonatology, Pediatric Intensive Care, Anesthesiology, Emergency Medicine, Cardiac Intensive Care, and Otolaryngology. Participants overwhelmingly preferred brand ‘A’ (89%) over brand ‘B’ (11%). Discussion: Providers overwhelmingly chose one laryngoscope over the other. Data from this evaluation were used to determine which of the two laryngoscope brands was purchased. Based on our experience, we feel other hospitals should consider the use of simulation to allow providers to examine, compare, and rate medical equipment prior to making purchasing decisions.

Variation in pediatric emergency department care of sickle cell disease and fever.

OBJECTIVES The objective was to study the variation in pediatric emergency department (PED) practice patterns for evaluation and management of children with sickle cell disease (SCD) and fever in U.S. childrens hospitals. METHODS A cross-sectional study of visits by children 3 months to 18 years of age with SCD and fever evaluated in 36 U.S. childrens hospital PEDs within the 2010 Pediatric Health Information System database. The main outcome measures were the proportions of SCD visits that received evaluation (laboratory testing and chest radiographs [CXRs]) and treatment (parenteral administration of antibiotics) and were admitted for fever. RESULTS Of the 4,853 PED visits for SCD and fever, 91.7% had complete blood counts (CBCs), 93.8% had reticulocyte counts, 93% had blood cultures obtained, 68.5% had CXRs, and 91.7% received antibiotics. Most (81.4%) patients received the recommended National Heart, Lung and Blood Institute evaluation (CBC, reticulocyte count, and blood culture) and treatment (parenteral antibiotics). In multivariate regression modeling controlling for hospital- and patient-level effects, age groups ≥1 to <5 years (odds ratio [OR] = 0.32, 95% confidence interval [CI] = 0.25 to 0.40) and ≥5 to <13 years (OR = 0.40, 95% CI = 0.32 to 0.50), and those visits that did not have CXRs had lower odds of hospital admission. After adjusting for age, payor status, receipt of laboratory testing, antibiotics, and CXRs, admission rates varied by sevenfold across U.S. childrens hospitals (p < 0.001). CONCLUSIONS Standardization of practice exists across childrens hospitals regarding obtaining laboratory studies and administering antibiotics for patients with SCD and fever. However, admission rates vary significantly. Evaluating the causes and consequences of such significant variation needs further exploration to improve the quality of care for patients with SCD.

Pediatric Toxidrome Simulation Curriculum: Liquid Nicotine Overdose

Introduction Liquid nicotine exposure is becoming more common in the pediatric population. Toxicity may occur with exposure to small quantities given the high concentrations in solutions available commercially. Effects can include altered mental status, seizure, and death. Methods This simulation-based case involves the identification and management of a toddler presenting with acute liquid nicotine exposure, with emphasis on the general approach to the acutely ill pediatric patient, consideration in toxic exposures, and the presentation of nicotine exposure. Providers should assess airway, breathing, and circulation while concurrently providing supportive care for an actively seizing simulated patient, necessitating appropriate selection of medications and acute airway management. Additionally, providers must maintain a broad differential diagnosis and obtain a focused history to narrow that differential and identify toxic exposure as a cause of the patients presentation. Preparatory and didactic material is provided to help the instructor prepare the simulation environment, guide learners through the case, and debrief with learners afterward. Results We implemented this curriculum with four pediatric emergency medicine fellows and 15 pediatric residents during two sessions. Feedback was overwhelmingly positive; participants who completed evaluations reported high levels of confidence with knowledge and skills directly related to the educational objectives after participation (mean Likert scores of 4.9 out of 5 in response to effectiveness of the case in teaching evaluation and management of nicotine toxicity). Discussion This comprehensive resource will aid in offering continuing education for providers and specifically in educating learners with regard to acute liquid nicotine exposure in a child.

Pediatric Emergency Medicine Simulation Curriculum: Electrical Injury

Introduction Electrical injuries are rare but potentially life-threatening medical emergencies that require providers to manage a critically ill patient while recognizing and treating the unique sequelae associated with the diagnosis. This simulation case is designed to give pediatric and emergency medicine residents, fellows, attendings, and nurses the opportunity to practice these skills in a realistic setting. Methods This simulation-based curriculum was designed for a high-fidelity mannequin in an emergency department resuscitation room but can be adapted to fit a variety of learning environments. The case featured a 16-year-old boy presenting to the emergency department after arresting in the field after sustaining an electrical injury. He developed ventricular tachycardia during the simulation and had significant hyperkalemia, requiring emergent management. The included debriefing tools assisted instructors in providing formative feedback to learners. Results A total of 40 residents, medical students, and fellows participated in this scenario and provided overwhelmingly positive feedback about the learning experience. Mean Likert scores for participant confidence related to learning objectives after the simulation were 4 or greater on a 5-point scale. Discussion This case was developed to help learners at various levels of training recognize and manage a low-frequency, high-acuity scenario in a standardized environment. Participants specifically had the opportunity to perform airway management, cardiopulmonary resuscitation, defibrillation, and management of hyperkalemia, which may present in real life from a multitude of etiologies. The included materials helped prepare and assist facilitators with debriefing, supplemental education, and bidirectional feedback.