Yiqun Lin

Reporting guidelines for health care simulation research: Extensions to the CONSORT and STROBE statements

BackgroundSimulation-based research (SBR) is rapidly expanding but the quality of reporting needs improvement. For a reader to critically assess a study, the elements of the study need to be clearly reported. Our objective was to develop reporting guidelines for SBR by creating extensions to the Consolidated Standards of Reporting Trials (CONSORT) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statements.MethodsAn iterative multistep consensus-building process was used on the basis of the recommended steps for developing reporting guidelines. The consensus process involved the following: (1) developing a steering committee, (2) defining the scope of the reporting guidelines, (3) identifying a consensus panel, (4) generating a list of items for discussion via online premeeting survey, (5) conducting a consensus meeting, and (6) drafting reporting guidelines with an explanation and elaboration document.ResultsThe following 11 extensions were recommended for CONSORT: item 1 (title/abstract), item 2 (background), item 5 (interventions), item 6 (outcomes), item 11 (blinding), item 12 (statistical methods), item 15 (baseline data), item 17 (outcomes/ estimation), item 20 (limitations), item 21 (generalizability), and item 25 (funding). The following 10 extensions were recommended for STROBE: item 1 (title/abstract), item 2 (background/rationale), item 7 (variables), item 8 (data sources/measurement), item 12 (statistical methods), item 14 (descriptive data), item 16 (main results), item 19 (limitations), item 21 (generalizability), and item 22 (funding). An elaboration document was created to provide examples and explanation for each extension.ConclusionsWe have developed extensions for the CONSORT and STROBE Statements that can help improve the quality of reporting for SBR (Sim Healthcare 00:00-00, 2016).

The use of high-fidelity manikins for advanced life support training—A systematic review and meta-analysis

OBJECTIVES The objective of this study was to evaluate the effectiveness of high versus low fidelity manikins in the context of advanced life support training for improving knowledge, skill performance at course conclusion, skill performance between course conclusion and one year, skill performance at one year, skill performance in actual resuscitations, and patient outcomes. METHODS A systematic search of Pubmed, Embase and Cochrane databases was conducted through January 31, 2014. We included two-group non-randomized and randomized studies in any language comparing high versus low fidelity manikins for advanced life support training. Reviewers worked in duplicate to extract data on learners, study design, and outcomes. The GRADE (Grades of Recommendation, Assessment, Development and Evaluation) approach was used to evaluate the overall quality of evidence for each outcome. RESULTS 3840 papers were identified from the literature search of which 14 were included (13 randomized controlled trials; 1 non-randomized controlled trial). Meta-analysis of studies reporting skill performance at course conclusion demonstrated a moderate benefit for high fidelity manikins when compared with low fidelity manikins [Standardized Mean Difference 0.59; 95% CI 0.13-1.05]. Studies measuring skill performance at one year, skill performance between course conclusion and one year, and knowledge demonstrated no significant benefit for high fidelity manikins. CONCLUSION The use of high fidelity manikins for advanced life support training is associated with moderate benefits for improving skills performance at course conclusion. Future research should define the optimal means of tailoring fidelity to enhance short and long term educational goals and clinical outcomes.

Reporting Guidelines for Health Care Simulation Research

Introduction Simulation-based research (SBR) is rapidly expanding but the quality of reporting needs improvement. For a reader to critically assess a study, the elements of the study need to be clearly reported. Our objective was to develop reporting guidelines for SBR by creating extensions to the Consolidated Standards of Reporting Trials (CONSORT) and Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statements. Methods An iterative multistep consensus-building process was used on the basis of the recommended steps for developing reporting guidelines. The consensus process involved the following: (1) developing a steering committee, (2) defining the scope of the reporting guidelines, (3) identifying a consensus panel, (4) generating a list of items for discussion via online premeeting survey, (5) conducting a consensus meeting, and (6) drafting reporting guidelines with an explanation and elaboration document. Results The following 11 extensions were recommended for CONSORT: item 1 (title/abstract), item 2 (background), item 5 (interventions), item 6 (outcomes), item 11 (blinding), item 12 (statistical methods), item 15 (baseline data), item 17 (outcomes/estimation), item 20 (limitations), item 21 (generalizability), and item 25 (funding). The following 10 extensions were recommended for STROBE: item 1 (title/abstract), item 2 (background/rationale), item 7 (variables), item 8 (data sources/measurement), item 12 (statistical methods), item 14 (descriptive data), item 16 (main results), item 19 (limitations), item 21 (generalizability), and item 22 (funding). An elaboration document was created to provide examples and explanation for each extension. Conclusions We have developed extensions for the CONSORT and STROBE Statements that can help improve the quality of reporting for SBR.

Variability in quality of chest compressions provided during simulated cardiac arrest across nine pediatric institutions.

AIM The variability in quality of CPR provided during cardiac arrest across pediatric institutions is unknown. We aimed to describe the degree of variability in the quality of CPR across 9 pediatric institutions, and determine if variability across sites would be affected by Just-in-Time CPR training and/or visual feedback during simulated cardiac arrest. METHODS We conducted secondary analyses of data collected from a prospective, multi-center trial. Participants were equally randomized to either: (1) No intervention; (2) Real-time CPR visual feedback during cardiac arrest or (3) Just-in-Time CPR training. We report the variability in median chest compression depth and rate across institutions, and the variability in the proportion of 30-s epochs of CPR meeting 2010 American Heart Association guidelines for depth and rate. RESULTS We analyzed data from 528 epochs in the no intervention group, 552 epochs in the visual feedback group, and 525 epochs in the JIT training group. In the no intervention group, compression depth (median range 22.2-39.2mm) and rate (median range 116.0-147.6 min(-1)) demonstrated significant variability between study sites (p<0.001). The proportion of compressions with adequate depth (0-11.5%) and rate (0-60.5%) also varied significantly across sites (p<0.001). The variability in compression depth and rate persisted despite use of real-time visual feedback or JIT training (p<0.001). CONCLUSION The quality of CPR across multiple pediatric institutions is variable. Variability in CPR quality across institutions persists even with the implementation of a Just-in-Time training session and visual feedback for CPR quality during simulated cardiac arrest.

The role of simulation in teaching pediatric resuscitation: current perspectives

The use of simulation for teaching the knowledge, skills, and behaviors necessary for effective pediatric resuscitation has seen widespread growth and adoption across pediatric institutions. In this paper, we describe the application of simulation in pediatric resuscitation training and review the evidence for the use of simulation in neonatal resuscitation, pediatric advanced life support, procedural skills training, and crisis resource management training. We also highlight studies supporting several key instructional design elements that enhance learning, including the use of high-fidelity simulation, distributed practice, deliberate practice, feedback, and debriefing. Simulation-based training is an effective modality for teaching pediatric resuscitation concepts. Current literature has revealed some research gaps in simulation-based education, which could indicate the direction for the future of pediatric resuscitation research.

The effect of step stool use and provider height on CPR quality during pediatric cardiac arrest: A simulation-based multicentre study

OBJECTIVES We aimed to explore whether a) step stool use is associated with improved cardiopulmonary resuscitation (CPR) quality; b) provider adjusted height is associated with improved CPR quality; and if associations exist, c) determine whether just-in-time (JIT) CPR training and/or CPR visual feedback attenuates the effect of height and/or step stool use on CPR quality. METHODS We analysed data from a trial of simulated cardiac arrests with three study arms: No intervention; CPR visual feedback; and JIT CPR training. Step stool use was voluntary. We explored the association between 1) step stool use and CPR quality, and 2) provider adjusted height and CPR quality. Adjusted height was defined as provider height + 23 cm (if step stool was used). Below-average height participants were ≤ gender-specific average height; the remainder were above average height. We assessed for interaction between study arm and both adjusted height and step stool use. RESULTS One hundred twenty-four subjects participated; 1,230 30-second epochs of CPR were analysed. Step stool use was associated with improved compression depth in below-average (female, p=0.007; male, p<0.001) and above-average (female, p=0.001; male, p<0.001) height providers. There is an association between adjusted height and compression depth (p<0.001). Visual feedback attenuated the effect of height (p=0.025) on compression depth; JIT training did not (p=0.918). Visual feedback and JIT training attenuated the effect of step stool use (p<0.001) on compression depth. CONCLUSIONS Step stool use is associated with improved compression depth regardless of height. Increased provider height is associated with improved compression depth, with visual feedback attenuating the effects of height and step stool use.

Visual assessment of CPR quality during pediatric cardiac arrest: Does point of view matter?

AIM In many clinical settings, providers rely on visual assessment when delivering feedback on CPR quality. Little is known about the accuracy of visual assessment of CPR quality. We aimed to determine how accurate pediatric providers are in their visual assessment of CPR quality and to identify the optimal position relative to the patient for accurate CPR assessment. METHODS We videotaped high-quality CPR (based on 2010 American Heart Association guidelines) and 3 variations of poor quality CPR in a simulated resuscitation, filmed from the foot, head and the side of the manikin. Participants watched 12 videos and completed a questionnaire to assess CPR quality. RESULTS One hundred and twenty-five participants were recruited. The overall accuracy of visual assessment of CPR quality was 65.6%. Accuracy was better from the side (70.8%) and foot (68.8%) of the bed when compared to the head of the bed (57.2%; p<0.001). The side was the best position for assessing depth (p<0.001). Rate assessment was equivalent between positions (p=0.58). The side and foot of the bed were superior to the head when assessing chest recoil (p<0.001). Factors associated with increased accuracy in visual assessment of CPR quality included recent CPR course completion (p=0.034) and involvement in more cardiac arrests as a team member (p=0.003). CONCLUSION Healthcare providers struggle to accurately assess the quality of CPR using visual assessment. If visual assessment is being used, providers should stand at the side of the bed.

Implementing economic evaluation in simulation-based medical education: challenges and opportunities

Simulation‐based medical education (SBME) is now ubiquitous at all levels of medical training. Given the substantial resources needed for SBME, economic evaluation of simulation‐based programmes or curricula is required to demonstrate whether improvement in trainee performance (knowledge, skills and attitudes) and health outcomes justifies the cost of investment. Current literature evaluating SBME fails to provide consistent and interpretable information on the relative costs and benefits of alternatives.

Causes for pauses during simulated pediatric cardiac arrest

Objectives: Pauses in cardiopulmonary resuscitation negatively impact clinical outcomes; however, little is known about the contributing factors. The objective of this study is to determine the frequency, duration, and causes for pauses during cardiac arrest. Design: This is a secondary analysis of video data collected from a prospective multicenter trial. Twenty-six simulated pediatric cardiac arrest scenarios each lasting 12 minutes in duration were analyzed by two independent reviewers to document events surrounding each pause in chest compressions. Setting: Ten children’s hospitals across Canada, the United, and the United Kingdom. Subjects: Resuscitation teams composed of three healthcare providers trained in cardiopulmonary resuscitation. Interventions: A simulated pediatric cardiac arrest case in a 5 year old. Measurements and Main Results: The frequency, duration, and associated factors for each pause were recorded. Communication was rated using a four-point scale reflecting the team’s shared mental model. Two hundred fifty-six pauses were reviewed with a median of 10 pauses per scenario (interquartile range, 7–12). Median pause duration was 5 seconds (interquartile range, 2–9 s), with 91% chest compression fraction per scenario (interquartile range, 88–94%). Only one task occurred during most pauses (66%). The most common tasks were a change of chest compressors (25%), performing pulse check (24%), and performing rhythm check (15%). Forty-nine (19%) of the pauses lasted greater than 10 seconds and were associated with shock delivery (p < 0.001), performing rhythm check (p < 0.001), and performing pulse check (p < 0.001). When a shared mental model was rated high, pauses were significantly shorter (mean difference, 4.2 s; 95% CI, 1.6–6.8 s; p = 0.002). Conclusions: Pauses in cardiopulmonary resuscitation occurred frequently during simulated pediatric cardiac arrest, with variable duration and underlying causes. A large percentage of pauses were greater than 10 seconds and occurred more frequently than the recommended 2-minute interval. Future efforts should focus on improving team coordination to minimize pause frequency and duration.

Workload of Team Leaders and Team Members During a Simulated Sepsis Scenario

Objectives: Crisis resource management principles dictate appropriate distribution of mental and/or physical workload so as not to overwhelm any one team member. Workload during pediatric emergencies is not well studied. The National Aeronautics and Space Administration-Task Load Index is a multidimensional tool designed to assess workload validated in multiple settings. Low workload is defined as less than 40, moderate 40–60, and greater than 60 signify high workloads. Our hypothesis is that workload among both team leaders and team members is moderate to high during a simulated pediatric sepsis scenario and that team leaders would have a higher workload than team members. Design: Multicenter observational study. Setting: Nine pediatric simulation centers (five United States, three Canada, and one United Kingdom). Patients: Team leaders and team members during a 12-minute pediatric sepsis scenario. Interventions: National Aeronautics and Space Administration-Task Load Index. Measurements and Main Results: One hundred twenty-seven teams were recruited from nine sites. One hundred twenty-seven team leaders and 253 team members completed the National Aeronautics and Space Administration-Task Load Index. Team leader had significantly higher overall workload than team member (51 ± 11 vs 44 ± 13; p < 0.01). Team leader had higher workloads in all subcategories except in performance where the values were equal and in physical demand where team members were higher than team leaders (29 ± 22 vs 18 ± 16; p < 0.01). The highest category for each group was mental 73 ± 13 for team leader and 60 ± 20 for team member. For team leader, two categories, mental (73 ± 17) and effort (66 ± 16), were high workload, most domains for team member were moderate workload levels. Conclusions: Team leader and team member are under moderate workloads during a pediatric sepsis scenario with team leader under high workloads (> 60) in the mental demand and effort subscales. Team leader average significantly higher workloads. Consideration of decreasing team leader responsibilities may improve team workload distribution.