Regina G. Taylor

Impact of simulation-based extracorporeal membrane oxygenation training in the simulation laboratory and clinical environment.

Introduction: Extracorporeal membrane oxygenation (ECMO) is a high-risk, complex therapy. Opportunities to develop teamwork skills and expertise to mitigate risks are few. Our objective was to assess whether simulation would improve technical and nontechnical skills in dealing with ECMO circuit emergencies and allow transfer of skills from the simulated setting to clinical environment. Methods: Subjects were ECMO circuit providers who performed scenarios utilizing an infant simulator and functional ECMO circuit, followed immediately by video-assisted debriefings. Within the simulation laboratory, outcomes were timed responses, percentage of correct actions, teamwork, safety knowledge, and attitudes. Identification of latent safety threats (LSTs) was the focus of debriefings. Within the clinical setting, translation of learned skills was assessed by measuring circuit readiness and compliance with a cannulation initiation checklist. Results: Nineteen subjects performed 96 simulations during enrollment. In the laboratory, there was no improvement in timed responses or percent correct actions. Teamwork (P = 0.001), knowledge (P = 0.033), and attitudes (P = 0.001) all improved compared with baseline. Debriefing identified 99 LSTs. Clinically, 26 cannulations occurred during enrollment. Median time from blood available to circuit readiness was 17 minutes (range, 5–95), with no improvement during the study. Compliance with the initiation checklist improved compared with prestudy baseline (P < 0.0001). Conclusions: Simulation-based training is an effective method to improve safety knowledge, attitudes, and teamwork surrounding ECMO emergencies. On-going training is feasible and allows identification of LSTs. Further work is needed to assess translation of learned skills and behaviors into the clinical environment.

Identification of Latent Safety Threats Using High-Fidelity Simulation-Based Training with Multidisciplinary Neonatology Teams

BACKGROUND Latent safety threats (LSTs) are errors in design, organization, training, or maintenance that may contribute to medical errors and have a significant impact on patient safety. The investigation described in this article was conducted as part of a larger prospective, longitudinal evaluation using laboratory- and in situ simulation-based training sessions to improve technical and nontechnical skills of neonatal ICU (NICU) providers at a Level III academic NICU. METHODS Simulations were performed in laboratory (4 scenarios per session) and in situ (1 scenario per session) settings with multidisciplinary neonatology teams. Facilitators and subjects identified LSTs during standardized debriefings immediately following each scenario After enrollment, facilitators classified LSTs into equipment, medication, personnel, resource, or technical skill. Pervasive team knowledge gaps were further subclassified into lack of awareness or understanding, procedure performed incorrectly, omission of necessary action, or inappropriate action. RESULTS In a 19-month period of enrollment (August 2009-March 2011), 177 subjects of 202 NICU providers were trained in the laboratory, 135 of whom participated in the in situ sessions. In the laboratory, 22 sessions were completed, with 70 LSTs identified (0.8 LSTs per scenario). During the 16 in situ sessions, 29 LSTs (1.8 LSTs per scenario) were identified. The 99 LSTs were reported to NICU leadership, leading to 19 documented improvements. CONCLUSIONS The NICU setting has a high rate of previously unidentified LSTs. Conducting in situ scenarios allows for the identification of novel LSTs not detected in the simulation laboratory. The subsequent clinical improvements made to the actual clinical care environment are the best objective evidence of the benefits of simulation-based multidisciplinary team training.

Teamwork skills in actual, in situ, and in-center pediatric emergencies: performance levels across settings and perceptions of comparative educational impact.

Introduction Pediatric emergencies require effective teamwork. These skills are developed and demonstrated in actual emergencies and in simulated environments, including simulation centers (in center) and the real care environment (in situ). Our aims were to compare teamwork performance across these settings and to identify perceived educational strengths and weaknesses between simulated settings. We hypothesized that teamwork performance in actual emergencies and in situ simulations would be higher than for in-center simulations. Methods A retrospective, video-based assessment of teamwork was performed in an academic, pediatric level 1 trauma center, using the Team Emergency Assessment Measure (TEAM) tool (range, 0–44) among emergency department providers (physicians, nurses, respiratory therapists, paramedics, patient care assistants, and pharmacists). A survey-based, cross-sectional assessment was conducted to determine provider perceptions regarding simulation training. Results One hundred thirty-two videos, 44 from each setting, were reviewed. Mean total TEAM scores were similar and high in all settings (31.2 actual, 31.1 in situ, and 32.3 in-center, P = 0.39). Of 236 providers, 154 (65%) responded to the survey. For teamwork training, in situ simulation was considered more realistic (59% vs. 10%) and more effective (45% vs. 15%) than in-center simulation. Discussion In a video-based study in an academic pediatric institution, ratings of teamwork were relatively high among actual resuscitations and 2 simulation settings, substantiating the influence of simulation-based training on instilling a culture of communication and teamwork. On the basis of survey results, providers favored the in situ setting for teamwork training and suggested an expansion of our existing in situ program.

Point-of-care testing improves accuracy of STI care in an emergency department

Objectives We aimed to examine the impact of a point-of-care (POC) test on overtreatment and undertreatment of sexually transmitted infections (STIs) by comparing treatment patterns for gonorrhoea (detected with nucleic acid amplification testing (NAAT)) with trichomoniasis (detected by POC test) for young women seen in an emergency department (ED). Methods We reviewed the database of a quality improvement (QI) project that aims to improve follow-up care for STIs in the ED. Data included the test result and antibiotic given (if any) during visits by women age 14–21 for whom an STI test was ordered. We generated Shewhart control charts and compared overtreatment and undertreatment rates for gonorrhoea and trichomoniasis using χ2 testing. Results Of 1877 visits over 18 months, 8.8% of women had gonorrhoea and 16.5% had trichomoniasis. Overtreatment was higher for women with gonorrhoea than trichomoniasis (54% vs 23%, p<0.001). Overtreatment for gonorrhoea decreased from 58% to 47% (p<0.01) and overtreatment for trichomoniasis decreased from 24% to 18% (p<0.01), which corresponded to improvements in patient follow-up for the QI project. Undertreatment was higher for women with gonorrhoea than trichomoniasis (29% vs 21%, p=0.03), and did not change over time. Conclusions A POC test improves the accuracy of STI care in an ED compared with NAAT testing. An unanticipated benefit of QI efforts to improve patient follow-up is the observed decrease in antibiotic use in the ED. Given the ability of gonorrhoea to develop antibiotic resistance, future efforts should focus on development of an accurate POC test for gonorrhoea.

Adolescent Patient Preferences Surrounding Partner Notification and Treatment for Sexually Transmitted Infections

OBJECTIVES Important barriers to addressing the sexually transmitted infection (STI) epidemic among adolescents are the inadequate partner notification of positive STI results and insufficient rates of partner testing and treatment. However, adolescent attitudes regarding partner notification and treatment are not well understood. The aim was to qualitatively explore the barriers to and preferences for partner notification and treatment among adolescent males and females tested for STIs in an emergency department (ED) setting and to explore the acceptability of ED personnel notifying their sexual partners. METHODS This was a descriptive, qualitative study in which a convenience sample of 40 adolescents (18 females, 22 males) 14 to 21 years of age who presented to either adult or pediatric EDs with STI-related complaints participated. Individualized, semistructured, confidential interviews were administered to each participant. Interviews were audiotaped and transcribed verbatim by an independent transcriptionist. Data were analyzed using framework analysis. RESULTS Barriers to partner notification included fear of retaliation or loss of the relationship, lack of understanding of or concern for the consequences associated with an STI, and social stigma and embarrassment. Participants reported two primary barriers to their partners obtaining STI testing and treatment: lack of transportation to the health care site and the partners fear of STI positive test results. Most participants preferred to notify their main sexual partners of an STI exposure via a face-to-face interaction or a phone call. Most participants were agreeable with a health care provider (HCP) notifying their main sexual partners of STI exposure and preferred that the HCP notify the partner by phone call. CONCLUSIONS There are several adolescent preferences and barriers for partner notification and treatment. To be most effective, future interventions to prevent adolescent STIs should incorporate these preferences and address the barriers to partner notification. In an ED setting, using HCPs to provide partner notification of STI exposures is acceptable to adolescent patients; however, the feasibility of this type of program needs further exploration.

Will they participate? Predicting patients’ response to clinical trial invitations in a pediatric emergency department

Abstract Objective (1) To develop an automated algorithm to predict a patient’s response (ie, if the patient agrees or declines) before he/she is approached for a clinical trial invitation; (2) to assess the algorithm performance and the predictors on real-world patient recruitment data for a diverse set of clinical trials in a pediatric emergency department; and (3) to identify directions for future studies in predicting patients’ participation response. Materials and Methods We collected 3345 patients’ response to trial invitations on 18 clinical trials at one center that were actively enrolling patients between January 1, 2010 and December 31, 2012. In parallel, we retrospectively extracted demographic, socioeconomic, and clinical predictors from multiple sources to represent the patients’ profiles. Leveraging machine learning methodology, the automated algorithms predicted participation response for individual patients and identified influential features associated with their decision-making. The performance was validated on the collection of actual patient response, where precision, recall, F-measure, and area under the ROC curve were assessed. Results Compared to the random response predictor that simulated the current practice, the machine learning algorithms achieved significantly better performance (Precision/Recall/F-measure/area under the ROC curve: 70.82%/92.02%/80.04%/72.78% on 10-fold cross validation and 71.52%/92.68%/80.74%/75.74% on the test set). By analyzing the significant features output by the algorithms, the study confirmed several literature findings and identified challenges that could be mitigated to optimize recruitment. Conclusion By exploiting predictive variables from multiple sources, we demonstrated that machine learning algorithms have great potential in improving the effectiveness of the recruitment process by automatically predicting patients’ participation response to trial invitations.

Leveraging the Critical Decision Method to Develop Simulation-Based Training for Early Recognition of Sepsis

Training hour reductions for resident physicians have resulted in fewer opportunities for novices to manage critically ill patients. Our goals were (a) to understand differences in how novices and experts notice and interpret clinical cues using sepsis as an exemplar and (b) to develop simulations that replicate clinical cues to facilitate acquisition of expertise. Researchers conducted 14 critical decision method (CDM) interviews with four novices (interns), four senior trainees (senior residents), and six faculty (expert) physicians. We interviewed across a spectrum of experience to better assess for experience-based differences in sepsis recognition. Investigators analyzed transcribed interviews using a card sort technique. Experts described more hypothesis testing and violated expectations than novices. Expert–novice differences in sepsis recognition informed the design and future piloting of training scenarios that require novices to seek, interpret, and act on relevant cues.

Defining the Simulation Technician Role: Results of a Survey-Based Study.

Introduction In health care simulation, simulation technicians perform multiple tasks to support various educational offerings. Technician responsibilities and the tasks that accompany them seem to vary between centers. The objectives were to identify the range and frequency of tasks that technicians perform and to determine if there is a correspondence between what technicians do and what they feel their responsibilities should be. We hypothesized that there is a core set of responsibilities and tasks for the technician position regardless of background, experience, and type of simulation center. Methods We conducted a prospective, survey-based study of individuals currently functioning in a simulation technician role in a simulation center. This survey was designed internally and piloted within 3 academic simulation centers. Potential respondents were identified through a national mailing list, and the survey was distributed electronically during a 3-week period. Results A survey request was sent to 280 potential participants, 136 (49%) responded, and 73 met inclusion criteria. Five core tasks were identified as follows: equipment setup and breakdown, programming scenarios into software, operation of software during simulation, audiovisual support for courses, and on-site simulator maintenance. Independent of background before they were hired, technicians felt unprepared for their role once taking the position. Formal training was identified as a need; however, the majority of technicians felt experience over time was the main contributor toward developing knowledge and skills within their role. Conclusions This study represents a first step in defining the technician role within simulation-based education and supports the need for the development of a formal job description to allow recruitment, development, and certification.

Video-based Assessment of Peripheral Intravenous Catheter Insertion in the Resuscitation Area of a Pediatric Emergency Department

OBJECTIVE The objective was to describe the frequency of and factors associated with prolonged peripheral intravenous catheter (PIV) insertion in the resuscitation area of a pediatric emergency department (PED). METHODS Video-based study of a consecutive sample of nontrauma patients undergoing PIV insertion in the resuscitation area of a PED. Preexisting videos were the main data source. The primary outcome was patients with prolonged duration of PIV insertion (>90 seconds from start of first attempt to successful flush/blood draw). Logistic regression identified variables independently associated with prolonged PIV insertion. RESULTS A total of 151 consecutive nontrauma patients underwent PIV insertion during a 2.5-month period. Sixty-nine patients (46%) had prolonged PIV insertion, including 14 for whom PED providers failed to insert PIVs. For patients with successful PIV insertion by PED providers, median duration was 48 seconds (interquartile range [IQR] = 23 to 295 seconds). Vascular access was ultimately achieved for 13 patients (93%) with initial insertion failure by the PED team (10 non-PED personnel, three intraosseous lines), with a median duration of 26.7 minutes (IQR = 19.9 to 34.2 minutes). Age ≤ 2 years (ORadj = 6.9; 95% confidence interval [CI] = 2.9 to 16.1) and musculoskeletal contractures (ORadj = 5.3; 95% CI = 1.6 to 17.2) were independently associated with prolonged PIV insertion. CONCLUSIONS Prolonged PIV insertion is common in a PED resuscitation area. When PED providers could not insert a PIV, time to insertion was very long. Young patients and those with contractures were at particular risk for prolonged and failed PIV placement. When emergent vascular access is required, alternative approaches should be considered early for these patients.

Factors associated with participation in research conducted in a pediatric emergency department.

Objective To examine the association of demographic and study characteristics in eligible subjects who agree to participate compared with those who did not participate in clinical research studies in a pediatric emergency department (PED). Methods Information for all families approached for participation in PED-based clinical research studies during a 6-year period was recorded in an electronic database. This included demographic factors, decision to participate, primary reason for not participating, and study characteristics. Forty studies were included in this analysis. Differences in participation rate among demographic and study characteristics were examined. Multivariable logistic regression was used to predict the likelihood of participation. Results Participation rates were similar with respect to sex (50.1% in male vs 49.9% in female), whereas families with younger children were more likely to participate (mean age, 8.5 years vs 10.2 years among nonparticipants P < 0.001). White patients were more likely to participate than African American patients (54.7% vs 45.6% in African Americans, P < 0.001). The presence of compensation, brief time requirement, and older children was negatively associated with participation for moderate to very invasive studies. However, for noninvasive and mildly invasive studies, the presence of compensation and the time required were not associated with participation. Conclusions Study characteristics including invasiveness, time required of patients, and whether compensation is offered, along with demographic factors, influence participation in clinical studies conducted in the PED. When designing a research study in the PED, these, along with novel approaches to including all races and ethnicities in PED research, should be considered.