Joseph B. House

Reporting Achievement of Medical Student Milestones to Residency Program Directors: An Educational Handover.

PROBLEM Competency-based education, including assessment of specialty-specific milestones, has become the dominant medical education paradigm; however, how to determine baseline competency of entering interns is unclear-as is to whom this responsibility falls. Medical schools should take responsibility for providing residency programs with accurate, competency-based assessments of their graduates. APPROACH A University of Michigan ad hoc committee developed (spring 2013) a post-Match, milestone-based medical student performance evaluation for seven students matched into emergency medicine (EM) residencies. The committee determined EM milestone levels for each student based on assessments from the EM clerkship, end-of-third-year multistation standardized patient exam, EM boot camp elective, and other medical school data. OUTCOMES In this feasibility study, the committee assessed nearly all 23 EM milestones for all seven graduates, shared these performance evaluations with the program director (PD) where each student matched, and subsequently surveyed the PDs regarding this pilot. Of the five responding PDs, none reported using the traditional medical student performance evaluation to customize training, four (80%) indicated that the proposed assessment provided novel information, and 100% answered that the assessment would be useful for all incoming trainees. NEXT STEPS An EM milestone-based, post-Match assessment that uses existing assessment data is feasible and may be effective for communicating competency-based information about medical school graduates to receiving residency programs. Next steps include further aligning assessments with competencies, determining the benefit of such an assessment for other specialties, and articulating the national need for an effective educational handover tool between undergraduate and graduate medical education institutions.

Understanding ethical dilemmas in the emergency department: views from medical students' essays.

BACKGROUND For medical students, the emergency department (ED) often presents ethical problems not encountered in other settings. In many medical schools there is little ethics training during the clinical years. The benefits of reflective essay writing in ethics and professionalism education are well established. OBJECTIVES The purpose of this study was to determine and categorize the types of ethical dilemmas and scenarios encountered by medical students in the ED through reflective essays. METHODS During a 4(th)-year emergency medicine rotation, all medical students wrote brief essays on an ethical situation encountered in the ED, and participated in an hour debriefing session about these essays. Qualitative analysis was performed to determine common themes from the essays. The frequency of themes was calculated. RESULTS The research team coded 173 essays. The most common ethical themes were autonomy (41%), social justice (32.4%), nonmaleficence (31.8%), beneficence (26.6%), fidelity (12%), and respect (8.7%). Many of the essays contained multiple ethical principles that were often in conflict with each other. In one essay, a student grappled with the decision to intubate a patient despite a preexisting do-not-resuscitate order. This patient encounter was coded with autonomy, beneficence, and nonmaleficence. Common scenarios included ethical concerns when caring for critical patients, treatment of pain, homeless or alcoholic patients, access to care, resource utilization, and appropriateness of care. CONCLUSION Medical students encounter patients with numerous ethically based issues. Frequently, they note conflicts between ethical principles. Such essays constitute an important resource for faculty, resident, and student ethics training.

Pediatric and neonatal intubation training gap analysis instruction, assessment, and technology

Summary Statement Intubating adult patients presents numerous challenges for clinicians. Procedural complexities associated with performing pediatric and neonatal intubation, along with a lower frequency of a need for intubating pediatric and neonatal patients, further amplifies the difficulties associated with acquiring and maintaining relevant clinical skills. Clinicians must develop and maintain competency through training and continuing medical education. A systematic review was conducted through June 2012 to examine current instructional methods, assessment tools, and training models in pediatric and neonatal intubation training. Variability among the included literature on instruction, assessment, and models used to support training makes direct comparison problematic. The results of this review emphasize the need for improvement of current instructional methods to promote competency acquisition; development of valid, reliable assessment tools to evaluate clinician competency; and identification of a superior training model to promote acquisition and maintenance of skills associated with intubation of pediatric patients.

Model for Developing Educational Research Productivity: The Medical Education Research Group.

Introduction Education research and scholarship are essential for promotion of faculty as well as dissemination of new educational practices. Educational faculty frequently spend the majority of their time on administrative and educational commitments and as a result educators often fall behind on scholarship and research. The objective of this educational advance is to promote scholarly productivity as a template for others to follow. Methods We formed the Medical Education Research Group (MERG) of education leaders from our emergency medicine residency, fellowship, and clerkship programs, as well as residents with a focus on education. First, we incorporated scholarship into the required activities of our education missions by evaluating the impact of programmatic changes and then submitting the curricula or process as peer-reviewed work. Second, we worked as a team, sharing projects that led to improved motivation, accountability, and work completion. Third, our monthly meetings served as brainstorming sessions for new projects, research skill building, and tracking work completion. Lastly, we incorporated a work-study graduate student to assist with basic but time-consuming tasks of completing manuscripts. Results The MERG group has been highly productive, achieving the following scholarship over a three-year period: 102 abstract presentations, 46 journal article publications, 13 MedEd Portal publications, 35 national didactic presentations and five faculty promotions to the next academic level. Conclusion An intentional focus on scholarship has led to a collaborative group of educators successfully improving their scholarship through team productivity, which ultimately leads to faculty promotions and dissemination of innovations in education.

Correlation of the NBME Advanced Clinical Examination in EM and the National EM M4 exams

Introduction Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams. Methods From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson’s correlation and random effects linear regression. Results 303 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (279 and 24, respectively). The mean percent correct for the exams were as follows: EM-ACE 74.8 (SD-8.83), V1 83.0 (SD-6.41), V2 78.5 (SD-7.70). Pearson’s correlation coefficient for the V1/EM-ACE was 0.51 (0.42 scaled) and for the V2/EM-ACE was 0.59 (0.41 scaled). The coefficient of determination for V1/EM-ACE was 0.72 and for V2/EM-ACE = 0.71 (0.86 and 0.49 for scaled scores). The R-squared values were 0.25 and 0.30 (0.18 and 0.13, scaled), respectively. There was significant cluster effect by institution. Conclusion There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams.

Lumbar Punctures at an Academic Level 4 NICU: Indications for a New Curriculum

Issue: Pediatric residents commonly perform lumbar punctures during their clinical training. The objective of this study was to assess residents’ rate of nontraumatic lumbar punctures, examine the adequacy of samples, and implement proper documentation of the procedure in an academic Level 4 Neonatal Intensive Care Unit. We hypothesize that traumatic taps are common and that documentation of the procedure is poor. Evidence: A retrospective chart review was done of infants admitted to the neonatal intensive care unit from January 2011 to November 2011 who underwent a lumbar puncture. Procedure notes were evaluated for completion of proper documentation, the lab specimen was assessed for red blood cell count less than 1,000 cells/mm3, and individuals were assessed for their ability to obtain a cerebrospinal fluid sample to send to the lab for analysis (i.e., sample of adequate volume and not clotted) and the total number of attempts to obtain a sample. A total of 184 charts were reviewed. Procedure notes were incomplete (58%) and lacked pertinent details. Eight percent of samples obtained had no record of the procedure being preformed. There was inadequate sample acquisition in 23% of the lumbar punctures. More than three attempts were noted in 14% of lumbar punctures performed. Many specimens contained very high red blood cell counts. Seventy-five percent of lumbar punctures with full documentation (n = 60), resulted in cerebrospinal fluid with more than 1,000 red blood cells/mm3 and 55% of underdocumented lumbar punctures resulted in cerebrospinal fluid with more than 1,000 red blood cells/mm3 (n = 71). Implications: We found that poorly documented lumbar punctures are common and the ability of residents to obtain satisfactory cerebrospinal fluid is low. The inability of residents to consistently perform nontraumatic lumbar punctures is likely a common phenomenon. New educational methods and evaluation criteria must be developed to address this gap in resident education.

Implementation of an Education Value Unit (EVU) system to recognize faculty contributions

Introduction Faculty educational contributions are hard to quantify, but in an era of limited resources it is essential to link funding with effort. The purpose of this study was to determine the feasibility of an educational value unit (EVU) system in an academic emergency department and to examine its effect on faculty behavior, particularly on conference attendance and completion of trainee evaluations. Methods A taskforce representing education, research, and clinical missions was convened to develop a method of incentivizing productivity for an academic emergency medicine faculty. Domains of educational contributions were defined and assigned a value based on time expended. A 30-hour EVU threshold for achievement was aligned with departmental goals. Targets included educational presentations, completion of trainee evaluations and attendance at didactic conferences. We analyzed comparisons of performance during the year preceding and after implementation. Results Faculty (N=50) attended significantly more didactic conferences (22.7 hours v. 34.5 hours, p<0.005) and completed more trainee evaluations (5.9 v. 8.8 months, p<0.005). During the pre-implementation year, 84% (42/50) met the 30-hour threshold with 94% (47/50) meeting post-implementation (p=0.11). Mean total EVUs increased significantly (94.4 hours v. 109.8 hours, p=0.04) resulting from increased conference attendance and evaluation completion without a change in other categories. Conclusion In a busy academic department there are many work allocation pressures. An EVU system integrated with an incentive structure to recognize faculty contributions increases the importance of educational responsibilities. We propose an EVU model that could be implemented and adjusted for differing departmental priorities at other academic departments.

Performance-based comparison of neonatal intubation training outcomes: simulator and live animal.

The purpose of this article was to establish psychometric validity evidence for competency assessment instruments and to evaluate the impact of 2 forms of training on the abilities of clinicians to perform neonatal intubation. To inform the development of assessment instruments, we conducted comprehensive task analyses including each performance domain associated with neonatal intubation. Expert review confirmed content validity. Construct validity was established using the instruments to differentiate between the intubation performance abilities of practitioners (N = 294) with variable experience (novice through expert). Training outcomes were evaluated using a quasi-experimental design to evaluate performance differences between 294 subjects randomly assigned to 1 of 2 training groups. The training intervention followed American Heart Association Pediatric Advanced Life Support and Neonatal Resuscitation Program protocols with hands-on practice using either (1) live feline or (2) simulated feline models. Performance assessment data were captured before and directly following the training. All data were analyzed using analysis of variance with repeated measures and statistical significance set at P < .05. Content validity, reliability, and consistency evidence were established for each assessment instrument. Construct validity for each assessment instrument was supported by significantly higher scores for subjects with greater levels of experience, as compared with those with less experience (P = .000). Overall, subjects performed significantly better in each assessment domain, following the training intervention (P = .000). After controlling for experience level, there were no significant differences among the cognitive, performance, and self-efficacy outcomes between clinicians trained with live animal model or simulator model. Analysis of retention scores showed that simulator trained subjects had significantly higher performance scores after 18 weeks (P = .01) and 52 weeks (P = .001) and cognitive scores after 52 weeks (P = .001). The results of this study demonstrate the feasibility of using valid, reliable assessment instruments to assess clinician competency and self-efficacy in the performance of neonatal intubation. We demonstrated the relative equivalency of live animal and simulation-based models as tools to support acquisition of neonatal intubation skills. Retention of performance abilities was greater for subjects trained using the simulator, likely because it afforded greater opportunity for repeated practice. Outcomes in each assessment area were influenced by the previous intubation experience of participants. This suggests that neonatal intubation training programs could be tailored to the level of provider experience to make efficient use of time and educational resources. Future research focusing on the uses of assessment in the applied clinical environment, as well as identification of optimal training cycles for performance retention, is merited.

Location of the Appendix in the Gravid Patient

BACKGROUND Several studies have attempted to support or dispel the teaching of appendix movement away from the right lower quadrant (RLQ) during pregnancy with contradictory results. OBJECTIVE This study investigated the location of the appendix in the gravid patient in an emergency department (ED) setting using computed tomography (CT). METHODS This was a retrospective chart review of consecutive gravid patients presenting to the ED for trauma who required abdominal CT. The patient population was obtained using the Vidant Medical Center Trauma Registry from January 1, 2000 to December 31, 2006. The abdomen was divided into nine regions using the mid-clavicular lines, superior anterior iliac spine, and umbilicus. A single Board-certified radiologist determined the region location of the appendix. RESULTS Forty-five patients were identified and 35 were studied. Ten patients were excluded due to appendix not identified, unknown gestational age, or inability to review the CT study. In 21 of 22 third-trimester pregnancies, the appendix was not found in the right lower region (RLR), which corresponded to the RLQ. All 11 patients in the second trimester did not have the appendix in the RLR. Two patients were identified in the first trimester and neither appendix was found in the RLR. CONCLUSIONS The appendix in the gravid patient was not found in the RLR with increasing frequency as pregnancy progressed.

Medical Student Performance on the National Board of Medical Examiners Emergency Medicine Advanced Clinical Examination and the National Emergency Medicine M4 Exams.

Introduction In April 2013, the National Board of Medical Examiners (NBME) released an Advanced Clinical Examination (ACE) in emergency medicine (EM). In addition to this new resource, CDEM (Clerkship Directors in EM) provides two online, high-quality, internally validated examinations. National usage statistics are available for all three examinations, however, it is currently unknown how students entering an EM residency perform as compared to the entire national cohort. This information may help educators interpret examination scores of both EM-bound and non-EM-bound students. Objectives The objective of this study was to compare EM clerkship examination performance between students who matched into an EM residency in 2014 to students who did not. We made comparisons were made using the EM-ACE and both versions of the National fourth year medical student (M4) EM examinations. Method In this retrospective multi-institutional cohort study, the EM-ACE and either Version 1 (V1) or 2 (V2) of the National EM M4 examination was given to students taking a fourth-year EM rotation at five institutions between April 2013 to February 2014. We collected examination performance, including the scaled EM-ACE score, and percent correct on the EM M4 exams, and 2014 NRMP Match status. Student t-tests were performed on the examination averages of students who matched in EM as compared with those who did not. Results A total of 606 students from five different institutions took both the EM-ACE and one of the EM M4 exams; 94 (15.5%) students matched in EM in the 2014 Match. The mean score for EM-bound students on the EM-ACE, V1 and V2 of the EM M4 exams were 70.9 (n=47, SD=9.0), 84.4 (n=36, SD=5.2), and 83.3 (n=11, SD=6.9), respectively. Mean scores for non-EM-bound students were 68.0 (n=256, SD=9.7), 82.9 (n=243, SD=6.5), and 74.5 (n=13, SD=5.9). There was a significant difference in mean scores in EM-bound and non-EM-bound student for the EM-ACE (p=0.05) and V2 (p<0.01) but not V1 (p=0.18) of the National EM M4 examination. Conclusion Students who successfully matched in EM performed better on all three exams at the end of their EM clerkship.