Robert C. Korte

Initial Validity Analysis of the Emergency Medicine Milestones.

OBJECTIVES The Accreditation Council for Graduate Medical Education (ACGME) Milestones describe behavioral markers for the progressive acquisition of competencies during residency. As a key component of the Next Accreditation System, all residents are evaluated for the acquisition of specialty-specific Milestones. The objective was to determine the validity and reliability of the emergency medicine (EM) Milestones. METHODS The ACGME and the American Board of Emergency Medicine performed this single-event observational study. The data included the initial EM Milestones performance ratings of all categorical EM residents submitted to the ACGME from October 31, 2013, to January 6, 2014. Mean performance ratings were determined for all 23 subcompetencies for every year of residency training. The internal consistency (reliability) of the Milestones was determined using a standardized Cronbachs alpha coefficient. Exploratory factor analysis was conducted to determine how the subcompetencies were interrelated. RESULTS EM Milestone performance ratings were obtained on 100% of EM residents (n = 5,805) from 162 residency programs. The mean performance ratings of the aggregate and individual subcompetency scores showed discrimination between residency years, and the factor structure further supported the validity of the EM Milestones. The reliability was α = 0.96 within each year of training. CONCLUSIONS The EM Milestones demonstrated validity and reliability as an assessment instrument for competency acquisition. EM residents can be assured that this evaluation process has demonstrated validity and reliability; faculty can be confident that the Milestones are psychometrically sound; and stakeholders can know that the Milestones are a nationally standardized, objective measure of specialty-specific competency acquisition.

2007 Survey of Medical Toxicology Practice

To date, there appear to be no studies investigating the practice settings of all Medical Toxicology (MT) diplomates. The MT Assessment of Practice Performance Taskforce queried all MT diplomates about their current practice settings relative to the number of patients seen, the most common diagnoses, and the percent of time spent in their roles as medical toxicologists (MTs) and in their primary specialty. One hundred twenty-seven surveys were completed (44% response rate). Seventy-nine percent of respondents were affiliated with poison centers. Eighty-eight percent of participants were clinically active and reported seeing or consulting on behalf of at least ten patients over a 2-year period. Acetaminophen toxicity was the most common diagnosis encountered by respondents. Other common diagnoses included antidepressant toxicity, antipsychotic toxicity, mental status alteration, metal/environmental toxicity, envenomation, and pesticide toxicity. While respondents were likely to spend more time in direct patient care in their primary specialty, compared to consulting on behalf of patients, they were more likely to consult on behalf of patients in their role as MTs. Respondents spent more time in research, education, and population health in their role as an MT than in their primary specialty. Administrative activities were more commonly reported in association with the respondents’ primary specialty than in their role as MTs. Most MTs encounter certain diagnoses with significant frequency and see a substantial number of patients within these categories. The majority spends more time on direct patient care in their primary specialty but is actively engaged in MT education, research, population health, and administration. A longitudinal assessment of MT practice patterns could inform MT curricular development and practice performance evaluation.

Components of the Model of the Clinical Practice of Emergency Medicine: A Survey of American Board of Emergency Medicine Diplomates

BACKGROUND The Model of the Clinical Practice of Emergency Medicine is the basis for the content specifications of all American Board of Emergency Medicine (ABEM) examinations. This study describes the frequency with which ABEM diplomates diagnose and manage the conditions and components listed in the Model of the Clinical Practice of Emergency Medicine. OBJECTIVES The objectives of this study were to determine the frequency with which ABEM diplomates diagnose and manage the conditions and components described in the Model of the Clinical Practice of Emergency Medicine. METHODS The listing of conditions and components of the Model of the Clinical Practice of Emergency Medicine were sent to 16,230 randomly selected ABEM diplomates. One of five surveys was sent to each diplomate. Each condition and component was assessed by participants for the frequency that emergency physicians diagnose (D) and manage (M) that condition, as seen in their practice of Emergency Medicine. RESULTS Of the 16,230 surveys sent, 5006 were returned (30.8% response rate). The genders of the respondents were 75% male and 24% female. The ages of the respondents were primarily in the age 40-49 years, and 30-39 years age groups. All categories of the listing of conditions and components of the Model of the Clinical Practice of Emergency Medicine were encountered frequently in the practice of Emergency Medicine, as indicated by study participants. CONCLUSIONS A survey of practicing ABEM diplomates was useful in defining the frequency with which specific conditions and components are diagnosed and managed in the practice of Emergency Medicine.

American Board of Emergency Medicine Report on Residency Training Information (2014-2015)

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine residency programs and the residents in those programs. We present the 2015 annual report on the status of US emergency medicine training programs.

Delaying the American Board of Emergency Medicine Qualifying Examination Is Associated With Poorer Performance

OBJECTIVES The initial step in certification by the American Board of Emergency Medicine (ABEM) requires passing a multiple-choice-question qualifying examination. The qualifying examination is typically taken in the first year after residency training. This study was undertaken to determine if a delay in taking the qualifying examination is associated with poorer performance. The authors also examined the relationship between in-training examination scores and qualifying examination scores. METHODS This was a pooled time-series cross-section study. Primary measurements were initial qualifying examination scores, the timing of the qualifying examination, and in-training examination scores. The three groups, based on qualifying examination timing, were immediate, 1-year delay, and ≥2-year delay. In-training examination scores were analyzed to determine the relationship between intrinsic ability, examination timing, and qualifying examination scores. For analysis, a generic pooled ordinary least-squares dummy variable model with robust standard errors was used. A pre hoc level of significance was determined to be α < 0.01. RESULTS There were 16,353 qualifying examination test administrations between 2000 and 2012. In-training examination scores were positively correlated with qualifying examination scores (p < 0.001). The group pass rates were 98.9% immediate, 95.6% 1-year delay, and 86.6% ≥2-year delay. After controlling for in-training examination scores, delay taking the qualifying examination of 1 year was associated with a decrease in score of -0.6 (p = 0.003). A delay in taking the qualifying examination ≥2 years was associated with a decrease in score of -2.5 points (p < 0.001). CONCLUSIONS After accounting for innate ability using in-training examination scores, delay taking the qualifying examination was associated with poorer performance. This effect was more pronounced if the delay was ≥2 years.

Report on residency training information (2011-2012), American Board of Emergency Medicine.

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine residency training programs and the residents in those programs. We present the 2012 annual report on the status of US emergency medicine training programs.

Emergency Department Quality Improvement Activity: An Inventory From the American Board of Emergency Medicine Maintenance of Certification Program

OBJECTIVES The American Board of Emergency Medicine (ABEM) Maintenance of Certification (MOC) program requires every ABEM-certified physician to attest to participating in a quality improvement (QI) activity every 5 years. Understanding the type and frequency of these QI activities could inform the emergency medicine community about the variety of QI activities in which emergency physicians (EPs) are involved. These QI activities could provide ideas for the development of additional quality measures. METHODS This was a retrospective descriptive study of self-reported QI activity attestations from the ABEM MOC program during 2013. Attestations were provided by ABEM-certified EPs using the ABEM MOC website. The type, number, and cumulative frequency of activities are reported. RESULTS ABEM received 9,380 attestations for QI activities in 91 different categories. The three most commonly reported activities were acute myocardial infarction-percutaneous coronary intervention within 90 minutes of arrival (includes door-to-balloon time), door-to-doctor times, and throughput time measures. These three activities comprised 36.4% of attestations. More than half (54.4%) of the attestations were captured by the five most frequently attested activities, 67.1% by the top seven categories, and 89.9% by the top 21 categories. Of these 21 categories, 10 involved clinical protocols, nine were time-centered measures, and two were patient-centered activities. CONCLUSIONS This report demonstrates that diverse QI activities occur in emergency departments (EDs) across the United States. The majority of reported projects are nested in a few categories, following recognized areas of emphasis in emergency care, particularly in areas using time-sensitive metrics.

American Board of Emergency Medicine Report on Residency Training Information (2012-2013), American Board of Emergency Medicine

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine residency programs and the residents in those programs. We present the 2013 annual report on the status of US emergency medicine training programs.

2007 Survey of Medical Toxicology Practice Improvement Activities

To date, there appear to be no studies that assess Medical Toxicologists’ (MTs) practice improvement (PI) activities in their Medical Toxicology practice settings. The MT Assessment of Practice Performance (APP) Taskforce queried all MT diplomates about (1) activities currently available in their practice settings that potentially would meet the requirements of APP, (2) potential APP activities that best fit with current MT practice, and (3) the relationship between MT practice patterns and APP requirements. One hundred twenty-seven surveys were completed. Participation in MT practice improvement activities is not universal, with approximately a third of the survey participants reporting that they are not involved in any practice improvement activity. Few respondents reported that they collected performance improvement-related data. Most who did so participated in CME, case, or chart reviews. Peer reviews, self-improvement plans based on chart reviews, and population research were considered the most valid measures of MT practice improvement. Communication skills were considered important topics for patient surveys. Suggested outcomes for peer assessment included accuracy of information provided, understanding medical staff concerns, timeliness of feedback, and helpfulness. Most respondents rated all of the APP options as being somewhat very intrusive. Access to those with sufficient knowledge of the diplomate’s practice improvement program to verify APP could pose a challenge to a successful completion of APP requirements. Optimal settings for the APP program administration are hospitals and poison centers. While barriers to MT APP activities exist, studying current MT diplomates’ opinions and practices could inform the future development and administration of such programs.