Michael S. Ryan

Benefits and barriers among volunteer teaching faculty: comparison between those who precept and those who do not in the core pediatrics clerkship

Background Community-based outpatient experiences are a core component of the clinical years in medical school. Central to the success of this experience is the recruitment and retention of volunteer faculty from the community. Prior studies have identified reasons why some preceptors volunteer their time however, there is a paucity of data comparing those who volunteer from those who do not. Methods A survey was developed following a review of previous studies addressing perceptions of community-based preceptors. A non-parametric, Mann-Whitney U test was used to compare active preceptors (APs) and inactive preceptors (IPs) and all data were analyzed in SPSS 20.0. Results There was a 28% response rate. Preceptors showed similar demographic characteristics, valued intrinsic over extrinsic benefits, and appreciated Continuing Medical Education (CME)/Maintenance of Certification (MOC) opportunities as the highest extrinsic reward. APs were more likely to also precept at the M1/M2 level and value recognition and faculty development opportunities (p<0.05). IPs denoted time as the most significant barrier and, in comparison to APs, rated financial compensation as more important (p<0.05). Conclusions Community preceptors are motivated by intrinsic benefits of teaching. Efforts to recruit should initially focus on promoting awareness of teaching opportunities and offering CME/MOC opportunities. Increasing the pool of preceptors may require financial compensation.Background Community-based outpatient experiences are a core component of the clinical years in medical school. Central to the success of this experience is the recruitment and retention of volunteer faculty from the community. Prior studies have identified reasons why some preceptors volunteer their time however, there is a paucity of data comparing those who volunteer from those who do not. Methods A survey was developed following a review of previous studies addressing perceptions of community-based preceptors. A non-parametric, Mann–Whitney U test was used to compare active preceptors (APs) and inactive preceptors (IPs) and all data were analyzed in SPSS 20.0. Results There was a 28% response rate. Preceptors showed similar demographic characteristics, valued intrinsic over extrinsic benefits, and appreciated Continuing Medical Education (CME)/Maintenance of Certification (MOC) opportunities as the highest extrinsic reward. APs were more likely to also precept at the M1/M2 level and value recognition and faculty development opportunities (p<0.05). IPs denoted time as the most significant barrier and, in comparison to APs, rated financial compensation as more important (p<0.05). Conclusions Community preceptors are motivated by intrinsic benefits of teaching. Efforts to recruit should initially focus on promoting awareness of teaching opportunities and offering CME/MOC opportunities. Increasing the pool of preceptors may require financial compensation.

Implementing an Entrustable Professional Activities Framework in Undergraduate Medical Education: Early Lessons From the Aamc Core Entrustable Professional Activities for Entering Residency Pilot

In 2014, the Association of American Medical Colleges (AAMC) published a list of 13 Core Entrustable Professional Activities for Entering Residency (Core EPAs) that medical school graduates might be expected to perform, without direct supervision, on the first day of residency. Soon after, the AAMC commissioned a five-year pilot with 10 medical schools across the United States, seeking to implement the Core EPA framework to improve the transition from undergraduate to graduate medical education. In this article, the pilot team presents the organizational structure and early results of collaborative efforts to provide guidance to other institutions planning to implement the Core EPA framework. They describe the aims, timeline, and organization of the pilot as well as findings to date regarding the concepts of entrustment, assessment, curriculum development, and faculty development. On the basis of their experiences over the first two years of the pilot, the authors offer a set of guiding principles for institutions intending to implement the Core EPA framework. They also discuss the impact of the pilot, its limitations, and next steps, as well as how the pilot team is engaging the broader medical education community. They encourage ongoing communication across institutions to capitalize on the expertise of educators to tackle challenges related to the implementation of this novel approach and to generate common national standards for entrustment. The Core EPA pilot aims to better prepare medical school graduates for their professional duties at the beginning of residency with the ultimate goal of improving patient care.

Epidemiology of Bacteremia in Previously Healthy Febrile Infants: A Follow-up Study

OBJECTIVE Describe the etiology of bacteremia among a geographically diverse sample of previously well infants with fever admitted for general pediatric care and to characterize demographic and clinical characteristics of infants with bacteremia according to bacterial etiology. We hypothesized that the epidemiology of bacteremia in febrile infants from a geographically diverse cohort would show similar results to smaller or single-center cohorts previously reported. METHODS This was a retrospective review of positive, pathogenic blood cultures in previously healthy, febrile infants≤90 days old admitted to a general unit. In total, there were 17 participating sites from diverse geographic regions of the United States. Cultures were included if the results were positive for bacteria, obtained from an infant 90 days old or younger with a temperature≥38.0°C, analyzed using an automated detection system, and treated as pathogenic. RESULTS Escherichia coli was the most prevalent species, followed by group B Streptococcus, Streptococcus viridans, and Staphylococcus aureus. Among the most prevalent bacteria, there was no association between gender and species (Ps>.05). Age at presentation was associated only with Streptococcus pneumoniae. There were no cases of Listeria monocytogenes. CONCLUSIONS Our study confirms the data from smaller or single-center studies and suggests that the management of febrile well-appearing infants should change to reflect the current epidemiology of bacteremia. Further research is needed into the role of lumbar puncture, as well as the role of Listeria and Enterococcus species in infantile bacteremia.

Recruiting and Retaining Community-Based Preceptors: A Multicenter Qualitative Action Study of Pediatric Preceptors

Purpose The recruitment and retention of community preceptors to teach medical students is difficult. The authors sought to characterize the underlying motivational factors for becoming a preceptor and to identify strategies for recruiting and retaining community-based pediatric preceptors. Method This multicenter qualitative action study included semistructured interviews with community-based pediatric preceptors affiliated with 12 institutions from August to December 2015. Only active preceptors were included, and participating institutions were diverse with respect to geographic location and class size. Interviews were conducted over the telephone and transcribed verbatim. Six investigators used deidentified transcripts to develop a codebook. Through a constant comparative method, codes were revised as data were analyzed and disagreements were resolved through discussion. All investigators organized the themes into dimensions. Results Fifty-one preceptors were interviewed. Forty-one themes coalesced into four dimensions: (1) least liked aspects of teaching, (2) preparation to teach, (3) inspiration to teach, and (4) ways to improve recruitment and retention. Time constraints and patient care demands were the most commonly cited deterrents to teaching. Successful preceptors balanced their clinical demands with their desire to teach using creative scheduling. External rewards (e.g., recognition, continuing medical education credit) served as incentives. Internal motivation inspired participants to share their enthusiasm for pediatrics and to develop longitudinal relationships with their learners. Conclusions Changes in health care delivery have imposed more time constraints on community-based preceptors. However, this study identified underlying factors motivating physicians to volunteer as preceptors. Strategies to recruit new and retain current preceptors must be collaborative.

Are Scores From NBME Subject Examinations Valid Measures of Knowledge Acquired During Clinical Clerkships

Purpose The National Board of Medical Examiners’ Clinical Science Subject Examinations are a component used by most U.S. medical schools to determine clerkship grades. The purpose of this study was to examine the validity of this practice. Method This was a retrospective cohort study of medical students at the Virginia Commonwealth University School of Medicine who completed clerkships in 2012 through 2014. Linear regression was used to determine how well United States Medical Licensing Examination Step 1 scores predicted Subject Examination scores in seven clerkships. The authors then substituted each student’s Subject Examination standard scores with his or her Step 1 standard score. Clerkship grades based on the Step 1 substitution were compared with actual grades with the Wilcoxon rank test. Results A total of 2,777 Subject Examination scores from 432 students were included in the analysis. Step 1 scores significantly predicted between 23% and 44% of the variance in Subject Examination scores, P < .001 for all clerkship regression equations. Mean differences between expected and actual Subject Examination scores were small (⩽ 0.2 points). There was a match between 73% of Step 1 substituted final clerkship grades and actual final clerkship grades. Conclusions The results of this study suggest that performance on Step 1 can be used to identify and counsel students at risk for poor performance on the Subject Examinations. In addition, these findings call into the question the validity of using scores from Subject Examinations as a high-stakes assessment of learning in individual clerkships.

Family-centered rounds and medical student performance on the NBME pediatrics subject (shelf) examination: a retrospective cohort study

Objective To determine the association between family-centered rounds (FCR) and medical student knowledge acquisition as assessed by the National Board of Medical Examiners (NBME) pediatric subject (shelf) exam. Methods A retrospective cohort study was conducted of third-year medical students who graduated from Virginia Commonwealth University School of Medicine between 2009 and 2014. This timeframe represented the transition from ‘traditional’ rounds to FCR on the pediatric inpatient unit. Data collected included demographics, United States Medical Licensing Examination (USMLE) Step 1 and 2 scores, and NBME subject examinations in pediatrics (PSE), medicine (MSE), and surgery (SSE). Results Eight hundred and sixteen participants were included in the analysis. Student performance on the PSE could not be statistically differentiated from performance on the MSE for any year except 2011 (z-score=−0.17, p=0.02). Average scores on PSE for years 2009, 2010, 2013, and 2014 were significantly higher than for SSE, but not significantly different for all other years. The PSE was highly correlated with USMLE Step 1 and Step 2 examinations (correlation range 0.56–0.77) for all years. Conclusions Our results showed no difference in PSE performance during a time in which our institution transitioned to FCR. These findings should be reassuring for students, attending physicians, and medical educators.Objective To determine the association between family-centered rounds (FCR) and medical student knowledge acquisition as assessed by the National Board of Medical Examiners (NBME) pediatric subject (shelf) exam. Methods A retrospective cohort study was conducted of third-year medical students who graduated from Virginia Commonwealth University School of Medicine between 2009 and 2014. This timeframe represented the transition from ‘traditional’ rounds to FCR on the pediatric inpatient unit. Data collected included demographics, United States Medical Licensing Examination (USMLE) Step 1 and 2 scores, and NBME subject examinations in pediatrics (PSE), medicine (MSE), and surgery (SSE). Results Eight hundred and sixteen participants were included in the analysis. Student performance on the PSE could not be statistically differentiated from performance on the MSE for any year except 2011 (z-score=−0.17, p=0.02). Average scores on PSE for years 2009, 2010, 2013, and 2014 were significantly higher than for SSE, but not significantly different for all other years. The PSE was highly correlated with USMLE Step 1 and Step 2 examinations (correlation range 0.56–0.77) for all years. Conclusions Our results showed no difference in PSE performance during a time in which our institution transitioned to FCR. These findings should be reassuring for students, attending physicians, and medical educators.

Recruitment and Retention of Community Preceptors

We provide an analysis of the challenges and proposed solutions in recruiting and retaining community preceptors from the viewpoint of pediatric department chairs. BACKGROUND: Recruiting and retaining community-based pediatricians for teaching medical students has been explored through the lens of preceptors and educational leaders. The purpose of this study was to explore the perspective of pediatric department chairs, a key stakeholder group charged with maintaining teaching capacity among a faculty. METHODS: In 2015, members of the Association of Medical School Pediatric Department Chairs and Council on Medical Student Education in Pediatrics joint task force disseminated a 20-item survey to pediatric department chairs in the United States and Canada. Topics included demographics, incentives offered to community pediatricians, and the perceived value and feasibility of such incentives. Data were analyzed using descriptive statistics and χ2 to compare categorical variables. RESULTS: Pediatric department chairs from 92 of 145 (63% response rate) medical schools returned the survey. Sixty-seven percent reported difficulty recruiting or retaining preceptors, and 51% reported high-reliance on preceptors for the ambulatory portion of the pediatrics clerkship. Almost all (92%) cited competition from other programs for the services of community preceptors. The provision of incentives was correlated with perceived feasibility (R2 = 0.65) but not their perceived value (R2 = 0.12). Few (21%) chairs reported providing financial compensation to preceptors. The provision of compensation was not related to reliance but did vary significantly by geographical region (P < .001). CONCLUSIONS: Pediatric departments rely heavily on community-based pediatricians but face competition from internal and external training programs. The perspective of department chairs is valuable in weighing interventions to facilitate continued recruitment and retention of community preceptors.

Innovation to Dissemination Workshop: Selecting Outcome Measures to Translate Educational Innovations Into Scholarship

Introduction Curricular innovations are invaluable to the improvement of medical education programs, and thus, their dissemination to broader audiences is imperative. However, medical educators often struggle to translate innovative ideas into scholarly pursuits due to a lack of experience or expertise in selecting outcome measures that demonstrate impact. A recent national call for increased focus on outcome measures for medical education research highlights the need for more training in this area. Methods We developed a 2-hour interactive workshop to improve educator ability to identify outcome measures for educational innovations. This workshop was delivered at a national pediatrics educational conference and at three local institutional faculty development sessions. Results Participants were diverse in terms of experience, expertise, and roles within their educational programs. Participants rated the workshop positively in each setting and identified next steps in developing their own products of educational scholarship. Discussion This workshop can provide faculty and faculty developers with a template for developing a skill set in identifying outcome measures and pairing them with educational innovations.

Top Medical Education Studies of 2016: A Narrative Review

Education, like clinical medicine, should be based on the most current evidence in the field. Unfortunately, medical educators can be overwhelmed by the sheer volume and range of resources for this literature. This article provides an overview of 15 articles from 2016 that the authors consider the top articles in the field of pediatric medical education. The 7 authors, all medical educators with combined leadership and expertise across the continuum of pediatric medical education, used an iterative 3-stage process to review more than 6339 abstracts published in 2016. This process was designed to identify a small subset of articles that were most relevant to educational practices and most applicable to pediatric medical education. In the first 2 stages, pairs of authors independently reviewed and scored abstracts in 13 medical education-related journals and reached consensus to identify the articles that best met these criteria. In the final stage, all articles were discussed using a group consensus model to select the final articles included in this review. This article presents summaries of the 15 articles that were selected. The results revealed a cluster of studies related to observed standardized clinical encounters, self-assessment, professionalism, clinical teaching, competencies/milestones, and graduate medical education management strategies. We provide suggestions on how medical educators can apply the findings to their own practice and educational settings. This narrative review offers a useful tool for educators interested in keeping informed about the most relevant and valuable information in the field.

Measuring Assessment Quality With an Assessment Utility Rubric for Medical Education

Introduction Prior research has identified seven elements of a good assessment, but the elements have not been operationalized in the form of a rubric to rate assessment utility. It would be valuable for medical educators to have a systematic way to evaluate the utility of an assessment in order to determine if the assessment used is optimal for the setting. Methods We developed and refined an assessment utility rubric using a modified Delphi process. Twenty-nine graduate students pilot-tested the rubric in 2016 with hypothetical data from three examinations, and interrater reliability of rubric scores was measured with interclass correlation coefficients (ICCs). Results Consensus for all rubric items was reached after three rounds. The resulting assessment utility rubric includes four elements (equivalence, educational effect, catalytic effect, acceptability) with three items each, one element (validity evidence) with five items, and space to provide four feasibility items relating to time and cost. Rater scores had ICC values greater than .75. Discussion The rubric shows promise in allowing educators to evaluate the utility of an assessment specific to their setting. The medical education field needs to give more consideration to how an assessment drives learning forward, how it motivates trainees, and whether it produces acceptable ranges of scores for all stakeholders.