Cynthia H. Ledford

Applying Adult Learning Practices in Medical Education

The application of the best practices of teaching adults to the education of adults in medical education settings is important in the process of transforming learners to become and remain effective physicians. Medical education at all levels should be designed to equip physicians with the knowledge, clinical skills, and professionalism that are required to deliver quality patient care. The ultimate outcome is the health of the patient and the health status of the society. In the translational science of medical education, improved patient outcomes linked directly to educational events are the ultimate goal and are best defined by rigorous medical education research efforts. To best develop faculty, the same principles of adult education and teaching adults apply. In a systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education, the use of experiential learning, feedback, effective relationships with peers, and diverse educational methods were found to be most important in the success of these programs. In this article, we present 5 examples of applying the best practices in teaching adults and utilizing the emerging understanding of the neurobiology of learning in teaching students, trainees, and practitioners. These include (1) use of standardized patients to develop communication skills, (2) use of online quizzes to assess knowledge and aid self-directed learning, (3) use of practice sessions and video clips to enhance significant learning of teaching skills, (4) use of case-based discussions to develop professionalism concepts and skills, and (5) use of the American Academy of Pediatrics PediaLink as a model for individualized learner-directed online learning. These examples highlight how experiential leaning, providing valuable feedback, opportunities for practice, and stimulation of self-directed learning can be utilized as medical education continues its dynamic transformation in the years ahead.

Do Attending Physicians, Nurses, Residents, and Medical Students Agree on What Constitutes Medical Student Abuse?

Background Whether attending physicians, residents, nurses, and medical students agree on what constitutes medical student abuse, its severity, or influencing factors is unknown. Method We surveyed 237 internal medicine attending physicians, residents, medical students, and nurses at 13 medical schools after viewing five vignettes depicting potentially abusive behaviors. Results The majority of each group felt the belittlement, ethnic insensitivity, and sexual harassment scenarios represented abuse but that excluding a student from participating in a procedure did not. Only a majority of attending physicians considered the negative feedback scenario as abuse. Medical students rated abuse severity significantly lower than other groups in the belittlement scenario (p < .05). Respondents who felt abused as students were more likely to rate behaviors as abusive (p < .05). Conclusions The groups generally agree on what constitutes abuse, but attending physicians and those abused as students may perceive more behaviors as abusive.

The Subinternship Curriculum in Internal Medicine: A National Survey of Clerkship Directors

Background: The 4th-year internal medicine subinternship (subI), with its strong emphasis on experience-based learning and increased patient responsibilities, is an important component of undergraduate medical education. Discussions have begun amongst educational leaders on the importance of standardizing curriculum and evaluation tools utilized during the subinternship. Purpose: The objective of this survey was to describe the current state of educational practices regarding the subI curriculum, use of Clerkship Directors in Internal Medicine (CDIM) curricular guidelines, evaluation methodologies, and subintern call frequency and duty hours. Methods: The survey was a part of the CDIM annual survey sent to 109 institutional members in 2005. The subinternship survey included 17 questions that addressed the prevalence of formal curricula in the subinternship, use of CDIM curricular guidelines and resources, and the evaluation tools utilized for assessment of the subinternship. Two questions examined the call frequency and duty hours of the subinterns. Results: Eighty-eight members responded (81%). Of the respondents, 37% have a formal curriculum and 35% used CDIM curricular guidelines for the subinternship. More than half of the respondents agreed that the curricular guide helped organize their subI rotations (53%), and 48% agreed that it enhanced the quality of subI education. A global rating summative evaluation form (56%) was the most commonly used evaluation tool in the subinternship. Objective Structured Clinical Examinations 1−3 (1%) and Mini-Clinical Evaluation Exercise (mini-CEX) 4 (2%) were much less utilized during the subinternship. The respondents expressed an interest in the development of a standardized exam (47%) and clinical assessment tools such as the mini-CEX (59%). The vast majority of IM subinterns participate in 3 to 9 calls per rotation and spend less than 80 hr in the hospital per week. Conclusions: A formal curriculum is offered in slightly more than one third of subIs. Clerkship directors expressed interest in developing standardized evaluation tools to assess subintern competencies. The majority of IM subinterns spend less than 80 hr in the hospital per week. Further studies are needed to assess barriers to incorporating a formal curriculum and develop standardized tools to assess subintern competencies.

Collaborative Concept Mapping and Critical Thinking in Fourth-Year Medical Students

Objective. To test the hypothesis that small group concept mapping of 4 core neonatal topics as part of a fourth-year allopathic medical student elective would improve critical thinking (CT) as measured by the California Critical Thinking Skills Test (CCTST). To describe any correlations between scores on the CCTST and the step 1 and step 2 Clinical Knowledge parts of the United States Medical Licensing Exam. Methods. Twenty-seven students participated in this pilot study during a 1-month elective. A pretest CCTST, California Critical Thinking Disposition Inventory (CCTDI), and multiple choice knowledge test (MCKT) were completed immediately before the elective began. Four weekly group sessions were held with assigned reading on each of the 4 neonatal topics. Concept mapping was performed in small groups of 4 to 6 students with a group concept map collected at the end of the exercise. A posttest CCTST and MCKT was completed after the 4 group sessions. Results. Pre-CCTST overall score was 83.9 ± 6, and post-CCTST overall score was 85.6 ± 6.9 (P = .57). Pearson correlation of USMLE step 1 and pre-CCTST showed r(25) = .276, P = .164. Pearson correlation of USMLE step 2 CK and pre-CCTST revealed r(25) = .214, P = .482. The precourse MCKT average was 35%, and the postcourse average 50% (P ≤ .001). Conclusions. A recent meta-analysis confirms this is the first report of a comparison between the increasingly common CCTST and the USMLE. We confirmed that concept mapping is a valid mechanism to teach content knowledge. Although the difference in the CCTST scores was not significant, this study could serve as an important start toward development of a curriculum devoted to teaching content and improving CT. The small number of students may have prevented us from defining a significant impact.

Developing a Conversational Virtual Standardized Patient to Enable Students to Practice History-Taking Skills

Introduction Although traditional virtual patient simulations are designed to teach and assess clinical reasoning skills, few employ conversational dialogue with the patients. The virtual standardized patients (VSPs) described herein represent standardized patients that students interview using natural language. Students take histories and develop differential diagnoses of the VSPs as much as they would with standardized or actual patients. The student-VSP interactions are recorded, creating a comprehensive record of questions and the order in which they were asked, which can be analyzed to assess information-gathering skills. Students document the encounter in an electronic medical record created for the VSPs. Methods The VSP was developed by integrating a dialogue management system (ChatScript) with emotionally responsive 3D characters created in a high-fidelity game engine (Unity). The system was tested with medical students at the Ohio State University College of Medicine. Students are able to take a history of a VSP, develop a differential diagnosis, and document the encounter in the electronic medical record. Results Accuracy of the VSP responses ranged from 79% to 86%, depending on the complexity of the case, type of history obtained, and skill of the student. Students were able to accurately develop an appropriate differential diagnosis on the basis of the information provided by the patient during the encounter. Conclusions The VSP enables students to practice their history-taking skills before encounters with standardized or actual patients. Future developments will focus on creating an assessment module that will automatically analyze VSP sessions and provide immediate student feedback.

Coaching the Coach: A Program for Development of Faculty Portfolio Coaches

ABSTRACT Problem: Faculty coaching is recognized as an essential element for effective use of portfolios in undergraduate medical education, yet best practices for training these coaches are uncertain. Intervention: New portfolio coaches participated in a multifaceted training program that included orienting modules, a 7.5-hr training workshop featuring analysis of reflective writing, an Observed Structured Teaching Exercise (OSTE), and subsequent longitudinal coaches’ meetings for timely task training. Four desired coaching skills were emphasized in the initial training: creating a safe environment, explicitly using performance data, asking questions that elicit reflection, and guiding the student to develop future goals and plans. We collected and analyzed several outcomes: (a) coaches’ self-assessment at key intervals, (b) open-ended written responses to three coaching vignettes, (c) video recordings of the OSTE, and (d) subsequent student evaluation of the coach. In an attempt to capture learning from the workshop, both the responses to written vignettes and the video-recorded encounters were coded for presence or absence of the four desired skills. Context: Our portfolio and coaching program was instituted as part of a major undergraduate medical education reform. A new cohort of 25 coaches is enrolled with each matriculating student class, and each coach is assigned to work individually with 8–10 students, forming a coaching relationship that continues over 4 years. Coaches are compensated at 5% full-time equivalent. Outcome: On coach self-assessment, the majority of coaches reported significant improvement in their perceived ability to assess a students level of reflection, enhance reflection, use performance data, and guide a student to develop goals and plans. After two semesters, coach perception of improved abilities persisted. Students rated coaches as excellent (82%), reporting that coaches created safe environments (99%), promoted insight (92%), and aided in goal setting (97%). Written responses to vignettes before the OSTE found that several coaches omitted desired behaviors; however, posttraining responses showed no discernable pattern of learning. Coding of the OSTE, in contrast, documented that all coaches demonstrated all four of the desired skills. Lessons Learned: Although coaches reported learning related to key skills, learning was not apparent when responses to written vignettes were examined. In contrast, skills were demonstrated in the OSTE, perhaps due to the added structured tasks as well as anticipation of feedback. In conclusion, this portfolio coach training program achieved its desired aim of providing students with portfolio coaches who demonstrated the desired skills, as reported by both coaches and students.

Development of an assessment for Entrustable Professional Activity (EPA) 10: Emergent patient management

Introduction Medical schools in the United States are encouraged to prepare and certify the entrustment of medical students to perform 13 core entrustable professional activities (EPAs) prior to graduation. Entrustment is defined as the informed belief that the learner is qualified to autonomously perform specific patient-care activities. Core EPA-10 is the entrustment of a graduate to care for the emergent patient. The purpose of this project was to design a realistic performance assessment method for evaluating fourth-year medical students on EPA-10. Methods First, we wrote five emergent patient case-scenarios that a medical trainee would likely confront in an acute care setting. Furthermore, we developed high-fidelity simulations to realistically portray these patient case scenarios. Finally, we designed a performance assessment instrument to evaluate the medical student’s performance on executing critical actions related to EPA-10 competencies. Critical actions included the following: triage skills, mustering the medical team, identifying causes of patient decompensation, and initiating care. Up to four students were involved with each case scenario; however, only the team leader was evaluated using the assessment instruments developed for each case. Results A total of 114 students participated in the EPA-10 assessment during their final year of medical school. Most students demonstrated competence in recognizing unstable vital signs (97%), engaging the team (93%), and making appropriate dispositions (92%). Almost 87% of the students were rated as having reached entrustment to manage the care of an emergent patient (99 of 114). Inter-rater reliability varied by case scenario, ranging from moderate to near-perfect agreement. Three of five case-scenario assessment instruments contained items that were internally consistent at measuring student performance. Additionally, the individual item scores for these case scenarios were highly correlated with the global entrustment decision. Conclusion High-fidelity simulation showed good potential for effective assessment of medical student entrustment of caring for the emergent patient. Preliminary evidence from this pilot project suggests content validity of most cases and associated checklist items. The assessments also demonstrated moderately strong faculty inter-rater reliability.

Portfolio-Associated Faculty: A Qualitative Analysis of Successful Behaviors from the Perspective of the Student

Purpose. While some aspects of what makes for an effective portfolio program are known, little is published about what students value in the faculty-student-portfolio relationship. Lack of student buy-in and faculty engagement can be significant challenges. The purpose of this study was to identify behaviors and types of engagement that students value in their relationships with portfolio-associated faculty. Methods. Medical students (174) participating in the Ohio State University College of Medicine Portfolio Program described behaviors observed in their portfolio-associated faculty in a survey completed at the end of the first year of their four-year program. Narrative responses were coded and categorized into themes, followed by member checking. Results. A total of 324 comments from 169 students were analyzed. Four themes were identified: (1) creating a supportive environment; (2) inspiring academic and professional growth; (3) investing time in students; and (4) providing advice and direction. Conclusions. The themes identified suggest that students value certain types of coaching and mentoring behaviors from their portfolio-associated faculty. The themes and their specific subcategories may be useful in making decisions regarding program development and guiding recruitment and training of these faculty coaches.

Getting Started With Online Faculty Development

Online faculty development (OFD) enables faculty to advance their teaching skills while respecting time constraints. At the 2015 Accreditation Council for Graduate Medical Education workshop on this topic, 57% of participants indicated they have tried OFD, 85% felt that it can be an effective FD method, and 98% believed that it increasingly would be utilized in the future. Yet, gathering the initial capital and technological expertise needed to create OFD can be daunting. This Rip Out presents a number of low-cost resources and strategies that can be used to create an OFD program.

Competency-Based Medical Education in the Internal Medicine Clerkship: A Report From the Alliance for Academic Internal Medicine Undergraduate Medical Education Task Force

As medical educators continue to redefine learning and assessment across the continuum, implementation of competency-based medical education in the undergraduate setting has become a focus of many medical schools. While standards of competency have been defined for the graduating student, there is no uniform approach for defining competency expectations for students during their core clerkship year. The authors describe the process by which an Alliance for Academic Internal Medicine task force developed a paradigm for competency-based assessment of students during their inpatient internal medicine (IM) clerkship. Building on work at the resident and fellowship levels, the task force focused on the development of key learning outcomes as defined by entrustable professional activities (EPAs) that were specific to educational experiences on the IM clerkship, as well as identification of high-priority assessment domains. The work was informed by a national survey of clerkship directors.Six key EPAs emerged: generating a differential diagnosis, obtaining a complete and accurate history and physical exam, obtaining focused histories and clinically relevant physical exams, preparing an oral presentation, interpreting the results of basic diagnostic studies, and providing well-organized clinical documentation. A model for assessment was proposed, with descriptors aligned to the scale of supervision and mapped to Accreditation Council for Graduate Medical Education domains of competence. The proposed paradigm offers a standardized template that may be used across IM clerkships, and which would effectively bridge competency evaluation in the clerkship to fourth-year assessment as well as eventual postgraduate training.