Robert Shochet

Assessing Medical Students' and Residents' Perceptions of the Learning Environment: Exploring Validity Evidence for the Interpretation of Scores From Existing Tools

Purpose Although most agree that supportive learning environments (LEs) are essential for effective medical education, an accurate assessment of LE quality has been challenging for educators and administrators. Two previous reviews assessed LE tools used in the health professions; however, both have shortcomings. The primary goal of this systematic review was to explore the validity evidence for the interpretation of scores from LE tools. Method The authors searched ERIC, PsycINFO, and PubMed for peer-reviewed studies that provided quantitative data on medical students’ and/or residents’ perceptions of the LE published through 2012 in the United States and internationally. They also searched SCOPUS and the reference lists of included studies for subsequent publications that assessed the LE tools. From each study, the authors extracted descriptive, sample, and validity evidence (content, response process, internal structure, relationship to other variables) information. They calculated a total validity evidence score for each tool. Results The authors identified 15 tools that assessed the LE in medical school and 13 that did so in residency. The majority of studies (17; 61%) provided some form of content validity evidence. Studies were less likely to provide evidence of internal structure, response process, and relationship to other variables. Conclusions Given the limited validity evidence for scores from existing LE tools, new tools may be needed to assess medical students’ and residents’ perceptions of the LE. Any new tools would need robust validity evidence testing and sampling across multiple institutions with trainees at multiple levels to establish their utility.

The new and improved learning community at Johns Hopkins University School of Medicine resembles that at Hogwarts School of Witchcraft and Wizardry

Background: In July 2005, a learning community was created at Johns Hopkins University School of Medicine (JHUSOM) to foster camaraderie, networking, advising, mentoring, professionalism, clinical skills, and scholarship—The Colleges. The cultural and structural changes that emerged with the creation of this program have resulted in JHUSOM bearing a resemblance to J. K. Rowlings fictional Hogwarts School of Witchcraft and Wizardry. Aims: This manuscript will describe the similarities between these two revered schools, and highlight the innovations and improvements made to JHUSOMs learning environment. Description: The intense, stressful, and lengthy professional training required to achieve competency in the practice of medicine and in the practice of witchcraft (albeit fictional) have meaningful parallels. Conclusion: The supportive learning environment at these two schools should afford the next generation of graduates to have an even more enriching experience than those who have come before them.

Gauging Events That Influence Students' Perceptions of the Medical School Learning Environment: Findings From One Institution

Purpose The medical school learning environment (LE), encompassing the physical, social, and psychological context for learning, holds significant influence on students’ professional development. Among these myriad experiences, the authors sought to gauge what students judge as influencing their perceptions of the LE. Method Fourth-year medical students at Johns Hopkins University participated in this cohort survey study before their 2010 graduation. A list of 55 events was iteratively revised and pilot-tested before being administered online. Responses assessed whether students experienced each event and, if so, the degree of impact on perceptions of the LE. A calculated mean impact score (MIS) provided a means to compare the relative impact of events. Results Of 119 students, 84 (71%) completed the survey. Students rated the overall LE as exceptional (29/84; 35%), good (36/84; 43%), fair (17/84; 20%), or poor (2/84; 2%). Eighty percent of students experienced at least 41 of the 55 events. MIS values ranged from 2.00 to 3.76 (highest possible: 4.00). Students rated positive events as having the highest impact. Few significant differences were found across gender, age, or surgical/nonsurgical specialty choice. MIS distributions differed between those perceiving the LE as exceptional or fair to poor for 22 (40%) of 55 events. Conclusions This study attempted to identify the discrete events that medical students perceive as most affecting their sense of the LE. Knowing the phenomena that most strongly influence student perceptions can inform how settings, relationships, and interactions can be shaped for meaningful learning and professional formation.

The growth of learning communities in undergraduate medical education.

Purpose To determine the presence and characteristics of learning communities (LCs) in undergraduate medical education. Method The authors updated an earlier Web-based survey to assess LCs in medical education. Using a cross-sectional study design, they sent the survey to an LC leader or dean at each Association of American Medical Colleges member medical school (n = 151) between October 2011 and March 2012. The first survey item asked respondents to indicate if their institution had LCs. Those with LCs were asked to provide details regarding the structure, governance, funding, space, curricular components, extracurricular activities, and areas addressed as part of the LCs. Those without LCs were asked only if they were considering developing them. The full survey instrument contained 35 items including yes/no, multiple-choice, and open-ended questions. The authors analyzed data using descriptive statistics and examined open-ended responses for recurrent themes. Results The response rate was 83.4% (126/151). Sixty-six schools (52.4%) had LCs. Of the 60 remaining schools without LCs, 29 (48.3%) indicated that they were considering creating them. Of the 52 schools that provided the year their LCs were established, 27 (51.9%) indicated they began in 2007 or later. LC characteristics varied widely. Conclusions The number of medical schools with LCs is increasing rapidly. LCs provide an opportunity to transform medical education through longitudinal relationships and mentoring. Further study is needed to document outcomes and best practices for LCs in medical education.

Medical student engagement and leadership within a new learning community

BackgroundMany medical schools are establishing learning communities to foster cohesion among students and to strengthen relationships between students and faculty members. Emerging learning communities require nurturing and attention; this represents an opportunity wherein medical students can become involved as leaders. This study sought to understand issues related to active involvement among students who chose to become highly engaged in a newly developed learning community.MethodsBetween April and June 2008, 36 students who assumed leadership roles within the Colleges Program were queried electronically with open-ended questions about their engagement. Qualitative analysis of the written responses was independently performed by two investigators; coding was compared for agreement. Content analysis identified major themes.Results35 students (97%) completed the questionnaire. Motives that emerged as reasons for getting involved included: endorsing the need for the program; excitement with the start-up; wanting to give back; commitment to institutional excellence; and collaboration with talented peers and faculty. Perceived benefits were grouped under the following domains: connecting with others; mentoring; learning new skills; and recognition. The most frequently identified drawbacks were the time commitment and the opportunity costs. Ideas for drawing medical students into new endeavors included: creating defined roles; offering a breadth of opportunities; empowering students with responsibility; and making them feel valued.ConclusionsMedical students were drawn to and took on leadership roles in a medical school curricular innovation. This example may prove helpful to others hoping to engage students as leaders in learning communities at their schools or those wishing to augment student involvement in other programs.

The Johns Hopkins Learning Environment Scale: Measuring Medical Students' Perceptions of the Processes Supporting Professional Formation

Purpose To construct a new measure to assess students’ perceptions of the medical school learning environment (LE). Method In 2012, students at Johns Hopkins University School of Medicine completed a survey containing 32 LE items. Additional questions asked about overall perception of the LE, personal growth, and recommending the school to a friend. Validity evidence for content, response process, internal structure, and relation to other variables was collected for interpretation of scores. Results Of 465 students surveyed, 377 (81%) completed all LE items. Exploratory factor analysis yielded the 28-item Johns Hopkins Learning Environment Scale (JHLES) with seven factors/subscales: community of peers, faculty relationships, academic climate, meaningful engagement, mentoring, inclusion and safety, and physical space. Students’ overall JHLES scores ranged from 51 to 139, of a possible 28 to 140, with a mean (SD) of 107 (15). Overall scores and most subscale scores did not differ significantly by gender or racial/ethnic background, but did differ significantly by overall perception of the LE (P ⩽ .001) and increased incrementally as overall perception improved. Overall JHLES scores were significantly higher for students with higher personal growth scores and students who would recommend the school (both P < .001). Subscale scores for all seven factors increased with improved overall perception of the LE (all P ⩽ .005). Conclusions The JHLES is a new measure to assess students’ perceptions of the medical school LE, with supporting validity evidence and content describing the social, relational, and academic processes of medical school that support students’ professional formation.

Benefits to faculty involved in medical school learning communities

Abstract Purpose: Job satisfaction plays a large role in enhancing retention and minimizing loss of physicians from careers in academic medicine. The authors explored the effect of learning communities (LCs) on the faculty members’ job satisfaction. Methods: Between October 2011 and May 2012, the authors surveyed 150 academic clinical faculty members serving as LC mentors for students at five US medical schools. Factor analysis was used to explore satisfaction themes and relationships between these themes and other characteristics. Results: Factor analysis revealed two major sources of this satisfaction: a Campus Engagement factor (e.g., feeling happier, improved sense of community, better communication skills, and feeling more productive) and a skills factor (e.g., improved clinical skills, being a better doctor). Higher Campus Engagement factor satisfaction was associated with less desire to leave the learning community (p = 0.01) and more FTE support for role in LC (p = 0.01). Higher skills factor satisfaction was associated with the school that provided more structured faculty development (p = 0.0001). Conclusion: Academic clinical faculty members reported serving as a mentor in an LC was a strong source of job satisfaction. LC may be a tool for retaining clinical faculty members in academic careers.

Impact of a fitness intervention on medical students.

Objective It is known that regular exercise improves both physical and mental health. This study sought to determine the impact of a fitness intervention on the levels of exercise and well-being of medical students. Methods In 2011, the authors conducted a prospective cohort study involving medical students at the Johns Hopkins School of Medicine. Intervention students experienced a 7-week, team-based, fitness competition and recorded exercise data online. Incentives were given to teams reaching an average of 150 minutes per teammate per week, an exercise goal recommended by the US Department of Health and Human Services. Both groups completed baseline and follow-up surveys about physical activity and well-being, using validated scoring methods. Results A total of 100 students (71 in the intervention group and 29 in the control group) participated fully, recording their exercise behaviors and completing both the pre- and postsurveys. In the intervention group, the percentage of individuals successfully reaching the exercise target of 150 minutes per week varied by week from 30% to 61%. Intervention students showed a significant improvement in their International Physical Activity Questionnaire scores (1669.4 ± 154.9 vs 2013.6 ± 174.6; P = 0.02) and levels of irritability on the subsection of the Positive Affect and Negative Affect Scale score (2.2 ± 0.1 vs 2.0 ± 0.1, P = 0.03). By contrast, the control group did not show any improvements in any of these measures across the same time period (all P > 0.05). Conclusions A well-orchestrated student-designed fitness intervention can effectively augment medical students’ exercise practices and positively affect well-being.

Case Study: A Midclerkship Crisis—Lessons Learned From Advising a Medical Student With Career Indecision

Advising medical students is a challenging task. Faculty who serve as advisors for students require specific skills and knowledge to do their jobs effectively. Career choice is one of the many complex issues about which medical students often seek assistance from a faculty advisor. The authors present a case of a third-year medical student with career indecision, with a focus on the various factors that may be influencing her thinking about career choice. Key advising principles are provided as a framework for the discussion of the case and include reflection, self-disclosure, active listening, support and advocacy, confidentiality, and problem solving. These principles were developed as part of the Advising Case Conference series of the Johns Hopkins University School of Medicine Colleges Advisory Program. Emergent themes from the case included a students evolving professional identity, a students distress and burnout, lifestyle considerations, and advisor bias and self-awareness. The authors propose reflective questions to enhance meaningful discussions between the advisor and student and assist in problem solving. Many of these questions, together with the key advising principles, are generalizable to a variety of advising scenarios between advisors and learners at all levels of training.

Commentary: Using Medical Student Case Presentations to Help Faculty Learn to be Better Advisers

The case presentation is a time-honored tradition in clinical medicine, and medical journals and national conferences have provided a forum for this type of scholarship for more than a century. Case presentations can also be used by educators as a means to understand challenging learner experiences, and by doing so, lead to advances in the practice of medical education. Medical school faculty are asked to serve in student advisor roles, yet best practices for student advising are not known. Unlike clinicians, who often discuss difficult patient cases, medical educators do not typically have opportunities to discuss challenging student cases to learn how best to support trainees. In this commentary, the authors-from the Johns Hopkins University School of Medicine Colleges Advisory Program (CAP), a longitudinal advising program with the goal of promoting personal and professional development of students-describe the novel quarterly Advisory Case Conference, where medical student cases can be confidentially presented and discussed by faculty advisors, along with relevant literature reviews, to enhance faculty advising skills for students. As medical student advising needs often vary, CAP advisors employ adult learning principles and emphasize shared responsibility between advisor and advisee as keys to successful advising. Unlike traditional clinical case conferences, the Advising Case Conference format encourages advisors to share perspectives about the cases by working in small groups to exchange ideas and role-play solutions. This model may be applicable to other schools or training programs wishing to enhance faculty advising skills.