Laura Torbeck

The current status of medical genetics instruction in U.S. and Canadian medical schools

Purpose Relatively little is known about how medical genetics is being taught in the undergraduate medical curriculum and whether educators concur regarding topical priority. This study sought to document the current state of medical genetics education in U.S. and Canadian accredited medical schools. Method In August 2004, surveys were sent from the Indiana University School of Medicine to 149 U.S. and Canadian medical genetics course directors or curricular deans. Returned surveys were collected through June 2005. Participants were asked about material covered, number of contact hours, year in which the course was offered, and what department sponsored the course. Data were collated according to instructional method and course content. Results The response rate was 75.2%. Most respondents (77%) taught medical genetics in the first year of medical school; only half (47%) reported that medical genetics was incorporated into the third and fourth years. About two thirds of respondents (62%) devoted 20 to 40 hours to medical genetics instruction, which was largely concerned with general concepts (86%) rather than practical application (11%). Forty-six percent of respondents reported teaching a stand-alone course versus 54% who integrated medical genetics into another course. Topics most commonly taught were cancer genetics (94.2%), multifactorial inheritance (91.3%), Mendelian disorders (90.3%), clinical cytogenetics (89.3%), and patterns of inheritance (87.4%). Conclusions The findings provide important baseline data relative to guidelines recently established by the Association of American Medical Colleges. Ultimately, improved genetics curricula will help train physicians who are knowledgeable and comfortable discussing and answering questions about genetics with their patients.

Remediation practices for surgery residents

BACKGROUND This study sought to determine to what extent surgery programs are remediating residents who fail to achieve competency and to offer remediation strategies. METHODS A web-based survey was e-mailed to 253 program directors of all US surgery residency programs. Questions were asked about remediation and probation practices for residents failing to meet the competencies. RESULTS Programs seem to struggle the least with knowing how to remediate medical knowledge and patient care deficits and struggle more with professionalism and interpersonal communication skills. Most programs have no remediation methods in place for systems-based practice and practice-based learning and improvement deficits. CONCLUSIONS Surgery residency programs are cognizant of the reality that some residents perform unsatisfactorily. Most have remediation plans for residents and understand that a process needs to be in place. Remediation methods tend to vary depending on the deficit and are devised tailored to the residents needs.

The Feasibility of Real-Time Intraoperative Performance Assessment With SIMPL (System for Improving and Measuring Procedural Learning): Early Experience From a Multi-institutional Trial

PURPOSE Intraoperative performance assessment of residents is of growing interest to trainees, faculty, and accreditors. Current approaches to collect such assessments are limited by low participation rates and long delays between procedure and evaluation. We deployed an innovative, smartphone-based tool, SIMPL (System for Improving and Measuring Procedural Learning), to make real-time intraoperative performance assessment feasible for every case in which surgical trainees participate, and hypothesized that SIMPL could be feasibly integrated into surgical training programs. METHODS Between September 1, 2015 and February 29, 2016, 15 U.S. general surgery residency programs were enrolled in an institutional review board-approved trial. SIMPL was made available after 70% of faculty and residents completed a 1-hour training session. Descriptive and univariate statistics analyzed multiple dimensions of feasibility, including training rates, volume of assessments, response rates/times, and dictation rates. The 20 most active residents and attendings were evaluated in greater detail. RESULTS A total of 90% of eligible users (1267/1412) completed training. Further, 13/15 programs began using SIMPL. Totally, 6024 assessments were completed by 254 categorical general surgery residents (n = 3555 assessments) and 259 attendings (n = 2469 assessments), and 3762 unique operations were assessed. There was significant heterogeneity in participation within and between programs. Mean percentage (range) of users who completed ≥1, 5, and 20 assessments were 62% (21%-96%), 34% (5%-75%), and 10% (0%-32%) across all programs, and 96%, 75%, and 32% in the most active program. Overall, response rate was 70%, dictation rate was 24%, and mean response time was 12 hours. Assessments increased from 357 (September 2015) to 1146 (February 2016). The 20 most active residents each received mean 46 assessments by 10 attendings for 20 different procedures. CONCLUSIONS SIMPL can be feasibly integrated into surgical training programs to enhance the frequency and timeliness of intraoperative performance assessment. We believe SIMPL could help facilitate a national competency-based surgical training system, although local and systemic challenges still need to be addressed.

A Method for Defining Competency-based Promotion Criteria for Family Medicine Residents

The Accreditation Council for Graduate Medical Education (ACGME) has mandated a shift from a structure- and process-based educational system to a competency-based system. The ACGME has not provided criteria (standards), preferring to leave that to the discretion of the individual training programs. Such criteria and an overall strong evaluation process are essential for residents to attain the appropriate knowledge, skills, and attitudes. With this need in mind, the authors describe an evaluation process in which they developed ACGME-competency-based promotion criteria for family medicine residents at the University of Kentucky College of Medicine in 2004. The authors thought that by providing residents and faculty with minimum criteria that residents must demonstrate at each level, the residency program could address the ACGME mandate to provide competency-based training and improve residents’ progress toward promotion. Along with the promotion criteria, the method of instruction and the setting for each criterion were identified. Tools were developed to assess the criteria, including a computer-based “same day preceptor evaluation,” a resident portfolio, and multisource feedback instruments. This information was formatted into a matrix. Making the task and criteria clearer to learners allows them to better demonstrate what is expected of them. Residency educators can target remediation in those residents failing to meet the criteria and improve faculty skills, especially in terms of how to train for and assess competence. The authors describe the initial use of the promotion criteria, including how the faculty and residents responded to it.

How much guidance is given in the operating room? Factors influencing faculty self-reports, resident perceptions, and faculty/resident agreement

BACKGROUND Guidance in the operating room impacts resident confidence and ability to function independently. The purpose of this study was to explore attending surgeon guidance practices in the operating room as reported by faculty members themselves and by junior and senior residents. METHODS This was an exploratory, cross-sectional survey research study involving 91 categorical residents and 82 clinical faculty members at two academic general surgery training programs. A series of analyses of variance along with descriptive statistics were performed to understand the impact of resident training year, program, and surgeon characteristics (sex and type of surgery performed routinely) on guidance practices. RESULTS Resident level (junior versus senior) significantly impacted the amount of guidance given as reported by faculty and as perceived by residents. Within each program, junior residents perceived less guidance than faculty reported giving. For senior guidance practices, however, the differences between faculty and resident practices varied by program. In terms of the effects of surgeon practice type (mostly general versus mostly complex cases), residents at both institutions felt they were more supervised closely by the faculty who perform mostly complex cases. CONCLUSION More autonomy is given to senior than to junior residents. Additionally, faculty report a greater amount of change in their guidance practices over the training period than residents perceive. Faculty and resident agreement about the need for guidance and for autonomy are important for achieving the goals of residency training.

Readiness of US General Surgery Residents for Independent Practice

Objective: This study evaluates the current state of the General Surgery (GS) residency training model by investigating resident operative performance and autonomy. Background: The American Board of Surgery has designated 132 procedures as being “Core” to the practice of GS. GS residents are expected to be able to safely and independently perform those procedures by the time they graduate. There is growing concern that not all residents achieve that standard. Lack of operative autonomy may play a role. Methods: Attendings in 14 General Surgery programs were trained to use a) the 5-level System for Improving and Measuring Procedural Learning (SIMPL) Performance scale to assess resident readiness for independent practice and b) the 4-level Zwisch scale to assess the level of guidance (ie, autonomy) they provided to residents during specific procedures. Ratings were collected immediately after cases that involved a categorical GS resident. Data were analyzed using descriptive statistics and supplemented with Bayesian ordinal model-based estimation. Results: A total of 444 attending surgeons rated 536 categorical residents after 10,130 procedures. Performance: from the first to the last year of training, the proportion of Performance ratings for Core procedures (n = 6931) at “Practice Ready” or above increased from 12.3% to 77.1%. The predicted probability that a typical trainee would be rated as Competent after performing an average Core procedure on an average complexity patient during the last week of residency training is 90.5% (95% CI: 85.7%–94%). This falls to 84.6% for more complex patients and to less than 80% for more difficult Core procedures. Autonomy: for all procedures, the proportion of Zwisch ratings indicating meaningful autonomy (“Passive Help” or “Supervision Only”) increased from 15.1% to 65.7% from the first to the last year of training. For the Core procedures performed by residents in their final 6 months of training (cholecystectomy, inguinal/femoral hernia repair, appendectomy, ventral hernia repair, and partial colectomy), the proportion of Zwisch ratings (n = 357) indicating near-independence (“Supervision Only”) was 33.3%. Conclusions: US General Surgery residents are not universally ready to independently perform Core procedures by the time they complete residency training. Progressive resident autonomy is also limited. It is unknown if the amount of autonomy residents do achieve is sufficient to ensure readiness for the entire spectrum of independent practice.

Impact of a competency-based curriculum on medical student advancement: a ten-year analysis.

Background: In 1999, the Indiana University School of Medicine implemented a new curriculum based on the attainment of core competencies beyond medical knowledge. Purpose: The objective was to document how the Student Promotions Committee (SPC) has adjudicated students’ competency-related deficiencies over the past decade. Methods: Using SPC records, the authors determined the frequency of competency-related deficiencies reported to the SPC over time, the nature of those deficiencies, and how the deficiencies were remediated. For the purposes of this study, traditional knowledge-related deficiencies like course failures were excluded from analysis. Results: From 1999 to 2009, 191 students (138 male, 53 female) were referred to the SPC for competency-related deficiencies in 8 performance domains involving communication, basic clinical skills, lifelong learning, self-awareness, social context, ethics, problem solving, and professionalism. By comparison, 1,090 students were referred to the SPC for knowledge-related deficiencies during this time. Collectively, the 191 students were cited for 317 separate competency-related deficiencies (M ± SD = 1.7 ± 1.3; range = 1–10). Of these 317 deficiencies, the most prevalent were in the competencies of professionalism (29.3%), basic clinical skills (28.4%), and self-awareness (17.7%). Each of the remaining competencies constituted less than 10% of the total. Successful remediation utilized 12 methods ranging from a simple warning letter to repeating the year under close monitoring. Remediation was unsuccessful for 17 students (8.9%) who were dismissed from medical school primarily due to unprofessional behaviors and poor self-awareness. Conclusions: Competency-related deficiencies can be identified and remediated in most cases, but deficiencies in professionalism and self-awareness are especially challenging.

Ranking Surgical Residency Programs: Reputation Survey or Outcomes Measures?

OBJECTIVE The release of general surgery residency program rankings by Doximity and U.S. News & World Report accentuates the need to define and establish measurable standards of program quality. This study evaluated the extent to which program rankings based solely on peer nominations correlated with familiar program outcomes measures. DESIGN Publicly available data were collected for all 254 general surgery residency programs. To generate a rudimentary outcomes-based program ranking, surgery programs were rank-ordered according to an average percentile rank that was calculated using board pass rates and the prevalence of alumni publications. A Kendall τ-b rank correlation computed the linear association between program rankings based on reputation alone and those derived from outcomes measures to validate whether reputation was a reasonable surrogate for globally judging program quality. RESULTS For the 218 programs with complete data eligible for analysis, the mean board pass rate was 72% with a standard deviation of 14%. A total of 60 programs were placed in the 75th percentile or above for the number of publications authored by program alumni. The correlational analysis reported a significant correlation of 0.428, indicating only a moderate association between programs ranked by outcomes measures and those ranked according to reputation. Seventeen programs that were ranked in the top 30 according to reputation were also ranked in the top 30 based on outcomes measures. CONCLUSIONS This study suggests that reputation alone does not fully capture a representative snapshot of a programs quality. Rather, the use of multiple quantifiable indicators and attributes unique to programs ought to be given more consideration when assigning ranks to denote program quality. It is advised that the interpretation and subsequent use of program rankings be met with caution until further studies can rigorously demonstrate best practices for awarding program standings.

How to Recruit, Retain, and Reap the Rewards of Working with PhD/EdD Educators in Surgery

BACKGROUND PhD and EdD educators in departments of surgery have and are increasingly becoming valuable colleagues. Professional educators typically assist chairpersons and program directors by positively impacting the education, research, and service missions. OBJECTIVE The purpose of this article is 3-fold: (1) to identify ways of finding prospective PhD/EdD educators, (2) to recognize ways to work with educators in a complimentary way so the educator and directors mutually benefit, and (3) to identify various ways departments and programs can benefit from employing a professional educator.

The Role of PhD Faculty in Advancing Research in Departments of Surgery.

Objective: To determine the academic contribution as measured by number of publications, citations, and National Institutes of Health (NIH) funding from PhD scientists in US departments of surgery. Summary Background Data: The number of PhD faculty working in US medical school clinical departments now exceeds the number working in basic science departments. The academic impact of PhDs in surgery has not been previously evaluated. Methods: Academic metrics for 3850 faculties at the top 55 NIH-funded university and hospital-based departments of surgery were collected using NIH RePORTER, Scopus, and departmental websites. Results: MD/PhDs and PhDs had significantly higher numbers of publications and citations than MDs, regardless of academic or institutional rank. PhDs had the greatest proportion of NIH funding compared to both MDs and MD/PhDs. Across all academic ranks, 50.2% of PhDs had received NIH funding compared with 15.2% of MDs and 33.9% of MD/PhDs (P < 0.001). The proportion of PhDs with NIH funding in the top 10 departments did not differ from those working in departments ranked 11 to 50 (P = 0.456). A greater percentage of departmental PhD faculty was associated with increased rates of MD funding. Conclusions: The presence of dedicated research faculty with PhDs supports the academic mission of surgery departments by increasing both NIH funding and scholarly productivity. In contrast to MDs and MD/PhDs, PhDs seem to have similar levels of academic output and funding independent of the overall NIH funding environment of their department. This suggests that research programs in departments with limited resources may be enhanced by the recruitment of PhD faculty.