Janet Shanedling

A Research Mentor Training Curriculum for Clinical and Translational Researchers

To design and evaluate a research mentor training curriculum for clinical and translational researchers. The resulting 8‐hour curriculum was implemented as part of a national mentor training trial.

Assessment of Technical Skills of Orthopaedic Surgery Residents Performing Open Carpal Tunnel Release Surgery

BACKGROUND Motor skills assessment is an important part of validating surgical competency. The need to test surgical skills competency has gained acceptance; however, assessment methods have not yet been defined or validated. The purpose of the present study was to evaluate the reliability and validity of four testing measures for the integrated assessment of orthopaedic surgery residents with regard to their competence in performing carpal tunnel release. METHODS Twenty-eight orthopaedic residents representing six levels of surgical training were tested for competence in performing carpal tunnel release on cadaver specimens. Four measures were used to assess competency. First, a web-based knowledge test of surgical anatomy, surgical indications, surgical steps, operative report dictation, and surgical complications was administered. Second, residents participated in an Objective Structured Assessment of Technical Skills; each resident performed surgery on a cadaver specimen. All residents were evaluated independently by two board-certified orthopaedic surgeons with a subspecialty certificate in hand surgery with use of a detailed checklist score, a global rating scale, and a pass/fail assessment. The time for completion of the surgery was also recorded. Each assessment tool was correlated with the others as well as with the residents level of training. RESULTS Significant differences were found between year of training and knowledge test scores (F = 7.913, p < 0.001), year of training and detailed checklist scores (F = 5.734, p = 0.002), year of training and global rating scale (F = 2.835, p = 0.040), and year of training and percentage pass rate (F = 26.3, p < 0.001). No significant differences were found between year of training and time to completion of the carpal tunnel release (F = 2.482, p < 0.063). CONCLUSIONS The results of the present study suggest that both knowledge and cadaver testing discriminate between novice and accomplished residents. However, although failure of the knowledge test can predict failure on technical skills testing, the presence of knowledge does not necessarily ensure successful performance of technical skills, as cognitive testing and technical skills testing are separate domains.

The National United States Center Data Repository: Core essential interprofessional practice & education data enabling triple aim analytics.

Abstract Understanding the impact that interprofessional education and collaborative practice (IPECP) might have on triple aim patient outcomes is of high interest to health care providers, educators, administrators, and policy makers. Before the work undertaken by the National Center for Interprofessional Practice and Education at the University of Minnesota, no standard mechanism to acquire and report outcome data related to interprofessional education and collaborative practice and its effect on triple aim outcomes existed. This article describes the development and adoption of the National Center Data Repository (NCDR) designed to capture data related to IPECP processes and outcomes to support analyses of the relationship of IPECP on the Triple Aim. The data collection methods, web-based survey design and implementation process are discussed. The implications of this informatics work to the field of IPECP and health care quality and safety include creating standardized capacity to describe interprofessional practice and measure outcomes connecting interprofessional education and collaborative practice to the triple aim within and across sites/settings, leveraging an accessible data collection process using user friendly web-based survey design to support large data scholarship and instrument testing, and establishing standardized data elements and variables that can potentially lead to enhancements to national/international information system and academic accreditation standards to further team-based, interprofessional, collaborative research in the field.

Examination of Skill Acquisition and Grader Bias in a Distal Radius Fracture Fixation Model

OBJECTIVES Primary: Assess the ability of faculty graders to predict the objectively measured strength of distal radius fracture fixation. Secondary: Compare resident skill variation and retention related to other knowable training data. DESIGN Residents were allowed 60 minutes to stabilize a standardized distal radius fracture using an assigned fixed-angle volar plate. Faculty observed and subjectively graded the residents without providing real-time feedback. Objective biomechanical evaluation (construct strength and stiffness) was compared to subjective grades. Resident-specific characteristics (sex, PGY, and ACGME case log) were also used to compare the objective data. SETTING A simulated operating room in our laboratory. PARTICIPANTS Post-graduate year 2, 3, 4, and 5 orthopedic residents. RESULTS Primary: Faculty were not successful at predicting objectively measured fixation, and their subjective scoring suggests confirmation bias as PGY increased. Secondary: Resident year-in-training alone did not predict objective measures (p = 0.53), but was predictive of subjective scores (p < 0.001). Skills learned were not always retained, as 29% of residents objectively failed subsequent to passing. Notably, resident-reported case-specific experience alone was inversely correlated with objective fixation strength. CONCLUSIONS This testing model enabled the collection of objective and subjective resident skill scores. Faculty graders did not routinely predict objective measures, and their subjective assessment appears biased related to PGY. Also, in vivo case volume alone does not predict objective results. Familiar faculty teaching consistency, and resident grading by external faculty unfamiliar with tested residents, might alter these results.