Kaustubh Prabhu

OpTrust: Validity of a Tool Assessing Intraoperative Entrustment Behaviors

Objective: The aim of this study is to establish evidence to support the validity of a novel faculty-resident intraoperative assessment tool for entrustment known as OpTrust. Background: Recently, the landscape of surgical training has been altered, in part, because of resident work-hour changes and increased supervision requirements. To address these concerns, a new model for assessment of teaching and learning in surgical residencies must be anchored on progression through milestones and entrustment. Methods: OpTrust was designed to assess the faculty-resident dyad in the operating room and measure the entrustment exhibited during intraoperative interactions across 5 domains: (i) types of questions asked, (ii) operative plan, (iii) instruction, (iv) problem solving, and (v) leadership by the surgical resident. After initial pilot testing and refinement of OpTrust, 5 individual raters underwent rater training sessions; 49 individual operating room observations were completed based on 28 cases. Results: OpTrust, as a tool for assessing intraoperative entrustment, is supported by strong validity evidence. In part, it demonstrates strong interrater reliability across all faculty domains as measured by intraclass correlation 1 (ICC1) (0.81–0.93). For resident domains the results were similar with ICC1 (0.84–0.94). Cronbach alpha was 0.89 and 0.87 for faculty and resident entrustment respectively, signifying the 5 domains could be combined into a single construct of entrustment. A high correlation existed between faculty and resident scores (Pearson r = 0.94, P < 0.001) indicating a strong positive linear relationship between faculty and resident mean entrustment scores across all scale domains. Conclusions: OpTrust successfully assesses behaviors associated with entrustment during intraoperative faculty-resident interactions, and has the potential to be adopted across other procedural-based specialties to promote autonomous training progression.

Stress-free automatic sleep deprivation using air puffs

BACKGROUND Sleep deprivation via gentle handling is time-consuming and personnel-intensive. NEW METHOD We present here an automated sleep deprivation system via air puffs. Implanted EMG and EEG electrodes were used to assess sleep/waking states in six male Sprague-Dawley rats. Blood samples were collected from an implanted intravenous catheter every 4h during the 12-h light cycle on baseline, 8h of sleep deprivation via air puffs, and 8h of sleep deprivation by gentle handling days. RESULTS The automated system was capable of scoring sleep and waking states as accurately as our offline version (∼90% for sleep) and with sufficient speed to trigger a feedback response within an acceptable amount of time (1.76s). Manual state scoring confirmed normal sleep on the baseline day and sleep deprivation on the two manipulation days (68% decrease in non-REM, 63% decrease in REM, and 74% increase in waking). No significant differences in levels of ACTH and corticosterone (stress hormones indicative of HPA axis activity) were found at any time point between baseline sleep and sleep deprivation via air puffs. COMPARISON WITH EXISTING METHOD There were no significant differences in ACTH or corticosterone concentrations between sleep deprivation by air puffs and gentle handling over the 8-h period. CONCLUSIONS Our system accurately detects sleep and delivers air puffs to acutely deprive rats of sleep with sufficient temporal resolution during the critical 4-5h post learning sleep-dependent memory consolidation period. The system is stress-free and a viable alternative to existing sleep deprivation techniques.

Association of Faculty Entrustment With Resident Autonomy in the Operating Room

Importance A critical balance is sought between faculty supervision, appropriate resident autonomy, and patient safety in the operating room. Variability in the release of supervision during surgery represents a potential safety hazard to patients. A better understanding of intraoperative faculty-resident interactions is needed to determine what factors influence entrustment. Objective To assess faculty and resident intraoperative entrustment behaviors and to determine whether faculty behaviors drive resident entrustability in the operating room. Design, Setting, and Participants This observational study was conducted from September 1, 2015, to August 31, 2016, at Michigan Medicine, the University of Michigan’s health care system. Two surgical residents, 1 medical student, 2 behavioral research scientists, and 1 surgical faculty member observed surgical intraoperative interactions between faculty and residents in 117 cases involving 28 faculty and 35 residents and rated entrustment behaviors. Without intervening in the interaction, 1 or 2 researchers observed each case and noted behaviors, verbal and nonverbal communication, and interaction processes. Immediately after the case, observers completed an assessment using OpTrust, a validated tool designed to assess progressive entrustment in the operating room. Purposeful sampling was used to generate variation in type of operation, case difficulty, faculty-resident pairings, faculty experience, and resident training level. Main Outcomes and Measures Observer results in the form of entrustability scores (range, 1-4, with 4 indicating full entrustability) were compared with resident- and faculty-reported measures. Difficulty of operation was rated on a scale of 1 to 3 (higher scores indicate greater difficulty). Path analysis was used to explore direct and indirect effects of the predictors. Associations between resident entrustability and observation duration, observation month, and faculty entrustment scores were assessed by pairwise Pearson correlation coefficients. Results Twenty-eight faculty and 35 residents were observed across 117 surgical cases from 4 surgical specialties. Cases observed by postgraduate year (PGY) of residents were distributed as follows: PGY-1, 21 (18%); 2, 15 (13%); 3, 17 (15%); 4, 27 (23%); 5, 28 (24%); and 6, 9 (8%). Case difficulty was evenly distributed: 36 (33%) were rated easy/straightforward; 43 (40%), moderately difficult; and 29 (27%), very difficult by attending physicians. Path analysis showed that the association of PGY with resident entrustability was mediated by faculty entrustment (0.23 [.03]; P < .001). At the univariate level, case difficulty (mean [SD] resident entrustability score range, 1.97 [0.75] for easy/straightforward cases to 2.59 [0.82] for very difficult cases; F = 6.69; P = .01), PGY (range, 1.31 [0.28] for PGY-1 to 3.16 [0.54] for PGY-6; F = 22.85; P < .001), and faculty entrustment (2.27 [0.79]; R2 = 0.91; P < .001) were significantly associated with resident entrustability. Mean (SD) resident entrustability scores were highest for very difficult cases (2.59 [0.82]) and PGY-6 (3.16 [0.54]). Conclusions and Relevance Faculty entrustment behaviors may be the primary drivers of resident entrustability. Faculty entrustment is a feature of faculty surgeons’ teaching style and could be amenable to faculty development efforts.

Impact of a resident's sex on intraoperative entrustment of surgery trainees

Background: Optimizing intraoperative education is critical for development of autonomous residents. Faculty decisions concerning intraoperative entrustment determine the degree to which a resident gains intraoperative responsibility. Accordingly, residents exhibit entrustable behaviors that further faculty entrustment in the operating room. Little empiric evidence exists evaluating how the sex of a resident influences faculty‐resident decisions of entrustment. Studies involving perception‐based measurements of autonomy report inequities for women residents. We sought to assess faculty behaviors in entrustment in relation to resident sex using OpTrust, a third‐party objective measurement tool. Methods: From September 2015 to June 2017 at the University of Michigan, surgical cases were observed and entrustment behaviors were rated using OpTrust. Critical case sampling was used to generate variation in operation type, case difficulty, faculty‐resident pairings, faculty experience, and the level of the residents training. Independent sample t‐tests were conducted to compare faculty entrustment scores, as well as resident entrustability scores. Results: A total of 56 faculty and 73 residents were observed across 223 surgical cases from 4 surgical specialties: general, plastic, thoracic, and vascular. There was no difference in faculty entrustment or entrustability scores between women and men (2.54 vs 2.35, P = .117 and 2.32 vs 2.22, P = .393, respectively). Conclusion: Using OpTrust scores, we found that a residents sex does not appear to influence faculty entrustment in the OR. Faculty entrustment scores for women and men residents are similar across cases. This observation suggests that during the intraoperative interaction, faculty are not extending entrustment or opportunities for autonomy differently to women or men. Future research is needed to identify and measure perioperative elements that inform resident autonomy, which may contribute to inequities for women residents.

Bridging the gap: The intersection of entrustability and perceived autonomy for surgical residents in the OR

BACKGROUND Faculty entrustment decisions affect resident entrustability behaviors and surgical autonomy. The relationship between entrustability and autonomy is not well understood. This pilot study explores that relationship. METHODS 108 case observations were completed. Entrustment behaviors were rated using OpTrust. Residents completed a Zwisch self-assessment to measure surgical autonomy. Resident perceived autonomy was collected for 67 cases used for this pilot study. RESULTS Full entrustability was observed in 5 of the 108 observed cases. Residents in our study did not report full autonomy. Spearmans rank correlation coefficient identified that resident entrustability was positively correlated with perceived resident autonomy (ρ = 0.66, p < 0.05). Ordinal logistic regression assessed the relationship between resident entrustability and autonomy. The relationship persisted while controlling for PGY level, gender, and case complexity (OR = 8.42, SEM = 4.54, p < 0.000). CONCLUSIONS Resident entrustability is positively associated with perceived autonomy, yet full entrustability is not translating to the perception of full autonomy for residents.