Adriana G. Ramirez

Cumulative sum: a proficiency metric for basic endoscopic training.

BACKGROUND As work hour restrictions increasingly limit some operative experiences, personalized evaluative methods are needed. We prospectively assessed the value of cumulative sum (Cusum) to measure proficiency with percutaneous endoscopic gastrostomy (PEG) among surgical trainees. MATERIALS AND METHODS Nine postgraduate year 1 surgery residents each underwent a 1-month rotation dedicated to endoscopy. Procedure durations for all PEG insertions were recorded prospectively. Criteria for task failure included need for attending takeover or procedure duration >10 min. Cusum parameters were defined a priori, with acceptable and unacceptable failure rates of 5% and 15%, respectively. Concurrently, expert endoscopists blinded to Cusum results evaluated trainee proficiency weekly using a multicategory, five-point Likert-scale survey. RESULTS Nine surgical residents performed an average of 21 PEGs each. Expert evaluations and Cusum analyses identified eight and seven participants who attained proficiency after a median of 11.5 and 12 cases, respectively. For four of the residents who achieved proficiency by Cusum criteria, eventual relapses to inadequate performance were identified. These relapses were not detected by expert evaluation. Six participants who attained proficiency by both metrics performed a combined 32 superfluous cases, which could have been redistributed to poor-performing trainees. CONCLUSIONS Although lacking the granular insight of expert evaluations, Cusum analysis is more sensitive to relapses of subproficient performance. Adding Cusum analysis to expert evaluations can provide longitudinal, formative feedback and promote efficient redistribution of operative experiences.

General Thoracic Surgery in Rwanda: An Assessment of Surgical Volume and of Workforce and Material Resource Deficits

BackgroundBenchmarking operative volume and resources is necessary to understand current efforts addressing thoracic surgical need. Our objective was to examine the impact on thoracic surgery volume and patient access in Rwanda following a comprehensive capacity building program, the Human Resources for Health (HRH) Program, and thoracic simulation training.MethodsA retrospective cohort study was conducted of operating room registries between 2011 and 2016 at three Rwandan referral centers: University Teaching Hospital of Kigali, University Teaching Hospital of Butare, and King Faisal Hospital. A facility-based needs assessment of essential surgical and thoracic resources was performed concurrently using modified World Health Organization forms. Baseline patient characteristics at each site were compared using a Pearson Chi-squared test or Kruskal–Wallis test. Comparisons of operative volume were performed using paired parametric statistical methods.ResultsOf 14,130 observed general surgery procedures, 248 (1.76%) major thoracic cases were identified. The most common indications were infection (45.9%), anatomic abnormalities (34.4%), masses (13.7%), and trauma (6%). The proportion of thoracic cases did not increase during the HRH program (2.07 vs 1.78%, respectively, p = 0.22) or following thoracic simulation training (1.95 2013 vs 1.44% 2015; p = 0.15). Both university hospitals suffer from inadequate thoracic surgery supplies and essential anesthetic equipment. The private hospital performed the highest percentage of major thoracic procedures consistent with greater workforce and thoracic-specific material resources (0.89% CHUK, 0.67% CHUB, and 5.42% KFH; p < 0.01).Conclusions and relevanceLack of specialist providers and material resources limits thoracic surgical volume in Rwanda despite current interventions. A targeted approach addressing barriers described is necessary for sustainable progress in thoracic surgical care.

Long-Term Skills Retention Following a Randomized Prospective Trial on Adaptive Procedural Training

OBJECTIVE Cumulative sum (CuSum) is a real-time proficiency-monitoring tool adapted for simulation-based training. This studys objective was to investigate long-term outcomes of a double blinded, randomized control trial conducted with medical students assessing CuSum-guided curriculum against volume-based standards. The trial found a nearly 20% reduction in practice time to reach proficiency using the CuSum curriculum but long-term effects of decreased practice volume on proficiency is unknown. DESIGN Prior participants completed a survey assessing confidence, exposure, and feedback at 12 to 18 months following trial completion. They underwent retention testing of suturing, intubation, and central venous catheter placement (CVC), which was video-recorded and assessed by an expert evaluator. Baseline characteristics among repeat subjects were compared using chi-squared tests. Retention and initial trial outcome were compared using paired parametric statistical methods. SETTING The study was conducted at a major tertiary care center and training hospital. PARTICIPANTS Medical students, which completed the initial randomized control trial were eligible for enrollment. A total of 30/46(65%) responded to the survey, whereas 33/46(72%) completed retention testing. RESULTS Average scores and decay in procedural tasks over time for suturing, intubation and CVC were 91.6% (-4.7%), 86.1% (-4.1%), and 76.2% (-14.8%), respectively. Compared to the control group, the CuSum group mean difference in retention evaluation scores was -5.6% (p = 0.12). Confidence was not associated with initial or retention testing performance in any procedural task. Higher confidence was associated with additional exposure to the procedural task in suturing and intubation (p = 0.03 and p = 0.02, respectively). For intubation, higher confidence was reported by participants who received positive feedback (p = 0.01), and those assigned to the volume-based training arm (p = 0.03). CONCLUSION CuSum-guided training was equivalent to conventional training for suturing, intubation, and CVC. These findings importantly suggest medical students can retain competency in invasive surgical tasks with modest decay in proficiency over time regardless of initial training method.

Observations on the Medicare Value-Based Ranking of Hospitals During Fiscal Years 2015 and 2016

Medicare’s Value-Based Purchasing Program (VBPP) compensates hospitals based on value of care provided. VBPP’s total performance score (TPS) components data were evaluated by hospital groups: physician-owned surgical hospitals (POSH), Kaiser Hospitals, University HealthSystem Consortium Hospitals, Pioneer Accountable Care Organization Hospitals, US News and World Report Honor Roll Hospitals, and other hospitals. Multilevel random coefficient models estimated mean and significance of TPS differences from fiscal year (FY) 2015 and FY 2016, by hospital type. Overall mean TPS for 2985 hospitals decreased from 41.65 to 40.25. POSH and Kaiser Hospitals had significantly higher TPS in FY 2015 and FY 2016. POSH Patient Experience Domain scores exceeded all other Patient Experience Domain scores. The Efficiency Domain scores of Kaiser greatly exceeded the scores of all groups. Results suggest that POSH and Kaiser Hospitals provide significantly greater value of care with consistency from year to year when compared with other groups studied.

Defining the effects of age and gender on clinical immune response to cancer vaccination

Meeting abstracts Cancer vaccines have promise as monotherapy or as part of combination immunotherapy regimens. Age and gender implications on immune response to cancer vaccinations have not previously been well described. There is uncertainty about including elderly patients as study participants