Marcia M. Russell

Evaluation of Hospital Readmissions in Surgical Patients: Do Administrative Data Tell the Real Story?

IMPORTANCE The Centers for Medicare & Medicaid Services has developed an all-cause readmission measure that uses administrative data to measure readmission rates and financially penalize hospitals with higher-than-expected readmission rates. OBJECTIVES To examine the accuracy of administrative codes in determining the cause of readmission as determined by medical record review, to evaluate the readmission measures ability to accurately identify a readmission as planned, and to document the frequency of readmissions for reasons clinically unrelated to the original hospital stay. DESIGN, SETTING, AND PARTICIPANTS Retrospective review of all consecutive patients discharged from general surgery services at a tertiary care, university-affiliated teaching hospital during 8 consecutive quarters (quarter 4 [October through December] of 2009 through quarter 3 [July through September] of 2011). Clinical readmission diagnosis determined from direct medical record review was compared with the administrative diagnosis recorded in a claims database. The number of planned hospital readmissions defined by the readmission measure was compared with the number identified using clinical data. Readmissions unrelated to the original hospital stay were identified using clinical data. MAIN OUTCOMES AND MEASURES Discordance rate between administrative and clinical diagnoses for all hospital readmissions, discrepancy between planned readmissions defined by the readmission measure and identified by clinical medical record review, and fraction of hospital readmissions unrelated to the original hospital stay. RESULTS Of the 315 hospital readmissions, the readmission diagnosis listed in the administrative claims data differed from the clinical diagnosis in 97 readmissions (30.8%). The readmission measure identified 15 readmissions (4.8%) as planned, whereas clinical data identified 43 readmissions (13.7%) as planned. Unrelated readmissions comprised 70 of the 258 unplanned readmissions (27.1%). CONCLUSIONS AND RELEVANCE Administrative billing data, as used by the readmission measure, do not reliably describe the reason for readmission. The readmission measure accounts for less than half of the planned readmissions and does not account for the nearly one-third of readmissions unrelated to the original hospital stay. Implementation of this readmission measure may result in unwarranted financial penalties for hospitals.

Relationship Between Hospital Performance on a Patient Satisfaction Survey and Surgical Quality

IMPORTANCE The Centers for Medicare and Medicaid Services include patient experience as a core component of its Value-Based Purchasing program, which ties financial incentives to hospital performance on a range of quality measures. However, it remains unclear whether patient satisfaction is an accurate marker of high-quality surgical care. OBJECTIVE To determine whether hospital performance on a patient satisfaction survey is associated with objective measures of surgical quality. DESIGN, SETTING, AND PARTICIPANTS Retrospective observational study of participating American College of Surgeons National Surgical Quality Improvement Project (ACS NSQIP) hospitals. We used data from a linked database of Medicare inpatient claims, ACS NSQIP, the American Hospital Association annual survey, and Hospital Compare from December 2, 2004, through December 31, 2008. A total of 103 866 patients older than 65 years undergoing inpatient surgery were included. Hospitals were grouped by quartile based on their performance on the Hospital Consumer Assessment of Healthcare Providers and Systems survey. Controlling for preoperative risk factors, we created hierarchical logistic regression models to predict the occurrence of adverse postoperative outcomes based on a hospitals patient satisfaction scores. MAIN OUTCOMES AND MEASURES Thirty-day postoperative mortality, major and minor complications, failure to rescue, and hospital readmission. RESULTS Of the 180 hospitals, the overall mean patient satisfaction score was 68.0% (first quartile mean, 58.7%; fourth quartile mean, 76.7%). Compared with patients treated at hospitals in the lowest quartile, those at the highest quartile had significantly lower risk-adjusted odds of death (odds ratio = 0.85; 95% CI, 0.73-0.99), failure to rescue (odds ratio = 0.82; 95% CI, 0.70-0.96), and minor complication (odds ratio = 0.87; 95% CI, 0.75-0.99). This translated to relative risk reductions of 11.1% (P = .04), 12.6% (P = .02), and 11.5% (P = .04), respectively. No significant relationship was noted between patient satisfaction and either major complication or hospital readmission. CONCLUSIONS AND RELEVANCE Using a national sample of hospitals, we demonstrated a significant association between patient satisfaction scores and several objective measures of surgical quality. Our findings suggest that payment policies that incentivize better patient experience do not require hospitals to sacrifice performance on other quality measures.

Teamwork, communication and safety climate: a systematic review of interventions to improve surgical culture

Objectives To define the target domains of culture-improvement interventions, to assess the impact of these interventions on surgical culture and to determine whether culture improvements lead to better patient outcomes and improved healthcare efficiency. Background Healthcare systems are investing considerable resources in improving workplace culture. It remains unclear whether these interventions, when aimed at surgical care, are successful and whether they are associated with changes in patient outcomes. Methods PubMed, Cochrane, Web of Science and Scopus databases were searched from January 1980 to January 2015. We included studies on interventions that aimed to improve surgical culture, defined as the interpersonal, social and organisational factors that affect the healthcare environment and patient care. The quality of studies was assessed using an adapted tool to focus the review on higher-quality studies. Due to study heterogeneity, findings were narratively reviewed. Findings The 47 studies meeting inclusion criteria (4 randomised trials and 10 moderate-quality observational studies) reported on interventions that targeted three domains of culture: teamwork (n=28), communication (n=26) and safety climate (n=19); several targeted more than one domain. All moderate-quality studies showed improvements in at least one of these domains. Two studies also demonstrated improvements in patient outcomes, such as reduced postoperative complications and even reduced postoperative mortality (absolute risk reduction 1.7%). Two studies reported improvements in healthcare efficiency, including fewer operating room delays. These findings were supported by similar results from low-quality studies. Conclusions The literature provides promising evidence for various strategies to improve surgical culture, although these approaches differ in terms of the interventions employed as well as the techniques used to measure culture. Nevertheless, culture improvement appears to be associated with other positive effects, including better patient outcomes and enhanced healthcare efficiency. Trial registration number CRD42013005987.

Preventable Readmissions to Surgical Services: Lessons Learned and Targets for Improvement

BACKGROUND Hospital readmissions are under intense scrutiny as a measure of health care quality. The Center for Medicare and Medicaid Services (CMS) has proposed using readmission rates as a benchmark for improving care, including targeting them as nonreimbursable events. Our study aim was to describe potentially preventable readmissions after surgery and to identify targets for improvement. STUDY DESIGN Patients discharged from a general surgery service over 8 consecutive quarters (Q4 2009 to Q3 2011) were selected. A working group of attending surgeons defined terms and created classification schemes. Thirty-day readmissions were identified and reviewed by a 2-physician team. Readmissions were categorized as preventable or unpreventable, and by target for future quality improvement intervention. RESULTS Overall readmission rate was 8.3% (315 of 3,789). The most common indication for initial admission was elective general surgery. Among readmitted patients in our sample, 28% did not undergo an operation during their index admission. Only 21% (55 of 258) of readmissions were likely preventable based on medical record review. Of the preventable readmissions, 38% of patients were discharged within 24 hours and 60% within 48 hours. Dehydration occurred more frequently among preventable readmissions (p < 0.001). Infection accounted for more than one-third of all readmissions. Among preventable readmissions, targets for improvement included closer follow-up after discharge (49%), management in the outpatient setting (42%), and avoidance of premature discharge (9%). CONCLUSIONS A minority of readmissions may potentially be preventable. Targets for reducing readmissions include addressing the clinical issues of infection and dehydration as well as improving discharge planning to limit both early and short readmissions. Policies aimed at penalizing reimbursements based on readmission rates should use clinical data to focus on inappropriate hospitalization in order to promote high quality patient care.

Surgeon perception of risk and benefit in the decision to operate

Objective: To determine how surgeons’ perceptions of treatment risks and benefits influence their decisions to operate. Background: Little is known about what makes one surgeon choose to operate on a patient and another chooses not to operate. Methods: Using an online study, we presented a national sample of surgeons (N = 767) with four detailed clinical vignettes (mesenteric ischemia, gastrointestinal bleed, bowel obstruction, appendicitis) where the best treatment option was uncertain and asked them to: (1) judge the risks (probability of serious complications) and benefits (probability of recovery) for operative and nonoperative management and (2) decide whether or not they would recommend an operation. Results: Across all clinical vignettes, surgeons varied markedly in both their assessments of the risks and benefits of operative and nonoperative management (narrowest range 4%–100% for all four predictions across vignettes) and in their decisions to operate (49%–85%). Surgeons were less likely to operate as their perceptions of operative risk increased [absolute difference (AD) = –29.6% from 1.0 standard deviation below to 1.0 standard deviation above mean (95% confidence interval, CI: –31.6, –23.8)] and their perceptions of nonoperative benefit increased [AD = –32.6% (95% CI: –32.8,–-28.9)]. Surgeons were more likely to operate as their perceptions of operative benefit increased [AD = 18.7% (95% CI: 12.6, 21.5)] and their perceptions of nonoperative risk increased [AD = 32.7% (95% CI: 28.7, 34.0)]. Differences in risk/benefit perceptions explained 39% of the observed variation in decisions to operate across the four vignettes. Conclusions: Given the same clinical scenarios, surgeons’ perceptions of treatment risks and benefits vary and are highly predictive of their decisions to operate.

Compliance With Evidence-Based Guidelines and Interhospital Variation in Mortality for Patients With Severe Traumatic Brain Injury

IMPORTANCE Compliance with evidence-based guidelines in traumatic brain injury (TBI) has been proposed as a marker of hospital quality. However, the association between hospital-level compliance rates and risk-adjusted clinical outcomes for patients with TBI remains poorly understood. OBJECTIVE To examine whether hospital-level compliance with the Brain Trauma Foundation guidelines for intracranial pressure monitoring and craniotomy is associated with risk-adjusted mortality rates for patients with severe TBI. DESIGN, SETTING, AND PARTICIPANTS All adult patients (N = 734) who presented to a regional consortium of 14 hospitals from January 1, 2009, through December 31, 2010, with severe TBI (ie, blunt head trauma, Glasgow Coma Scale score of <9, and abnormal intracranial findings from computed tomography of the head). Data analysis took place from December 2013 through January 2015. We used hierarchical mixed-effects models to assess the association between hospital-level compliance with Brain Trauma Foundation guidelines and mortality rates after adjusting for patient-level demographics, severity of trauma (eg, mechanism of injury and Injury Severity Score), and TBI-specific variables (eg, cranial nerve reflexes and findings from computed tomography of the head). MAIN OUTCOMES AND MEASURES Hospital-level risk-adjusted inpatient mortality rate and hospital-level compliance with Brain Trauma Foundation guidelines for intracranial pressure monitoring and craniotomy. RESULTS Unadjusted mortality rates varied by site from 20.0% to 50.0% (median, 42.6; interquartile range, 35.5-46.2); risk-adjusted rates varied from 24.3% to 56.7% (median, 41.1; interquartile range, 36.4-47.8). Overall, only 338 of 734 patients (46.1%) with an appropriate indication underwent placement of an intracranial pressure monitor and only 134 of 335 (45.6%) underwent craniotomy. Hospital-level compliance ranged from 9.6% to 65.2% for intracranial pressure monitoring and 6.7% to 76.2% for craniotomy. Despite widespread variation in compliance across hospitals, we found no association between hospital-level compliance rates and risk-adjusted patient outcomes (Spearman ρ = 0.030 [P = .92] for ICP monitoring and Spearman ρ = -0.066 [P = .83] for craniotomy). CONCLUSIONS AND RELEVANCE Hospital-level compliance with evidence-based guidelines has minimal association with risk-adjusted outcomes in patients with severe TBI. Our results suggest that caution should be taken before using compliance with these measures as independent quality metrics. Given the complexity of TBI care, outcomes-based metrics, including functional recovery, may be more accurate than current process measures at determining hospital quality.

Comparative Effectiveness of Sphincter-Sparing Surgery versus Abdominoperineal Resection in Rectal Cancer: Patient-Reported Outcomes in National Surgical Adjuvant Breast and Bowel Project Randomized Trial R-04

OBJECTIVE National Surgical Adjuvant Breast and Bowel Project (NSABP) R-04 was a randomized controlled trial of neoadjuvant chemoradiotherapy in patients with resectable stage II-III rectal cancer. We hypothesized that patients who underwent abdominoperineal resection (APR) would have a poorer quality of life than those who underwent sphincter-sparing surgery (SSS). METHODS To obtain patient-reported outcomes (PROs) we administered two symptom scales at baseline and 1 year postoperatively: the Functional Assessment of Cancer Therapy-Colorectal (FACT-C) and the European Organization for the Research and Treatment of Cancer module for patients with Colorectal Cancer Quality of Life Questionnaire (EORTC QLQ-CR38). Scoring was stratified by nonrandomly assigned definitive surgery (APR vs SSS). Analyses controlled for baseline scores and stratification factors: age, sex, stage, intended surgery, and randomly assigned chemoradiotherapy. RESULTS Of 1,608 randomly assigned patients, 987 had data for planned analyses; 62% underwent SSS; 38% underwent APR. FACT-C total and subscale scores were not statistically different by surgery at 1 year. For the EORTC QLQ-CR38 functional scales, APR patients reported worse body image (70.3 vs 77.0, P = 0.0005) at 1 year than did SSS patients. Males undergoing APR reported worse sexual enjoyment (43.7 vs 54.7, P = 0.02) at 1 year than did those undergoing SSS. For the EORTC QLQ-CR38 symptom scale scores, APR patients reported worse micturition symptoms than the SSS group at 1 year (26.9 vs 21.5, P = 0.03). SSS patients reported worse gastrointestinal tract symptoms than did the APR patients (18.9 vs 15.2, P < 0.0001), as well as weight loss (10.1 vs 6.0, P = 0.002). CONCLUSIONS Symptoms and functional problems were detected at 1 year by EORTC QLQ-CR38, reflecting different symptom profiles in patients who underwent APR than those who underwent SSS. Information from these PROs may be useful in counseling patients anticipating surgery for rectal cancer.

Extending the value of the National Surgical Quality Improvement Program claims dataset to study long-term outcomes: Rate of repeat ventral hernia repair

BACKGROUND Existing large clinical registries capture short-term follow-up. Yet, there are many important long-term outcomes in surgery, such as recurrence of a ventral hernia after ventral hernia repair. The goal of the current study was to conduct an exploratory analysis to determine whether the rates, timing, and risk factors for ventral hernia re-repair in claims data linked to registry data were consistent with the known clinical literature. STUDY DESIGN The American College of Surgeons National Surgical Quality Improvement Program (ACS-NSQIP) and Medicare inpatient claims linked data set from 2005 to 2008 was queried to identify ventral hernia re-repairs after index ventral hernia repairs. Survival analysis was used to examine the ventral hernia re-repair rate over time and to quantify the relationship with clinical variables. RESULTS Of 3,730 index ventral hernia repairs identified in ACS-NSQIP, 247 patients (6.6%) underwent re-repair of a ventral hernia during the study period (2005-2008) in the Medicare claims data. ACS-NSQIP clinical variables that were associated with the ventral hernia re-repair rate in Medicare claims data 1 year after index ventral hernia repair were being a smoker (hazard ratio [HR] = 1.70, P = .02), body mass index (HR = 1.16, P = .04), and postoperative superficial surgical-site infection (HR = 2.88, P < .001). CONCLUSION Long-term rate and timing of ventral hernia re-repair obtained from claims data were an underestimate compared with clinical studies. Yet, several known clinical risk factors for recurrence in the clinical registry were associated with the re-repair rate in claims data at one year. It may be possible to study certain long-term outcomes using selected reoperation rates using the technique of linked clinical registry-claims data, with an understanding that event rates are conservative estimates.

Hospital Standards to Promote Optimal Surgical Care of the Older Adult: A Report From the Coalition for Quality in Geriatric Surgery.

Objective: The aim of this study was to establish high-quality, valid standards to improve surgical care of the older adult. Background: The aging population increases demand for high-quality surgical care. Building upon prior guidelines, quality indicators, and pilot projects, the Coalition for Quality in Geriatric Surgery (CQGS) includes 58 diverse stakeholder organizations committed to improving geriatric surgery. Methods: Using a modified RAND-UCLA Appropriateness Methodology, 44 of 58 CQGS Stakeholders twice rated validity (primary outcome) and feasibility for 308 standards, ranging from goals and decision-making, pre-operative assessment and optimization, perioperative and postoperative care, to transitions of care beyond the acute care hospital. Results: Three hundred six of 308 (99%) standards were rated as valid to improve quality of geriatric surgery. There were 4 sections. Section 1 included 157 (57%) standards and focused on goals and decision-making, preoperative optimization, and transitions into and out of the hospital. Section 2 included 84 (27.3%) standards focused on in-hospital care, across the immediate preoperative, intraoperative, and postoperative phases. Section 3 included 59 (19.1%) standards about program management, including personnel and committee structure, credentialing, and education. Section 4 included 8 (2.6%) standards establishing overarching concepts for data collection and patient follow-up. Two hundred ninety of 308 standards (94.2%) were rated as feasible; 18 (5.8%) were rated as uncertain in feasibility. Conclusions: CQGS Stakeholders rated the vast majority of standards of care as highly valid (99%) and feasible (94%) for improving the quality of surgical care provided to older adults. Future work will focus on a pilot phase to better understand and address challenges to implementation of the standards.

Variation in Hospital Use of Postacute Care After Surgery and the Association With Care Quality.

Background:Little is known about hospital use of postacute care after surgery and whether it is related to measures of surgical quality. Research Design:We used data merged between a national surgery registry, Medicare inpatient claims, the Area Resource File, and the American Hospital Association Annual Survey (2005–2008). Using bivariate and multivariate analyses, we calculated hospital-level, risk-adjusted rates of postacute care use for both inpatient facilities (IF) and home health care (HHC), and examined the association of these rates with hospital quality measures, including mortality, complications, readmissions, and length of stay. Results:Of 112,620 patients treated at 217 hospitals, 18.6% were discharged to an IF, and 19.9% were discharged with HHC. Even after adjusting for differences in patient and hospital characteristics, hospitals varied widely in their use of both IF (mean, 20.3%; range, 2.7%–39.7%) and HHC (mean, 22.3%; range, 3.1%–57.8%). A hospital’s risk-adjusted postoperative mortality rate or complication rate was not significantly associated with its use of postacute care, but higher 30-day readmission rates were associated with higher use of IF (24.1% vs. 21.2%, P=0.03). Hospitals with longer average length of stay used IF less frequently (19.4% vs. 24.4%, P<0.01). Conclusions:Hospitals vary widely in their use of postacute care. Although hospital use of postacute care was not associated with risk-adjusted complication or mortality rates, hospitals with high readmission rates and shorter lengths of stay used inpatient postacute care more frequently. To reduce variations in care, better criteria are needed to identify which patients benefit most from these services.