Gerald O. McDonald

Risk adjustment of the postoperative morbidity rate for the comparative assessment of the quality of surgical care : Results of the National Veterans Affairs Surgical Risk Study

BACKGROUND The National Veterans Affairs Surgical Risk Study was designed to collect reliable, valid data on patient risk and outcomes for major surgery in the Veterans Health Administration and to report comparative risk-adjusted postoperative mortality rates for surgical services in Veterans Health Administration. STUDY DESIGN This cohort study was conducted in 44 Veterans Affairs Medical Centers. Included were 87,078 major noncardiac operations performed under general, spinal, or epidural anesthesia between October 1, 1991, and December 31, 1993. The main outcomes measure was all-cause mortality within 30 days after the index procedure. Multivariable logistic regression risk-adjustment models for all operations and for eight surgical subspecialties were developed. Risk-adjusted surgical mortality rates were expressed as observed-to-expected ratios and were compared with unadjusted 30-day postoperative mortality rates. RESULTS Patient risk factors predictive of postoperative mortality included serum albumin level, American Society of Anesthesia class, emergency operation, and 31 additional preoperative variables. Considerable variability in unadjusted mortality rates for all operations was observed across the 44 hospitals (1.2-5.4%). After risk adjustment, observed-to-expected ratios ranged from 0.49 to 1.53. Rank order correlation of the hospitals by unadjusted and risk-adjusted mortality rates for all operations was 0.64. Ninety-three percent of the hospitals changed rank after risk adjustment, 50% by more than 5 and 25% by more than 10. CONCLUSIONS The Department of Veterans Affairs has successfully implemented a system for the prospective collection and comparative reporting of risk-adjusted postoperative mortality rates after major noncardiac operations. Risk adjustment had an appreciable impact on the rank ordering of the hospitals and provided a means for monitoring and potentially improving the quality of surgical care.

On-Pump versus Off-Pump Coronary-Artery Bypass Surgery

BACKGROUND Coronary-artery bypass grafting (CABG) has traditionally been performed with the use of cardiopulmonary bypass (on-pump CABG). CABG without cardiopulmonary bypass (off-pump CABG) might reduce the number of complications related to the heart-lung machine. METHODS We randomly assigned 2203 patients scheduled for urgent or elective CABG to either on-pump or off-pump procedures. The primary short-term end point was a composite of death or complications (reoperation, new mechanical support, cardiac arrest, coma, stroke, or renal failure) before discharge or within 30 days after surgery. The primary long-term end point was a composite of death from any cause, a repeat revascularization procedure, or a nonfatal myocardial infarction within 1 year after surgery. Secondary end points included the completeness of revascularization, graft patency at 1 year, neuropsychological outcomes, and the use of major resources. RESULTS There was no significant difference between off-pump and on-pump CABG in the rate of the 30-day composite outcome (7.0% and 5.6%, respectively; P=0.19). The rate of the 1-year composite outcome was higher for off-pump than for on-pump CABG (9.9% vs. 7.4%, P=0.04). The proportion of patients with fewer grafts completed than originally planned was higher with off-pump CABG than with on-pump CABG (17.8% vs. 11.1%, P<0.001). Follow-up angiograms in 1371 patients who underwent 4093 grafts revealed that the overall rate of graft patency was lower in the off-pump group than in the on-pump group (82.6% vs. 87.8%, P<0.01). There were no treatment-based differences in neuropsychological outcomes or short-term use of major resources. CONCLUSIONS At 1 year of follow-up, patients in the off-pump group had worse composite outcomes and poorer graft patency than did patients in the on-pump group. No significant differences between the techniques were found in neuropsychological outcomes or use of major resources. (ClinicalTrials.gov number, NCT00032630.).

Relation of Surgical Volume to Outcome in Eight Common Operations : Results From the VA National Surgical Quality Improvement Program

OBJECTIVE To examine, in the Veterans Health Administration (VHA), the relation between surgical volume and outcome in eight commonly performed operations of intermediate complexity. SUMMARY BACKGROUND DATA In multihospital health care systems such as VHA, consideration is often given to closing low-volume surgical services, with the assumption that better surgical outcomes are achieved in hospitals with larger surgical volumes. Literature data to support this assumption in intermediate-complexity operations are either limited or controversial. METHODS The VHA National Surgical Quality Improvement Program data on nonruptured abdominal aortic aneurysmectomy, vascular infrainguinal reconstruction, carotid endarterectomy (CEA), lung lobectomy/pneumonectomy, open and laparoscopic cholecystectomy, partial colectomy, and total hip arthroplasty were used. Pearson correlation, analysis of variance, mixed effects hierarchical logistic regression, and automatic interaction detection analysis were used to assess the association of annual procedure/specialty volume with risk-adjusted 30-day death (and stroke in CEA). RESULTS Eight major surgical procedures (68,631 operations) were analyzed. No statistically significant associations between procedure or specialty volume and 30-day mortality rate (or 30-day stroke rate in CEA) were found. CONCLUSIONS In VHA hospitals, the procedure and surgical specialty volume in eight prevalent operations of intermediate complexity are not associated with risk-adjusted 30-day mortality rate from these operations, or with the risk-adjusted 30-day stroke rate from CEA. Volume of surgery in these operations should not be used as a surrogate for quality of surgical care.

A Decade’s Experience With Quality Improvement in Cardiac Surgery Using the Veterans Affairs and Society of Thoracic Surgeons National Databases

ObjectiveTo review the Department of Veteran Affairs (VA) and the Society of Thoracic Surgeons (STS) national databases over the past 10 years to evaluate their relative similarities and differences, to appraise their use as quality improvement tools, and to assess their potential to facilitate improvements in quality of cardiac surgical care. Summary Background DataThe VA developed a mandatory risk-adjusted database in 1987 to monitor outcomes of cardiac surgery at all VA medical centers. In 1989 the STS developed a voluntary risk-adjusted database to help members assess quality and outcomes in their individual programs and to facilitate improvements in quality of care. MethodsA short data form on every veteran operated on at each VA medical center is completed and transmitted electronically for analysis of unadjusted and risk-adjusted death and complications, as well as length of stay. Masked, confidential semiannual reports are then distributed to each program’s clinical team and the associated administrator. These reports are also reviewed by a national quality oversight committee. Thus, VA data are used both locally for quality improvement and at the national level with quality surveillance. The STS dataset (217 core fields and 255 extended fields) is transmitted for each patient semiannually to the Duke Clinical Research Institute (DCRI) for warehousing, analysis, and distribution. Site-specific reports are produced with regional and national aggregate comparisons for unadjusted and adjusted surgical deaths and complications, as well as length of stay for coronary artery bypass grafting (CABG), valvular procedures, and valvular/CABG procedures. Both databases use the logistic regression modeling approach. Data for key processes of care are also captured in both databases. Research projects are frequently carried out using each database. ResultsMore than 74,000 and 1.6 million cardiac surgical patients have been entered into the VA and STS databases, respectively. Risk factors that predict surgical death for CABG are very similar in the two databases, as are the odds ratios for most of the risk factors. One major difference is that the VA is 99% male, the STS 71% male. Both databases have shown a significant reduction in the risk-adjusted surgical death rate during the past decade despite the fact that patients have presented with an increased risk factor profile. The ratio of observed to expected deaths decreased from 1.05 to 0.9 for the VA and from 1.5 to 0.9 for the STS. ConclusionIt appears that the routine feedback of risk-adjusted data on local performance provided by these programs heightens awareness and leads to self-examination and self-assessment, which in turn improves quality and outcomes. This general quality improvement template should be considered for application in other settings beyond cardiac surgery.

Comparison of Surgical Outcomes Between Teaching and Nonteaching Hospitals in the Department of Veterans Affairs

ObjectiveTo determine whether the investment in postgraduate education and training places patients at risk for worse outcomes and higher costs than if medical and surgical care was delivered in nonteaching settings. Summary Background DataThe Veterans Health Administration (VA) plays a major role in the training of medical students, residents, and fellows. MethodsThe database of the VA National Surgical Quality Improvement Program was analyzed for all major noncardiac operations performed during fiscal years 1997, 1998, and 1999. Teaching status of a hospital was determined on the basis of a background and structure questionnaire that was independently verified by a research fellow. Stepwise logistic regression was used to construct separate models predictive of 30-day mortality and morbidity for each of seven surgical specialties and eight operations. Based on these models, a severity index for each patient was calculated. Hierarchical logistic regression models were then created to examine the relationship between teaching versus nonteaching hospitals and 30-day postoperative mortality and morbidity, after adjusting for patient severity. ResultsTeaching hospitals performed 81% of the total surgical workload and 90% of the major surgery workload. In most specialties in teaching hospitals, the residents were the primary surgeons in more than 90% of the operations. Compared with nonteaching hospitals, the patient populations in teaching hospitals had a higher prevalence of risk factors, underwent more complex operations, and had longer operation times. Risk-adjusted mortality rates were not different between the teaching and nonteaching hospitals in the specialties and operations studied. The unadjusted complication rate was higher in teaching hospitals in six of seven specialties and four of eight operations. Risk adjustment did not eliminate completely these differences, probably reflecting the relatively poor predictive validity of some of the risk adjustment models for morbidity. Length of stay after major operations was not consistently different between teaching and nonteaching hospitals. ConclusionCompared with nonteaching hospitals, teaching hospitals in the VA perform the majority of complex and high-risk major procedures, with comparable risk-adjusted 30-day mortality rates. Risk-adjusted 30-day morbidity rates in teaching hospitals are higher in some specialties and operations than in nonteaching hospitals. Although this may reflect the weak predictive validity of some of the risk adjustment models for morbidity, it may also represent suboptimal processes and structures of care that are unique to teaching hospitals. Despite good quality of care in teaching hospitals, as evidenced by the 30-day mortality data, efforts should be made to examine further the structures and processes of surgical care prevailing in these hospitals.

Risk factors for intermediate-term survival after coronary artery bypass grafting.

BACKGROUND Risk factors for short-term mortality after coronary artery bypass grafting are well established, but little is known about risk factors for intermediate-term mortality. METHODS We analyzed the outcomes of 11,815 patients undergoing coronary artery bypass grafting in one of the 43 cardiac surgery programs of the Department of Veteran Affairs. Risk factors for intermediate- and short-term mortality were determined using Cox proportional hazards regression models. Effects of risk factors during these two periods were explicitly compared. RESULTS We found important differences in mortality risk-factor sets between the intermediate- and short-term periods after coronary artery bypass grafting. The majority of predictors of intermediate-term mortality were noncardiac-related variables, whereas the majority of predictors of short-term mortality were cardiac-related variables. Impaired functional status, chronic obstructive pulmonary disease, and renal dysfunction had greater effects in the intermediate-term period. Previous heart operation, angina class III or IV, previous myocardial infarction, and preoperative use of an intraaortic balloon pump had greater effects in the short-term period. CONCLUSIONS The risk factors for intermediate-term mortality identified in this study can augment preoperative risk assessment and counseling of patients. Clinicians should be aware of the importance of noncardiac-related variables as predictors of mortality in the intermediate-term period after coronary artery bypass grafting.

Comparison of short-term mortality risk factors for valve replacement versus coronary artery bypass graft surgery.

BACKGROUND Risk factors for 30-day operative (short-term) mortality following coronary artery bypass graft (CABG only) procedures are well established. However, little is known about how the risk factors for short-term mortality following valve replacement procedures (with or without a CABG procedure performed) compare with CABG only risk factors. METHODS Department of Veterans Affairs (VA) records (65,585 records) were collected from October 1991 through March 2001 and analyzed. Risk factors for short-term mortality were compared across three subgroups of patients: CABG only surgery (n = 56,318), aortic valve replacement (AVR) with or without CABG (n = 7450), and mitral valve replacement (MVR) with or without CABG (n = 1817). Multivariable logistic regression analyses were used to compare the relative magnitude of risk for 19 candidate predictor variables across subgroups. RESULTS Only three patient baseline characteristics differed significantly in magnitude of risk between the procedure groups. Partially or totally dependent functional status significantly increased the risk of short-term mortality for AVR patients (odds ratio [OR] 1.64, 95% confidence interval [CI] 1.29-2.09) and MVR patients (OR 2.21, 95% CI 1.48-3.30), but not for CABG only patients (OR 1.04, 95% CI 0.93-1.16). Conversely, previous heart surgery and New York Heart Association functional class III or IV symptoms conferred greater magnitude of risk for CABG only patients compared with the valve subgroups. CONCLUSIONS Overall, the risk factors for short-term mortality following valve replacement and CABG surgery appear to be relatively consistent. However, clinicians should be aware of the importance of preoperative functional status as a unique predictor of mortality following valve surgery.

A study design to assess the safety and efficacy of on-pump versus off-pump coronary bypass grafting: the ROOBY trial.

Background Since the late 1960s, coronary artery bypass graft (CABG-only) procedures were traditionally performed using a heart-lung machine on an arrested heart (on-pump). Over the past decade, an increasing number CABG-only procedures were performed on a beating heart (off-pump). Advocates of the off-pump approach expect to reduce many of the adverse side effects related to using the heart-lung machine, while advocates for the on-pump procedure raise concerns related to graft patency rates and long-term event-free survival for the off-pump technique. Purpose The U.S. Department of Veteran Affairs (VA) Cooperative Studies Program funded a randomized, multicenter clinical trial comparing the clinical and resourcerelated outcomes following on-pump versus off-pump techniques for veterans undergoing a non-emergent CABG-only procedure. The planning committee was faced with several critically important challenges to assure feasibility of study costs and required sample size; generalizability to non-VA surgical practices; and comparability of clinically meaningful results. These challenges are discussed. Methods This study is a prospective, randomized, multicenter, single blinded (patient) clinical trial that compares on-pump and off-pump techniques for veterans requiring non-emergent CABG-only procedures. There will be 2200 patients randomized at 17 VA Medical Centers when the five-year recruitment period ends on 15 April 2007. There are two primary objectives: a short-term objective to assess the immediate impact of the two techniques on 30-day mortality/morbidity and a long-term objective to assess one-year mortality/morbidity. Major secondary outcomes are one-year graft patency rates and change in neuropsychological assessments from baseline to one year. All patients are assessed at 30 days post-surgery or discharge from the hospital, whichever is latest, and at one-year post-surgery. Results During planning, several key issues had to be decided. These included 1) choosing primary objectives: a short-term (30-day) and a long-term (one-year) objective were chosen; 2) choosing primary outcome measures: composite measures were selected to ensure sufficient end-points; 3) standardization of surgical techniques: minimal standardization required but guidelines and continuing discussions on both techniques provided; 4) establishing criteria for surgeons and residents for participation: surgeons required to have completed 20 off-pump procedures prior to doing study procedures and residents, in presence of study surgeon, capable of doing either procedure; 5) identifying metrics of cognitive dysfunction sensitive to treatment: a neuropshychologist hired who centrally monitors cognitive functioning testing; and 6) blinding participants of surgical procedure: attempt to blind participants. Limitations Areas of concern are whether all surgeons sufficiently experienced on the off-pump procedure, should residents have been allowed to do study surgeries, should techniques have been standardized more and were the best neurocognitive tests selected. Conclusion The study design presented allows for a balanced and fair assessment of the on-pump and off-pump CABG procedures across a diversity of clinical outcomes and resource use metrics. Its results have the potential to influence clinical cardiac surgical practice in the future.

Variation in mortality risk factors with time after coronary artery bypass graft operation.

BACKGROUND Differences in mortality risk factor sets during different time periods (eg, short-term versus intermediate-term) after coronary artery bypass grafting have been reported. However, little is known about the time-varying effects of mortality risk factors after the operation. METHODS We analyzed 11,815 veterans who had coronary artery bypass grafting at any of the 43 Veterans Affairs cardiac surgery centers from October 1997 to September 1999. Time-varying effects of 14 mortality risk factors during the 210 days after coronary artery bypass grafting were evaluated using Cox B-spline regression, which provides an estimate of risk for each variable for each day after operation. RESULTS Eight variables showed significant time-varying effects after operation. The effect of prior heart operation was very high immediately after operation, but disappeared within 1 week. Three other cardiac variables (prior myocardial infarction, preoperative intraaortic balloon pump, and Canadian Cardiovascular Society anginal class III or IV) also conferred the highest risk on the day of operation and decreased thereafter. In contrast, the four time-varying noncardiac risk variables (age, impaired functional status, chronic obstructive pulmonary disease, and renal dysfunction) showed little or no association with mortality immediately after operation, but had increasing impact during the several months after operation. CONCLUSIONS A sizable number of mortality risk factors have time-varying effects after coronary artery bypass grafting. Several cardiac risk factors have peak impact immediately after operation but dissipate thereafter. Several noncardiac risk factors confer little risk immediately after operation, but these risks increase during several months. This information may help clinicians focus management strategies for patients during the 7 months after operation.

Comparison of postoperative mortality in VA and private hospitals.

OBJECTIVE This study compared unselected VA (Department of Veterans Affairs) and private multi-hospital postoperative mortality rates. In the absence of national standards for postoperative mortality rates and in view of the unique volume and range of surgical procedures studied, the second objective is to help establish national standards through the dissemination of these postoperative mortality norms. SUMMARY BACKGROUND DATA Public Law 99-166, Section 204, enacted by Congress December 3, 1985, required that the VA compare postoperative mortality and morbidity rates for each type of surgical procedure it performs with the prevailing national standard and analyze any deviation between such rates in terms of patient characteristics. METHODS The authors compared postoperative mortality in the VA to that in private hospitals, adjusting for the patient characteristics of age, diagnosis, comorbidity, or severity of illness. We used a total of 830,000 patients discharge records (323,000 VA and 507,000 private patients) from 1984 through 1986 among 309 individual surgical procedures within 113 comparison surgical procedures or procedure groups. RESULTS The authors found no significant differences in postoperative mortality rates between the VA and private hospital systems for 105 of the 113 surgical procedures or procedure groups. VA postoperative mortality rates that were higher than those in private hospitals were found for suture of ulcer, revision of gastric anastomosis, small-to-small intestinal anastomosis, appendectomy, and reclosure of postoperative disruption of abdominal wall (p = 0.05). Vascular bypass surgery, portal systemic venous shunt, and esophageal surgery showed a significantly lower postoperative mortality in the VA as compared with that in private hospitals (p = 0.05). CONCLUSIONS VA postoperative mortality in 113 surgical procedures or procedure groups is comparable to that in private hospitals.