Alfredo J. Selim

Patient-reported measures of health: The Veterans Health Study.

Abstract:The goal of the Veterans Health Study (VHS) was to extend the work of the Medical Outcomes Study (MOS) into the VA, by developing methodology for monitoring patient-based outcomes of care for use in ambulatory outpatient care. The principal objective of the VHS was developing valid and reliable measures to assess general health-related quality of life (HRQoL) and identifying the presence of selected health conditions, their severity, and their impact on HRQoL. In this article, we provide an overview of the historical context, framework, objectives, and applications of the VHS for the purpose of assessing the health outcomes of veteran patients. The VHS is a prospective observational study that has followed 2425 VA patients for up to 2 years. The patients were sampled from users of the Veterans Affairs (VA) ambulatory care system in the Boston area. The health conditions selected were hypertension, diabetes, chronic lung disease, osteoarthritis of the knee, chronic low-back pain, and alcohol-related problems. These conditions were chosen because they are both prevalent in the VA and have measurable impacts on HRQoL. One of the cornerstones of the VHS was the development of the Veterans SF-36, modified from the MOS SF-36 for use in veteran ambulatory populations. Other key accomplishments included the development of patient-based disease-specific measures of health and the establishment of methods and logistics for comprehensive health outcomes research in large health care systems such as the VA, using these patient-based measures. Selected measures developed in the VHS, eg, the Veterans SF-36, have been integrated into the VA outcomes measurement system. The scope of the VHS is unique; it resulted in the development of a broad range of patient-focused process and outcome measures, as well as methodologies for assessing large numbers of patients, that have been widely used in the VA outpatient health care system for monitoring health outcomes across the nation.

Deriving SF-12v2 physical and mental health summary scores: a comparison of different scoring algorithms

PurposeSummary scores for the SF-12, version 2 (SF-12v2) health status measure are based on scoring coefficients derived for version 1 of the SF-36, despite changes in item wording and response scales and despite the fact that SF-12 scales only contain a subset of SF-36 items. This study derives new summary scores based directly on SF-12v2 data from a recent U.S. sample and compares the new summary scores to the standard ones. Due to controversy regarding methods for developing scoring coefficients for the summary score, we compare summary scores produced by different methods.MethodsWe analyzed nationally representative U.S. data, which provided 53,399 observations for the SF-12v2 in 2003–2005. In addition to the standard SF-12V2 scoring algorithm, summary scores were generated using exploratory factor analysis (EFA), principal components analysis (PCA), and confirmatory factor analysis (CFA), with orthogonal and oblique rotation. We examined correlations among different summary scores, their associations with demographic and clinical variables, and the consistency between changes in scale scores and in summary scores over time.ResultsThe 8 scale means in the current data were similar to the 1998 SF-12v2 means, with the exception of the vitality scale. Correlations among the scales based on SF-12v2 data differed slightly from correlations derived from scales based on the SF-36 data. Correlations among summary scores derived using different methods were high (≥0.84). However, changes in summary scores derived using orthogonal rotation of components or factors were not consistent with changes in sub-scales, whereas changes in summary scores derived using oblique rotation were more consistent with patterns of change in sub-scales.ConclusionsAlthough the basic structure of the SF-12 is stable, summary scores derived from oblique rotation are preferable and more consistent with changes in individual scales. On empirical and conceptual grounds, we suggest using summary scores based on oblique CFA.

The health status of elderly veteran enrollees in the Veterans Health Administration

Objectives: To examine the health status of elderly veteran enrollees, stratified by age group, and compare with nonveteran populations.

Applications of methodologies of the Veterans Health Study in the VA healthcare system: conclusions and summary.

The Veterans Health Study (VHS) had as its overarching goal the development, testing, and application of patient-centered assessments for monitoring patient outcomes in ambulatory care in large integrated care systems such as the Department of Veterans Affairs (VA). Unlike other previous studies, the VHS has capitalized on rich administrative databases restricted to the VA and linked to patient-centered outcomes. The VHS has developed a comprehensive set of general and disease-specific measures for use by systems of care for ambulatory patients. Chief among these assessments is the Veterans SF-36 Health Survey for measuring health-related quality of life in veteran ambulatory populations. The Veterans SF-36 Health Survey provides the cornerstone for this study and historically has been extensively disseminated and used in the VA with close to 2 million administrations nationally as part of its quality management system. National surveys administered by the VA since 1996 using the Veterans SF-36 Health Survey indicate important regional differences with implications for varying resource needs. Based upon the rich foundation provided by the VHS methodology, the VA has implemented some of these approaches as part of its quality monitoring system and can serve as a model for other large integrated systems of care.

Risk-adjusted mortality rates as a potential outcome indicator for outpatient quality assessments

Objective. The quality of outpatient medical care is increasingly recognized as having an important impact on mortality. We examined whether a clinically credible risk adjustment methodology can be developed for outpatient quality assessments. Research Design. This study used data from the 1998 National Survey of Ambulatory Care Patients, a prospective monitoring system of outcomes of patients receiving ambulatory care in the Veterans Affairs (VA) integrated service networks. Subjects. Thirty-one thousand eight hundred twenty-three patients were followed for 18 months. Measures. The main study outcome measures were observed and risk-adjusted mortality rates. Results. Of the 31,823 patients, 1559 (5%) died during the 18-months of follow-up. Observed mortality rates across the 22 VA integrated service networks varied significantly from 3.3% to 6.7% (P <0.001). Age, gender, comorbidities (Charlson Index), physical health, and mental health were significant predictors of dying. The resulting risk-adjusted mortality model performed well in cross-validated tests of discrimination (c-statistic = 0.768; 95% CI, 0.749–0.788) and calibration. Analysis of variance confirmed that the 22 integrated service networks differed in their average level of expected risk (P <0.001). Risk-adjusted rates and ranks of the networks differed considerably from unadjusted ratings. Conclusions. Risk-adjusted mortality rates may be a useful outcome measure for assessing quality of outpatient care. We have developed a clinically credible risk adjustment model with good performance properties using sociodemographics, diagnoses, and functional status data. The resulting risk adjustment model altered assessments of the performance of the integrated service networks when compared with the unadjusted mortality rates.

Dissemination of methods and results from the veterans health study: final comments and implications for future monitoring strategies within and outside the veterans healthcare system.

The Veterans Health Study (VHS) followed a cohort of patients receiving ambulatory care in the Veterans Affairs healthcare system for up to 5 years. One of the principal aims of this study was to develop a library of methodologies including general and disease-specific health outcome questionnaires for use in monitoring the quality of healthcare and for research purposes. The cornerstone for this work is the Veterans RAND 36 and 12 Item Health Surveys (VR-36 and VR-12), a general measure developed in the VHS for measuring the physical and psychologic well-being of the patient. A comprehensive set of disease-specific assessments has also been developed as part of this study for the purposes of monitoring specific chronic conditions more commonly seen in routine ambulatory care settings. Since 1996, more than 2 million questionnaires have been administered in the VA for quality monitoring purposes, using the VR-36 and VR-12. Research studies that have used these batteries span randomized clinical trials in the VA cooperative studies program and clinical effectiveness research. Health assessments using VHS batteries are being disseminated for widespread use outside the VA. Chief among the assessments used is the VR-12, which has recently been included in the 2006 Health Plan Employer Data and Information Set (HEDIS) as part of the Medicare Health Outcomes Survey for monitoring the Medicare Advantage Program. The methods and batteries developed in the VHS are in the public domain and provide a framework for future patient monitoring using standard measures of health.

Assessment of Functional Status, Low Back Disability, and Use of Diagnostic Imaging in Patients with Low Back Pain and Radiating Leg Pain

We analyzed data from outpatients with chronic low back pain (LBP) in the Veterans Health Study (n = 563) to examine the relationship between localized LBP intensity and radiating leg pain in assessing patient functional status, low back disability, and use of diagnostic imaging. Based on the localized LBP intensity, the study subjects were divided into tertiles (low, moderate, and high intensity). The study subjects were also stratified by the extent of radiating leg pain. Using analysis of variance and multiple regression analysis, we compared the relative importance of localized LBP intensity and radiating leg pain in explaining the variability in the means of the SF-36 scales and low back disability days, and in the proportion of patients who had used diagnostic imaging. The results of the study indicate that measures of localized LBP intensity and radiating leg pain contribute separately to the assessment of patient functional status, low back disability, and use of diagnostic imaging. These results suggest that localized LBP intensity and radiating leg pain may represent two different approaches in assessing back pain severity. Future epidemiological and health services research should consider both measures in assessing the impact of LBP on patient functional status, low back disability, and use of diagnostic imaging.

Racial differences in the use of lumbar spine radiographs: results from the Veterans Health Study.

Study Design. We analyzed data from the Veterans Health Study, a longitudinal study of male patients receiving VA ambulatory care. Objective. To determine whether clinical differences and/or race account for disparities between white and nonwhite patients in the use of lumbar spine radiographs. Summary and Background Data. Four hundred one patients with low back pain (LBP) receiving ambulatory care services in four VA outpatient clinics in the greater Boston area were followed for 12 months. Methods. Participants were mailed the Medical Outcome Study Short Form Health Survey (SF-36) and had scheduled interviews that included the completion of a low back questionnaire, a comorbidity index, and a straight leg raising (SLR) test. Using self-reported racial data, patients were grouped as whites (315 patients) and nonwhites (among whom 22 were black, 4 nonwhite Hispanics, and 1 other race). Results. Nonwhite patients had lumbar spine films more often (13 of 27, 48%) than white patients (87 of 315, 27%)(P = 0.02). Nonwhite patients had higher pain intensity scores than white patients (63 ± 21 vs. 48 ± 21, P < 0.01) and were more likely to have radiating leg pain (20 of 27, 76%; compared with 171 of 315, 55%;P = 0.01) than white patients. Nonwhite patients had worse physical functioning (P = 0.01), general health perception (P = 0.05), social functioning (P = 0.02), and role limitations because of emotional problems (P < 0.01). At higher LBP intensity level, nonwhite patients received more lumbar spine films (20 of 27, 74%) than did white patients (155 of 315, 50%)(P < 0.01). Among patients with positive SLR test, nonwhite patients also had lumbar spine films more often (5 of 22, 23%) than white patients (29 of 315, 11%) (P < 0.01). However, after adjusting for multiple clinical characteristics, race was no longer found to be an independent predictor of lumbar spine radiograph use. A positive SLR test remained to be associated with higher radiograph use, whereas better mental health status was associated with lower radiograph use. Conclusions. There was greater use of lumbar spine radiographs by nonwhite patients compared with white patients. This remained true when patients were subcategorized by severity of LBP or SLR test. However, race had no influence when multiple clinical characteristics of the patients were controlled for simultaneously. This study demonstrates the importance of careful and comprehensive case-mix adjustment when assessing apparent differences in the use of medical services.

Risk-adjusted mortality as an indicator of outcomes: comparison of the Medicare Advantage Program with the Veterans' Health Administration.

Background:The Medicare Advantage Program (MAP) and the Veterans’ Health Administration (VHA) currently provide many services that benefit the elderly, and a comparative study of their risk-adjusted mortality rates has the potential to provide important information regarding these 2 systems of care. Objective:The objective of this retrospective study was to compare mortality rates between the MAP and the VHA after controlling for case-mix differences. Subjects:This study consisted of 584,294 MAP patients and 420,514 VHA patients. Measures:We used the Death Master File to ascertain the vital status of each study subject over approximately 4 years. We used Cox regression models to estimate hazard ratios (HRs) with 95% confidence intervals (CIs) for the MAP compared with VHA patients. Results:The average age for male MAP patients was 73.8 years (±5.6) and for male VHA patients was 74.05 years (±6.3). Unadjusted mortality rates of males for VHA and MAP were 25.7% and 22.8%, respectively, over approximately 4 years (P < 0.0001), respectively. The case-mix of VHA patients, however, was sicker than those from MAP. After adjusting for case-mix, the HR for mortality in the MAP was significantly higher than that in the VHA (HR, 1.404; 95% CI = 1.383–1.426). We obtained similar results when we compared the mortality rates of females for VHA and MAP. Conclusions:After adjusting for their higher prevalence of chronic disease and worse self-reported health, mortality rates were lower for patients cared for in the VHA compared with those in the MAP. Further studies should examine what differences in care structures and processes contribute to lower mortality in the VHA.

Comparison of Health Outcomes for Male Seniors in the Veterans Health Administration and Medicare Advantage Plans

OBJECTIVES To compare the Veterans Health Administration (VHA) with the Medicare Advantage (MA) plans with regard to health outcomes. DATA SOURCES The Medicare Health Outcome Survey, the 1999 Large Health Survey of Veteran Enrollees, and the Ambulatory Care Survey of Healthcare Experiences of Patients (Fiscal Years 2002 and 2003). STUDY DESIGN A retrospective study. EXTRACTION METHODS Men 65+ receiving care in MA (N=198,421) or in VHA (N=360,316). We compared the risk-adjusted probability of being alive with the same or better physical (PCS) and mental (MCS) health at 2-years follow-up. We computed hazard ratio (HR) for 2-year mortality. PRINCIPAL FINDINGS Veterans had a higher adjusted probability of being alive with the same or better PCS compared with MA participants (VHA 69.2 versus MA 63.6 percent, p<.001). VHA patients had a higher adjusted probability than MA patients of being alive with the same or better MCS (76.1 versus 69.6 percent, p<.001). The HRs for mortality in the MA were higher than in the VHA (HR, 1.26 [95 percent CI 1.23-1.29]). CONCLUSIONS Our findings indicate that the VHA has better patient outcomes than the private managed care plans in Medicare. The VHAs performance offers encouragement that the public sector can both finance and provide exemplary health care.