Jacqueline Kosecoff

Consensus methods: characteristics and guidelines for use.

Consensus methods are being used increasingly to solve problems in medicine and health. Their main purpose is to define levels of agreement on controversial subjects. Advocates suggest that, when properly employed, consensus strategies can create structured environments in which experts are given the best available information, allowing their solutions to problems to be more justifiable and credible than otherwise. This paper surveys the characteristics of several major methods (Delphi, Nominal Group, and models developed by the National Institutes of Health and Glaser) and provides guidelines for those who want to use the techniques. Among the concerns these guidelines address are selecting problems, choosing members for consensus panels, specifying acceptable levels of agreement, properly using empirical data, obtaining professional and political support, and disseminating results.

A method for the detailed assessment of the appropriateness of medical technologies.

The standard way to assess medical technologies is to conduct a randomized clinical trial. Patients are randomly assigned to groups receiving alternative treatments, and outcomes are monitored over a long period of time. For example, some victims of left main coronary artery disease may undergo coronary artery bypass surgery, and others may receive medical treatment with nitroglycerine and beta blockers. Comparison of five-year mortality and morbidity in the two groups helps to determine the relative appropriateness of the two procedures. In addition, information about quality of life and cost can also be collected and compared.

Variations in the Use of Medical and Surgical Services By the Medicare Population

We measured geographic differences in the use of medical and surgical services during 1981 by Medicare beneficiaries (age greater than or equal to 65) in 13 large areas of the United States. The average number of Medicare beneficiaries per site was 340,000. We found large and significant differences in the use of services provided by all medical and surgical specialties. Of 123 procedures studied, 67 showed at least threefold differences between sites with the highest and lowest rates of use. Use rates were not consistently high in one site, but rates for procedures used to diagnose and treat a specific disease varied together, as did alternative treatments for the same condition. These results cannot be explained by the actions of a small number of physicians. We do not know whether physicians in high-use areas performed too many procedures, whether physicians in low-use areas performed too few, or whether neither or both of these explanations are accurate. However, we do know that the differences are too large to ignore and that unless they are understood at a clinical level, uninformed policy decisions that have adverse effects on the health of the elderly may be made.

The Appropriateness of Carotid Endarterectomy

Abstract Carotid endarterectomy is a commonly performed but controversial procedure. We developed from the literature a list of 864 possible reasons for performing carotid endarterectomy, and asked a panel of nationally known experts to rate the appropriateness of each indication using a modified Delphi technique. On the basis of the panels ratings, we determined the appropriateness of carotid endarterectomy in a random sample of 1302 Medicare patients in three geographic areas who had had the procedure in 1981. Thirty-five percent of the patients in our sample had carotid endarterectomy for appropriate reasons, 32 percent for equivocal reasons, and 32 percent for inappropriate reasons. Of the patients having inappropriate surgery, 48 percent had less than 50 percent stenosis of the carotid artery that was operated on. Fifty-four percent of all the procedures were performed in patients without transient ischemic attacks in the carotid distribution. Of these procedures, 18 percent were judged appropriate,...

Physician Ratings of Appropriate Indications for Six Medical and Surgical Procedures

We convened three panels of physicians to rate the appropriateness of a large number of indications for performing a total of six medical and surgical procedures. The panels followed a modified Delphi process. Panelists separately assigned initial ratings, then met in Santa Monica, California where they received reports showing their initial ratings and the distribution of the other panelists ratings. They discussed the indications and revised the indications lists, then individually assigned final ratings. There was generally better agreement on the final ratings than on the initial ratings. Based on reasonable criteria for agreement and disagreement, and excluding one outlying procedure, the panelists agreed on ratings for 42 to 56 per cent of the indications, and disagreed on 11 to 29 per cent.

The functional status questionnaire

A comprehensive functional assessment requires thorough and careful inquiry, which is difficult to accomplish in most busy clinical practices. This paper examines the reliability and validity of the Functional Status Questionnaire (FSQ), a brief, standardized, self-administered questionnaire designed to provide a comprehensive and feasible assessment of physical, psychological, social and role function in ambulatory patients. The FSQ can be completed and computer-scored in minutes to produce a one-page report which includes six summated-rating scale scores and six single-item scores. The clinician can use this report both to screen for and to monitor patients’ functional status. In this study, the FSQ was administered to 497 regular users of Boston’s Beth Israel Hospital’ Healthcare Associates and 656 regular users of 76 internal medicine practices in Los Angeles. The data demonstrate that the FSQ produces reliable sub-scales with construct validity. The authors believe the FSQ addresses many of the problems behind the slow diffusion into primary care of systematic functional assessment.

Physician and Patient Satisfaction as Factors Related to the Organization of Internal Medicine Group Practices

The present study compares patient satisfaction scores with job satisfaction scores of the physicians providing their care in 16 general internal medicine teaching hospital group practices. Practice sites with more satisfied patients were also more likely to have more satisfied housestaff and faculty physicians. Additionally, higher satisfaction scores for both physician groups and patients were consistently associated with a greater percentage of patients experiencing continuity of care, lower patient no-show rates, more efficient use of ancillary staff in providing direct patient care, and more reasonable charges for a routine follow-up visit. These findings suggest that improving physician and patient satisfaction may have economic as well as psychological and social benefits.

Predicting the Appropriate Use of Carotid Endarterectomy, Upper Gastrointestinal Endoscopy, and Coronary Angiography

BACKGROUND AND METHODS In a nationally representative population 65 years of age or older, we have demonstrated that about one quarter of coronary angiographies and upper gastrointestinal endoscopies and two thirds of carotid endarterectomies were performed for reasons that were less than medically appropriate. In this paper we examine whether specific characteristics of patients (age, sex, and race), physicians (age, board-certification status, and experience with the procedure), or hospitals (teaching status, profit-making status, and size) predict whether a procedure will be performed appropriately. RESULTS In general, we found that little of the variability in the appropriateness of care (4 percent or less) could be explained on the basis of standard, easily obtainable data about the patient, the physician, or the hospital. For all three procedures, however, performance in a teaching hospital increased the likelihood that the reasons would be medically appropriate (P = 0.09 for angiography, P = 0.30 for endoscopy, and P less than 0.01 for endarterectomy). In addition, angiographies were more often performed for appropriate reasons in older or more affluent patients (P less than 0.01 for both). Being treated by a surgeon who performed a high rather than a low number of procedures decreased the likelihood of an appropriate endarterectomy by one third, from 40 to 28 percent (P less than 0.01). CONCLUSIONS Appropriateness of care cannot be closely predicted from many easily determined characteristics of patients, physicians, or hospitals. Thus, for the present, if appropriateness is to be improved it will have to be assessed directly at the level of each patient, hospital, and physician.

The Use and Misuse of Upper Gastrointestinal Endoscopy

STUDY OBJECTIVE To determine how appropriately physicians in 1981 did upper gastrointestinal endoscopy in a randomly selected, community-based sample of Medicare patients. DESIGN We developed a comprehensive and clinically detailed list of 1069 indications for upper gastrointestinal endoscopy. A national panel of nine clinicians rated the appropriateness of the indications. We categorized the indications as appropriate, inappropriate, or equivocal. We did a clinically detailed medical record review of a random sample of 1585 patients having upper gastrointestinal endoscopy to assess the appropriateness of using upper gastrointestinal endoscopy. SETTING Patients were sampled from large geographic areas in three states. Two areas represented high use, and one area, low use. PATIENTS Random sample of patients 65 years of age or older receiving diagnostic upper gastrointestinal endoscopy. INTERVENTIONS None; the study was retrospective. MEASUREMENT AND RESULTS Patient characteristics, histories, and clinical indications for upper gastrointestinal endoscopy were similar across low- and high-use areas. Overall, 72% of the endoscopies were done for appropriate indications, 11% for equivocal indications, and 17% for inappropriate indications. Upper gastrointestinal bleeding (26%), follow-up to an abnormal upper gastrointestinal series (21%), dysphagia (18%), and dyspepsia (15%) were the most frequent clinical reasons for doing endoscopy. Inpatient endoscopies were more often appropriate and less often inappropriate than outpatient endoscopies. CONCLUSIONS This analysis of practice patterns among study sites provides the clinical basis for understanding the use of upper gastrointestinal endoscopy. The finding of 17% inappropriate use may be cause for concern.

Relation Between Surgeons' Practice Volumes and Geographic Variation in the Rate of Carotid Endarterectomy

We examined the relation between the number of operative procedures carried out by individual surgeons and the variation in the rate of carotid endarterectomy among Medicare beneficiaries in areas of high, average, and low use of the procedure in 1981. Rates ranged from 48 per 100,000 in the low-use area to 178 per 100,000 in the high-use area. Two variables accounted for most of the differences in the rates: the number of surgeons performing the procedure and the number of endarterectomies performed by surgeons with high practice volumes. Twice as many surgeons in the high-use area and 25 percent more in the average-use area performed carotid endarterectomy as compared with those in the low-use area. If the average number of cases per surgeon had been the same, the differences in the number of surgeons would have accounted for 36 percent and 15 percent, respectively, of the differences in use. Surgeons who performed 15 or more carotid endarterectomies during the year accounted for most of the variation in the rates. These high-volume surgeons represented 15 percent and 17 percent of the surgeons in the areas of high and average use, respectively, as compared with 4 percent of those in the low-use area. They accounted for 60 and 77 percent, respectively, of the additional endarterectomies. Three fourths of the surgeons performing carotid endarterectomies carried out fewer than 10, and 24 percent did only 1. We conclude that most of the geographic variation in the rate of carotid endarterectomy is caused by a few surgeons in high-use areas who perform large numbers of operations.