Saul N. Weingart

Overrides of Medication Alerts in Ambulatory Care

BACKGROUND Electronic prescribing systems with decision support may improve patient safety in ambulatory care by offering drug allergy and drug interaction alerts. However, preliminary studies show that clinicians override most of these alerts. METHODS We performed a retrospective analysis of 233 537 medication safety alerts generated by 2872 clinicians in Massachusetts, New Jersey, and Pennsylvania who used a common electronic prescribing system from January 1, 2006, through September 30, 2006. We used multivariate techniques to examine factors associated with alert acceptance. RESULTS A total of 6.6% of electronic prescription attempts generated alerts. Clinicians accepted 9.2% of drug interaction alerts and 23.0% of allergy alerts. High-severity interactions accounted for most alerts (61.6%); clinicians accepted high-severity alerts slightly more often than moderate- or low-severity interaction alerts (10.4%, 7.3%, and 7.1%, respectively; P < .001). Clinicians accepted 2.2% to 43.1% of high-severity interaction alerts, depending on the classes of interacting medications. In multivariable analyses, we found no difference in alert acceptance among clinicians of different specialties (P = .16). Clinicians were less likely to accept a drug interaction alert if the patient had previously received the alerted medication (odds ratio, 0.03; 95% confidence interval, 0.03-0.03). CONCLUSION Clinicians override most medication alerts, suggesting that current medication safety alerts may be inadequate to protect patient safety.

What Can Hospitalized Patients Tell Us About Adverse Events? Learning from Patient-Reported Incidents

PURPOSE: Little is known about how well hospitalized patients can identify errors or injuries in their care. Accordingly, the purpose of this study was to elicit incident reports from hospital inpatients in order to identify and characterize adverse events and near-miss errors.SUBJECTS: We conducted a prospective cohort study of 228 adult inpatients on a medicine unit of a Boston teaching hospital.METHODS: Investigators reviewed medical records and interviewed patients during the hospitalization and by telephone 10 days after discharge about “problems,” “mistakes,” and “injuries” that occurred. Physician investigators classified patients’ reports. We calculated event rates and used multivariable Poisson regression models to examine the factors associated with patient-reported events.RESULTS: Of 264 eligible patients, 228 (86%) agreed to participate and completed 528 interviews. Seventeen patients (8%) experienced 20 adverse events; 1 was serious. Eight patients (4%) experienced 13 near misses; 5 were serious or life threatening. Eleven (55%) of 20 adverse events and 4 (31%) of 13 near misses were documented in the medical record, but none were found in the hospital incident reporting system. Patients with 3 or more drug allergies were more likely to report errors compared with patients without drug allergies (incidence rate ratio 4.7, 95% CI 1.7, 13.4).CONCLUSIONS: Inpatients can identify adverse events affecting their care. Many patient-identified events are not captured by the hospital incident reporting system or recorded in the medical record. Engaging hospitalized patients as partners in identifying medical errors and injuries is a potentially promising approach for enhancing patient safety.

Outpatient Prescribing Errors and the Impact of Computerized Prescribing

AbstractBACKGROUND: Medication errors are common among inpatients and many are preventable with computerized prescribing. Relatively little is known about outpatient prescribing errors or the impact of computerized prescribing in this setting. OBJECTIVE: To assess the rates, types, and severity of outpatient prescribing errors and understand the potential impact of computerized prescribing. DESIGN: Prospective cohort study in 4 adult primary care practices in Boston using prescription review, patient survey, and chart review to identify medication errors, potential adverse drug events (ADEs) and preventable ADEs. PARTICIPANTS: Outpatients over age 18 who received a prescription from 24 participating physicians. RESULTS: We screened 1879 prescriptions from 1202 patients, and completed 661 surveys (response rate 55%). Of the prescriptions, 143 (7.6%; 95% confidence interval (CI) 6.4% to 8.8%) contained a prescribing error. Three errors led to preventable ADEs and 62 (43%; 3% of all prescriptions) had potential for patient injury (potential ADEs); I was potentially life-threatening (2%) and 15 were serious (24%). Errors in frequency (n=77, 54%) and dose (n=26, 18%) were common. The rates of medication errors and potential ADEs were not significantly different at basic computerized prescribing sites (4.3% vs 11.0%, P=.31; 2.6% vs 4.0%, P=.16) compared to handwritten sites. Advanced checks (including dose and frequency checking) could have prevented 95% of potential ADEs. CONCLUSIONS: Prescribing errors occurred in 7.6% of outpatient prescriptions and many could have harmed patients. Basic computerized prescribing systems may not be adequate to reduce errors. More advanced systems with dose and frequency checking are likely needed to prevent potentially harmful errors.

Who Uses the Patient Internet Portal? The PatientSite Experience

OBJECTIVE Although the patient Internet portal is a potentially transformative technology, there is little scientific information about the demographic and clinical characteristics of portal enrollees and the features that they access. DESIGN We describe two pilot studies of a comprehensive Internet portal called PatientSite. These pilots include a prospective one-year cohort study of all patients who enrolled in April 2003 and a case-control study in 2004 of enrollees and nonenrollees at two hospital-based primary care practices. MEASUREMENTS The cohort study tracked patient enrollment and features in PatientSite that enrollees accessed, such as laboratory and radiology results, prescription renewals, appointment requests, managed care referrals, and clinical messaging. The case-control study used medical record review to compare the demographic and clinical characteristics of 100 randomly selected PatientSite enrollees and 100 nonenrollees. RESULTS PatientSite use grew steadily after its introduction. New enrollees logged in most frequently in the first month, but 26% to 77% of the cohort continued to access the portal at least monthly. They most often examined laboratory and radiology results and sent clinical messages to their providers. PatientSite enrollees were younger and more affluent and had fewer medical problems than nonenrollees. CONCLUSION Expanding the use of patient portals will require an understanding of obstacles that prevent access for those who might benefit most from this technology.

Confidential Clinician‐reported Surveillance of Adverse Events Among Medical Inpatients

BACKGROUND: Although iatrogenic injury poses a significant risk to hospitalized patients, detection of adverse events (AEs) is costly and difficult.METHODS: The authors developed a confidential reporting method for detecting AEs on a medicine unit of a teaching hospital. Adverse events were defined as patient injuries. Potential adverse events (PAEs) represented errors that could have, but did not result in harm. Investigators interviewed house officers during morning rounds and by e-mail, asking them to identify obstacles to high quality care and iatrogenic injuries. They compared house officer reports with hospital incident reports and patients’ medical records. A multivariate regression model identified correlates of reporting.RESULTS: One hundred ten events occurred, affecting 84 patients. Queries by e-mail (incidence rate ratio [IRR]=0.16; 95% confidence interval [95% CI], 0.05 to 0.49) and on days when house officers rotated to a new service (IRR=0.12; 95% CI, 0.02 to 0.91) resulted in fewer reports. The most commonly reported process of care problems were inadequate evaluation of the patient (16.4%), failure to monitor or follow up (12.7%), and failure of the laboratory to perform at test (12.7%). Respondents identified 29 (26.4%) AEs, 52 (47.3%) PAEs, and 29 (26.4%) other house officer-identified quality problems. An AE occurred in 2.6% of admissions. The hospital incident reporting system detected only one house officer-reported event. Chart review corroborated 72.9% of events.CONCLUSIONS: House officers detect many AEs among inpatients. Confidential peer interviews of front-line providers is a promising method for identifying medical errors and substandard quality.

Patients Discharged Against Medical Advice from a General Medicine Service

This study compares the demographic features and hospital course of all 472 patients discharged against medical advice from the general medicine service of an urban teaching hospital between 1984 and 1995 and 1,113 control patients discharged with physician approval. In the multivariate analysis, younger age (odds ratio [OR] 0.97 per year; 95% confidence interval [CI] 0.96, 0.98), male gender (OR 1.9; 95% CI 1.4, 2.4), lack of health insurance (OR 2.0; 95% CI 1.3, 3.1), Medicaid applicant or recipient status (OR 2.2; 95% CI 1.6, 3.1), admission through the emergency department (OR 2.2; 95% CI 1.4, 3.5), and lack of a personal attending physician at the time of admission (OR 2.1; 95% CI 1.6, 2.8) increased the odds of discharge against medical advice. Fifty-four percent of patients who left against medical advice. Fifty-four percent of patients who left against medical advice were readmitted to the hospital during the study period; 98% were then discharged with physician approval. Patients who left the hospital against medical advice included many disadvantaged individuals without ongoing primary care.

A Physician-based Voluntary Reporting System for Adverse Events and Medical Errors

AbstractOBJECTIVE: To create a voluntary reporting method for identifying adverse events (AEs) and potential adverse events (PAEs) among medical inpatients. DESIGN: Medical house officers asked their peers about obstacles to care, injuries or extended hospitalizations, and problems with medications that affected their patients. Two independent reviewers coded event narratives for adverse outcomes, responsible parties, preventability, and process problems. We corroborated house officers’ reports with hospital incident reports and conducted a retrospective chart review. SETTING: The cardiac step-down, oncology, and medical intensive care units of an urban teaching hospital. INTERVENTION: Structured confidential interviews by postgraduate year-2 and -3 medical residents of interns during work rounds. MEASUREMENTS AND MAIN RESULTS: Respondents reported 88 events over 3 months. AEs occurred among 5 patients (0.5% of admissions) and PAEs among 48 patients (4.9% of admissions). Delayed diagnoses and treatments figured prominently among PAEs (54%). Clinicians were responsible for the greatest number of incidents (55%), followed by workers in the laboratory (11%), radiology (15%), and pharmacy (3%). Respondents identified a variety of problematic processes of care, including problems with diagnosis (16%), therapy (26%), and failure to provide clinical and support services (29%). We corroborated 84% of reported events in the medical record. Participants found voluntary peer reporting of medical errors unobtrusive and agreed that it could be implemented on a regular basis. CONCLUSIONS: A physician-based voluntary reporting system for medical errors is feasible and acceptable to front-line clinicians.

Creating a Quality Improvement Elective for Medical House Officers

The Accreditation Council on Graduate Medical Education (ACGME) requires that house officers demonstrate competencies in “practice-based learning and improvement” and in “the ability to effectively call on system resources to provide care that is of optimum value.” Anticipating this requirement, faculty at a Boston teaching hospital developed a 3-week elective for medical house officers in quality improvement (QI).The objectives of the elective were to enhance residents’ understanding of QI concepts, their familiarity with the hospital’s QI infrastructure, and to gain practical experience with root-cause analysis and QI initiatives. Learners participated in three didactic seminars, joined hospital-based QI activities, conducted a root-cause analysis, and completed a QI project under the guidance of a faculty mentor.The elective enrolled 26 residents in 3 years. Sixty-three percent of resident respondents said that the elective increased their understanding of QI in health care; 88% better understood QI in their own institution.

Health coaching via an internet portal for primary care patients with chronic conditions: a randomized controlled trial.

Background:Efforts to enhance patient-physician communication may improve management of underdiagnosed chronic conditions. Patient internet portals offer an efficient venue for coaching patients to discuss chronic conditions with their primary care physicians (PCP). Objectives:We sought to test the effectiveness of an internet portal-based coaching intervention to promote patient-PCP discussion about chronic conditions. Research Design:We conducted a randomized trial of a nurse coach intervention conducted entirely through a patient internet-portal. Subjects:Two hundred forty-one patients who were registered portal users with scheduled PCP appointments were screened through the portal for 3 target conditions, depression, chronic pain, mobility difficulty, and randomized to intervention and control groups. Measures:One-week and 3-month patient surveys assessed visit experiences, target conditions, and quality of life; chart abstractions assessed diagnosis and management during PCP visit. Results:Similar high percentages of intervention (85%) and control (80%) participants reported discussing their screened condition during their PCP visit. More intervention than control patients reported their PCP gave them specific advice about their health (94% vs. 84%; P = 0.03) and referred them to a specialist (51% vs. 28%; P = 0.002). Intervention participants reported somewhat higher satisfaction than controls (P = 0.07). Results showed no differences in detection or management of screened conditions, symptom ratings, and quality of life between groups. Conclusions:Internet portal-based coaching produced some possible benefits in care for chronic conditions but without significantly changing patient outcomes. Limited sample sizes may have contributed to insignificant findings. Further research should explore ways internet portals may improve patient outcomes in primary care. ClinicalTrials.gov registration NCT00130416.

An empirical model to estimate the potential impact of medication safety alerts on patient safety, health care utilization, and cost in ambulatory care

BACKGROUND Because ambulatory care clinicians override as many as 91% of drug interaction alerts, the potential benefit of electronic prescribing (e-prescribing) with decision support is uncertain. METHODS We studied 279 476 alerted prescriptions written by 2321 Massachusetts ambulatory care clinicians using a single commercial e-prescribing system from January 1 through June 30, 2006. An expert panel reviewed a sample of common drug interaction alerts, estimating the likelihood and severity of adverse drug events (ADEs) associated with each alert, the likely injury to the patient, and the health care utilization required to address each ADE. We estimated the cost savings due to e-prescribing by using third-party-payer and publicly available information. RESULTS Based on the expert panels estimates, electronic drug alerts likely prevented 402 (interquartile range [IQR], 133-846) ADEs in 2006, including 49 (14-130) potentially serious, 125 (34-307) significant, and 228 (85-409) minor ADEs. Accepted alerts may have prevented a death in 3 (IQR, 2-13) cases, permanent disability in 14 (3-18), and temporary disability in 31 (10-97). Alerts potentially resulted in 39 (IQR, 14-100) fewer hospitalizations, 34 (6-74) fewer emergency department visits, and 267 (105-541) fewer office visits, for a cost savings of 402,619 USD (IQR, 141,012-1,012,386 USD). Based on the panels estimates, 331 alerts were required to prevent 1 ADE, and a few alerts (10%) likely accounted for 60% of ADEs and 78% of cost savings. CONCLUSIONS Electronic prescribing alerts in ambulatory care may prevent a substantial number of injuries and reduce health care costs in Massachusetts. Because a few alerts account for most of the benefit, e-prescribing systems should suppress low-value alerts.