Jonathan M. Teich

The Impact of Computerized Physician Order Entry on Medication Error Prevention

BACKGROUND Medication errors are common, and while most such errors have little potential for harm they cause substantial extra work in hospitals. A small proportion do have the potential to cause injury, and some cause preventable adverse drug events. OBJECTIVE To evaluate the impact of computerized physician order entry (POE) with decision support in reducing the number of medication errors. DESIGN Prospective time series analysis, with four periods. SETTING AND PARTICIPANTS All patients admitted to three medical units were studied for seven to ten-week periods in four different years. The baseline period was before implementation of POE, and the remaining three were after. Sophistication of POE increased with each successive period. INTERVENTION Physician order entry with decision support features such as drug allergy and drug-drug interaction warnings. MAIN OUTCOME MEASURE Medication errors, excluding missed dose errors. RESULTS During the study, the non-missed-dose medication error rate fell 81 percent, from 142 per 1,000 patient-days in the baseline period to 26.6 per 1,000 patient-days in the final period (P < 0.0001). Non-intercepted serious medication errors (those with the potential to cause injury) fell 86 percent from baseline to period 3, the final period (P = 0.0003). Large differences were seen for all main types of medication errors: dose errors, frequency errors, route errors, substitution errors, and allergies. For example, in the baseline period there were ten allergy errors, but only two in the following three periods combined (P < 0.0001). CONCLUSIONS Computerized POE substantially decreased the rate of non-missed-dose medication errors. A major reduction in errors was achieved with the initial version of the system, and further reductions were found with addition of decision support features.

A Roadmap for National Action on Clinical Decision Support

This document comprises an AMIA Board of Directors approved White Paper that presents a roadmap for national action on clinical decision support. It is published in JAMIA for archival and dissemination purposes. The full text of this material has been previously published on the AMIA Web site (www.amia.org/inside/initiatives/cds). AMIA is the copyright holder.

Grand challenges in clinical decision support

There is a pressing need for high-quality, effective means of designing, developing, presenting, implementing, evaluating, and maintaining all types of clinical decision support capabilities for clinicians, patients and consumers. Using an iterative, consensus-building process we identified a rank-ordered list of the top 10 grand challenges in clinical decision support. This list was created to educate and inspire researchers, developers, funders, and policy-makers. The list of challenges in order of importance that they be solved if patients and organizations are to begin realizing the fullest benefits possible of these systems consists of: improve the human-computer interface; disseminate best practices in CDS design, development, and implementation; summarize patient-level information; prioritize and filter recommendations to the user; create an architecture for sharing executable CDS modules and services; combine recommendations for patients with co-morbidities; prioritize CDS content development and implementation; create internet-accessible clinical decision support repositories; use freetext information to drive clinical decision support; mine large clinical databases to create new CDS. Identification of solutions to these challenges is critical if clinical decision support is to achieve its potential and improve the quality, safety and efficiency of healthcare.

A randomized trial of a computer-based intervention to reduce utilization of redundant laboratory tests

PURPOSE To determine the impact of giving physicians computerized reminders about apparently redundant clinical laboratory tests. SUBJECTS AND METHODS We performed a prospective randomized controlled trial that included all inpatients at a large teaching hospital during a 15-week period. The intervention consisted of computerized reminders at the time a test was ordered that appeared to be redundant. Main outcome measures were the proportions of clinical laboratory orders that were canceled and the proportion of the tests that were actually performed. RESULTS During the study period, there were 939 apparently redundant laboratory tests among the 77,609 study tests that were ordered among the intervention (n = 5,700 patients) and control (n = 5,886 patients) groups. In the intervention group, 69% (300 of 437) of tests were canceled in response to reminders. Of 137 overrides, 41% appeared to be justified based on chart review. In the control group, 51% of ordered redundant tests were performed, whereas in the intervention group only 27% of ordered redundant tests were performed (P <0.001). However, the estimated annual savings in laboratory charges was only

Using a computerized sign-out program to improve continuity of inpatient care and prevent adverse events.

35,000. This occurred because only 44% of redundant tests performed had computer orders, because only half the computer orders were screened for redundancy, and because almost one-third of the reminders were overridden. CONCLUSIONS Reminders about orders for apparently redundant laboratory tests were effective when delivered. However, the overall effect was limited because many tests were performed without corresponding computer orders, and many orders were not screened for redundancy.

Improving Response to Critical Laboratory Results with Automation: Results of a Randomized Controlled Trial

BACKGROUND Many medical injuries are preventable, but there are few reported successful strategies to prevent such injuries. Previous work identified coverage by house staff not primarily responsible for the patient (cross-coverage) as a significant correlate of risk for preventable adverse events. A four-month intervention--computerized sign-outs--was introduced in 1993 in an urban teaching hospital to improve continuity of care during cross-coverage and thereby reduce risk for preventable adverse events. MEASUREMENTS A previously tested confidential self-report system was used to identify adverse events, which were defined as unexpected complications of medical therapy that resulted in increased length of stay or disability at discharge. A panel of three board-certified internists confirmed events and evaluated preventability based on case summaries. RESULTS After the intervention, the rate of preventable adverse events among the 3,747 patients admitted to the medical service decreased from 1.7% to 1.2% (p < 0.10). Both univariate and multivariate analysis revealed no association between cross coverage and preventable adverse events after the intervention. In the baseline period, the odds ratio (OR) for a patient suffering a preventable adverse event during cross coverage was 5.2 (95% confidence interval [CI], 1.5-18.2; p = 0.01), but was no longer significant after the intervention (OR, 1.5; 95% CI, 0.2-9.0). CONCLUSION House staff are willing participants in efforts to measure and improve the quality of health care systems. The intervention may have reduced the risk for medical injury associated with discontinuity of inpatients care. Four years after the end of the study, the computerized sign-out program remained an integral part of the computing support system for house staff and was widely used.

Clinical Decision Support in Electronic Prescribing: Recommendations and an Action Plan Report of the Joint Clinical Decision Support Workgroup

Objective: To evaluate the effect of an automatic alerting system on the time until treatment is ordered for patients with critical laboratory results. Design: Prospective randomized controlled trial. Intervention: A computer system to detect critical conditions and automatically notify the responsible physician via the hospitals paging system. Patients: Medical and surgical inpatients at a large academic medical center. One two-month study period for each service. Main outcomes: Interval from when a critical result was available for review until an appropriate treatment was ordered. Secondary outcomes were the time until the critical condition resolved and the frequency of adverse events. Methods: The alerting system looked for 12 conditions involving laboratory results and medications. For intervention patients, the covering physician was automatically notified about the presence of the results. For control patients, no automatic notification was made. Chart review was performed to determine the outcomes. Results: After exclusions, 192 alerting situations (94 interventions, 98 controls) were analyzed. The intervention group had a 38 percent shorter median time interval (1.0 hours vs. 1.6 hours, P = 0.003; mean, 4.1 vs. 4.6 hours, P = 0.003) until an appropriate treatment was ordered. The time until the alerting condition resolved was less in the intervention group (median, 8.4 hours vs. 8.9 hours, P = 0.11; mean, 14.4 hours vs. 20.2 hours, P = 0.11), although these results did not achieve statistical significance. The impact of the intervention was more pronounced for alerts that did not meet the laboratorys critical reporting criteria. There was no significant difference between the two groups in the number of adverse events. Conclusion: An automatic alerting system reduced the time until an appropriate treatment was ordered for patients who had critical laboratory results. Information technologies that facilitate the transmission of important patient data can potentially improve the quality of care.

Patient safety and computerized medication ordering at Brigham and Women's Hospital.

Clinical decision support (CDS) in electronic prescribing (eRx) systems can improve the safety, quality, efficiency, and cost-effectiveness of care. However, at present, these potential benefits have not been fully realized. In this consensus white paper, we set forth recommendations and action plans in three critical domains: (1) advances in system capabilities, including basic and advanced sets of CDS interventions and knowledge, supporting database elements, operational features to improve usability and measure performance, and management and governance structures; (2) uniform standards, vocabularies, and centralized knowledge structures and services that could reduce rework by vendors and care providers, improve dissemination of well-constructed CDS interventions, promote generally applicable research in CDS methods, and accelerate the movement of new medical knowledge from research to practice; and (3) appropriate financial and legal incentives to promote adoption.

The Brigham integrated computing system (BICS): advanced clinical systems in an academic hospital environment

BACKGROUND Medications are important therapeutic tools in health care, yet creating safe medication processes is challenging for many reasons. Computerized physician order entry (CPOE), one important way that technology can be used to improve the medication process, has been in place at Brigham and Womens Hospital (BWH; Boston) since 1993. CPOE AT BWH The CPOE application, designed and developed internally by the BWH information systems team, allows physicians and other clinicians to enter all patient orders into the computer. Physicians enter 85% of orders, with the remainder entered electronically by other clinicians. CPOE AND SAFE MEDICATION USE The CPOE application at BWH includes several features designed to improve medication safety--structural features (for example, required fields, use of pick lists), enhanced workflow features (order sets, standard scales for insulin and potassium), alerts and reminders (drug-drug and drug-allergy interaction checking), and adjunct features (the pharmacy system, access to online reference information). RESULTS AT BWH Studies of the impact of CPOE on physician decision making and patient safety at BWH include assessment of CPOEs impact on the serious medication error and the preventable adverse drug event rate, the impact of computer guidelines on the use of vancomycin, the impact of guidelines on the use of heparin in patients at bed rest, and the impact of dosing suggestions on excessive dosing. CONCLUSION CPOE and several forms of clinical decision support targeted at increasing patient safety have substantially decreased the frequency of serious medication errors and have had an even bigger impact on the overall medication error rate.

Using information systems to measure and improve quality

The Brigham integrated computing system (BICS) provides nearly all clinical, administrative, and financial computing services to Brigham and Womens Hospital, an academic tertiary-care hospital in Boston. The BICS clinical information system includes a very wide range of data and applications, including results review, longitudinal medical records, provider order entry, critical pathway management, operating-room dynamic scheduling, critical-event detection and altering, dynamic coverage lists, automated inpatient summaries, and an online reference library. BICS design emphasizes direct physician interaction and extensive clinical decision support. Impact studies have demonstrated significant value of the system in preventing adverse events and in saving costs, particularly for medications.