Jos Aarts

Overriding of Drug Safety Alerts in Computerized Physician Order Entry

Many computerized physician order entry (CPOE) systems have integrated drug safety alerts. The authors reviewed the literature on physician response to drug safety alerts and interpreted the results using Reasons framework of accident causation. In total, 17 papers met the inclusion criteria. Drug safety alerts are overridden by clinicians in 49% to 96% of cases. Alert overriding may often be justified and adverse drug events due to overridden alerts are not always preventable. A distinction between appropriate and useful alerts should be made. The alerting system may contain error-producing conditions like low specificity, low sensitivity, unclear information content, unnecessary workflow disruptions, and unsafe and inefficient handling. These may result in active failures of the physician, like ignoring alerts, misinterpretation, and incorrect handling. Efforts to improve patient safety by increasing correct handling of drug safety alerts should focus on the error-producing conditions in software and organization. Studies on cognitive processes playing a role in overriding drug safety alerts are lacking.

The Impact of Computerized Provider Order Entry Systems on Inpatient Clinical Workflow: A Literature Review

Previous studies have shown the importance of workflow issues in the implementation of CPOE systems and patient safety practices. To understand the impact of CPOE on clinical workflow, we developed a conceptual framework and conducted a literature search for CPOE evaluations between 1990 and June 2007. Fifty-one publications were identified that disclosed mixed effects of CPOE systems. Among the frequently reported workflow advantages were the legible orders, remote accessibility of the systems, and the shorter order turnaround times. Among the frequently reported disadvantages were the time-consuming and problematic user-system interactions, and the enforcement of a predefined relationship between clinical tasks and between providers. Regarding the diversity of findings in the literature, we conclude that more multi-method research is needed to explore CPOEs multidimensional and collective impact on especially collaborative workflow.

Drug safety alert generation and overriding in a large Dutch university medical centre

To evaluate numbers and types of drug safety alerts generated and overridden in a large Dutch university medical centre.

The dangerous decade

Over the next 10 years, more information and communication technology (ICT) will be deployed in the health system than in its entire previous history. Systems will be larger in scope, more complex, and move from regional to national and supranational scale. Yet we are at roughly the same place the aviation industry was in the 1950s with respect to system safety. Even if ICT harm rates do not increase, increased ICT use will increase the absolute number of ICT related harms. Factors that could diminish ICT harm include adoption of common standards, technology maturity, better system development, testing, implementation and end user training. Factors that will increase harm rates include complexity and heterogeneity of systems and their interfaces, rapid implementation and poor training of users. Mitigating these harms will not be easy, as organizational inertia is likely to generate a hysteresis-like lag, where the paths to increase and decrease harm are not identical.

Organizational issues in health informatics: a model approach

In this paper, we present a model that describes the stages of the implementation of an information system in a health care organization. The model offers no explanation of the implementation process but rather describes in a cyclic order the domains that are relevant when implementing a system. The model offers thus an opportunity to identify gaps in our knowledge and understanding of implementation processes and provides also the conceptual basis for a higher education course of health informatics that is focusing on organizational change and the pivotal role of information and communication technology.

Anatomy of a failure: A sociotechnical evaluation of a laboratory physician order entry system implementation

OBJECTIVE To investigate the human, social and organizational issues surrounding a Computerized Physician Order Entry system for Laboratory ordering (CPOE-L) implementation process and to analyze their interrelated effects on the system implementation failure in an academic medical setting. Second, to provide lessons learned and recommendations on to how to manage challenges of human, social and organizational nature surrounding CPOE-L implementations. METHODS The themes surrounding CPOE introduction were identified by a heuristic analysis of literature on CPOE implementations. The resulting set of themes was applied as a reference model for 20 semi-structured interviews conducted during the CPOE-L implementation process with 11 persons involved in the CPOE-L project and in reviewing all CPOE-L related project documentation. Data was additionally gathered by user questionnaires, by user discussion rounds and through an ethnographical study performed at the involved clinical and laboratory departments. In analyzing the interview transcripts, project documentation and data from user questionnaires and discussion rounds a grounded theory approach was applied by the evaluation team to identify problem areas or issues deserving further analysis. RESULTS Outlined central problem areas concerning the CPOE-L implementation and their mutual relations were depicted in a conceptual interpretative model. Understanding of clinical workflow was identified as a key theme pressured by organizational, human and social issues ultimately influencing the entire implementation process in a negative way. Vast delays in CPOE introduction, system immaturity and under-functionality could all be directly attributed to a superficial understanding of workflow. Consequently, final CPOE integration into clinical and laboratory workflows was inhibited by both end-users as well as department managers and withdrawal of the CPOE-L system became inevitable. CONCLUSION This case study demonstrates which human, social and organizational issues relevant to CPOE implementation cumulatively led to a failure outcome of the CPOE-L pilot introduction. The experiences and considerations described in this paper show important issues for CPOE systems to be successfully introduced and to be taken into account in future CPOE implementations. Understanding and consideration of (clinical) workflow aspects by project managers and the involved clinical organization is of extreme importance from the very start of a CPOE implementation process.

Using a descriptive model of change when implementing large scale clinical information systems to identify priorities for further research.

In this paper we identify domains for research based on a model that describes the stages of change when designing and implementing large scale information and communication technology throughout a healthcare organization. We use the model in the case of the electronic patient record systems. We suggest that the research agenda should include approaches from the social and business sciences.

On the alert: future priorities for alerts in clinical decision support for computerized physician order entry identified from a European workshop

BackgroundClinical decision support (CDS) for electronic prescribing systems (computerized physician order entry) should help prescribers in the safe and rational use of medicines. However, the best ways to alert users to unsafe or irrational prescribing are uncertain. Specifically, CDS systems may generate too many alerts, producing unwelcome distractions for prescribers, or too few alerts running the risk of overlooking possible harms. Obtaining the right balance of alerting to adequately improve patient safety should be a priority.MethodsA workshop funded through the European Regional Development Fund was convened by the University Hospitals Birmingham NHS Foundation Trust to assess current knowledge on alerts in CDS and to reach a consensus on a future research agenda on this topic. Leading European researchers in CDS and alerts in electronic prescribing systems were invited to the workshop.ResultsWe identified important knowledge gaps and suggest research priorities including (1) the need to determine the optimal sensitivity and specificity of alerts; (2) whether adaptation to the environment or characteristics of the user may improve alerts; and (3) whether modifying the timing and number of alerts will lead to improvements. We have also discussed the challenges and benefits of using naturalistic or experimental studies in the evaluation of alerts and suggested appropriate outcome measures.ConclusionsWe have identified critical problems in CDS, which should help to guide priorities in research to evaluate alerts. It is hoped that this will spark the next generation of novel research from which practical steps can be taken to implement changes to CDS systems that will ultimately reduce alert fatigue and improve the design of future systems.

A comparative review of patient safety initiatives for national health information technology

OBJECTIVE To collect and critically review patient safety initiatives for health information technology (HIT). METHOD Publicly promulgated set of advisories, recommendations, guidelines, or standards potentially addressing safe system design, build, implementation or use were identified by searching the websites of regional and national agencies and programmes in a non-exhaustive set of exemplar countries including England, Denmark, the Netherlands, the USA, Canada and Australia. Initiatives were categorised by type and software systems covered. RESULTS We found 27 patient safety initiatives for HIT predominantly dealing with software systems for health professionals. Three initiatives addressed consumer systems. Seven of the initiatives specifically dealt with software for diagnosis and treatment, which are regulated as medical devices in England, Denmark and Canada. Four initiatives dealt with blood bank and image management software which is regulated in the USA. Of the 16 initiatives directed at unregulated software, 11 were aimed at increasing standardisation using guidelines and standards for safe system design, build, implementation and use. Three initiatives for unregulated software were aimed at certification in the USA, Canada and Australia. Safety is addressed alongside interoperability in the Australian certification programme but it is not explicitly addressed in the US and Canadian programmes, though conformance with specific functionality, interoperability, security and privacy requirements may lead to safer systems. England appears to have the most comprehensive safety management programme for unregulated software, incorporating safety assurance at a local healthcare organisation level based on standards for risk management and user interface design, with national incident monitoring and a response function. CONCLUSIONS There are significant gaps in the safety initiatives for HIT systems. Current initiatives are largely focussed on software. With the exception of diagnostic, prognostic, monitoring and treatment software, which are subject to medical device regulations in some countries, the safety of the most common types of HIT systems such as EHRs and CPOE without decision support is not being explicitly addressed in most nations. Appropriate mechanisms for safety assurance are required for the full range of HIT systems for health professionals and consumers including all software and hardware throughout the system lifecycle. In addition to greater standardisation and oversight to ensure safe system design and build, appropriate implementation and use of HIT is critical to ensure patient safety.

Time-dependent Drug-Drug Interaction Alerts in Care Provider Order Entry: Software May Inhibit Medication Error Reductions

Time-dependent drug-drug interactions (TDDIs) are drug combinations that result in a decreased drug effect due to coadministration of a second drug. Such interactions can be prevented by separately administering the drugs. This study attempted to reduce drug administration errors due to overridden TDDIs in a care provider order entry (CPOE) system. In four periods divided over two studies, logged TDDIs were investigated by reviewing the time intervals prescribed in the CPOE and recorded on the patient chart. The first study showed significant drug administration error reduction from 56.4 to 36.2% (p<0.05), whereas the second study was not successful (46.7 and 45.2%; p>0.05). Despite interventions, drug administration errors still occurred in more than one third of cases and prescribing errors in 79-87%. Probably the low alert specificity, the unclear alert information content, and the inability of the software to support safe and efficient TDDI alert handling all diminished correct prescribing, and consequently, insufficiently reduced drug administration errors.