Farah Magrabi

A systematic review of the psychological literature on interruption and its patient safety implications.

OBJECTIVE To understand the complex effects of interruption in healthcare. MATERIALS AND METHODS As interruptions have been well studied in other domains, the authors undertook a systematic review of experimental studies in psychology and human-computer interaction to identify the task types and variables influencing interruption effects. RESULTS 63 studies were identified from 812 articles retrieved by systematic searches. On the basis of interruption profiles for generic tasks, it was found that clinical tasks can be distinguished into three broad types: procedural, problem-solving, and decision-making. Twelve experimental variables that influence interruption effects were identified. Of these, six are the most important, based on the number of studies and because of their centrality to interruption effects, including working memory load, interruption position, similarity, modality, handling strategies, and practice effect. The variables are explained by three main theoretical frameworks: the activation-based goal memory model, prospective memory, and multiple resource theory. DISCUSSION This review provides a useful starting point for a more comprehensive examination of interruptions potentially leading to an improved understanding about the impact of this phenomenon on patient safety and task efficiency. The authors provide some recommendations to counter interruption effects. CONCLUSION The effects of interruption are the outcome of a complex set of variables and should not be considered as uniformly predictable or bad. The task types, variables, and theories should help us better to identify which clinical tasks and contexts are most susceptible and assist in the design of information systems and processes that are resilient to interruption.

A Web-based approach for electrocardiogram monitoring in the home

A Web-based electrocardiogram (ECG) monitoring service in which a longitudinal clinical record is used for management of patients, is described. The Web application is used to collect clinical data from the patients home. A database on the server acts as a central repository where this clinical information is stored. A Web browser provides access to the patients records and ECG data. We discuss the technologies used to automate the retrieval and storage of clinical data from a patient database, and the recording and reviewing of clinical measurement data. On the clients Web browser, ActiveX controls embedded in the Web pages provide a link between the various components including the Web server, Web page, the specialised client side ECG review and acquisition software, and the local file system. The ActiveX controls also implement FTP functions to retrieve and submit clinical data to and from the server. An intelligent software agent on the server is activated whenever new ECG data is sent from the home. The agent compares historical data with newly acquired data. Using this method, an optimum patient care strategy can be evaluated, a summarised report along with reminders and suggestions for action is sent to the doctor and patient by email.

Errors and electronic prescribing: a controlled laboratory study to examine task complexity and interruption effects

OBJECTIVE To examine the effect of interruptions and task complexity on error rates when prescribing with computerized provider order entry (CPOE) systems, and to categorize the types of prescribing errors. DESIGN Two within-subject factors: task complexity (complex vs simple) and interruption (interruption vs no interruption). Thirty-two hospital doctors used a CPOE system in a computer laboratory to complete four prescribing tasks, half of which were interrupted using a counterbalanced design. MEASUREMENTS Types of prescribing errors, error rate, resumption lag, and task completion time. RESULTS Errors in creating and updating electronic medication charts that were measured included failure to enter allergy information; selection of incorrect medication, dose, route, formulation, or frequency of administration from lists and drop-down menus presented by the CPOE system; incorrect entry or omission in entering administration times, start date, and free-text qualifiers; and omissions in prescribing and ceasing medications. When errors occurred, the error rates across the four prescribing tasks ranged from 0.5% (1 incorrect medication selected out of 192 chances for selecting a medication or error opportunities) to 16% (5 failures to enter allergy information out of 32 error opportunities). Any impact of interruptions on prescribing error rates and task completion times was not detected in our experiment. However, complex tasks took significantly longer to complete (F(1, 27)=137.9; p<0.001) and when execution was interrupted they required almost three times longer to resume compared to simple tasks (resumption lag complex=9.6 seconds, SD=5.6; resumption lag simple=3.4 seconds, SD=1.7; t(28)=6.186; p<0.001). CONCLUSION Most electronic prescribing errors found in this study could be described as slips in using the CPOE system to create and update electronic medication charts. Cues available within the user interface may have aided resumption of interrupted tasks making CPOE systems robust to some interruption effects. Further experiments are required to rule out any effect interruption might have on CPOE error rates.

Web based longitudinal ECG monitoring

A Web based ECG monitoring service in which a longitudinal clinical record is used for management of patients, is described. The Web application is used to collect clinical data from the patients home. A database server acts as a central repository where this clinical information is stored. A Web browser provides access to the patients records and clinical data. An intelligent software agent on the Web server is activated whenever new patient data is collected remotely from the home. The agent compares historical data with newly acquired data. Using this method, an optimum patient care strategy can be evaluated, with reminders and suggestions for action sent to the doctor and patient by email.

Are we measuring the right end-points? Variables that affect the impact of computerised decision support on patient outcomes: a systematic review.

Previous reviews of electronic decision-support systems (EDSS) have often treated them as a single category, and factors that may modify their effectiveness of EDSS have not been examined. The objective was to summarise the evidence associating the use of computerised decision support and improved patient outcomes. PubMed/Medline and the Database of Abstracts were searched for randomised controlled trials (RCT) of EDSS from 1 January 1994 to 31 January 2006. Twenty-four RCT studies from 97 reviewed were selected, eight of them examined systems supporting decisions for patients who presented with an acute illness, and 16 studies enrolled patients with chronic conditions. Overall, 13 (54%) of the studies showed a positive result, and 11 (46%) were with no impact. Critiquing and consultative systems showed the impact in 71% and 47% of studies, respectively. All systems targeting decisions related to acute disease improved patient outcomes compared with 38% of systems focused on the management of chronic conditions (P = 0.005). Provision of EDSS improves prescribing practices and treatment outcomes of patients with acute illnesses; however, EDSS were less effective in primary care. Complex interventions as clinical EDSS may require new metrics of assessment to describe the impact on patient outcomes.

Impact of a web-based personally controlled health management system on influenza vaccination and health services utilization rates: a randomized controlled trial

OBJECTIVE To assess the impact of a web-based personally controlled health management system (PCHMS) on the uptake of seasonal influenza vaccine and primary care service utilization among university students and staff. MATERIALS AND METHODS A PCHMS called Healthy.me was developed and evaluated in a 2010 CONSORT-compliant two-group (6-month waitlist vs PCHMS) parallel randomized controlled trial (RCT) (allocation ratio 1:1). The PCHMS integrated an untethered personal health record with consumer care pathways, social forums, and messaging links with a health service provider. RESULTS 742 university students and staff met inclusion criteria and were randomized to a 6-month waitlist (n=372) or the PCHMS (n=370). Amongst the 470 participants eligible for primary analysis, PCHMS users were 6.7% (95% CI: 1.46 to 12.30) more likely than the waitlist to receive an influenza vaccine (waitlist: 4.9% (12/246, 95% CI 2.8 to 8.3) vs PCHMS: 11.6% (26/224, 95% CI 8.0 to 16.5); χ(2)=7.1, p=0.008). PCHMS participants were also 11.6% (95% CI 3.6 to 19.5) more likely to visit the health service provider (waitlist: 17.9% (44/246, 95% CI 13.6 to 23.2) vs PCHMS: 29.5% (66/224, 95% CI: 23.9 to 35.7); χ(2)=8.8, p=0.003). A dose-response effect was detected, where greater use of the PCHMS was associated with higher rates of vaccination (p=0.001) and health service provider visits (p=0.003). DISCUSSION PCHMS can significantly increase consumer participation in preventive health activities, such as influenza vaccination. CONCLUSIONS Integrating a PCHMS into routine health service delivery systems appears to be an effective mechanism for enhancing consumer engagement in preventive health measures. TRIAL REGISTRATION Australian New Zealand Clinical Trials Registry ACTRN12610000386033. http://www.anzctr.org.au/trial_view.aspx?id=335463.

Web-based acquisition, storage, and retrieval of biomedical signals

The Web allows ubiquitous access to distributed databases through standard browser technology. However, appropriate middleware software needs to be developed to provide the tools both for accessing databases over the Web and ensuring that querying the knowledge base is possible. In this article we explore a number of these Web technologies and examine a case study based around the acquisition of respiratory flow signals from a Web-enabled spirometer.

The impact of clinical leadership on health information technology adoption: systematic review.

PURPOSE To conduct a systematic review to examine evidence of associations between clinical leadership and successful information technology (IT) adoption in healthcare organisations. METHODS We searched Medline, Embase, Cinahl, and Business Source Premier for articles published between January 2000 to May 2013 with keywords and subject terms related to: (1) the setting--healthcare provider organisations; (2) the technology--health information technology; (3) the process--adoption; and (4) the intervention--leadership. We identified 3121 unique citations, of which 32 met our criteria and were included in the review. Data extracted from the included studies were assessed in light of two frameworks: Bassellier et al.s IT competence framework; and Avgar et al.s health IT adoption framework. RESULTS The results demonstrate important associations between the attributes of clinical leaders and IT adoption. Clinical leaders who have technical informatics skills and prior experience with IT project management are likely to develop a vision that comprises a long-term commitment to the use of IT. Leaders who possess such a vision believe in the value of IT, are motivated to adopt it, and can maintain confidence and stability through the adversities that IT adoptions often entail. This leads to proactive leadership behaviours and partnerships with IT professionals that are associated with successful organisational and clinical outcomes. CONCLUSIONS This review provides evidence that clinical leaders can positively contribute to successful IT adoption in healthcare organisations. Clinical leaders who aim for improvements in the processes and quality of care should cultivate the necessary IT competencies, establish mutual partnerships with IT professionals, and execute proactive IT behaviours to achieve successful IT adoption.

A comparative review of patient safety initiatives for national health information technology

OBJECTIVE To collect and critically review patient safety initiatives for health information technology (HIT). METHOD Publicly promulgated set of advisories, recommendations, guidelines, or standards potentially addressing safe system design, build, implementation or use were identified by searching the websites of regional and national agencies and programmes in a non-exhaustive set of exemplar countries including England, Denmark, the Netherlands, the USA, Canada and Australia. Initiatives were categorised by type and software systems covered. RESULTS We found 27 patient safety initiatives for HIT predominantly dealing with software systems for health professionals. Three initiatives addressed consumer systems. Seven of the initiatives specifically dealt with software for diagnosis and treatment, which are regulated as medical devices in England, Denmark and Canada. Four initiatives dealt with blood bank and image management software which is regulated in the USA. Of the 16 initiatives directed at unregulated software, 11 were aimed at increasing standardisation using guidelines and standards for safe system design, build, implementation and use. Three initiatives for unregulated software were aimed at certification in the USA, Canada and Australia. Safety is addressed alongside interoperability in the Australian certification programme but it is not explicitly addressed in the US and Canadian programmes, though conformance with specific functionality, interoperability, security and privacy requirements may lead to safer systems. England appears to have the most comprehensive safety management programme for unregulated software, incorporating safety assurance at a local healthcare organisation level based on standards for risk management and user interface design, with national incident monitoring and a response function. CONCLUSIONS There are significant gaps in the safety initiatives for HIT systems. Current initiatives are largely focussed on software. With the exception of diagnostic, prognostic, monitoring and treatment software, which are subject to medical device regulations in some countries, the safety of the most common types of HIT systems such as EHRs and CPOE without decision support is not being explicitly addressed in most nations. Appropriate mechanisms for safety assurance are required for the full range of HIT systems for health professionals and consumers including all software and hardware throughout the system lifecycle. In addition to greater standardisation and oversight to ensure safe system design and build, appropriate implementation and use of HIT is critical to ensure patient safety.

Long-term patterns of online evidence retrieval use in general practice: a 12-month study.

Background Provision of online evidence at the point of care is one strategy that could provide clinicians with easy access to up-to-date evidence in clinical settings in order to support evidence-based decision making. Objective The aim was to determine long-term use of an online evidence system in routine clinical practice. Methods This was a prospective cohort study. 59 clinicians who had a computer with Internet access in their consulting room participated in a 12-month trial of Quick Clinical, an online evidence system specifically designed around the needs of general practitioners (GPs). Patterns of use were determined by examination of computer logs and survey analysis. Results On average, 9.9 searches were conducted by each GP in the first 2 months of the study. After this, usage dropped to 4.4 searches per GP in the third month and then levelled off to between 0.4 and 2.6 searches per GP per month. The majority of searches (79.2%, 2013/2543) were conducted during practice hours (between 9 am and 5 pm) and on weekdays (90.7%, 2315/2543). The most frequent searches related to diagnosis (33.6%, 821/2291) and treatment (34.5%, 844/2291). Conclusion GPs will use an online evidence retrieval system in routine practice; however, usage rates drop significantly after initial introduction of the system. Long-term studies are required to determine the extent to which GPs will integrate the use of such technologies into their everyday clinical practice and how this will affect the satisfaction and health outcomes of their patients.