Vishnu Mohan

Use of simulation to assess electronic health record safety in the intensive care unit: a pilot study.

Objective To establish the role of high-fidelity simulation training to test the efficacy and safety of the electronic health record (EHR)–user interface within the intensive care unit (ICU) environment. Design Prospective pilot study. Setting Medical ICU in an academic medical centre. Participants Postgraduate medical trainees. Interventions A 5-day-simulated ICU patient was developed in the EHR including labs, hourly vitals, medication administration, ventilator settings, nursing and notes. Fourteen medical issues requiring recognition and subsequent changes in management were included. Issues were chosen based on their frequency of occurrence within the ICU and their ability to test different aspects of the EHR–user interface. ICU residents, blinded to the presence of medical errors within the case, were provided a sign-out and given 10 min to review the case in the EHR. They then presented the case with their management suggestions to an attending physician. Participants were graded on the number of issues identified. All participants were provided with immediate feedback upon completion of the simulation. Primary and secondary outcomes To determine the frequency of error recognition in an EHR simulation. To determine factors associated with improved performance in the simulation. Results 38 participants including 9 interns, 10 residents and 19 fellows were tested. The average error recognition rate was 41% (range 6–73%), which increased slightly with the level of training (35%, 41% and 50% for interns, residents, and fellows, respectively). Over-sedation was the least-recognised error (16%); poor glycemic control was most often recognised (68%). Only 32% of the participants recognised inappropriate antibiotic dosing. Performance correlated with the total number of screens used (p=0.03). Conclusions Despite development of comprehensive EHRs, there remain significant gaps in identifying dangerous medical management issues. This gap remains despite high levels of medical training, suggesting that EHR-specific training may be beneficial. Simulation provides a novel tool in order to both identify these gaps as well as foster EHR-specific training.

Design and evaluation of the ONC health information technology curriculum

OBJECTIVE As part of the Heath Information Technology for Economic and Clinical Health (HITECH) Act, the Office of the National Coordinator for Health Information Technology (ONC) implemented its Workforce Development Program, which included initiatives to train health information technology (HIT) professionals in 12 workforce roles, half of them in community colleges. To achieve this, the ONC tasked five universities with established informatics programs with creating curricular materials that could be used by community colleges. The five universities created 20 components that were made available for downloading from the National Training and Dissemination Center (NTDC) website. This paper describes an evaluation of the curricular materials by its intended audience of educators. METHODS We measured the quantity of downloads from the NTDC site and administered a survey about the curricular materials to its registered users to determine use patterns and user characteristics. The survey was evaluated using mixed methods. Registered users downloaded nearly half a million units or components from the NTDC website. We surveyed these 9835 registered users. RESULTS 1269 individuals completed all or part of the survey, of whom 339 identified themselves as educators (26.7% of all respondents). This paper addresses the survey responses of educators. DISCUSSION Successful aspects of the curriculum included its breadth, convenience, hands-on and course planning capabilities. Several areas were identified for potential improvement. CONCLUSIONS The ONC HIT curriculum met its goals for community college programs and will likely continue to be a valuable resource for the larger informatics community in the future.

Feasibility of utilizing a commercial eye tracker to assess electronic health record use during patient simulation

Numerous reports describe unintended consequences of electronic health record implementation. Having previously described physicians’ failures to recognize patient safety issues within our electronic health record simulation environment, we now report on our use of eye and screen-tracking technology to understand factors associated with poor error recognition during an intensive care unit–based electronic health record simulation. We linked performance on the simulation to standard eye and screen-tracking readouts including number of fixations, saccades, mouse clicks and screens visited. In addition, we developed an overall Composite Eye Tracking score which measured when, where and how often each safety item was viewed. For 39 participants, the Composite Eye Tracking score correlated with performance on the simulation (p = 0.004). Overall, the improved performance was associated with a pattern of rapid scanning of data manifested by increased number of screens visited (p = 0.001), mouse clicks (p = 0.03) and saccades (p = 0.004). Eye tracking can be successfully integrated into electronic health record–based simulation and provides a surrogate measure of cognitive decision making and electronic health record usability.

Multiple perspectives on clinical decision support: a qualitative study of fifteen clinical and vendor organizations

BackgroundComputerized clinical decision support (CDS) can help hospitals to improve healthcare. However, CDS can be problematic. The purpose of this study was to discover how the views of clinical stakeholders, CDS content vendors, and EHR vendors are alike or different with respect to challenges in the development, management, and use of CDS.MethodsWe conducted ethnographic fieldwork using a Rapid Assessment Process within ten clinical and five health information technology (HIT) vendor organizations. Using an inductive analytical approach, we generated themes from the clinical, content vendor, and electronic health record vendor perspectives and compared them.ResultsThe groups share views on the importance of appropriate manpower, careful knowledge management, CDS that fits user workflow, the need for communication among the groups, and for mutual strategizing about the future of CDS. However, views of usability, training, metrics, interoperability, product use, and legal issues differed. Recommendations for improvement include increased collaboration to address legal, manpower, and CDS sharing issues.ConclusionsThe three groups share thinking about many aspects of CDS, but views differ in a number of important respects as well. Until these three groups can reach a mutual understanding of the views of the other stakeholders, and work together, CDS will not reach its potential.

Electronic Health Records Improve the Quality of Care in Underserved Populations: A Literature Review

Organizations in underserved settings are implementing or upgrading electronic health records (EHRs) in hopes of improving quality and meeting Federal goals for meaningful use of EHRs. However, much of the research that has been conducted on health information technology does not study use in underserved settings, or does not include EHRs. We conducted a structured literature search of MEDLINE to find articles supporting the contention that EHRs improve quality in underserved settings. We found 17 articles published between 2003 and 2011. These articles were mostly in urban settings, and most study types were descriptive in nature. The articles provide evidence that EHRs can improve documentation, process measures, guideline-adherence, and (to a lesser extent) outcome measures. Providers and managers believed that EHRs would improve the quality and efficiency of care. The limited quantity and quality of evidence point to a need for ongoing research in this area.

Early experiences of accredited clinical informatics fellowships

Since the launch of the clinical informatics subspecialty for physicians in 2013, over 1100 physicians have used the practice and education pathways to become board-certified in clinical informatics. Starting in 2018, only physicians who have completed a 2-year clinical informatics fellowship program accredited by the Accreditation Council on Graduate Medical Education will be eligible to take the board exam. The purpose of this viewpoint piece is to describe the collective experience of the first four programs accredited by the Accreditation Council on Graduate Medical Education and to share lessons learned in developing new fellowship programs in this novel medical subspecialty.

Frequency of Passive Ehr Alerts in the Icu: Another Form of Alert Fatigue?

Objectives The intensive care unit (ICU) is a complex environment in terms of data density and alerts, with alert fatigue, a recognized barrier to patient safety. The Electronic Health Record (EHR) is a major source of these alerts. Although studies have looked at the incidence and impact of active EHR alerts, little research has studied the impact of passive data alerts on patient safety. Method We reviewed the EHR database of 100 consecutive ICU patient records; within, we assessed the number of values flagged as either as abnormal or “panic” across all data domains. We used data from our previous studies to determine the 10 most commonly visited screens while preparing for rounds to determine the total number of times, an abnormal value would be expected to be viewed. Results There were 64.1 passive alerts/patient per day, of which only 4.5% were panic values. When accounting for the commonly used EHR screens by providers, this was increased to 165.3 patient/d. Laboratory values comprised 71% of alerts, with the remaining occurring in vitals (25%) and medications (6%). Despite the high prevalence of alerts, certain domains including ventilator settings (0.04 flags/d) were rarely flagged. Conclusions The average ICU patient generates a large number of passive alerts daily, many of which may be clinically irrelevant. Issues with EHR design and use likely further magnify this problem. Our results establish the need for additional studies to understand how a high burden of passive alerts impact clinical decision making and how to design passive alerts to optimize their clinical utility.

Professional and interprofessional differences in electronic health records use and recognition of safety issues in critically ill patients

ABSTRACT During interprofessional intensive care unit (ICU) rounds each member of the interprofessional team is responsible for gathering and interpreting information from the electronic health records (EHR) to facilitate effective team decision-making. This study was conducted to determine how each professional group reviews EHR data in preparation for rounds and their ability to identify patient safety issues. Twenty-five physicians, 29 nurses, and 20 pharmacists participated. Individual participants were given verbal and written sign-out and then asked to review a simulated record in our institution’s EHR, which contained 14 patient safety items. After reviewing the chart, subjects presented the patient and the number of safety items recognised was recorded. About 40%, 30%, and 26% of safety issues were recognised by physicians, nurses, and pharmacists, respectively (p = 0.0006) and no item recognised 100% of the time. There was little overlap between the three groups with only 50% of items predicted to be recognised 100% of the time by the team. Differential recognition was associated with marked differences in EHR use, with only 3/152 EHR screens utilised by all three groups and the majority of screens used exclusively only by one group. There were significant and non-overlapping differences in individual profession recognition of patient safety issues in the EHR. Preferential identification of safety issues by certain professional groups may be attributed to differences in EHR use. Future studies will be needed to determine if shared decision-making during rounds can improve recognition of safety issues.

Integrating the Electronic Health Record into high-fidelity interprofessional intensive care unit simulations

Abstract With the rapid adoption of electronic health records (EHR), there is a growing appreciation for the central role they play in clinical decision making and team communication, with many studies documenting new safety issues with integration of the EHR into the clinical enterprise. To study these issues, we created a high-fidelity simulation instance of our clinical EHR. In this paper, we describe the impact of integrating the EHR into high-fidelity, interprofessional intensive care unit (ICU) simulations, and the errors induced. We found a number of safety issues directly related to the EHR including alert fatigue, negative impacts on interprofessional communication, and problems with selective data gathering, and these issues were present for all members of the interprofessional team. Through successful integration of the EHR into high-fidelity team-based simulations, we now have an infrastructure to focus educational initiative and deploy informatics solutions to mitigate these safety issues.

Multiple perspectives on clinical decision support

BackgroundComputerized clinical decision support (CDS) can help hospitals to improve healthcare. However, CDS can be problematic. The purpose of this study was to discover how the views of clinical stakeholders, CDS content vendors, and EHR vendors are alike or different with respect to challenges in the development, management, and use of CDS.MethodsWe conducted ethnographic fieldwork using a Rapid Assessment Process within ten clinical and five health information technology (HIT) vendor organizations. Using an inductive analytical approach, we generated themes from the clinical, content vendor, and electronic health record vendor perspectives and compared them.ResultsThe groups share views on the importance of appropriate manpower, careful knowledge management, CDS that fits user workflow, the need for communication among the groups, and for mutual strategizing about the future of CDS. However, views of usability, training, metrics, interoperability, product use, and legal issues differed. Recommendations for improvement include increased collaboration to address legal, manpower, and CDS sharing issues.ConclusionsThe three groups share thinking about many aspects of CDS, but views differ in a number of important respects as well. Until these three groups can reach a mutual understanding of the views of the other stakeholders, and work together, CDS will not reach its potential.