Pamela M. Neri

Usability of a novel clinician interface for genetic results

The complexity and rapid growth of genetic data demand investment in information technology to support effective use of this information. Creating infrastructure to communicate genetic information to healthcare providers and enable them to manage that data can positively affect a patients care in many ways. However, genetic data are complex and present many challenges. We report on the usability of a novel application designed to assist providers in receiving and managing a patients genetic profile, including ongoing updated interpretations of the genetic variants in those patients. Because these interpretations are constantly evolving, managing them represents a challenge. We conducted usability tests with potential users of this application and reported findings to the application development team, many of which were addressed in subsequent versions. Clinicians were excited about the value this tool provides in pushing out variant updates to providers and overall gave the application high usability ratings, but had some difficulty interpreting elements of the interface. Many issues identified required relatively little development effort to fix suggesting that consistently incorporating this type of analysis in the development process can be highly beneficial. For genetic decision support applications, our findings suggest the importance of designing a system that can deliver the most current knowledge and highlight the significance of new genetic information for clinical care. Our results demonstrate that using a development and design process that is user focused helped optimize the value of this application for personalized medicine.

How physicians document outpatient visit notes in an electronic health record

BACKGROUND Clinical documentation, an essential process within electronic health records (EHRs), takes a significant amount of clinician time. How best to optimize documentation methods to deliver effective care remains unclear. OBJECTIVE We evaluated whether EHR visit note documentation method was influenced by physician or practice characteristics, and the association of physician satisfaction with an EHR notes module. MEASUREMENTS We surveyed primary care physicians (PCPs) and specialists, and used EHR and provider data to perform a multinomial logistic regression of visit notes from 2008. We measured physician documentation method use and satisfaction with an EHR notes module and determined the relationship between method and physician and practice characteristics. RESULTS Of 1088 physicians, 85% used a single method to document the majority of their visits. PCPs predominantly documented using templates (60%) compared to 34% of specialists, while 38% of specialists predominantly dictated. Physicians affiliated with academic medical centers (OR 1.96, CI (1.23, 3.12)), based at a hospital (OR 1.57, 95% CI (1.04, 2.36)) and using the EHR for longer (OR 1.13, 95% CI (1.03, 1.25)) were more likely to dictate than use templates. Most physicians of 383 survey responders were satisfied with the EHR notes module, regardless of their preferred documentation method. CONCLUSIONS Physicians predominantly utilized a single method of visit note documentation and were satisfied with their approach, but the approaches they chose varied. Demographic characteristics were associated with preferred documentation method. Further research should focus on why variation exists, and the quality of the documentation resulting from different methods used.

Association of note quality and quality of care: a cross-sectional study

Background While physician notes are known to vary in organisation, content and quality, the relationship between note quality and clinical quality is uncertain. Methods We performed a cross-sectional study of outpatient visit physician notes by adult patients with coronary artery disease or diabetes mellitus seen in 2010. We assessed physician note quality using the 9-item Physician Documentation Quality Instrument (PDQI-9) and compared this to disease-specific clinical quality scores constructed from data extracted from the electronic health record (EHR). We also assessed the presence of typical note subsections, and indicators of quality care in physician notes. Results We evaluated 239 notes, written by 111 physicians; 110 notes were written by primary care physicians, 52 by cardiologists and 77 by endocrinologists. Reason for visit was absent in 10% of notes, medication list was not present in the note in 19.7% and timing for follow-up was absent in 18.0% of notes. Significant copy/pasted material was present in 10.5% of notes. Laboratory quality indicators were more often found in other EHR sections than in the physician note. Clinical quality scores for diabetes and coronary artery disease (CAD) showed no significant association with subjective note quality (diabetes: r −0.119, p=0.065, CAD: r −0.124, p=0.06). Conclusions Notes varied in documentation method and length, and important note subsections were frequently missing. Key clinical data to support quality patient care were often not present in physician notes, but were often found elsewhere in the EHR. Subjective assessment of note quality did not correlate with clinical quality scores, suggesting that writing high-quality notes and meeting quality measures are not mutually reinforcing activities.

Usability of the Massachusetts Prescription Drug Monitoring Program in the Emergency Department: A Mixed-methods Study.

OBJECTIVES Prescription drug monitoring programs (PDMPs) are underutilized, despite evidence showing that they may reduce the epidemic of opioid-related addiction, diversion, and overdose. We evaluated the usability of the Massachusetts (MA) PDMP by emergency medicine providers (EPs), as a systems usability may affect how often it is used. METHODS This was a mixed-methods study of 17 EPs. We compared the time and number of clicks required to review one patients record in the PDMP to three other commonly performed computer-based tasks in the emergency department (ED: ordering a computed tomography [CT] scan, writing a prescription, and searching a medication history service integrated within the electronic medical record [EMR]). We performed semistructured interviews and analyzed participant comments and responses regarding their experience using the MA PDMP. RESULTS The PDMP task took a longer time to complete (mean = 4.22 minutes) and greater number of mouse clicks to complete (mean = 50.3 clicks) than the three other tasks (CT-pulmonary embolism = 1.42 minutes, 24.8 clicks; prescription = 1.30 minutes, 19.5 clicks; SureScripts = 1.45 minutes, 9.5 clicks). Qualitative analysis yielded four main themes about PDMP usability, three negative and one positive: 1) difficulty accessing the PDMP, 2) cumbersome acquiring patient medication history information within the PDMP, 3) nonintuitive display of patient medication history information within the PDMP, and 4) overall perceived value of the PDMP despite an inefficient interface. CONCLUSIONS The complicated processes of gaining access to, logging in, and using the MA PDMP are barriers to preventing its more frequent use. All states should evaluate the PDMP usability in multiple practice settings including the ED and work to improve provider enrollment, login procedures, patient information input, prescription data display, and ultimately, PDMP data integration into EMRs.

A novel clinician interface to improve clinician access to up-to-date genetic results

OBJECTIVES To understand the impact of GeneInsight Clinic (GIC), a web-based tool designed to manage genetic information and facilitate communication of test results and variant updates from the laboratory to the clinics, we measured the use of GIC and the time it took for new genetic knowledge to be available to clinicians. METHODS Usage data were collected across four study sites for the GIC launch and post-GIC implementation time periods. The primary outcome measures were the time (average number of days) between variant change approval and notification of clinic staff, and the time between notification and viewing the patient record. RESULTS Post-GIC, time between a variant change approval and provider notification was shorter than at launch (average days at launch 503.8, compared to 4.1 days post-GIC). After e-mail alerts were sent at launch, providers clicked into the patient record associated with 91% of these alerts. In the post period, clinic providers clicked into the patient record associated with 95% of the alerts, on average 12 days after the e-mail was sent. DISCUSSION We found that GIC greatly increased the likelihood that a provider would receive updated variant information as well as reduced the time associated with distributing that variant information, thus providing a more efficient process for incorporating new genetic knowledge into clinical care. CONCLUSIONS Our study results demonstrate that health information technology systems have the potential effectively to assist providers in utilizing genetic information in patient care.

Using a medical simulation center as an electronic health record usability laboratory

Usability testing is increasingly being recognized as a way to increase the usability and safety of health information technology (HIT). Medical simulation centers can serve as testing environments for HIT usability studies. We integrated the quality assurance version of our emergency department (ED) electronic health record (EHR) into our medical simulation center and piloted a clinical care scenario in which emergency medicine resident physicians evaluated a simulated ED patient and documented electronically using the ED EHR. Meticulous planning and close collaboration with expert simulation staff was important for designing test scenarios, pilot testing, and running the sessions. Similarly, working with information systems teams was important for integration of the EHR. Electronic tools are needed to facilitate entry of fictitious clinical results while the simulation scenario is unfolding. EHRs can be successfully integrated into existing simulation centers, which may provide realistic environments for usability testing, training, and evaluation of human-computer interactions.

Efficiency and Usability of a Near Field Communication-Enabled Tablet for Medication Administration

Background Barcode-based technology coupled with the electronic medication administration record (e-MAR) reduces medication errors and potential adverse drug events (ADEs). However, many current barcode-enabled medication administration (BCMA) systems are difficult to maneuver and often require multiple barcode scans. We developed a prototype, next generation near field communication-enabled medication administration (NFCMA) system using a tablet. Objective We compared the efficiency and usability of the prototype NFCMA system with the traditional BCMA system. Methods We used a mixed-methods design using a randomized observational cross-over study, a survey, and one-on-one interviews to compare the prototype NFCMA system with a traditional BCMA system. The study took place at an academic medical simulation center. Twenty nurses with BCMA experience participated in two simulated patient medication administration scenarios: one using the BCMA system, and the other using the prototype NFCMA system. We collected overall scenario completion time and number of medication scanning attempts per scenario, and compared those using paired t tests. We also collected participant feedback on the prototype NFCMA system using the modified International Business Machines (IBM) Post-Study System Usability Questionnaire (PSSUQ) and a semistructured interview. We performed descriptive statistics on participant characteristics and responses to the IBM PSSUQ. Interview data was analyzed using content analysis with a qualitative description approach to review and categorize feedback from participants. Results Mean total time to complete the scenarios using the NFCMA and the BCMA systems was 202 seconds and 182 seconds, respectively (P=.09). Mean scan attempts with the NFCMA was 7.6 attempts compared with 6.5 attempts with the BCMA system (P=.12). In the usability survey, 95% (19/20) of participants agreed that the prototype NFCMA system was easy to use and easy to learn, with a pleasant interface. Participants expressed interest in using the NFCMA tablet in the hospital; suggestions focused on implementation issues, such as storage of the mobile devices and infection control methods. Conclusions The NFCMA system had similar efficiency to the BCMA system in a simulated scenario. The prototype NFCMA system was well received by nurses and offers promise to improve nurse medication administration efficiency.

Relationship between documentation method and quality of chronic disease visit notes

OBJECTIVE To assses the relationship between methods of documenting visit notes and note quality for primary care providers (PCPs) and specialists, and to determine the factors that contribute to higher quality notes for two chronic diseases. METHODS Retrospective chart review of visit notes at two academic medical centers. Two physicians rated the subjective quality of content areas of the note (vital signs, medications, lifestyle, labs, symptoms, assessment & plan), overall quality, and completed the 9 item Physician Documentation Quality Instrument (PDQI-9). We evaluated quality ratings in relation to the primary method of documentation (templates, free-form or dictation) for both PCPs and specialists. A one factor analysis of variance test was used to examine differences in mean quality scores among the methods. RESULTS A total of 112 physicians, 71 primary care physicians (PCP) and 41 specialists, wrote 240 notes. For specialists, templated notes had the highest overall quality scores (p≤0.001) while for PCPs, there was no statistically significant difference in overall quality score. For PCPs, free form received higher quality ratings on vital signs (p = 0.01), labs (p = 0.002), and lifestyle (p = 0.002) than other methods; templated notes had a higher rating on medications (p≤0.001). For specialists, templated notes received higher ratings on vital signs, labs, lifestyle and medications (p = 0.001). DISCUSSION There was no significant difference in subjective quality of visit notes written using free-form documentation, dictation or templates for PCPs. The subjective quality rating of templated notes was higher than that of dictated notes for specialists. CONCLUSION As there is wide variation in physician documentation methods, and no significant difference in note quality between methods, recommending one approach for all physicians may not deliver optimal results.

Incorporating medication indications into the prescribing process

Purpose The incorporation of medication indications into the prescribing process to improve patient safety is discussed. Summary Currently, most prescriptions lack a key piece of information needed for safe medication use: the patient‐specific drug indication. Integrating indications could pave the way for safer prescribing in multiple ways, including avoiding look‐alike/sound‐alike errors, facilitating selection of drugs of choice, aiding in communication among the healthcare team, bolstering patient understanding and adherence, and organizing medication lists to facilitate medication reconciliation. Although strongly supported by pharmacists, multiple prior attempts to encourage prescribers to include the indication on prescriptions have not been successful. We convened 6 expert panels to consult high‐level stakeholders on system design considerations and requirements necessary for building and implementing an indications‐based computerized prescriber order‐entry (CPOE) system. We summarize our findings from the 6 expert stakeholder panels, including rationale, literature findings, potential benefits, and challenges of incorporating indications into the prescribing process. Based on this stakeholder input, design requirements for a new CPOE interface and workflow have been identified. Conclusion The emergence of universal electronic prescribing and content knowledge vendors has laid the groundwork for incorporating indications into the CPOE prescribing process. As medication prescribing moves in the direction of inclusion of the indication, it is imperative to design CPOE systems to efficiently and effectively incorporate indications into prescriber workflows and optimize ways this can best be accomplished.

User Requirements for a Chronic Kidney Disease Clinical Decision Support Tool to Promote Timely Referral

BACKGROUND Timely referral of patients with CKD has been associated with cost and mortality benefits, but referrals are often done too late in the course of the disease. Clinical decision support (CDS) offers a potential solution, but interventions have failed because they were not designed to support the physician workflow. We sought to identify user requirements for a chronic kidney disease (CKD) CDS system to promote timely referral. METHODS We interviewed primary care physicians (PCPs) to identify data needs for a CKD CDS system that would encourage timely referral and also gathered information about workflow to assess risk factors for progression of CKD. Interviewees were general internists recruited from a network of 14 primary care clinics affiliated with Brigham and Womens Hospital (BWH). We then performed a qualitative analysis to identify user requirements and system attributes for a CKD CDS system. RESULTS Of the 12 participants, 25% were women, the mean age was 53 (range 37-82), mean years in clinical practice was 27 (range 11-58). We identified 21 user requirements. Seven of these user requirements were related to support for the referral process workflow, including access to pertinent information and support for longitudinal co-management. Six user requirements were relevant to PCP management of CKD, including management of risk factors for progression, interpretation of biomarkers of CKD severity, and diagnosis of the cause of CKD. Finally, eight user requirements addressed user-centered design of CDS, including the need for actionable information, links to guidelines and reference materials, and visualization of trends. CONCLUSION These 21 user requirements can be used to design an intuitive and usable CDS system with the attributes necessary to promote timely referral.