Monique W. M. Jaspers

Anatomy of a failure: A sociotechnical evaluation of a laboratory physician order entry system implementation

OBJECTIVE To investigate the human, social and organizational issues surrounding a Computerized Physician Order Entry system for Laboratory ordering (CPOE-L) implementation process and to analyze their interrelated effects on the system implementation failure in an academic medical setting. Second, to provide lessons learned and recommendations on to how to manage challenges of human, social and organizational nature surrounding CPOE-L implementations. METHODS The themes surrounding CPOE introduction were identified by a heuristic analysis of literature on CPOE implementations. The resulting set of themes was applied as a reference model for 20 semi-structured interviews conducted during the CPOE-L implementation process with 11 persons involved in the CPOE-L project and in reviewing all CPOE-L related project documentation. Data was additionally gathered by user questionnaires, by user discussion rounds and through an ethnographical study performed at the involved clinical and laboratory departments. In analyzing the interview transcripts, project documentation and data from user questionnaires and discussion rounds a grounded theory approach was applied by the evaluation team to identify problem areas or issues deserving further analysis. RESULTS Outlined central problem areas concerning the CPOE-L implementation and their mutual relations were depicted in a conceptual interpretative model. Understanding of clinical workflow was identified as a key theme pressured by organizational, human and social issues ultimately influencing the entire implementation process in a negative way. Vast delays in CPOE introduction, system immaturity and under-functionality could all be directly attributed to a superficial understanding of workflow. Consequently, final CPOE integration into clinical and laboratory workflows was inhibited by both end-users as well as department managers and withdrawal of the CPOE-L system became inevitable. CONCLUSION This case study demonstrates which human, social and organizational issues relevant to CPOE implementation cumulatively led to a failure outcome of the CPOE-L pilot introduction. The experiences and considerations described in this paper show important issues for CPOE systems to be successfully introduced and to be taken into account in future CPOE implementations. Understanding and consideration of (clinical) workflow aspects by project managers and the involved clinical organization is of extreme importance from the very start of a CPOE implementation process.

Effect of predefined order sets and usability problems on efficiency of computerized medication ordering

OBJECTIVES To study the effect of predefined order sets on the efficiency of computerized medication ordering, and to analyze the effect of different types of usability problems on ordering efficiency. METHODS Crossover study to comparing the efficiency of two methods of ordering (with and without use of predefined order sets) in a laboratory setting using a computerized physician order entry system (CPOE). The excess number of mouse clicks and keystrokes (the difference in number of mouse clicks and keystrokes needed by each physician and the minimally required numbers to accomplish the ordering tasks) for each method was measured and per physician, occurrences of usability problems during the task sessions were recorded. Observed usability problems were categorized using Zhang et al.s heuristic principles of good user interface design. The effect of different types of usability problems on the excess number of mouse clicks and keystrokes was statistically analyzed. RESULTS The median excess number of mouse clicks and keystrokes needed by physicians was 6.2 times lower in the method with predefined order sets (p<0.01). The excess number of mouse clicks and keystrokes was significantly increased by vague and erroneous system messages with a factor of 2.62 (95% CI 2.24-3.07), the use of unfamiliar language and terminology by a factor of 1.28 (95% CI 1.14-1.43), and non-informative system feedback by a factor of 1.15 (95% CI 1.03-1.28), respectively. Other categories of usability problems had little influence on ordering efficiency. CONCLUSIONS Predefined order sets can improve the efficiency of computerized ordering by reducing the excess number of mouse clicks and keystrokes. However, the efficiency of computerized ordering can be significantly impaired by usability problems due to vague and incorrect system messages, unfamiliar language, and non-informative system feedback.

A framework for performance and data quality assessment of Radio Frequency IDentification (RFID) systems in health care settings

OBJECTIVE RFID offers great opportunities to health care. Nevertheless, prior experiences also show that RFID systems have not been designed and tested in response to the particular needs of health care settings and might introduce new risks. The aim of this study is to present a framework that can be used to assess the performance of RFID systems particularly in health care settings. METHODS We developed a framework describing a systematic approach that can be used for assessing the feasibility of using an RFID technology in a particular healthcare setting; more specific for testing the impact of environmental factors on the quality of RFID generated data and vice versa. This framework is based on our own experiences with an RFID pilot implementation in an academic hospital in The Netherlands and a literature review concerning RFID test methods and current insights of RFID implementations in healthcare. The implementation of an RFID system within the blood transfusion chain inside a hospital setting was used as a show case to explain the different phases of the framework. RESULTS The framework consists of nine phases, including an implementation development plan, RFID and medical equipment interference tests, data accuracy- and data completeness tests to be run in laboratory, simulated field and real field settings. CONCLUSIONS The potential risks that RFID technologies may bring to the healthcare setting should be thoroughly evaluated before they are introduced into a vital environment. The RFID performance assessment framework that we present can act as a reference model to start an RFID development, engineering, implementation and testing plan and more specific, to assess the potential risks of interference and to test the quality of the RFID generated data potentially influenced by physical objects in specific health care environments.

Renal Dysfunction and Elevated Blood Pressure in Long-Term Childhood Cancer Survivors

BACKGROUND AND OBJECTIVES Little is known about renal function and blood pressure (BP) in long-term childhood cancer survivors. This cross-sectional study evaluated prevalence of these outcomes and associated risk factors in long-term childhood cancer survivors at their first visit to a specialized outpatient clinic. DESIGN, SETTING, PARTICIPANTS, & MEASUREMENTS Estimated GFR; percentages of patients with albuminuria, hypomagnesemia, and hypophosphatemia; and BP were assessed in 1442 survivors ≥5 years after diagnosis. Multivariable logistic regression analyses were used to estimate effect of chemotherapy, nephrectomy, and radiation therapy on the different outcomes. RESULTS At a median age of 19.3 years (interquartile range, 15.6-24.5 years), 28.1% of all survivors had at least one renal adverse effect or elevated BP. The median time since cancer diagnosis was 12.1 years (interquartile range, 7.8-17.5 years). High BP and albuminuria were most prevalent, at 14.8% and 14.5%, respectively. Sixty-two survivors (4.5%) had an estimated GFR <90 ml/min per 1.73 m(2). Survivors who had undergone nephrectomy had the highest risk for diminished renal function (odds ratio, 8.6; 95% confidence interval [CI], 3.4-21.4). Combined radiation therapy and nephrectomy increased the odds of having elevated BP (odds ratio, 4.92; 95% CI, 2.63-9.19), as did male sex, higher body mass index, and longer time since cancer treatment. CONCLUSION Almost 30% of survivors had renal adverse effects or high BP. Therefore, monitoring of renal function in high-risk groups and BP in all survivors may help clinicians detect health problems at an early stage and initiate timely therapy to prevent additional damage.

Attitude of physicians towards automatic alerting in computerized physician order entry systems. A comparative international survey

OBJECTIVES To analyze the attitude of physicians towards alerting in CPOE systems in different hospitals in different countries, addressing various organizational and technical settings and the view of physicians not currently using a CPOE. METHODS A cross-sectional quantitative and qualitative questionnaire survey. We invited 2,600 physicians in eleven hospitals from nine countries to participate. Eight of the hospitals had different CPOE systems in use, and three of the participating hospitals were not using a CPOE system. RESULTS 1,018 physicians participated. The general attitude of the physicians towards CPOE alerting is positive and is found to be mostly independent of the country, the specific organizational settings in the hospitals and their personal experience with CPOE systems. Both quantitative and qualitative results show that the majority of the physicians, both CPOE-users and non-users, appreciate the benefits of alerting in CPOE systems on medication safety. However, alerting should be better adapted to the clinical context and make use of more sophisticated ways to present alert information. The vast majority of physicians agree that additional information regarding interactions is useful on demand. Around half of the respondents see possible alert overload as a major problem; in this regard, physicians in hospitals with sophisticated alerting strategies show partly better attitude scores. CONCLUSIONS Our results indicate that the way alerting information is presented to the physicians may play a role in their general attitude towards alerting, and that hospitals with a sophisticated alerting strategy with less interruptive alerts tend towards more positive attitudes. This aspect needs to be further investigated in future studies.

Health Information Needs of Childhood Cancer Survivors and Their Family

Knowledge about past disease, treatment, and possible late effects has previously been shown to be low in survivors of childhood cancer and their relatives. This study investigated the information needs of childhood cancer survivors and their parents and explored possible determinants for differences in information need and health‐related Internet use.

Two Decades of Teledermatology: Current Status and Integration in National Healthcare Systems

Teledermatology, originating in 1995, has been one of the first telemedicine services to see the light of day. Two decades of teledermatology research is summarized in this review. A literature search was conducted in PubMed. Search terms included “teledermatology,” “teledermoscopy,” “tele wound care,” “telederm*,” “(dermatology OR dermoscopy OR wound care OR skin) AND (telemedicine OR ehealth or mhealth OR telecare OR teledermatology OR teledermoscopy).” Inclusion criteria were (i) Dutch or English written papers and (ii) publication year from 2011 to present or (iii) (systematic) reviews with publication year before 2011. One hundred fourteen publications and 14 (systematic) reviews were included for full text reading. Focus of this review is on the following outcomes: (i) actors (primary, secondary, tertiary), (ii) purposes (consultation, triage, follow-up, education) and subspecialties (tele-wound care, burn care, teledermoscopy (teledermatoscopy), teledermatopathology, and mobile teledermatology), (iii) delivery modalities and technologies (store and forward, real-time interactive, and hybrid modalities using web-based systems, email, mobile phones, tablets, or videoconferencing equipment), (iv) business models, (v) integration of teledermatology into national healthcare systems, (vi) preconditions and requirements for implementation (security, ethical issues, responsibility, reimbursement, user satisfaction, technique, and technology standards), and (vii) added value.To conclude, teledermatology is an efficient and effective healthcare service compared to in-person care. Teledermatology reduces patients’ travel time and waiting time, avoids (unnecessary) dermatologic visits, and improves access of care to underserved patients.

IPHIE: An International partnership in health informatics education

Medical informatics contributes significantly to high quality and efficient health care and medical research. The need for well educated professionals in the field of medical informatics therefore is now worldwide recognized. Students of medicine, computer science/informatics are educated in the field of medical informatics and dedicated curricula on medical informatics have emerged. To advance and further develop the beneficial role of medical informatics in the medical field, an international orientation of health and medical informatics students seems an indispensable part of their training. An international orientation and education of medical informatics students may help to accelerate the dissemination of acquired knowledge and skills in the field and the promotion of medical informatics research results on a more global level. Some years ago, the departments of medical informatics of the university of Heidelberg/university of applied sciences Heilbronn and the university of Amsterdam decided to co-operate in the field of medical informatics. Now, this co-operation has grown out to an International Partnership of Health Informatics Education (IPHIE) of 5 universities, i.e. the university of Heidelberg, the university of Heilbronn, the university of Minnesota, the university of Utah and the university of Amsterdam. This paper presents the rationale behind this international partnership, the state of the art of the co-operation and our future plans for expanding this international co-operation.

Physicians' Perceptions on the usefulness of contextual information for prioritizing and presenting alerts in computerized physician order entry systems

BackgroundOne possible approach towards avoiding alert overload and alert fatigue in Computerized Physician Order Entry (CPOE) systems is to tailor their drug safety alerts to the context of the clinical situation. Our objective was to identify the perceptions of physicians on the usefulness of clinical context information for prioritizing and presenting drug safety alerts.MethodsWe performed a questionnaire survey, inquiring CPOE-using physicians from four hospitals in four European countries to estimate the usefulness of 20 possible context factors.ResultsThe 223 participants identified the ‘ severity of the effect’ and the ‘clinical status of the patient’ as the most useful context factors. Further important factors are the ‘complexity of the case’ and the ‘risk factors of the patient’.ConclusionsOur findings confirm the results of a prior, comparable survey inquiring CPOE researchers. Further research should focus on implementing these context factors in CPOE systems and on subsequently evaluating their impact.

Evaluating a Web-Based Health Risk Assessment With Tailored Feedback: What Does an Expert Focus Group Yield Compared to a Web-Based End-User Survey?

Background Increasingly, Web-based health applications are developed for the prevention and management of chronic diseases. However, their reach and utilization is often disappointing. Qualitative evaluations post-implementation can be used to inform the optimization process and ultimately enhance their adoption. In current practice, such evaluations are mainly performed with end-user surveys. However, a review approach by experts in a focus group may be easier to administer and might provide similar results. Objective The aim of this study was to assess whether industrial design engineers in a focus group would address the same issues as end users in a Web-based survey when evaluating a commercial Web-based health risk assessment (HRA) with tailored feedback. Methods Seven Dutch companies used the HRA as part of their corporate health management strategy. Employees using the HRA (N=2289) and 10 independent industrial designers were invited to participate in the study. The HRA consisted of four components: (1) an electronic health questionnaire, (2) biometric measurements, (3) laboratory evaluation, and (4) individually tailored feedback generated by decision support software. After participating in the HRA as end users, both end users and designers evaluated the program. End users completed an evaluation questionnaire that included a free-text field. Designers participated in a focus group discussion. Constructs from user satisfaction and technology acceptance theories were used to categorize and compare the remarks from both evaluations. Results We assessed and qualitatively analyzed 294 remarks of 189 end users and 337 remarks of 6 industrial designers, pertaining to 295 issues in total. Of those, 137 issues were addressed in the end-user survey and 148 issues in the designer focus group. Only 7.3% (10/137) of the issues addressed in the survey were also addressed in the focus group. End users made more remarks about the usefulness of the HRA and prior expectations that were not met. Designers made more remarks about how the information was presented to end users, quality of the feedback provided by the HRA, recommendations on the marketing and on how to create more unity in the design of the HRA, and on how to improve the HRA based on these issues. Conclusions End-user surveys should not be substituted for expert focus groups. Issues identified by end users in the survey and designers in the focus group differed considerably, and the focus group produced a lot of new issues. The issues addressed in the focus group often focused on different aspects of user satisfaction and technology acceptance than those addressed by the survey participants; when they did focus on the same aspects, then the nature of issues differed considerably in content.