Huibert Tange

Determinants of Success of Inpatient Clinical Information Systems: A Literature Review

We reviewed the English and Dutch literature on evaluations of patient care information systems that require data entry by health care professionals published from 1991 to 2001. Our objectives were to identify attributes that were used to assess the success of such systems and to test the ability of a framework developed by Delone and McLean for management information systems(1) to categorize these attributes correctly. The framework includes six dimensions or success factors: system quality, information quality, usage, user satisfaction, individual impact, and organizational impact. Thirty-three papers were selected for complete review. Types of study design included descriptive, correlational, comparative, and case studies. A variety of relevant attributes could be assigned to the six dimensions in the Delone and McLean framework, but some attributes, predominantly in cases of failure, did not fit any of the categories. They related to contingent factors, such as organizational culture. Our review points out the need for more thorough evaluations of patient care information systems that look at a wide range of factors that can affect the relative success or failure of these systems.

Development and implementation of an EPR: how to encourage the user

This paper reports on the role users played in the design and development of an electronic patient record. Two key users participated in the project team. All future users received questionnaires and a selection of them was interviewed. Before starting the development of the EPR, the attitude of users towards electronic record keeping, their satisfaction with the paper clinical records, their knowledge of computers, and their needs and expectations of computer applications in health care were measured by means of a questionnaire. The results of the questionnaire were supplemented with in-depth interviews. Users had a neutral attitude towards electronic record keeping. They were more positive about data entry of the paper records than data retrieval. During the development phase, but prior to the implementation of the EPR, a second questionnaire measured satisfaction with the paper records. Satisfaction appeared to be related to self-rated computer experience. Inexperienced computer users tended to be more positive about the paper records. In general, respondents did not have many expectations about electronic record keeping. A second series of interviews zoomed in on the expectations users had. Except for more concise reporting no beneficial effects of electronic record keeping were expected.

A pilot study of a tool to stimulate physical activity in patients with COPD or type 2 diabetes in primary care

Summary We tested the performance, acceptance and user satisfaction of a tool to stimulate physical activity. The tool consisted of an accelerometer, a smartphone app and a server/web application. Patients received feedback concerning their physical activity relative to a goal, which was set in dialogue with their practice nurse. Nurses could monitor their patients’ physical activity via a website. Twenty patients with COPD or type 2 diabetes used the tool for three months, combined with behaviour change counselling. Physical activity data were collected at the server and a log file was used to record technical problems. We interviewed patients and nurses after every consultation. At baseline, and after the intervention, patients completed questionnaires. Participants were positive about the tool, although motivation dropped when technical problems occurred caused by log-in and connectivity errors. On average, physical activity increased from 29 (SD 21) min per day in the first two weeks to 39 (SD 24) min per day in the last two weeks (P = 0.02), and quality of life scores increased from 0.76 (SD 0.21) to 0.84 (SD 0.17) (P = 0.04). Provided that no connectivity problems occur, the tool is a feasible intervention when embedded in primary care, and has a positive effect on physical activity levels.

Early detection of COPD in general practice: patient or practice managed? A randomised controlled trial of two strategies in different socioeconomic environments

Background: The burden of chronic obstructive pulmonary disease (COPD) is high. Health benefits can be gained in primary care by early detection and preventive measures. Aims: To compare the effectiveness of two strategies for population-based early detection of COPD, taking into account different socioeconomic status (SES) settings. Methods: Practices were randomised on strategy and stratified on SES setting. The Respiratory Health Screening Questionnaire (RHSQ) was distributed to all participants. In the practice-managed condition, the practice was responsible for the whole procedure, while in the patient-managed condition, patients were responsible for calculating their RHSQ risk score and applying for a spirometry test. The main outcome measure was the rate of COPD diagnoses after screening. Results: More new COPD patients were detected in the practice-managed condition (36%) than in the patient-managed condition (18%). In low SES practices, more high-risk patients were found (16%) than in moderate-to-high SES practices (9%). Recalculated for a standard Dutch practice (2,350 patients), the yield would be 8.9 new COPD diagnoses, which is a 20% increase of known cases. Conclusions: The practice-managed variant of this screening procedure shows a substantial yield of new COPD diagnoses for both low and moderate-to-high SES practices.

Usability Evaluation of an Online, Tailored Self-Management Intervention for Chronic Obstructive Pulmonary Disease Patients Incorporating Behavior Change Techniques

Background An eHealth intervention using computer tailored technology including several behavior change techniques was developed to support the self-management of chronic obstructive pulmonary disease patients. Objective The goal of this study was to evaluate and improve the usability of the eHealth intervention. Methods We conducted a usability evaluation with 8 chronic obstructive pulmonary disease patients, with a mixed methods design. We improved the usability through iterative cycles of evaluation and adaptation. Participants were asked to think aloud during the evaluation sessions. Participants then completed a semi-structured interview. The sessions were observed and recorded. Descriptive statistics and content analysis were used to uncover usability issues. Results Areas for improvement were layout, navigation, and content. Most issues could be solved within 3 iterations of improvement. Overall, participants found the program easy to use. The length of the program urged us to further analyze the appreciation of behavior change techniques. Some were perceived as helpful and easy to use, while others evoked frustration. Conclusions The usability study identified several issues for improvement, confirming the need for usability evaluation during the development of eHealth interventions. The uncovered strengths and limitations of behavior change techniques may lead to optimization of eHealth interventions, but further insight is needed.

Themes affecting health-care consumers’ choice of a hospital for elective surgery when receiving web-based comparative consumer information

OBJECTIVE To get insights into the decision-making strategy of health-care consumers when confronted with comparative consumer information. METHODS Qualitative descriptive study among 18 consumers who had a hip or knee replacement no longer than five years ago. To study their decision-making strategies a paper draft for a website was used providing comparative consumer information. Data were collected by cognitive interviews and focus-group meetings and subjected to thematic analysis. RESULTS Consumers were able to understand the presented information, but had problems to use it as a decision aid. They primarily relied on previous experiences. Four themes were revealed: decision making, perceived benefits, unmet information needs, and trustworthiness. Consumers used different decision strategies and showed unpredictable behavior when choosing a hospital. CONCLUSION Individual decision strategies, unsatisfied information needs, limited tenability and too coarse aggregation levels of quality scores are barriers for a proper use of comparative consumer information. Personal experience remains a valuable information source for hospital selection. We suggest that a website presenting comparative consumer information should be flexible in various ways and should include functionality to share personal experience.

It's LiFe! Mobile and Web-Based Monitoring and Feedback Tool Embedded in Primary Care Increases Physical Activity: A Cluster Randomized Controlled Trial

Background Physical inactivity is a major public health problem. The It’s LiFe! monitoring and feedback tool embedded in the Self-Management Support Program (SSP) is an attempt to stimulate physical activity in people with chronic obstructive pulmonary disease or type 2 diabetes treated in primary care. Objective Our aim was to evaluate whether the SSP combined with the use of the monitoring and feedback tool leads to more physical activity compared to usual care and to evaluate the additional effect of using this tool on top of the SSP. Methods This was a three-armed cluster randomised controlled trial. Twenty four family practices were randomly assigned to one of three groups in which participants received the tool + SSP (group 1), the SSP (group 2), or care as usual (group 3). The primary outcome measure was minutes of physical activity per day. The secondary outcomes were general and exercise self-efficacy and quality of life. Outcomes were measured at baseline after the intervention (4-6 months), and 3 months thereafter. Results The group that received the entire intervention (tool + SSP) showed more physical activity directly after the intervention than Group 3 (mean difference 11.73, 95% CI 6.21-17.25; P<.001), and Group 2 (mean difference 7.86, 95% CI 2.18-13.54; P=.003). Three months after the intervention, this effect was still present and significant (compared to Group 3: mean difference 10.59, 95% CI 4.94-16.25; P<.001; compared to Group 2: mean difference 9.41, 95% CI 3.70-15.11; P<.001). There was no significant difference in effect between Groups 2 and 3 on both time points. There was no interaction effect for disease type. Conclusions The combination of counseling with the tool proved an effective way to stimulate physical activity. Counseling without the tool was not effective. Future research about the cost-effectiveness and application under more tailored conditions and in other target groups is recommended. Trial Registration ClinicalTrials.gov: NCT01867970, https://clinicaltrials.gov/ct2/show/NCT01867970 (archived by WebCite at http://www.webcitation.org/6a2qR5BSr).

Integrating a tailored e-health self-management application for chronic obstructive pulmonary disease patients into primary care: a pilot study

BackgroundChanges in reimbursement have been compelling for Dutch primary care practices to apply a disease management approach for patients with chronic obstructive pulmonary disease (COPD). This approach includes individual patient consultations with a practice nurse, who coaches patients in COPD management. The aim of this study was to gauge the feasibility of adding a web-based patient self-management support application, by assessing patients’ self-management, patients’ health status, the impact on the organization of care, and the level of application use and appreciation.MethodsThe study employed a mixed methods design. Six practice nurses recruited COPD patients during a consultation. The e-Health application included a questionnaire that captured information on demographics, self-management related behaviors (smoking cessation, physical activity and medication adherence) and their determinants, and nurse recommendations. The application provided tailored feedback messages to patients and provided the nurse with reports. Data were collected through questionnaires and medical record abstractions at baseline and one year later. Semi-structured interviews with patients and nurses were conducted. Descriptive statistics were calculated for quantitative data and content analysis was used to analyze the qualitative data.ResultsEleven patients, recruited by three nurses, used the application 1 to 7 times (median 4). Most patients thought that the application supported self-management, but their interest diminished after multiple uses. Impact on patients’ health could not be determined due to the small sample size. Nurses reported benefits for the organization of care and made suggestions to optimize the use of the reports.ConclusionResults suggest that it is possible to integrate a web-based COPD self-management application into the current primary care disease management process. The pilot study also revealed opportunities to improve the application and reports, in order to increase technology use and appreciation.

Patient's decision making in selecting a hospital for elective orthopaedic surgery

RATIONALE, AIMS AND OBJECTIVES The admission to a hospital for elective surgery, like arthroplasty, can be planned ahead. The elective nature of arthroplasty and the increasing stimulus of the public to critically select a hospital raise the issue of how patients actually take such decisions. The aim of this paper is to describe the decision-making process of selecting a hospital as experienced by people who underwent elective joint arthroplasty and to understand what factors influenced the decision-making process. METHODS Qualitative descriptive study with 18 participants who had a hip or knee replacement within the last 5 years. Data were gathered from eight individual interviews and four focus group interviews and analysed by content analysis. RESULTS Three categories that influenced the selection of a hospital were revealed: information sources, criteria in decision making and decision-making styles within the GP- patient relationship. Various contextual aspects influenced the decision-making process. Most participants gave higher priority to the selection of a medical specialist than to the selection of a hospital. CONCLUSION Selecting a hospital for arthroplasty is extremely complex. The decision-making process is a highly individualized process because patients have to consider and assimilate a diversity of aspects, which are relevant to their specific situation. Our findings support the model of shared decision making, which indicates that general practitioners should be attuned to the distinct needs of each patient at various moments during the decision making, taking into account personal, medical and contextual factors.

Usability testing of a monitoring and feedback tool to stimulate physical activity

Introduction A monitoring and feedback tool to stimulate physical activity, consisting of an activity sensor, smartphone application (app), and website for patients and their practice nurses, has been developed: the ‘It’s LiFe!’ tool. In this study the usability of the tool was evaluated by technology experts and end users (people with chronic obstructive pulmonary disease or type 2 diabetes, with ages from 40–70 years), to improve the user interfaces and content of the tool. Patients and methods The study had four phases: 1) a heuristic evaluation with six technology experts; 2) a usability test in a laboratory by five patients; 3) a pilot in real life wherein 20 patients used the tool for 3 months; and 4) a final lab test by five patients. In both lab tests (phases 2 and 4) qualitative data were collected through a thinking-aloud procedure and video recordings, and quantitative data through questions about task complexity, text comprehensiveness, and readability. In addition, the post-study system usability questionnaire (PSSUQ) was completed for the app and the website. In the pilot test (phase 3), all patients were interviewed three times and the Software Usability Measurement Inventory (SUMI) was completed. Results After each phase, improvements were made, mainly to the layout and text. The main improvement was a refresh button for active data synchronization between activity sensor, app, and server, implemented after connectivity problems in the pilot test. The mean score on the PSSUQ for the website improved from 5.6 (standard deviation [SD] 1.3) to 6.5 (SD 0.5), and for the app from 5.4 (SD 1.5) to 6.2 (SD 1.1). Satisfaction in the pilot was not very high according to the SUMI. Discussion The use of laboratory versus real-life tests and expert-based versus user-based tests revealed a wide range of usability issues. The usability of the It’s LiFe! tool improved considerably during the study.