Rudolf B Kool

Patient satisfaction revisited: A multilevel approach.

Patient satisfaction surveys are increasingly used for benchmarking purposes. In the Netherlands, the results of these surveys are reported at the univariate level without taking case mix factors into account. The first objective of the present study was to determine whether differences in patient satisfaction are attributed to the hospital, department or patient characteristics. Our second aim was to investigate which case mix variables could be taken into account when satisfaction surveys are carried out for benchmarking purposes. Patients who either were discharged from eight academic and fourteen general Dutch hospitals or visited the outpatient departments of the same hospitals in 2005 participated in cross-sectional satisfaction surveys. Satisfaction was measured on six dimensions of care and one general dimension. We used multilevel analysis to estimate the proportion of variance in satisfaction scores determined by the hospital and department levels by calculating intra-class correlation coefficients (ICCs). Hospital size, hospital type, population density and response rate are four case mix variables we investigated at the hospital level. We also measured the effects of patient characteristics (gender, age, education, health status, and mother language) on satisfaction. We found ICCs on hospital and department levels ranging from 0% to 4% for all dimensions. This means that only a minor part of the variance in patient satisfaction scores is attributed to the hospital and department levels. Although all patient characteristics had some statistically significant influence on patient satisfaction, age, health status and education appeared to be the most important determinants of patient satisfaction and could be considered for case mix correction. Gender, mother language, hospital type, hospital size, population density and response rate seemed to be less important determinants. The explained variance of the patient and hospital characteristics ranged from 3% to 5% for the different dimensions. Our conclusions are, first, that a substantial part of the variance is on the patient level, while only a minor part of the variance is at the hospital and department levels. Second, patient satisfaction outcomes in the Netherlands can be corrected by the case mix variables age, health status and education.

Social Media and Rating Sites as Tools to Understanding Quality of Care: A Scoping Review

Background Insight into the quality of health care is important for any stakeholder including patients, professionals, and governments. In light of a patient-centered approach, it is essential to assess the quality of health care from a patient’s perspective, which is commonly done with surveys or focus groups. Unfortunately, these “traditional” methods have significant limitations that include social desirability bias, a time lag between experience and measurement, and difficulty reaching large groups of people. Information on social media could be of value to overcoming these limitations, since these new media are easy to use and are used by the majority of the population. Furthermore, an increasing number of people share health care experiences online or rate the quality of their health care provider on physician rating sites. The question is whether this information is relevant to determining or predicting the quality of health care. Objective The goal of our research was to systematically analyze the relation between information shared on social media and quality of care. Methods We performed a scoping review with the following goals: (1) to map the literature on the association between social media and quality of care, (2) to identify different mechanisms of this relationship, and (3) to determine a more detailed agenda for this relatively new research area. A recognized scoping review methodology was used. We developed a search strategy based on four themes: social media, patient experience, quality, and health care. Four online scientific databases were searched, articles were screened, and data extracted. Results related to the research question were described and categorized according to type of social media. Furthermore, national and international stakeholders were consulted throughout the study, to discuss and interpret results. Results Twenty-nine articles were included, of which 21 were concerned with health care rating sites. Several studies indicate a relationship between information on social media and quality of health care. However, some drawbacks exist, especially regarding the use of rating sites. For example, since rating is anonymous, rating values are not risk adjusted and therefore vulnerable to fraud. Also, ratings are often based on only a few reviews and are predominantly positive. Furthermore, people providing feedback on health care via social media are presumably not always representative for the patient population. Conclusions Social media and particularly rating sites are an interesting new source of information about quality of care from the patient’s perspective. This new source should be used to complement traditional methods, since measuring quality of care via social media has other, but not less serious, limitations. Future research should explore whether social media are suitable in practice for patients, health insurers, and governments to help them judge the quality performance of professionals and organizations.

A core questionnaire for the assessment of patient satisfaction in academic hospitals in The Netherlands: development and first results in a nationwide study

Background Patient satisfaction is one of the relevant indicators of quality of care; however, measuring patient satisfaction had been criticised. A major criticism is that many instruments are not reliable and/or valid. The instruments should have enough discriminative power for benchmarking of the results. Objective To develop a “core questionnaire for the assessment of patient satisfaction in academic hospitals” (COPS) that is reliable and appropriate for benchmarking patient satisfaction results. Research design The development of COPS, the testing of its psychometric quality and its use in eight Dutch academic hospitals in three national comparative studies in 2003, 2005 and 2007 are described in this study. Results were reported only if they were significant (p<0.05) and relevant (also Cohen d>0.2). Results The questionnaire was returned in 2003 by 40 678 patients (77 450 sent, 53%) and by 40 248 patients (75 423 sent, 53%) in 2005. In 2007, the questionnaire was returned by 45 834 patients (87 137, 53%). The six dimensions have good Cronbach αs, varying from 0.79 to 0.88.The results of every item were reported to the individual hospital. A benchmark overview showed the overall comparison of all specialties of the eight hospitals for the clinic and outpatient departments. The 2007 measurement showed relevant differences in satisfaction on two dimensions in the clinical setting. Conclusions COPS is shown to be a feasible and reliable instrument to measure the satisfaction of patients in Dutch academic hospitals. It allows comparison of hospitals and gives benchmark information on a hospital as well as data on specialty levels and previous measurements, including best practices.

Towards integration of general practitioner posts and accident and emergency departments: a case study of two integrated emergency posts in the Netherlands

BackgroundAccident and emergency (A&E) departments and general practitioner (GP) posts are often used inappropriately, leading to overcrowding. In the Netherlands, increasingly more integrated emergency posts (IEPs) are being created, integrating the care provided by GP posts and A&E departments, in order to improve the provision of the emergency care.MethodsThis explorative study compares the efficiency and patient and employee satisfaction in IEPs with those in two GP posts and two A&E departments. To this end, information was retrieved from hospital and GP patient records for the first quarter of the year before and of the year after the creation of IEPs. Patients and employees were sent a questionnaire to measure their satisfaction. Lastly, groups of hospital doctors, GPs, GP assistants, and nurses were interviewed.ResultsAfter the creation of IEPs, there was a shift of more than fifteen percent from secondary care to primary care for emergency consultations and waiting/consultation times were shortened by more than ten percent. Compared with the control settings, patients were more satisfied about telephone contact with an IEP, but professionals working at the IEP were less satisfied with several aspects of their work.ConclusionIEPs could be a promising innovation to organize emergency care more efficiently; however, it might take time to convince professionals of the possible advantages. Studies involving more IEPs and longer follow-up times are needed to determine whether such integration should be stimulated.

Using patient experiences on Dutch social media to supervise health care services: exploratory study

Background Social media has become mainstream and a growing number of people use it to share health care-related experiences, for example on health care rating sites. These users’ experiences and ratings on social media seem to be associated with quality of care. Therefore, information shared by citizens on social media could be of additional value for supervising the quality and safety of health care services by regulatory bodies, thereby stimulating participation by consumers. Objective The objective of the study was to identify the added value of social media for two types of supervision by the Dutch Healthcare Inspectorate (DHI), which is the regulatory body charged with supervising the quality and safety of health care services in the Netherlands. These were (1) supervision in response to incidents reported by individuals, and (2) risk-based supervision. Methods We performed an exploratory study in cooperation with the DHI and searched different social media sources such as Twitter, Facebook, and healthcare rating sites to find additional information for these incidents and topics, from five different sectors. Supervision experts determined the added value for each individual result found, making use of pre-developed scales. Results Searches in social media resulted in relevant information for six of 40 incidents studied and provided relevant additional information in 72 of 116 cases in risk-based supervision of long-term elderly care. Conclusions The results showed that social media could be used to include the patient’s perspective in supervision. However, it appeared that the rating site ZorgkaartNederland was the only source that provided information that was of additional value for the DHI, while other sources such as forums and social networks like Twitter and Facebook did not result in additional information. This information could be of importance for health care inspectorates, particularly for its enforcement by risk-based supervision in care of the elderly. Further research is needed to determine the added value for other health care sectors.

Implementation of multiple-domain covering computerized decision support systems in primary care: a focus group study on perceived barriers

BackgroundDespite the widespread availability of computerized decision support systems (CDSSs) in various healthcare settings, evidence on their uptake and effectiveness is still limited. Most barrier studies focus on CDSSs that are aimed at a limited number of decision points within selected small-scale academic settings. The aim of this study was to identify the perceived barriers to using large-scale implemented CDSSs covering multiple disease areas in primary care.MethodsThree focus group sessions were conducted in which 24 primary care practitioners (PCPs) participated (general practitioners, general practitioners in training and practice nurses), varying from 7 to 9 per session. In each focus group, barriers to using CDSSs were discussed using a semi-structured literature-based topic list. Focus group discussions were audio-taped and transcribed verbatim. Two researchers independently performed thematic content analysis using the software program Atlas.ti 7.0.ResultsThree groups of barriers emerged, related to 1) the users’ knowledge of the system, 2) the users’ evaluation of features of the system (source and content, format/lay out, and functionality), and 3) the interaction of the system with external factors (patient-related and environmental factors). Commonly perceived barriers were insufficient knowledge of the CDSS, irrelevant alerts, too high intensity of alerts, a lack of flexibility and learning capacity of the CDSS, a negative effect on patient communication, and the additional time and work it requires to use the CDSS.ConclusionsMultiple types of barriers may hinder the use of large-scale implemented CDSSs covering multiple disease areas in primary care. Lack of knowledge of the system is an important barrier, emphasizing the importance of a proper introduction of the system to the target group. Furthermore, barriers related to a lack of integration into daily practice seem to be of primary concern, suggesting that increasing the system’s flexibility and learning capacity in order to be able to adapt the decision support to meet the varying needs of different users should be the main target of CDSS interventions.

An instrument assessing patient satisfaction with day care in hospitals

BackgroundPatient satisfaction is an important indicator of quality of care in hospitals. Reliable and valid instruments to measure clinical and outpatient satisfaction already exist. Recently hospitals have increasingly provided day care, i.e., admitting patients for one day without an overnight stay. This article describes the adaption of the ‘Core questionnaire for the assessment of Patient Satisfaction’ (COPS) for general Day care (COPS-D), and the subsequent validation of the COPS-D.MethodsThe clinical COPS was supplemented with items to cover two new dimensions: Pre-admission visit and Operation Room. It was sent to a sample of day care patients of five general Dutch hospitals to investigate dimensionality, acceptability, reliability, construct and external validity. Construct validity was established by correlating the dimensions of the COPS-D with patients’ overall satisfaction.ResultsThe COPS-D was returned by 3802 patients (response 46%). Factor analysis confirmed its’ structure: Pre-intake visit, Admission, Operation room, Nursing care, Medical care, Information, Autonomy and Discharge and aftercare (extraction communality 0.63-0.90). The internal consistency of the eight dimensions was good (α = 0.82-0.90); the item internal consistency corrected for overlap was satisfactory (>0.40); all inter-item correlations were higher than 0.45 but not too high (<0.90). The construct validity of all dimensions was good (r from 0.52-0.62, p < 0.01). The Information dimension had the strongest correlation with overall day care satisfaction.ConclusionsThe COPS-D is a reliable and valid instrument for measuring satisfaction with day care. It complements the model of measuring patient satisfaction with clinical and outpatient care given in hospitals. It also fulfils the conditions made while developing the clinical and outpatient COPS: a short, core instrument to screen patient satisfaction.

Am I my brother's keeper? A survey of 10 healthcare professions in the Netherlands about experiences with impaired and incompetent colleagues

Background Dealing with poor individual performance of healthcare professionals is essential in patient safety management. The objective of the current study was to explore potential differences regarding experiences with impaired and incompetent colleagues between a broad range of healthcare professions. Methods A survey of 10 legally regulated professions in the Netherlands on knowledge on dealing with impaired/incompetent colleagues, experiences with such colleagues, action taken upon an impaired and incompetent colleague and reasons for not taking action. Results We approached 4348 professionals, of whom 1238 responded (28.5%). One-third of the respondents (31.3%) had an experience with an impaired or incompetent colleague in the preceding 12 months, and 84% of these reported cases concerned incompetence. Even under the extreme assumption that all non-respondents had no such experiences, our results indicate that at least 9% of the total sample had dealt with an impaired or incompetent colleague in the previous 12 months. Two-thirds of the professionals (68.6%) who had an experience reported having acted upon it. Respondents significantly less often reported to have acted (49.6% vs 79.1%, p=0.000) when the colleague was working at a different organisation. The primary reason for not taking action was that impairment/incompetence could not be proven. Conclusions Even using an extreme correction for our low response rate, at least 9% of healthcare professionals reported dealing with impaired or incompetent colleagues in the past year. Creating and clarifying reporting opportunities when confronted with an incompetent or impaired colleague should be a priority for professional organisations, policymakers and regulatory bodies.

Trends in patient satisfaction in Dutch university medical centers: room for improvement for all

BackgroundResults of patient satisfaction research provide hospitals areas for quality improvement. Although it may take several years to achieve such improvement, not all hospitals analyze changes in patient satisfaction over time structurally. Consequently, they lack information from patients’ perspective on effectiveness of improvement programs. This study presents a trend analysis of the patient satisfaction scores in the eight university medical centers in the Netherlands. We focus on the trends, effect size and its consequences for improving patient-centered care.MethodsThe Core Questionnaire for the assessment of Patient satisfaction (COPS) was used in four large-scale nationwide comparative studies (2003–2009). Data were analyzed at a national level, and for each academic hospital separately. We analyzed the polynomial contrasts in the four measurements by performing an univariate analysis of variance (ANCOVA). The trend lines are presented graphically, with the means, SD, F-statistics and the standardized effect size including confidence intervals expressed by Cohen’s d. By analyzing the (logit transformed) percentages of very satisfied patients we examined the change scores.ResultsThe dataset consisted of 58,055 inpatients and 79,498 outpatients. Significant positive trends were found on national level and hospital level, especially in outpatient departments. Improvement was especially seen on the dimensions “information” and “discharge and aftercare”. Not only university medical centers with a lower score at the start, but surprisingly some best practices and university medical centers with a high initial score improved.ConclusionsWe conclude that significant trends in patient satisfaction can be identified on a national and a hospital level, in inpatient and outpatient departments. The observed effect size expressed by Cohen’s d is rather small. Hospitals have found room for improvement, even hospitals with initial high satisfaction scores. We recommend that hospitals monitor their patient satisfaction scores over time and relate these to quality interventions and organizational changes. Furthermore, we recommend to expand the research to subgroups of unsatisfied patients to improve patient-centered care for all patients.

A new impetus for guideline development and implementation: construction and evaluation of a toolbox

BackgroundIn the last decade, guideline organizations faced a number of problems, including a lack of standardization in guideline development methods and suboptimal guideline implementation. To contribute to the solution of these problems, we produced a toolbox for guideline development, implementation, revision, and evaluation.MethodsAll relevant guideline organizations in the Netherlands were approached to prioritize the topics. We sent out a questionnaire and discussed the results at an invitational conference. Based on consensus, twelve topics were selected for the development of new tools. Subsequently, working groups were composed for the development of the tools. After development of the tools, their draft versions were pilot tested in 40 guideline projects. Based on the results of the pilot tests, the tools were refined and their final versions were presented.ResultsThe vast majority of organizations involved in pilot testing of the tools reported satisfaction with using the tools. Guideline experts involved in pilot testing of the tools proposed a variety of suggestions for the implementation of the tools. The tools are available in Dutch and in English at a web-based platform on guideline development and implementation (http://www.ha-ring.nl).ConclusionsA collaborative approach was used for the development and evaluation of a toolbox for development, implementation, revision, and evaluation of guidelines. This approach yielded a potentially powerful toolbox for improving the quality and implementation of Dutch clinical guidelines. Collaboration between guideline organizations within this project led to stronger linkages, which is useful for enhancing coordination of guideline development and implementation and preventing duplication of efforts. Use of the toolbox could improve quality standards in the Netherlands, and might facilitate the development of high-quality guidelines in other countries as well.