Adalsteinn D. Brown

The Canadian Adverse Events Study: the incidence of adverse events among hospital patients in Canada

Background: Research into adverse events (AEs) has highlighted the need to improve patient safety. AEs are unintended injuries or complications resulting in death, disability or prolonged hospital stay that arise from health care management. We estimated the incidence of AEs among patients in Canadian acute care hospitals. Methods: We randomly selected 1 teaching, 1 large community and 2 small community hospitals in each of 5 provinces (British Columbia, Alberta, Ontario, Quebec and Nova Scotia) and reviewed a random sample of charts for nonpsychiatric, nonobstetric adult patients in each hospital for the fiscal year 2000. Trained reviewers screened all eligible charts, and physicians reviewed the positively screened charts to identify AEs and determine their preventability. Results: At least 1 screening criterion was identified in 1527 (40.8%) of 3745 charts. The physician reviewers identified AEs in 255 of the charts. After adjustment for the sampling strategy, the AE rate was 7.5 per 100 hospital admissions (95% confidence interval [CI] 5.7– 9.3). Among the patients with AEs, events judged to be preventable occurred in 36.9% (95% CI 32.0%–41.8%) and death in 20.8% (95% CI 7.8%–33.8%). Physician reviewers estimated that 1521 additional hospital days were associated with AEs. Although men and women experienced equal rates of AEs, patients who had AEs were significantly older than those who did not (mean age [and standard deviation] 64.9 [16.7] v. 62.0 [18.4] years; p = 0.016). Interpretation: The overall incidence rate of AEs of 7.5% in our study suggests that, of the almost 2.5 million annual hospital admissions in Canada similar to the type studied, about 185 000 are associated with an AE and close to 70 000 of these are potentially preventable.

Response Audit of an Internet Survey of Health Care Providers and Administrators: Implications for Determination of Response Rates

Background Internet survey modalities often compare unfavorably with traditional survey modalities, particularly with respect to response rates. Response to Internet surveys can be affected by the distribution options and response/collection features employed as well as the existence of automated (out-of-office) replies, automated forwarding, server rejection, and organizational or personal spam filters. However, Internet surveys also provide unparalleled opportunities to track study subjects and examine many of the factors influencing the determination of response rates. Tracking data available for Internet surveys provide detailed information and immediate feedback on a significant component of response that other survey modalities cannot match. This paper presents a response audit of a large Internet survey of more than 5000 cancer care providers and administrators in Ontario, Canada. Objective Building upon the CHEcklist for Reporting Results of Internet E-Surveys (CHERRIES), the main objectives of the paper are to (a) assess the impact of a range of factors on the determination of response rates for Internet surveys and (b) recommend steps for improving published descriptions of Internet survey methods. Methods We audited the survey response data, analyzing the factors that affected the numerator and denominator in the ultimate determination of response. We also conducted a sensitivity analysis to account for the inherent uncertainty associated with the impact of some of the factors on the response rates. Results The survey was initially sent out to 5636 health care providers and administrators. The determination of the numerator was influenced by duplicate/unattached responses and response completeness. The numerator varied from a maximum of 2031 crude (unadjusted) responses to 1849 unique views, 1769 participants, and 1616 complete responses. The determination of the denominator was influenced by forwarding of the invitation email to unknown individuals, server rejections, automated replies, spam filters, and ‘opt out’ options. Based on these factors, the denominator varied from a minimum of 5106 to a maximum of 5922. Considering the different assumptions for the numerator and the denominator, the sensitivity analysis resulted in a 12.5% variation in the response rate (from minimum of 27.3% to maximum of 39.8%) with a best estimate of 32.8%. Conclusions Depending on how the numerator and denominator are chosen, the resulting response rates can vary widely. The CHERRIES statement was an important advance in identifying key characteristics of Internet surveys that can influence response rates. This response audit suggests the need to further clarify some of these factors when reporting on Internet surveys for health care providers and administrators, particularly when using commercially available Internet survey packages for specified, rather than convenience, samples.

Assessing the Volume-Outcome Hypothesis and Region-Level Quality Improvement Interventions: Pancreas Cancer Surgery in Two Canadian Provinces

BackgroundThe volume-outcome hypothesis suggests that if increased provider procedure volume is associated with improved patient outcomes, then greater regionalization to high-volume providers should improve region-level outcomes. Quality improvement interventions for pancreas cancer surgery implemented in year 1999 in Ontario, Canada were designed to regionalize surgery to high-volume hospitals and decrease operative mortality. Similar interventions were not used in Quebec, Canada. We assessed the volume-outcome hypothesis and the impact of the Ontario quality improvement interventions.Materials and MethodsAdministrative databases helped identify pancreatic resections from years 1994 to 2004 and relevant patient and hospital characteristics. Hospitals were high-volume if they provided ≥10 procedures in a given calendar year. Outcomes were regionalization of surgery to high-volume providers and rates of operative mortality.ResultsFrom 1994 to 2004 the percentage of cases in high-volume hospitals increased from 33 to 71% in Ontario and from 36 to 76% in Quebec. Annual rates of operative mortality dropped in Ontario (10.4–2.2% or less) and changed little in Quebec (7.2–9.8%). Changes in measures over time in both provinces were similar before and after year 1999.ConclusionsRegionalization was associated with improved operative mortality in Ontario but not in Quebec, undermining the volume-outcome hypothesis. The Ontario quality improvement interventions likely were of little influence since patterns in regionalization and operative mortality were similar before and after year 1999.

World survey of mental illness stigma

OBJECTIVE To obtain rapid and reproducible opinions that address mental illness stigma around the world. METHOD Random global Web users were exposed to brief questions, asking whether they interacted daily with someone with mental illness, whether they believed that mental illness was associated with violence, whether it was similar to physical illness, and whether it could be overcome. RESULTS Over a period of 1.7 years, 596,712 respondents from 229 countries completed the online survey. The response rate was 54.3%. China had the highest proportion of respondents in daily contact with a person with mental illness. In developed countries, 7% to 8% of respondents endorsed the statement that individuals with mental illness were more violent than others, in contrast to 15% or 16% in developing countries. While 45% to 51% of respondents from developed countries believed that mental illness was similar to physical illness, only 7% believed that mental illness could be overcome. To test for reproducibility, 21 repeats of the same questions were asked monthly in India for 21 months. Each time, 10.1 ± 0.11% s.e., of respondents endorsed the statement that persons who suffer from mental illness are more violent than others, indicating strong reproducibility of response. CONCLUSION This study shows that surveys of constructs such as stigma towards mental illness can be carried out rapidly and repeatedly across the globe, so that the impact of policy interventions can be readily measured. LIMITATIONS The method engages English speakers only, mainly young, educated males.

CEO Compensation and Hospital Financial Performance

Growing interest in pay-for-performance and the level of chief executive officers’ (CEOs’) pay raises questions about the link between performance and compensation in the health sector. This study compares the compensation of nonprofit hospital CEOs in Ontario, Canada to the three longest reported and most used measures of hospital financial performance. Our sample consisted of 132 CEOs from 92 hospitals between 1999 and 2006. Unbalanced panel data were analyzed using fixed effects regression. Results suggest that CEO compensation was largely unrelated to hospital financial performance. Inflation-adjusted salaries appeared to increase over time independent of hospital performance, and hospital size was positively correlated with CEO compensation. The apparent upward trend in salary despite some declines in financial performance challenges the fundamental assumption underlying this article, that is, financial performance is likely linked to CEO compensation in Ontario. Further research is needed to understand long-term performance related to compensation incentives.

How do hospitalization experience and institutional characteristics influence inpatient satisfaction? A multilevel approach

Over the last several years, interest in benchmarking health services’ quality—particularly patient satisfaction (PS)—across organizations has increased. Comparing patient experiences of care across hospitals requires risk adjustment to control for important differences in patient case-mix and provider characteristics. This study investigates the individual-level and organizational-level determinants of PS with public hospitals by applying hierarchical models. The analysis focuses on the effect of hospital characteristics, such as self-discharges, on overall evaluations and on across hospital variation in scores. Sociodemographics, admission mode, place of residence, hospitalization ward and continuity of care were statistically significant predictors of inpatient satisfaction. Interestingly, it was observed that hospitals with a higher percentage of Patients Leaving Against Medical Advice (PLAMA) received lower scores. The latter result suggests that the percentage of PLAMA may provide a useful measure of a hospital’s inability to meet patient needs and a proxy indicator of PS with hospital care.

The population health approach: A qualitative study of conceptual and operational definitions for leaders in Canadian healthcare

Objectives: The population health approach is increasingly recognized for its role in health system reform; however, its broad scope and definition have been criticized for being a barrier to clear communication. This qualitative study examined the way senior healthcare leaders in Canada conceptualize and operationalize the population health approach in planning and decision-making. Findings: Core elements of the population health approach included focusing on health and wellness rather than illness, taking a population rather than individual orientation, understanding needs and solutions through community outreach, addressing health disparities/health in vulnerable groups, addressing the social determinants of health and inter-sectoral action and partnerships. Conclusion: The population health approach is increasingly recognized for its role in reducing healthcare demand and contributing to health system sustainability. This study demonstrated the growing need to clarify terminology among multiform partners to establish a foundation for future healthcare integration and inter-sectoral action.

What do we mean when we talk about the Triple Aim? A systematic review of evolving definitions and adaptations of the framework at the health system level

Notwithstanding important contributions of the Triple Aim, uncritical enthusiasm regarding the implications of the framework may be leading to inconsistent use, particularly when applied at the health system level, which goes beyond the original positioning of the framework as a strategic organizing principle to guide improvement initiatives at the organizational or local community level. We systematically identified uses of the Triple Aim that extended beyond its original intention to focus on uses at the whole health system level, to assess convergence and divergence with the original definition. We also attempted to identify consistencies in the way the Triple Aim was adapted for different contexts and settings. Data sources were indexed databases, web search engines, and international experts. Forty-seven articles were included in the analysis. We found that the definition of the Triple Aim has been subject to important modifications when the framework is used to define goals for whole health care systems or globally. Despite widespread recognition of the name, what constitutes the Triple Aim framework varies. We identified the need to consider the inclusion of at least two additional aims of health care systems - the provider experience of care, and the desire to achieve health equity for populations.

Approaching Etuaptmumk – introducing a consensus-based mixed method for health services research

With the recognized need for health systems’ improvements in the circumpolar and indigenous context, there has been a call to expand the research agenda across all sectors influencing wellness and to recognize academic and indigenous knowledge through the research process. Despite being recognized as a distinct body of knowledge in international forums and across indigenous groups, examples of methods and theories based on indigenous knowledge are not well documented in academic texts or peer-reviewed literature on health systems. This paper describes the use of a consensus-based, mixed method with indigenous knowledge by an experienced group of researchers and indigenous knowledge holders who collaborated on a study that explored indigenous values underlying health systems stewardship. The method is built on the principles of Etuaptmumk or two-eyed seeing, which aim to respond to and resolve the inherent conflicts between indigenous ways of knowing and the scientific inquiry that informs the evidence base in health care. Mixed methods’ frameworks appear to provide a framing suitable for research questions that require data from indigenous knowledge sources and western knowledge. The nominal consensus method, as a western paradigm, was found to be responsive to embedding of indigenous knowledge and allowed space to express multiple perspectives and reach consensus on the question at hand. Further utilization and critical evaluation of this mixed methodology with indigenous knowledge are required.

Intellectual capital in the healthcare sector: a systematic review and critique of the literature

BackgroundVariations in the performance of healthcare organizations may be partly explained by differing “stocks” of intellectual capital (IC), and differing approaches and capacities for leveraging IC. This study synthesizes what is currently known about the conceptualization, management and measurement of IC in healthcare through a review of the literature.MethodsPeer-reviewed papers on IC in healthcare published between 1990 and 2014 were identified through searches of five databases using the following key terms: intellectual capital/assets, knowledge capital/assets/resources, and intangible assets/resources. Articles deemed relevant for inclusion underwent systematic data extraction to identify overarching themes and were assessed for their methodological quality.ResultsThirty-seven papers were included in the review. The primary research method used was cross-sectional questionnaires focused on hospital managers’ perceptions of IC, followed by semi-structured interviews and analysis of administrative data. Empirical studies suggest that IC is linked to subjective process and performance indicators in healthcare organizations. Although the literature on IC in healthcare is growing, it is not advanced. In this paper, we identify and examine the conceptual, theoretical and methodological limitations of the literature.ConclusionsThe concept and framework of IC offer a means to study the value of intangible resources in healthcare organizations, how to manage systematically these resources together, and their mutually enhancing interactions on performance. We offer several recommendations for future research.