Charles D. Shaw

Optimal methods for guideline implementation: conclusions from Leeds Castle meeting.

Background.Quality problems in medical care are not a new finding. Variations in medical practice as well as actual medical errors have been pointed out for many decades. The current movement to write practice guidelines to attempt to correct these deviations from recommended medical practice has not solved the problem. Objectives.In order to gain greater acceptance of these guidelines and to change the behavior of health care providers, the science of guideline implementation must be understood better. Research Design. A group of experts who have studied the problem of implementation in Europe and the United States was convened. This meeting summary enumerates the implementation methods studied to date, reviews the theories of behavioral change, and makes recommendation for effecting better implementation guidelines. Results.A research agenda was proposed to further our knowledge of effective evidence-based implementation.

Accreditation and ISO certification: do they explain differences in quality management in European hospitals?

BACKGROUND Hospital accreditation and International Standardisation Organisation (ISO) certification offer alternative mechanisms for improving safety and quality, or as a mark of achievement. There is little published evidence on their relative merits. OBJECTIVE To identify systematic differences in quality management between hospitals that were accredited, or certificated, or neither. Research design ANALYSIS of compliance with measures of quality in 89 hospitals in six countries, as assessed by external auditors using a standardized tool, as part of the EC-funded METHODS of Assessing Response to Quality Improvement Strategies project. MAIN OUTCOME MEASURES Compliance scores in six dimensions of each hospital-grouped according to the achievement of accreditation, certification or neither. RESULTS Of the 89 hospitals selected for external audit, 34 were accredited (without ISO certification), 10 were certificated under ISO 9001 (without accreditation) and 27 had neither accreditation nor certification. Overall percentage scores for 229 criteria of quality and safety were 66.9, 60.0 and 51.2, respectively. Analysis confirmed statistically significant differences comparing mean scores by the type of external assessment (accreditation, certification or neither); however, it did not substantially differentiate between accreditation and certification only. Some of these associations with external assessments were confounded by the country in which the sample hospitals were located. CONCLUSIONS It appears that quality and safety structures and procedures are more evident in hospitals with either the type of external assessment and suggest that some differences exist between accredited versus certified hospitals. Interpretation of these results, however, is limited by the sample size and confounded by variations in the application of accreditation and certification within and between countries.

Sustainable healthcare accreditation: messages from Europe in 2009

BACKGROUND Healthcare accreditation has grown rapidly since the 1980s but critics question the value of accreditation rather than certification or inspection. Research has focused more on evidence of impact on provider institutions than on health systems; little has been published on the determinants of growth or decline of accreditation organizations and programmes. OBJECTIVE To describe the development of national accreditation organizations in Europe in relation to incentives, funding and market position in 2009; to identify trends over time using data from previous surveys. METHODS Contacts in 24 countries, identified by previous surveys, were invited to complete a web-based questionnaire comprising 183 items seeking numerical data or posing multiple choice options. Preliminary results were verified with respondents and agreed for publication. MAIN OUTCOME MEASURES National healthcare environment, incentives, government policy, legislation, regulation; programme governance, development, funding. RESULTS The survey identified 18 active national accreditation organizations in Europe. Older ones tend to be independent, profession-dominated and self-financing; they have shown little growth in activity and coverage of the potential market. Newer ones have broad stakeholder governance, support from government policy and growth sustained by legal or financial incentives-giving wide coverage across the healthcare system. The traditional collegial model of accreditation is moving towards a semi-regulatory model of external assessment which could integrate minimal standards of licensing, public safety and accountability with aspirational standards for organizational development and improvement. CONCLUSIONS The principal challenges to sustainable accreditation appear to be market size, consistency of policy support, programme funding and financial incentives for participation.

Profiling health-care accreditation organizations: an international survey.

OBJECTIVE To describe global patterns among health-care accreditation organizations (AOs) and to identify determinants of sustainability and opportunities for improvement. DESIGN Web-based questionnaire survey. PARTICIPANTS Organizations offering accreditation services nationally or internationally to health-care provider institutions or networks at primary, secondary or tertiary level in 2010. MAIN OUTCOME MEASURE s) External relationships, scope and activity public information. RESULTS Forty-four AOs submitted data, compared with 33 in a survey 10 years earlier. Of the 30 AOs that reported survey activity in 2000 and 2010, 16 are still active and stable or growing. New and old programmes are increasingly linked to public funding and regulation. CONCLUSIONS While the number of health-care AOs continues to grow, many fail to thrive. Successful organizations tend to complement mechanisms of regulation, health-care funding or governmental commitment to quality and health-care improvement that offer a supportive environment. Principal challenges include unstable business (e.g. limited market, low uptake) and unstable politics. Many organizations make only limited information available to patients and the public about standards, procedures or results.

The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals

Objective To investigate the relationship between ISO 9001 certification, healthcare accreditation and quality management in European hospitals. Design A mixed method multi-level cross-sectional design in seven countries. External teams assessed clinical services on the use of quality management systems, illustrated by four clinical pathways. Setting and Participants Seventy-three acute care hospitals with a total of 291 services managing acute myocardial infarction (AMI), hip fracture, stroke and obstetric deliveries, in Czech Republic, France, Germany, Poland, Portugal, Spain and Turkey. Main Outcome Measure Four composite measures of quality and safety [specialized expertise and responsibility (SER), evidence-based organization of pathways (EBOP), patient safety strategies (PSS) and clinical review (CR)] applied to four pathways. Results Accreditation in isolation showed benefits in AMI and stroke more than in deliveries and hip fracture; the greatest significant association was with CR in stroke. Certification in isolation showed little benefit in AMI but had more positive association with the other conditions; greatest significant association was in PSS with stroke. The combination of accreditation and certification showed least benefit in EBOP, but significant benefits in SER (AMI), in PSS (AMI, hip fracture and stroke) and in CR (AMI and stroke). Conclusions Accreditation and certification are positively associated with clinical leadership, systems for patient safety and clinical review, but not with clinical practice. Both systems promote structures and processes, which support patient safety and clinical organization but have limited effect on the delivery of evidence-based patient care. Further analysis of DUQuE data will explore the association of certification and accreditation with clinical outcomes.

Comparison of health service accreditation programs in low- and middle-income countries with those in higher income countries: a cross-sectional study

OBJECTIVE The study aim was twofold: to investigate and describe the organizational attributes of accreditation programmes in low- and middle-income countries (LMICs) to determine how or to what extent these differ from those in higher-income countries (HICs) and to identify contextual factors that sustain or are barriers to their survival. DESIGN Web-based questionnaire survey. PARTICIPANTS National healthcare accreditation providers and those offering international services. In total, 44 accreditation agencies completed the survey. MAIN OUTCOME MEASURE(S) Income distinctions, accreditation programme features, organizational attributes and cross-national divergence. RESULTS Accreditation programmes of LMICs exhibit similar characteristics to those of HICs. The consistent model of accreditation worldwide, centres on promoting improvements, applying standards and providing feedback. Where they do differ, the divergence is over specialized features rather than the general logic. LMICs were less likely than HICs to include an evaluation component to programmes, more likely to have certification processes for trainee surveyors and more likely to make decisions on the accreditation status based on a formulaic, mathematically oriented approach. Accreditation programme sustainability, irrespective of country characteristics, is influenced by ongoing policy support from government, a sufficient large healthcare market size, stable programme funding, diverse incentives to encourage participation in accreditation by Health Care Organizations as well as the continual refinement and improvement in accreditation agency operations and programme delivery. CONCLUSIONS Understanding the similarities, differences and factors that sustain accreditation programmes in LMICs, and HICs, can be applied to benefit programmes around the world. A flourishing accreditation programme is one element of the institutional basis for high-quality health care.

Do European hospitals have quality and safety governance systems and structures in place

Internal systems for quality and safety were assessed in 89 hospitals in six European states, by external teams using standardised criteria and procedures, as part of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) project. The assessments were made primarily to identify the current use of quality management systems in the sample hospitals, and also to demonstrate a potential tool for comparable assessment of hospitals in general. The large majority of the hospitals had a formal, documented infrastructure to manage quality and safety, but a significant minority had no designated mission, programme or coordination. In two-thirds of hospitals, the governing body was active in defining policy and programmes for improvement, and received reports on quality, safety and patient satisfaction at least once a year. The brief on-site assessments identified systematic variations, within and between countries, in structures and processes of governance and to document the uptake of best practice. Unacceptable variations in practice could be reduced, to the benefit of consumers and providers, by developing and publishing basic organisational standards relevant to all European states. The simple assessment criteria designed for this project could be developed into a practical tool for self-assessment, peer review or benchmarking of hospitals across national borders. This assessment, combined with explicit, relevant and achievable standards, could provide a vehicle to promote the voluntary uptake of best practice and consistency in quality and safety among hospitals in Europe.

Learning from MARQuIS: future direction of quality and safety in hospital care in the European Union.

This article summarises the significant lessons to be drawn from, and the policy implications of, the findings of the Methods of Assessing Response to Quality Improvement Strategies (MARQuIS) project—a part of the suite of research projects intended to support policy established by the European Commission through its Sixth Framework Programme. The article first reviews the findings of MARQuIS and their implications for healthcare providers (and particularly for hospitals), and then addresses the broader policy implications for member states of the European Union (EU) and for the commission itself. Against the background of the European Commission’s Seventh Framework Programme, it then outlines a number of future areas for research to inform policy and practice in quality and safety in Europe. The article concludes that at this stage, a unique EU-wide quality improvement system for hospitals does not seem to be feasible or effective. Because of possible future community action in this field, attention should focus on the use of existing research on quality and safety strategies in healthcare, with the aim of combining soft measures to accelerate mutual learning. Concrete measures should be considered only in areas for which there is substantial evidence and effective implementation can be ensured.

Evidence-based organization and patient safety strategies in European hospitals.

Objective To explore how European hospitals have implemented patient safety strategies (PSS) and evidence-based organization of care pathway (EBOP) recommendations and examine the extent to which implementation varies between countries and hospitals. Design Mixed-method multilevel cross-sectional design in seven countries as part of the European Union-funded project ‘Deepening our Understanding of Quality improvement in Europe’ (DUQuE). Setting and participants Seventy-four acute care hospitals with 292 departments managing acute myocardial infarction (AMI), hip fracture, stroke, and obstetric deliveries. Main outcome measure Five multi-item composite measures—one generic measure for PSS and four pathway-specific measures for EBOP. Results Potassium chloride had only been removed from general medication stocks in 9.4–30.5% of different pathways wards and patients were adequately identified with wristband in 43.0–59.7%. Although 86.3% of areas treating AMI patients had immediate access to a specialist physician, only 56.0% had arrangements for patients to receive thrombolysis within 30 min of arrival at the hospital. A substantial amount of the total variance observed was due to between-hospital differences in the same country for PSS (65.9%). In EBOP, between-country differences play also an important role (10.1% in AMI to 57.1% in hip fracture). Conclusions There were substantial gaps between evidence and practice of PSS and EBOP in a sample of European hospitals and variations due to country differences are more important in EBOP than in PSS, but less important than within-country variations. Agencies supporting the implementation of PSS and EBOP should closely re-examine the effectiveness of their current strategies.

Towards hospital standardization in Europe

QUALITY PROBLEM There is no simple tool to assess compliance with common national and European directives, guidance and professional advice on the management of healthcare institutions. Despite evidence of unacceptable variations in the protection of patient and staff safety little attention has been given to harmonizing the way services are organized and managed. INITIAL ASSESSMENT Existing systems which define organizational standards, or assess compliance with them, are not in a position to extend this activity into or across national borders in Europe. Certification, accreditation and licensing programmes are too variable to provide a common basis for consistent assessment. Consensual standards would inevitably be minimal if they were to achieve acceptance by all or a majority of member state governments; they would not be standards for excellence or help the majority of organizations to improve performance. PROPOSED SOLUTION This paper proposes the development of a framework and measurement tool, initially for hospitals, which could be used for self-assessment or peer review to demonstrate compliance with European legislation, guidance and public expectations without infringing national responsibilities. A common code of management practice could be developed through a process similar to that adopted for clinical practice guidelines by the European commission-funded project on appraisal of guidelines research and evaluation. CONCLUSIONS In practice, the legal relationships between member states and intergovernmental organizations inhibit the harmonization of management practice across-borders. Faster progress to higher levels of performance would be achieved by voluntary, non-regulatory cooperation of enthusiasts to define, measure and improve the quality of healthcare in European hospitals.