Jonathan Benn

Feedback from incident reporting: information and action to improve patient safety

Introduction: Effective feedback from incident reporting systems in healthcare is essential if organisations are to learn from failures in the delivery of care. Despite the wide-scale development and implementation of incident reporting in healthcare, studies in the UK suggest that information concerning system vulnerabilities could be better applied to improve operational safety within organisations. In this article, the findings and implications of research to identify forms of effective feedback from incident reporting are discussed, to promote best practices in this area. Methods: The research comprised a mixed methods review to investigate mechanisms of effective feedback for healthcare, drawing upon experience within established reporting programmes in high-risk industry and transport domains. Systematic searches of published literature were undertaken, and 23 case studies describing incident reporting programmes with feedback were identified for analysis from the international healthcare literature. Semistructured interviews were undertaken with 19 subject matter experts across a range of domains, including: civil aviation, maritime, energy, rail, offshore production and healthcare. Results: In analysis, qualitative information from several sources was synthesised into practical requirements for developing effective feedback in healthcare. Both action and information feedback mechanisms were identified, serving safety awareness, improvement and motivational functions. The provision of actionable feedback that visibly improved systems was highlighted as important in promoting future reporting. Fifteen requirements for the design of effective feedback systems were identified, concerning: the role of leadership, the credibility and content of information, effective dissemination channels, the capacity for rapid action and the need for feedback at all levels of the organisation, among others. Above all, the safety-feedback cycle must be closed by ensuring that reporting, analysis and investigation result in timely corrective actions that effectively address vulnerabilities in existing work systems. Conclusions: Limited research evidence exists concerning the issue of effective forms of safety feedback within healthcare. Much valuable operational knowledge resides in safety management communities within high-risk industries. Multiple means of feeding back recommended actions and safety information may be usefully employed to promote safety awareness, improve clinical processes and promote future reporting. Further work is needed to establish best practices for feedback systems in healthcare that effectively close the safety loop.

Studying large-scale programmes to improve patient safety in whole care systems: challenges for research.

Large-scale national and multi-institutional patient safety improvement programmes are being developed in the health care systems of several countries to address problems in the reliability of care delivered to patients. Drawing upon popular collaborative improvement models, these campaigns are ambitious in their aims to improve patient safety in macro-level systems such as whole health care organisations. This article considers the methodological issues involved in conducting research and evaluation of these programmes. Several specific research challenges are outlined, which result from the complexity of longitudinal, multi-level intervention programmes and the variable, highly sociotechnical care systems, with which they interact. Organisational-level improvement programmes are often underspecified due to local variations in context and organisational readiness for improvement work. The result is variable implementation patterns and local adaptations. Programme effects span levels and other boundaries within a system, vary dynamically or are cumulative over time and are problematic to understand in terms of cause and effect, where concurrent external influences exist and the impact upon study endpoints may be mediated by a range of organisational and social factors. We outline the methodological approach to research in the United Kingdom Safer Patients Initiative, to exemplify how some of the challenges for research in this area can be met through a multi-method, longitudinal research design. Specifically, effective research designs must be sensitive to complex variation, through employing multiple qualitative and quantitative measures, collect data over time to understand change and utilise descriptive techniques to capture specific interactions between programme and context for implementation. When considering the long-term, sustained impact of an improvement programme, researchers must consider how to define and measure the capability for continuous safe and reliable care as a property of the whole care system. This requires a sociotechnical approach, rather than focusing upon one microsystem, disciplinary perspective or single level of the system.

Using quality indicators in anaesthesia: feeding back data to improve care

After recent UK policy developments, considerable attention has been focused upon how clinical specialties measure and report on the quality of care delivered to patients. Defining the right indicators alone is insufficient to close the feedback loop. This narrative review aims to describe and synthesize a diverse body of research relevant to the question of how information from quality indicators can be fed back and used effectively to improve care. Anaesthesia poses certain challenges in the identification of valid outcome indicators sensitive to variations in anaesthetic care. Metrics collected during the immediate post-anaesthetic recovery period, such as patient temperature, patient-reported quality of recovery, and pain and nausea, provide potentially useful information for the anaesthetist, yet this information is not routinely fed back. Reviews of the effects of feeding back performance data to healthcare providers suggest that this may result in small to moderate positive effects upon outcomes and professional practice, with stronger effects where feedback is integrated within a broader quality improvement strategy. The dominant model for use of data within quality improvement is based upon the industrial process control approach, in which care processes are monitored continuously for process changes which are rapidly detectable for corrective action. From this review and experience of implementing these principles in practice, effective feedback from quality indicators is timely, credible, confidential, tailored to the recipient, and continuous. Considerable further work is needed to understand how information from quality indicators can be fed back in an effective way to clinicians and clinical units, in order to support revalidation and continuous improvement.

Perceptions of the impact of a large‐scale collaborative improvement programme: experience in the UK Safer Patients Initiative

RATIONALE AND AIMS In several countries, collaborative improvement programmes involving multiple health care organizations have been developed to address the issue of patient safety and reliability of care at an organization-wide level. In the UK, the Health Foundations Safer Patients Initiative (SPI) was developed to achieve breakthrough improvement in the quality and safety of care in 24 acute hospital Trusts between 2004 and 2008. Research evidence for the effectiveness of programmes of this type and the mechanisms by which positive outcomes are achieved remains limited. We report a multi-method preliminary study based upon phase 1 of SPI to understand participants perceptions of the local impact of the programme and to form the basis of future research in this area. METHODS Data were collected on the perceived local impact of SPI on a range of clinical, organizational and social dimensions relating to care quality and safety. Data were collected retrospectively from local SPI programme improvement teams using semi-structured interviews and surveys. Qualitative and quantitative analyses were performed, and the results synthesized under common themes and frameworks. RESULTS Specific dimensions of care systems commonly considered to be affected by SPI, included culture, strategic priority, organizational capability and clinical care delivery. Survey data revealed the perceived importance for success of a range of programme components: quality improvement methodology, learning sessions and programme faculty support, along with predefined clinical practice changes. Safety climate and capability dimensions rated as most sensitive to the effects of the SPI programme related to multi-professional engagement and communication, the degree of routine monitoring of care processes and the capacity to evaluate the impact of changes to clinical work systems. CONCLUSIONS Study findings support the view that programmes such as SPI have considerable impact upon the cultural, inter-professional, strategic and organizational aspects of care delivery, in addition to clinical working practices. The specific implications for understanding the effects of complex organization-level interventions and future research design are discussed.

Improving Decision Making in Multidisciplinary Tumor Boards: Prospective Longitudinal Evaluation of a Multicomponent Intervention for 1,421 Patients

BACKGROUND Due to its complexity, cancer care is increasingly being delivered by multidisciplinary tumor boards (MTBs). Few studies have investigated how best to organize and run MTBs to optimize clinical decision making. We developed and evaluated a multicomponent intervention designed to improve the MTBs ability to reach treatment decisions. STUDY DESIGN We conducted a prospective longitudinal study during 16 months that evaluated MTB decision making for urological cancer patients at a university hospital in London, UK. After a baseline period, MTB improvement interventions (eg, MTBs checklist, MTB team training, and written guidance) were delivered sequentially. Outcomes measures were the MTBs ability to reach a decision, the quality of information presentation, and the quality of teamwork (as assessed by trained assessors using a previously validated observational assessment tool). The efficacy of the intervention was evaluated using multivariate analyses. RESULTS There were 1,421 patients studied between December 2009 and April 2, 2011. All outcomes improved considerably between baseline and intervention implementation: the MTBs ability to reach a decision rose from 82.2% to 92.7%, quality of information presentation rose from 29.6% to 38.3%, and quality of teamwork rose from 37.8% to 43.0%. The MTBs ability to reach a treatment decision was related to the quality of available information (r = 0.298; p < 0.05) and quality of teamwork within the MTB (r = 0.348; p < 0.05). The most common barriers to reaching clinical decisions were inadequate radiologic information (n = 77), inadequate pathologic information (n = 51), and inappropriate patient referrals (n = 21). CONCLUSIONS Multidisciplinary tumor board-delivered treatment is becoming the standard for cancer care worldwide. Our intervention is efficacious and applicable to MTBs and can improve decision making and expedite cancer care.

Improving patient safety incident reporting systems by focusing upon feedback - lessons from English and Welsh trusts.

This paper describes practical implications and learning from a multi-method study of feedback from patient safety incident reporting systems. The study was performed using the Safety Action and Information Feedback from Incident Reporting model, a model of the requirements of the feedback element of a patient safety incident reporting and learning system, derived from a scoping review of research and expert advice from world leaders in safety in high-risk industries. We present the key findings of the studies conducted in the National Health Services (NHS) trusts in England and Wales in 2006. These were a survey completed by risk managers for 351 trusts in England and Wales, three case studies including interviews with staff concerning an example of good practice feedback and an audit of 90 trusts clinical risk staff newsletters. We draw on an Expert Workshop that included 71 experts from the NHS, from regulatory bodies in health care, Royal Colleges, Health and Safety Executive and safety agencies in health care and high-risk industries (commercial aviation, rail and maritime industries). We draw recommendations of enduring relevance to the UK NHS that can be used by trust staff to improve their systems. The recommendations will be of relevance in general terms to health services worldwide.

Factors predicting change in hospital safety climate and capability in a multi-site patient safety collaborative: a longitudinal survey study

Objective The study had two specific objectives: (1) To analyse change in a survey measure of organisational patient safety climate and capability (SCC) resulting from participation in the UK Safer Patients Initiative and (2) To investigate the role of a range of programme and contextual factors in predicting change in SCC scores. Design Single group longitudinal design with repeated measurement at 12-month follow-up. Setting Multiple service areas within NHS hospital sites across England, Wales, Scotland and Northern Ireland. Participants Stratified sample of 284 respondents representing programme teams at 19 hospital sites. Intervention A complex intervention comprising a multi-component quality improvement collaborative focused upon patient safety and designed to impact upon hospital leadership, communication, organisation and safety climate. Measures A survey including a 31-item SCC scale was administered at two time-points. Results Modest but significant positive movement in SCC score was observed between the study time-points. Individual programme responsibility, availability of early adopters, multi-professional collaboration and extent of process measurement were significant predictors of change in SCC. Hospital type and size, along with a range of programme preconditions, were not found to be significant. Conclusion A range of social, cultural and organisational factors may be sensitive to this type of intervention but the measurable effect is small. Supporting critical local programme implementation factors may be an effective strategy in achieving development in organisational patient SCC, regardless of contextual factors and organisational preconditions.

High reliability in health care.

Examples from other industries should be informative, not prescriptive

Predictors of the perceived impact of a patient safety collaborative: an exploratory study.

OBJECTIVE The aim of this study was to evaluate the influence of various factors on the perceived impact of a patient safety improvement collaborative in the UK, the Safer Patients Initiative (SPI). STUDY DESIGN A cross-sectional survey design was used. Study setting Twenty National Health Service organizations from the UK that participated in the main phase of the SPI programme, which ran from September 2007 to 2008. PARTICIPANTS Senior executive leads, clinical operational leads in the four clinical areas targeted by the programme, programme coordinators and any other staff involved in the SPI (n = 635). INTERVENTION The SPI is a patient safety improvement intervention based on the Breakthrough Series Collaborative model (Institute of Healthcare Improvement, 2004) aimed at improving patient safety in four clinical areas (general ward care, intensive care, perioperative care and pharmacy) through implementing a number of evidence-based clinical practices and a focus on organizational leadership. Outcome measures Participant perceptions of the impact of the programme on their organizations. RESULTS Exploratory regression analysis showed that programme management, the value assigned to programme methodology and length of data collection contributed the largest variance in perceived impact of the SPI followed by perceived support from junior doctors, inter-professional collaboration, difference of the programme from existing safety improvement practices and organizational readiness. CONCLUSIONS The resulting model suggests hierarchical importance for a range of variables to support future research concerning the mechanisms by which large-scale organizational programmes, such as the SPI, impact on the care systems they are designed to influence.

Teamwork enables remote surgical control and a new model for a surgical system emerges

Technology has revolutionised surgery in minimising anatomical invasiveness and increasing the range of surgical interventions available. However, modern remote and robot assisted surgery places unorthodox demands on surgeons and on all those involved in surgical operations in the operating theatre/room. This system of work is of vital importance to surgical success. However, research for developing surgical technique focuses mainly on the surgeon’s interface with the operative site, neglecting the operating room system supporting that technique. Furthermore, there is yet no agreement on the framework for regularly organising this vital system and for optimising its design for interprofessional work. By expanding on the conventional human–machine interface, we develop a model depicting the surgeon controlling surgical action through the media and technology of the operating room system. We show how the operating room team mediate the control of the surgical operation. By viewing control and communication in the operating room as a property of a distributed or joint cognitive system, we emphasise the potential for the team, their media and technology to either impair or enhance surgical performance.