Joanne Rycroft-Malone

Realist synthesis: illustrating the method for implementation research

BackgroundRealist synthesis is an increasingly popular approach to the review and synthesis of evidence, which focuses on understanding the mechanisms by which an intervention works (or not). There are few published examples of realist synthesis. This paper therefore fills a gap by describing, in detail, the process used for a realist review and synthesis to answer the question ‘what interventions and strategies are effective in enabling evidence-informed healthcare?’ The strengths and challenges of conducting realist review are also considered.MethodsThe realist approach involves identifying underlying causal mechanisms and exploring how they work under what conditions. The stages of this review included: defining the scope of the review (concept mining and framework formulation); searching for and scrutinising the evidence; extracting and synthesising the evidence; and developing the narrative, including hypotheses.ResultsBased on key terms and concepts related to various interventions to promote evidence-informed healthcare, we developed an outcome-focused theoretical framework. Questions were tailored for each of four theory/intervention areas within the theoretical framework and were used to guide development of a review and data extraction process. The search for literature within our first theory area, change agency, was executed and the screening procedure resulted in inclusion of 52 papers. Using the questions relevant to this theory area, data were extracted by one reviewer and validated by a second reviewer. Synthesis involved organisation of extracted data into evidence tables, theming and formulation of chains of inference, linking between the chains of inference, and hypothesis formulation. The narrative was developed around the hypotheses generated within the change agency theory area.ConclusionsRealist synthesis lends itself to the review of complex interventions because it accounts for context as well as outcomes in the process of systematically and transparently synthesising relevant literature. While realist synthesis demands flexible thinking and the ability to deal with complexity, the rewards include the potential for more pragmatic conclusions than alternative approaches to systematic reviewing. A separate publication will report the findings of the review.

Improving Quality of Care through Routine, Successful Implementation of Evidence-Based Practice at the Bedside: An Organizational Case Study Protocol Using the Pettigrew and Whipp Model of Strategic Change

BackgroundEvidence-based practice (EBP) is an expected approach to improving the quality of patient care and service delivery in health care systems internationally that is yet to be realized. Given the current evidence-practice gap, numerous authors describe barriers to achieving EBP. One recurrently identified barrier is the setting or context of practice, which is likewise cited as a potential part of the solution to the gap. The purpose of this study is to identify key contextual elements and related strategic processes in organizations that find and use evidence at multiple levels, in an ongoing, integrated fashion, in contrast to those that do not.MethodsThe core theoretical framework for this multi-method explanatory case study is Pettigrew and Whipps Content, Context, and Process model of strategic change. This framework focuses data collection on three entities: the Why of strategic change, the What of strategic change, and the How of strategic change, in this case related to implementation and normalization of EBP. The data collection plan, designed to capture relevant organizational context and related outcomes, focuses on eight interrelated factors said to characterize a receptive context. Selective, purposive sampling will provide contrasting results between two cases (departments of nursing) and three embedded units in each. Data collection methods will include quantitative tools (e.g., regarding culture) and qualitative approaches including focus groups, interviews, and documents review (e.g., regarding integration and “success”) relevant to the EBP initiative.DiscussionThis study should provide information regarding contextual elements and related strategic processes key to successful implementation and sustainability of EBP, specifically in terms of a pervasive pattern in an acute care hospital-based health care setting. Additionally, this study will identify key contextual elements that differentiate successful implementation and sustainability of EBP efforts, both within varying levels of a hospital-based clinical setting and across similar hospital settings interested in EBP.

A realist review of interventions and strategies to promote evidence-informed healthcare: A focus on change agency

BackgroundChange agency in its various forms is one intervention aimed at improving the effectiveness of the uptake of evidence. Facilitators, knowledge brokers and opinion leaders are examples of change agency strategies used to promote knowledge utilization. This review adopts a realist approach and addresses the following question: What change agency characteristics work, for whom do they work, in what circumstances and why?MethodsThe literature reviewed spanned the period 1997-2007. Change agency was operationalized as roles that are aimed at effecting successful change in individuals and organizations. A theoretical framework, developed through stakeholder consultation formed the basis for a search for relevant literature. Team members, working in sub groups, independently themed the data and developed chains of inference to form a series of hypotheses regarding change agency and the role of change agency in knowledge use.Results24, 478 electronic references were initially returned from search strategies. Preliminary screening of the article titles reduced the list of potentially relevant papers to 196. A review of full document versions of potentially relevant papers resulted in a final list of 52 papers. The findings add to the knowledge of change agency as they raise issues pertaining to how change agents’ function, how individual change agent characteristics effect evidence-informed health care, the influence of interaction between the change agent and the setting and the overall effect of change agency on knowledge utilization. Particular issues are raised such as how accessibility of the change agent, their cultural compatibility and their attitude mediate overall effectiveness. Findings also indicate the importance of promoting reflection on practice and role modeling. The findings of this study are limited by the complexity and diversity of the change agency literature, poor indexing of literature and a lack of theory-driven approaches.ConclusionThis is the first realist review of change agency. Though effectiveness evidence is weak, change agent roles are evolving, as is the literature, which requires more detailed description of interventions, outcomes measures, the context, intensity, and levels at which interventions are implemented in order to understand how change agent interventions effect evidence-informed health care.

Standards for Reporting Implementation Studies (StaRI) Statement

Implementation studies are often poorly reported and indexed, reducing their potential to inform initiatives to improve healthcare services. The Standards for Reporting Implementation Studies (StaRI) initiative aimed to develop guidelines for transparent and accurate reporting of implementation studies. Informed by the findings of a systematic review and a consensus-building e-Delphi exercise, an international working group of implementation science experts discussed and agreed the StaRI Checklist comprising 27 items. It prompts researchers to describe both the implementation strategy (techniques used to promote implementation of an underused evidence-based intervention) and the effectiveness of the intervention that was being implemented. An accompanying Explanation and Elaboration document (published in BMJ Open, doi:10.1136/bmjopen-2016-013318) details each of the items, explains the rationale, and provides examples of good reporting practice. Adoption of StaRI will improve the reporting of implementation studies, potentially facilitating translation of research into practice and improving the health of individuals and populations.

Evidence into practice: evaluating a child-centred intervention for diabetes medicine management The EPIC Project

BackgroundThere is a lack of high quality, child-centred and effective health information to support development of self-care practices and expertise in children with acute and long-term conditions. In type 1 diabetes, clinical guidelines indicate that high-quality, child-centred information underpins achievement of optimal glycaemic control with the aim of minimising acute readmissions and reducing the risk of complications in later life. This paper describes the development of a range of child-centred diabetes information resources and outlines the study design and protocol for a randomized controlled trial to evaluate the information resources in routine practice. The aim of the diabetes information intervention is to improve children and young peoples quality of life by increasing self-efficacy in managing their type 1 diabetes.Methods/DesignWe used published evidence, undertook qualitative research and consulted with children, young people and key stakeholders to design and produce a range of child-centred, age-appropriate childrens diabetes diaries, carbohydrate recording sheets, and assembled child-centred, age-appropriate diabetes information packs containing published information in a folder that can be personalized by children and young people with pens and stickers. Resources have been designed for children/young people 6-10; 11-15; and 16-18 years.To evaluate the information resources, we designed a pragmatic randomized controlled trial to assess the effectiveness, cost effectiveness, and implementation in routine practice of individually tailored, age-appropriate diabetes diaries and information packs for children and young people age 6-18years, compared with currently available standard practice.Children and young people will be stratified by gender, length of time since diagnosis (< 2years and > 2years) and age (6-10; 11-15; and 16-18 years). The following data will be collected at baseline, 3 and 6 months: PedsQL (generic, diabetes and parent versions), and EQ-5 D (parent and child); NHS resource use and process data (questionnaire and interview). Baseline and subsequent HbA1c measurements, blood glucose meter use, readings and insulin dose will be taken from routine test results and hand-held records when attending routine 3-4 monthly clinic visits.The primary outcome measure is diabetes self-efficacy and quality-of-life (Diabetes PedsQL). Secondary outcomes include: HbA1c, generic quality of life, routinely collected NHS/child-held data, costs, service use, acceptability and utility.Trial RegistrationISRCTN17551624.

Bringing critical realism to nursing practice: Roy Bhaskar's contribution.

In the context of modern nursing practice that is embedded within complex social situations, critical discussions about the contribution of major philosophers are relevant and important. Whilst nurse theorists have advanced and shaped nursing as a discipline, other major philosophers can offer much to advance nursing enquiry. In this paper, we focus on philosopher Roy Bhaskar who, amongst others, developed critical realism, a philosophy for social science which connects with how many of us think about the world. Bhaskars work focuses our attention on the interplay between structure and agency and on the search for the causative or generative mechanisms that explain the social world. Bhaskar was interested in human emancipation, and we suggest his work is of great importance to advance understanding of complex social situations. Critical realism has already been endorsed by a range of disciplines, especially in research which focuses on real problems and acknowledges the complexities of the social world. In recent evidence from healthcare literature, there has been a surge in research using realist methodology (realist evaluation and realist synthesis), which is underpinned by the philosophy of critical realism and which offers a different perspective to understanding nursing and healthcare problems through the realist lens. However, we suggest that sufficient attention is not always paid to the philosophical roots of this methodology. In this paper, we provide insight into Bhaskars work and demonstrate how research positioned within critical realism and realist methodology can advance nursing and healthcare-related knowledge. Through shining a light on Bhaskar, we illustrate how critical realism philosophy is a natural fit with human and health science enquiry, including nursing.

Implementation and trial evidence: a plea for fore-thought

In a world where evidence-based practice is see as the foundation of modern healthcare, this paper asks when and how should we be accounting for the input of patients, the public, dental professionals, commissioners and policy-makers in the evidence generation process?

Do guidelines for treating chest disease in children use Cochrane Reviews effectively? A systematic review

Cochrane Reviews summarise best evidence and should inform guidelines. We assessed the use of Cochrane Reviews in the UK guidelines for paediatric respiratory disease. We found 21 guidelines which made 1025 recommendations, of which 96 could be informed by a Cochrane Review. In 38/96 recommendations (40%), some or all of the relevant Cochrane Reviews were not cited. We linked recommendations to 140 Cochrane Reviews. In 37/140 (26%) cases, the guideline recommendation did not fully agree with the Cochrane Review. Guideline developers may fail to use Cochrane Reviews or may make recommendations which are not in line with best evidence.

Exploring the use of Soft Systems Methodology with realist approaches: A novel way to map programme complexity and develop and refine programme theory:

As the use of realist approaches gains momentum, there is a growing interest in how systems approaches can complement realist thinking. In this article, we discuss how the epistemology of Soft Systems Methodology is compatible with realist approaches. Both Soft Systems Methodology and realist approaches emphasize the necessity to engage stakeholders; through models, the description of contingencies and exploring the intricacies of how complex programmes really work. We outline the key elements of realist approaches and Soft Systems Methodology, and report on two novel case studies. Drawing on our own experiences, we make the case that, used in conjunction with a realist approach, Soft Systems Methodology can provide a useful tool to a) map programme complexity, and b) develop and refine stakeholders programme theories, thus increasing the transparency, reliability, validity and accuracy of the theory building and refining process in realist approaches. We highlight Soft Systems Methodology as a novel companion to realist approaches and detail the first case studies of its use.