Kate Seers

Evaluating the successful implementation of evidence into practice using the PARiHS framework: theoretical and practical challenges

BackgroundThe PARiHS framework (Promoting Action on Research Implementation in Health Services) has proved to be a useful practical and conceptual heuristic for many researchers and practitioners in framing their research or knowledge translation endeavours. However, as a conceptual framework it still remains untested and therefore its contribution to the overall development and testing of theory in the field of implementation science is largely unquantified.DiscussionThis being the case, the paper provides an integrated summary of our conceptual and theoretical thinking so far and introduces a typology (derived from social policy analysis) used to distinguish between the terms conceptual framework, theory and model – important definitional and conceptual issues in trying to refine theoretical and methodological approaches to knowledge translation.Secondly, the paper describes the next phase of our work, in particular concentrating on the conceptual thinking and mapping that has led to the generation of the hypothesis that the PARiHS framework is best utilised as a two-stage process: as a preliminary (diagnostic and evaluative) measure of the elements and sub-elements of evidence (E) and context (C), and then using the aggregated data from these measures to determine the most appropriate facilitation method. The exact nature of the intervention is thus determined by the specific actors in the specific context at a specific time and place.In the process of refining this next phase of our work, we have had to consider the wider issues around the use of theories to inform and shape our research activity; the ongoing challenges of developing robust and sensitive measures; facilitation as an intervention for getting research into practice; and finally to note how the current debates around evidence into practice are adopting wider notions that fit innovations more generally.SummaryThe paper concludes by suggesting that the future direction of the work on the PARiHS framework is to develop a two-stage diagnostic and evaluative approach, where the intervention is shaped and moulded by the information gathered about the specific situation and from participating stakeholders. In order to expedite the generation of new evidence and testing of emerging theories, we suggest the formation of an international research implementation science collaborative that can systematically collect and analyse experiences of using and testing the PARiHS framework and similar conceptual and theoretical approaches.We also recommend further refinement of the definitions around conceptual framework, theory, and model, suggesting a wider discussion that embraces multiple epistemological and ontological perspectives.

Ingredients for change: revisiting a conceptual framework

Finding ways to deliver care based on the best possible evidence remains an ongoing challenge. Further theoretical developments of a conceptual framework are presented which influence the uptake of evidence into practice. A concept analysis has been conducted on the key elements of the framework—evidence, context, and facilitation—leading to refinement of the framework. While these three essential elements remain key to the process of implementation, changes have been made to their constituent sub-elements, enabling the detail of the framework to be revised. The concept analysis has shown that the relationship between the elements and sub-elements and their relative importance need to be better understood when implementing evidence based practice. Increased understanding of these relationships would help staff to plan more effective change strategies. Anecdotal reports suggest that the framework has a good level of validity. It is planned to develop it into a practical tool to aid those involved in planning, implementing, and evaluating the impact of changes in health care.

Systematic review of the use of honey as a wound dressing

ObjectiveTo investigate topical honey in superficial burns and wounds though a systematic review of randomised controlled trials.Data sourcesCochrane Library, MEDLINE, EMBASE, PubMed, reference lists and databases were used to seek randomised controlled trials. Seven randomised trials involved superficial burns, partial thickness burns, moderate to severe burns that included full thickness injury, and infected postoperative wounds.Review methodsStudies were randomised trials using honey, published papers, with a comparator. Main outcomes were relative benefit and number-needed-to-treat to prevent an outcome relating to wound healing time or infection rate.ResultsOne study in infected postoperative wounds compared honey with antiseptics plus systemic antibiotics. The number needed to treat with honey for good wound healing compared with antiseptic was 2.9 (95% confidence interval 1.7 to 9.7). Five studies in patients with partial thickness or superficial burns involved less than 40% of the body surface. Comparators were polyurethane film, amniotic membrane, potato peel and silver sulphadiazine. The number needed to treat for seven days with honey to produce one patient with a healed burn was 2.6 (2.1 to 3.4) compared with any other treatment and 2.7 (2.0 to 4.1) compared with potato and amniotic membrane. For some or all outcomes honey was superior to all these treatments. Time for healing was significantly shorter for honey than all these treatments. The quality of studies was low.ConclusionConfidence in a conclusion that honey is a useful treatment for superficial wounds or burns is low. There is biological plausibility.

The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework

BackgroundThe case has been made for more and better theory-informed process evaluations within trials in an effort to facilitate insightful understandings of how interventions work. In this paper, we provide an explanation of implementation processes from one of the first national implementation research randomized controlled trials with embedded process evaluation conducted within acute care, and a proposed extension to the Promoting Action on Research Implementation in Health Services (PARIHS) framework.MethodsThe PARIHS framework was prospectively applied to guide decisions about intervention design, data collection, and analysis processes in a trial focussed on reducing peri-operative fasting times. In order to capture a holistic picture of implementation processes, the same data were collected across 19 participating hospitals irrespective of allocation to intervention. This paper reports on findings from data collected from a purposive sample of 151 staff and patients pre- and post-intervention. Data were analysed using content analysis within, and then across data sets.ResultsA robust and uncontested evidence base was a necessary, but not sufficient condition for practice change, in that individual staff and patient responses such as caution influenced decision making. The implementation context was challenging, in which individuals and teams were bounded by professional issues, communication challenges, power and a lack of clarity for the authority and responsibility for practice change. Progress was made in sites where processes were aligned with existing initiatives. Additionally, facilitators reported engaging in many intervention implementation activities, some of which result in practice changes, but not significant improvements to outcomes.ConclusionsThis study provided an opportunity for reflection on the comprehensiveness of the PARIHS framework. Consistent with the underlying tenant of PARIHS, a multi-faceted and dynamic story of implementation was evident. However, the prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the framework. We propose that successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice. This proposal will enhance the potential of the PARIHS framework for explanation, and ensure theoretical development both informs and responds to the evidence base for implementation.Trial registrationISRCTN18046709 - Peri-operative Implementation Study Evaluation (PoISE).

FIRE (Facilitating Implementation of Research Evidence): a study protocol.

BackgroundResearch evidence underpins best practice, but is not always used in healthcare. The Promoting Action on Research Implementation in Health Services (PARIHS) framework suggests that the nature of evidence, the context in which it is used, and whether those trying to use evidence are helped (or facilitated) affect the use of evidence. Urinary incontinence has a major effect on quality of life of older people, has a high prevalence, and is a key priority within European health and social care policy. Improving continence care has the potential to improve the quality of life for older people and reduce the costs associated with providing incontinence aids.ObjectivesThis study aims to advance understanding about the contribution facilitation can make to implementing research findings into practice via: extending current knowledge of facilitation as a process for translating research evidence into practice; evaluating the feasibility, effectiveness, and cost-effectiveness of two different models of facilitation in promoting the uptake of research evidence on continence management; assessing the impact of contextual factors on the processes and outcomes of implementation; and implementing a pro-active knowledge transfer and dissemination strategy to diffuse study findings to a wide policy and practice community.Setting and sampleFour European countries, each with six long-term nursing care sites (total 24 sites) for people aged 60 years and over with documented urinary incontinenceMethods and designPragmatic randomised controlled trial with three arms (standard dissemination and two different programmes of facilitation), with embedded process and economic evaluation. The primary outcome is compliance with the continence recommendations. Secondary outcomes include proportion of residents with incontinence, incidence of incontinence-related dermatitis, urinary tract infections, and quality of life. Outcomes are assessed at baseline, then at 6, 12, 18, and 24 months after the start of the facilitation interventions. Detailed contextual and process data are collected throughout, using interviews with staff, residents and next of kin, observations, assessment of context using the Alberta Context Tool, and documentary evidence. A realistic evaluation framework is used to develop explanatory theory about what works for whom in what circumstances.Trial registrationCurrent Controlled Trials ISRCTN11598502.

'Trying to pin down jelly' - exploring intuitive processes in quality assessment for meta-ethnography

BackgroundStudies that systematically search for and synthesise qualitative research are becoming more evident in health care, and they can make an important contribution to patient care. However, there is still no agreement as to whether, or how we should appraise studies for inclusion. We aimed to explore the intuitive processes that determined the ‘quality’ of qualitative research for inclusion in qualitative research syntheses. We were particularly interested to explore the way that knowledge was constructed.MethodsWe used qualitative methods to explore the process of quality appraisal within a team of seven qualitative researchers funded to undertake a meta-ethnography of chronic non-malignant musculoskeletal pain. Team discussions took place monthly between October 2010 and June 2012 and were recorded and transcribed. Data was coded and organised using constant comparative method. The development of our conceptual analysis was both iterative and collaborative. The strength of this team approach to quality came from open and honest discussion, where team members felt free to agree, disagree, or change their position within the safety of the group.ResultsWe suggest two core facets of quality for inclusion in meta-ethnography - (1) Conceptual clarity; how clearly has the author articulated a concept that facilitates theoretical insight. (2) Interpretive rigour; fundamentally, can the interpretation ‘be trusted?’ Our findings showed that three important categories help the reader to judge interpretive rigour: (ii) What is the context of the interpretation? (ii) How inductive is the interpretation? (iii) Has the researcher challenged their interpretation?ConclusionsWe highlight that methods alone do not determine the quality of research for inclusion into a meta-ethnography. The strength of a concept and its capacity to facilitate theoretical insight is integral to meta-ethnography, and arguably to the quality of research. However, we suggest that to be judged ‘good enough’ there also needs to be some assurance that qualitative findings are more than simply anecdotal. Although our conceptual model was developed specifically for meta-ethnography, it may be transferable to other research methodologies.

GRIPP2 reporting checklists: tools to improve reporting of patient and public involvement in research

BackgroundWhile the patient and public involvement (PPI) evidence base has expanded over the past decade, the quality of reporting within papers is often inconsistent, limiting our understanding of how it works, in what context, for whom, and why.ObjectiveTo develop international consensus on the key items to report to enhance the quality, transparency, and consistency of the PPI evidence base. To collaboratively involve patients as research partners at all stages in the development of GRIPP2.MethodsThe EQUATOR method for developing reporting guidelines was used. The original GRIPP (Guidance for Reporting Involvement of Patients and the Public) checklist was revised, based on updated systematic review evidence. A three round Delphi survey was used to develop consensus on items to be included in the guideline. A subsequent face-to-face meeting produced agreement on items not reaching consensus during the Delphi process.ResultsOne hundred forty-three participants agreed to participate in round one, with an 86% (123/143) response for round two and a 78% (112/143) response for round three. The Delphi survey identified the need for long form (LF) and short form (SF) versions. GRIPP2-LF includes 34 items on aims, definitions, concepts and theory, methods, stages and nature of involvement, context, capture or measurement of impact, outcomes, economic assessment, and reflections and is suitable for studies where the main focus is PPI. GRIPP2-SF includes five items on aims, methods, results, outcomes, and critical perspective and is suitable for studies where PPI is a secondary focus.ConclusionsGRIPP2-LF and GRIPP2-SF represent the first international evidence based, consensus informed guidance for reporting patient and public involvement in research. Both versions of GRIPP2 aim to improve the quality, transparency, and consistency of the international PPI evidence base, to ensure PPI practice is based on the best evidence. In order to encourage its wide dissemination this article is freely accessible on The BMJ and Research Involvement and Engagement journal websites.

Meta-ethnography 25 years on: challenges and insights for synthesising a large number of qualitative studies

Studies that systematically search for and synthesise qualitative research are becoming more evident in health care, and they can make an important contribution to patient care. Our team was funded to complete a meta-ethnography of patients’ experience of chronic musculoskeletal pain. It has been 25 years since Noblit and Hare published their core text on meta-ethnography, and the current health research environment brings additional challenges to researchers aiming to synthesise qualitative research. Noblit and Hare propose seven stages of meta-ethnography which take the researcher from formulating a research idea to expressing the findings. These stages are not discrete but form part of an iterative research process. We aimed to build on the methods of Noblit and Hare and explore the challenges of including a large number of qualitative studies into a qualitative systematic review. These challenges hinge upon epistemological and practical issues to be considered alongside expectations about what determines high quality research. This paper describes our method and explores these challenges. Central to our method was the process of collaborative interpretation of concepts and the decision to exclude original material where we could not decipher a concept. We use excerpts from our research team’s reflexive statements to illustrate the development of our methods.

Systematic review of enriched enrolment, randomised withdrawal trial designs in chronic pain: a new framework for design and reporting.

Abstract Enriched enrolment, randomised withdrawal (EERW) pain trials select, before randomisation, patients who respond by demonstrating a predetermined degree of pain relief and acceptance of adverse events. There is uncertainty over the value of this design. We report a systematic review of EERW trials in chronic noncancer pain together with a critical appraisal of methods and potential biases in the methods used and recommendations for the design and reporting of future EERW trials. Electronic and other searches found 25 EERW trials published between 1995 and June 2014, involving 5669 patients in a randomised withdrawal phase comparing drug with placebo; 13 (median, 107 patients) had a randomised withdrawal phase of 6 weeks or less, and 12 (median, 334) lasted 12 to 26 weeks. Risks of bias included short duration, inadequate outcome definition, incomplete outcome data reporting, small size, and inadequate dose tapering on randomisation to placebo. Active treatment was usually better than placebo (22/25 trials). This review reduces the uncertainty around the value of EERW trials in pain. If properly designed, conducted, and reported, they are feasible and useful for making decisions about pain therapies. Shorter, small studies can be explanatory; longer, larger studies can inform practice. Current evidence is inadequate for valid comparisons in outcome between EERW and classical trials, although no gross differences were found. This systematic review provides a framework for assessing potential biases and the value of the EERW trials, and for the design of future studies by making recommendations for the conduct and reporting of EERW trials.

A pragmatic cluster randomised trial evaluating three implementation interventions

BackgroundImplementation research is concerned with bridging the gap between evidence and practice through the study of methods to promote the uptake of research into routine practice. Good quality evidence has been summarised into guideline recommendations to show that peri-operative fasting times could be considerably shorter than patients currently experience. The objective of this trial was to evaluate the effectiveness of three strategies for the implementation of recommendations about peri-operative fasting.MethodsA pragmatic cluster randomised trial underpinned by the PARIHS framework was conducted during 2006 to 2009 with a national sample of UK hospitals using time series with mixed methods process evaluation and cost analysis. Hospitals were randomised to one of three interventions: standard dissemination (SD) of a guideline package, SD plus a web-based resource championed by an opinion leader, and SD plus plan-do-study-act (PDSA). The primary outcome was duration of fluid fast prior to induction of anaesthesia. Secondary outcomes included duration of food fast, patients’ experiences, and stakeholders’ experiences of implementation, including influences. ANOVA was used to test differences over time and interventions.ResultsNineteen acute NHS hospitals participated. Across timepoints, 3,505 duration of fasting observations were recorded. No significant effect of the interventions was observed for either fluid or food fasting times. The effect size was 0.33 for the web-based intervention compared to SD alone for the change in fluid fasting and was 0.12 for PDSA compared to SD alone. The process evaluation showed different types of impact, including changes to practices, policies, and attitudes. A rich picture of the implementation challenges emerged, including inter-professional tensions and a lack of clarity for decision-making authority and responsibility.ConclusionsThis was a large, complex study and one of the first national randomised controlled trials conducted within acute care in implementation research. The evidence base for fasting practice was accepted by those participating in this study and the messages from it simple; however, implementation and practical challenges influenced the interventions’ impact. A set of conditions for implementation emerges from the findings of this study, which are presented as theoretically transferable propositions that have international relevance.Trial registrationISRCTN18046709 - Peri-operative Implementation Study Evaluation (POISE).