Claire Hawkes

The role of evidence, context, and facilitation in an implementation trial: implications for the development of the PARIHS framework

BackgroundThe case has been made for more and better theory-informed process evaluations within trials in an effort to facilitate insightful understandings of how interventions work. In this paper, we provide an explanation of implementation processes from one of the first national implementation research randomized controlled trials with embedded process evaluation conducted within acute care, and a proposed extension to the Promoting Action on Research Implementation in Health Services (PARIHS) framework.MethodsThe PARIHS framework was prospectively applied to guide decisions about intervention design, data collection, and analysis processes in a trial focussed on reducing peri-operative fasting times. In order to capture a holistic picture of implementation processes, the same data were collected across 19 participating hospitals irrespective of allocation to intervention. This paper reports on findings from data collected from a purposive sample of 151 staff and patients pre- and post-intervention. Data were analysed using content analysis within, and then across data sets.ResultsA robust and uncontested evidence base was a necessary, but not sufficient condition for practice change, in that individual staff and patient responses such as caution influenced decision making. The implementation context was challenging, in which individuals and teams were bounded by professional issues, communication challenges, power and a lack of clarity for the authority and responsibility for practice change. Progress was made in sites where processes were aligned with existing initiatives. Additionally, facilitators reported engaging in many intervention implementation activities, some of which result in practice changes, but not significant improvements to outcomes.ConclusionsThis study provided an opportunity for reflection on the comprehensiveness of the PARIHS framework. Consistent with the underlying tenant of PARIHS, a multi-faceted and dynamic story of implementation was evident. However, the prominent role that individuals played as part of the interaction between evidence and context is not currently explicit within the framework. We propose that successful implementation of evidence into practice is a planned facilitated process involving an interplay between individuals, evidence, and context to promote evidence-informed practice. This proposal will enhance the potential of the PARIHS framework for explanation, and ensure theoretical development both informs and responds to the evidence base for implementation.Trial registrationISRCTN18046709 - Peri-operative Implementation Study Evaluation (PoISE).

FIRE (Facilitating Implementation of Research Evidence): a study protocol.

BackgroundResearch evidence underpins best practice, but is not always used in healthcare. The Promoting Action on Research Implementation in Health Services (PARIHS) framework suggests that the nature of evidence, the context in which it is used, and whether those trying to use evidence are helped (or facilitated) affect the use of evidence. Urinary incontinence has a major effect on quality of life of older people, has a high prevalence, and is a key priority within European health and social care policy. Improving continence care has the potential to improve the quality of life for older people and reduce the costs associated with providing incontinence aids.ObjectivesThis study aims to advance understanding about the contribution facilitation can make to implementing research findings into practice via: extending current knowledge of facilitation as a process for translating research evidence into practice; evaluating the feasibility, effectiveness, and cost-effectiveness of two different models of facilitation in promoting the uptake of research evidence on continence management; assessing the impact of contextual factors on the processes and outcomes of implementation; and implementing a pro-active knowledge transfer and dissemination strategy to diffuse study findings to a wide policy and practice community.Setting and sampleFour European countries, each with six long-term nursing care sites (total 24 sites) for people aged 60 years and over with documented urinary incontinenceMethods and designPragmatic randomised controlled trial with three arms (standard dissemination and two different programmes of facilitation), with embedded process and economic evaluation. The primary outcome is compliance with the continence recommendations. Secondary outcomes include proportion of residents with incontinence, incidence of incontinence-related dermatitis, urinary tract infections, and quality of life. Outcomes are assessed at baseline, then at 6, 12, 18, and 24 months after the start of the facilitation interventions. Detailed contextual and process data are collected throughout, using interviews with staff, residents and next of kin, observations, assessment of context using the Alberta Context Tool, and documentary evidence. A realistic evaluation framework is used to develop explanatory theory about what works for whom in what circumstances.Trial registrationCurrent Controlled Trials ISRCTN11598502.

Epidemiology and outcomes from out-of-hospital cardiac arrests in England

INTRODUCTION This study reports the epidemiology and outcomes from out-of-hospital cardiac arrest (OHCA) in England during 2014. METHODS Prospective observational study from the national OHCA registry. The incidence, demographic and outcomes of patients who were treated for an OHCA between 1st January 2014 and 31st December 2014 in 10 English ambulance service (EMS) regions, serving a population of almost 54 million, are reported in accordance with Utstein recommendations. RESULTS 28,729 OHCA cases of EMS treated cardiac arrests were reported (53 per 100,000 of resident population). The mean age was 68.6 (SD=19.6) years and 41.3% were female. Most (83%) occurred in a place of residence, 52.7% were witnessed by either the EMS or a bystander. In non-EMS witnessed cases, 55.2% received bystander CPR whilst public access defibrillation was used rarely (2.3%). Cardiac aetiology was the leading cause of cardiac arrest (60.9%). The initial rhythm was asystole in 42.4% of all cases and was shockable (VF or pVT) in 20.6%. Return of spontaneous circulation at hospital transfer was evident in 25.8% (n=6302) and survival to hospital discharge was 7.9%. CONCLUSION Cardiac arrest is an important cause of death in England. With less than one in ten patients surviving, there is scope to improve outcomes. Survival rates were highest amongst those who received bystander CPR and public access defibrillation.

A pragmatic cluster randomised trial evaluating three implementation interventions

BackgroundImplementation research is concerned with bridging the gap between evidence and practice through the study of methods to promote the uptake of research into routine practice. Good quality evidence has been summarised into guideline recommendations to show that peri-operative fasting times could be considerably shorter than patients currently experience. The objective of this trial was to evaluate the effectiveness of three strategies for the implementation of recommendations about peri-operative fasting.MethodsA pragmatic cluster randomised trial underpinned by the PARIHS framework was conducted during 2006 to 2009 with a national sample of UK hospitals using time series with mixed methods process evaluation and cost analysis. Hospitals were randomised to one of three interventions: standard dissemination (SD) of a guideline package, SD plus a web-based resource championed by an opinion leader, and SD plus plan-do-study-act (PDSA). The primary outcome was duration of fluid fast prior to induction of anaesthesia. Secondary outcomes included duration of food fast, patients’ experiences, and stakeholders’ experiences of implementation, including influences. ANOVA was used to test differences over time and interventions.ResultsNineteen acute NHS hospitals participated. Across timepoints, 3,505 duration of fasting observations were recorded. No significant effect of the interventions was observed for either fluid or food fasting times. The effect size was 0.33 for the web-based intervention compared to SD alone for the change in fluid fasting and was 0.12 for PDSA compared to SD alone. The process evaluation showed different types of impact, including changes to practices, policies, and attitudes. A rich picture of the implementation challenges emerged, including inter-professional tensions and a lack of clarity for decision-making authority and responsibility.ConclusionsThis was a large, complex study and one of the first national randomised controlled trials conducted within acute care in implementation research. The evidence base for fasting practice was accepted by those participating in this study and the messages from it simple; however, implementation and practical challenges influenced the interventions’ impact. A set of conditions for implementation emerges from the findings of this study, which are presented as theoretically transferable propositions that have international relevance.Trial registrationISRCTN18046709 - Peri-operative Implementation Study Evaluation (POISE).

Clinical guideline for nurse-led early extubation after coronary artery bypass: an evaluation.

AIM This paper is a report of an investigation of the development, implementation and outcomes of a clinical guideline for nurse-led early extubation of adult coronary artery bypass graft patients. BACKGROUND Healthcare knowledge translation and utilization is an emerging but under-developed research area. The complex context for guideline development and use is methodologically challenging for robust and rigorous evaluation. This study contributes one such evaluation. METHODS This was a mixed methods evaluation, with a dominant quantitative study with a secondary qualitative study in a single UK cardiac surgery centre. An interrupted time series study (N = 567 elective coronary artery bypass graft patients) with concurrent within person controls was used to measure the impact of the guideline on the primary outcome: time to extubation. Semi-structured interviews with 11 clinical staff, informed by applied practitioner ethnography, explored the process of guideline development and implementation. The data were collected between January 2001 and January 2003. RESULTS There was no change in the interrupted time series study primary outcome as a consequence of the guideline implementation. The qualitative study identified three themes: context, process and tensions highlighting that the guideline did not require clinicians to change their practice, although it may have helped maintain practice through its educative role. CONCLUSION Further investigation and development of appropriate methods to capture the dynamism in healthcare contexts and its impact on guideline implementation seems warranted. Multi-site mixed methods investigations and programmes of research exploring knowledge translation and utilization initiatives, such as guideline implementation, are needed.

Fracture in the Elderly Multidisciplinary Rehabilitation (FEMuR): study protocol for a phase II randomised feasibility study of a multidisciplinary rehabilitation package following hip fracture [ISRCTN22464643]

BackgroundProximal femoral fracture is a common, major health problem in old age resulting in loss of functional independence and a high-cost burden on society, with estimated health and social care costs of £2.3 billion per year in the UK. Rehabilitation has the potential to maximise functional recovery and maintain independent living, but evidence of effectiveness is lacking. Usual rehabilitation care is delivered by a multi-disciplinary team in the hospital and in the community. An ‘enhanced rehabilitation’ intervention has been developed consisting of a workbook, goal-setting diary and extra therapy sessions, designed to improve self-efficacy and increase the amount and quality of the practice of physical exercise and activities of daily living.Methods/designThis paper describes the design of a phase II study comprising an anonymous cohort of all proximal femoral fracture patients admitted to the three acute hospitals in Betsi Cadwaladr University Health Board over a 6-month period with a randomised feasibility study comparing the enhanced rehabilitation intervention with usual care. These will assess the feasibility of a future definitive randomised controlled trial and concurrent economic evaluation in terms of recruitment, retention, outcome measure completion, compliance with the intervention and fidelity of delivery, health service use data, willingness to be randomised and effect size for a future sample size calculation. Focus groups will provide qualitative data to contribute to the assessment of the acceptability of the intervention amongst patients, carers and rehabilitation professionals and the feasibility of delivering the planned intervention. The primary outcome measure is function assessed by the Barthel Index. Secondary outcomes measure the ability to perform activities of daily living, anxiety and depression, potential mediators of outcomes such as hip pain, self-efficacy and fear of falling, health utility, health service use, objectively assessed physical function and adverse events. Participants’ preference for rehabilitation services will be assessed in a discrete choice experiment.DiscussionPhase II studies are an opportunity to not only assess the feasibility of trial methods but also to compare different methods of outcome measurement and novel methods of obtaining health service use data from routinely collected patient information.Trial registrationCurrent Controlled Trials ISRCTN22464643, UKCRN16677.

Fracture in the Elderly Multidisciplinary Rehabilitation (FEMuR): A phase II randomised feasibility study of a multidisciplinary rehabilitation package following hip fracture

Objective To conduct a rigorous feasibility study for a future definitive parallel-group randomised controlled trial (RCT) and economic evaluation of an enhanced rehabilitation package for hip fracture. Setting Recruitment from 3 acute hospitals in North Wales. Intervention delivery in the community. Participants Older adults (aged ≥65) who received surgical treatment for hip fracture, lived independently prior to fracture, had mental capacity (assessed by clinical team) and received rehabilitation in the North Wales area. Intervention Remote randomisation to usual care (control) or usual care+enhanced rehabilitation package (intervention), including six additional home-based physiotherapy sessions delivered by a physiotherapist or technical instructor, novel information workbook and goal-setting diary. Primary and secondary outcome measures Primary: Barthel Activities of Daily Living (BADL). Secondary measures included Nottingham Extended Activities of Daily Living scale (NEADL), EQ-5D, ICECAP capability, a suite of self-efficacy, psychosocial and service-use measures and costs. Outcome measures were assessed at baseline and 3-month follow-up by blinded researchers. Results 62 participants were recruited, 61 randomised (control 32; intervention 29) and 49 (79%) completed 3-month follow-up. Minimal differences occurred between the 2 groups for most outcomes, including BADL (adjusted mean difference 0.5). The intervention group showed a medium-sized improvement in the NEADL relative to the control group, with an adjusted mean difference between groups of 3.0 (Cohens d 0.63), and a trend for greater improvement in self-efficacy and mental health, but with small effect sizes. The mean cost of delivering the intervention was £231 per patient. There was a small relative improvement in quality-adjusted life year in the intervention group. No serious adverse events relating to the intervention were reported. Conclusions The trial methods were feasible in terms of eligibility, recruitment and retention. The effectiveness and cost-effectiveness of the rehabilitation package should be tested in a phase III RCT. Trial registration number ISRCTN22464643; Results.

Development of an evidence-based complex intervention for community rehabilitation of patients with hip fracture using realist review, survey and focus groups

Objectives To develop an evidence and theory-based complex intervention for improving outcomes in elderly patients following hip fracture. Design Complex-intervention development (Medical Research Council (MRC) framework phase I) using realist literature review, surveys and focus groups of patients and rehabilitation teams. Setting North Wales. Participants Surveys of therapy managers (n=13), community and hospital-based physiotherapists (n=129) and occupational therapists (n=68) throughout the UK. Focus groups with patients (n=13), their carers (n=4) and members of the multidisciplinary rehabilitation teams in North Wales (n=13). Results The realist review provided understanding of how rehabilitation interventions work in the real-world context and three programme theories were developed: improving patient engagement by tailoring the intervention to individual needs; reducing fear of falling and improving self-efficacy to exercise and perform activities of daily living; and coordination of rehabilitation delivery. The survey provided context about usual rehabilitation practice; focus groups provided data on the experience, acceptability and feasibility of rehabilitation interventions. An intervention to enhance usual rehabilitation was developed to target these theory areas comprising: a physical component consisting of six additional therapy sessions; and a psychological component consisting of a workbook to enhance self-efficacy and a patient-held goal-setting diary for self-monitoring. Conclusions A realist approach may have advantages in the development of evidence-based interventions and can be used in conjunction with other established methods to contribute to the development of potentially more effective interventions. A rehabilitation intervention was developed which can be tested in a future randomised controlled trial (MRC framework phases II and III). Trial registration number ISRCTN22464643, Pre-results.

Data quality and 30-day survival for out-of-hospital cardiac arrest in the UK out-of-hospital cardiac arrest registry: a data linkage study

Objectives The Out-of-Hospital Cardiac Arrest Outcomes (OHCAO) project aims to understand the epidemiology and outcomes of out-of-hospital cardiac arrest (OHCA) across the UK. This data linkage study is a subproject of OHCAO. The aim was to establish the feasibility of linking OHCAO data to National Health Service (NHS) patient demographic data and Office for National Statistics (ONS) date of death data held on the NHS Personal Demographics Service (PDS) database to improve OHCAO demographic data quality and enable analysis of 30-day survival from OHCA. Design and setting Data were collected from 1 January 2014 to 31 December 2014 as part of a prospective, observational study of OHCA attended by 10 English NHS Ambulance Services. 28 729 OHCA cases had resuscitation attempted by Emergency Medical Services and were included in the study. Data linkage was carried out using a data linkage service provided by NHS Digital, a national provider of health-related data. To assess data linkage feasibility a random sample of 3120 cases was selected. The sample was securely transferred to NHS Digital to be matched using OHCAO patient demographic data to return previously missing demographic data and provide ONS date of death data. Results A total of 2513 (80.5%) OHCAO cases were matched to patients in the NHS PDS database. Using the linkage process, missing demographic data were retrieved for 1636 (72.7%) out of 2249 OHCAO cases that had previously incomplete demographic data. Returned ONS date of death data allowed analysis of 30-day survival status. The results showed a 30-day survival rate of 9.3%, reducing unknown survival status from 46.1% to 8.5%. Conclusions In this sample, data linkage between the OHCAO registry and NHS PDS database was shown to be feasible, improving demographic data quality and allowing analysis of 30-day survival status.

The size of the problem

have direct knowledge, is the size of the problem. There were certified for employment in the City of New York last year, the year ending July 31, nearly 52,000 children, under the age of sixteen years, to all of whom was issued what is known as a regular employment certificate. In addition there were issued during the months of July and August nearly ^6,000 vacation employment certificates. Any child over fourteen years of age who can prove that fact and who is in normally good health can obtain such vacation employment certificate. Of this large number of children who leave school to work the greater portion come from graduates of elementary schools and from children attending high schools. Until a few years -ago, the preponderance lay in the other direction, and the young people who obtained employment certificates came principally from the seventh and eighth grades of the elementary school. The emphasis has since been shifted. In 1920 somewhat more than 32,000 certificates were issued to elementary graduates and high school students and somewhat less than 20,000 were issued to children of the seventh and eighth grades. This does not of course include high school students above the age of sixteen who are likel to work in the summer without certificates. In the high schools there are now registered some 78,000 students, and of this number ab ut one-third are over sixteen years of ge.