Sam Porter

The use and limitation of realistic evaluation as a tool for evidence-based practice: a critical realist perspective

The use and limitation of realistic evaluation as a tool for evidence-based practice: a critical realist perspective In this paper, we assess realistic evaluations articulation with evidence-based practice (EBP) from the perspective of critical realism. We argue that the adoption by realistic evaluation of a realist causal ontology means that it is better placed to explain complex healthcare interventions than the traditional method used by EBP, the randomized controlled trial (RCT). However, we do not conclude from this that the use of RCTs is without merit, arguing that it is possible to use both methods in combination under the rubric of realist theory. More negatively, we contend that the rejection of critical theory and utopianism by realistic evaluation in favour of the pragmatism of piecemeal social engineering means that it is vulnerable to accusations that it promotes technocratic interpretations of human problems. We conclude that, insofar as realistic evaluation adheres to the ontology of critical realism, it provides a sound contribution to EBP, but insofar as it rejects the critical turn of Bhaskars realism, it replicates the technocratic tendencies inherent in EBP.

Management of long-term sickness absence: a systematic realist review

Purpose The increasing impact and costs of long term sickness absence have been well documented. However, the diversity and complexity of interventions and of the contexts in which these take place makes a traditional review problematic. Therefore, we undertook a systematic realist review to identify the dominant programme theories underlying best practice, to assess the evidence for these theories, and to throw light on important enabling or disabling contextual factors. Method A search of the scholarly literature from 1950 to 2011 identified 5,576 articles, of which 269 formed the basis of the review. Results We found that the dominant programme theories in relation to effective management related to: early intervention or referral by employers; having proactive organisational procedures; good communication and cooperation between stakeholders; and workplace-based occupational rehabilitation. Significant contextual factors were identified as the level of support for interventions from top management, the size and structure of the organisation, the level of financial and organisational investment in the management of long-term sickness absence, and the quality of relationships between managers and staff. Conclusions Consequently, those with responsibility for managing absence should bear in mind the contextual factors that are likely to have an impact on interventions, and do what they can to ensure stakeholders have at least a mutual understanding (if not a common purpose) in relation to their perceptions of interventions, goals, culture and practice in the management of long term sickness absence.

Systematic realist review of key factors affecting the successful implementation and sustainability of the Liverpool care pathway for the dying patient.

BACKGROUND The Liverpool Care Pathway (LCP) is recommended internationally as a best practice model for the care of patients and their families at the end of life. However, a recent national audit in the United Kingdom highlighted shortcomings; and understanding is lacking regarding the processes and contextual factors that affect implementation. AIM To identify and investigate factors that help or hinder successful implementation and sustainability of the LCP. METHODS Electronic databases (Medline, CINAHL, British Nursing Index, Science Direct) and grey literature were searched, supplemented by citation tracking, in order to identify English language papers containing information relevant to the implementation of the LCP. Using a realist review approach, we systematically reviewed all relevant studies that focused on end of life care and integrated care pathway processes and identified theories that explained how the LCP and related programmes worked. RESULTS Fifty-eight papers were included in the review. Key factors identified were: a dedicated facilitator, education and training, audit and feedback, organisational culture, and adequate resources. DISCUSSION We discuss how these factors change behaviour by influencing the beliefs, attitudes, motivation and confidence of staff in relation to end of life care, and how contextual factors moderate behaviour change. CONCLUSIONS The implementation process recommended by the developers of the LCP is necessary but not sufficient to ensure successful implementation and sustainability of the pathway. The key components of the intervention (a dedicated facilitator, education and training, audit and feedback) must be configured to influence the beliefs of staff in relation to end of life care, and increase their motivation and self-efficacy in relation to using the LCP. The support of senior managers is vital to the release of necessary resources, and a dominant culture of cure, which sees every death as a failure, works against effective communication and collaboration in relation to the LCP.

The uncritical realism of realist evaluation

This article is a response to Ray Pawson’s critique of critical realism, the philosophy of science elaborated by Roy Bhaskar. I argue with Pawson’s interpretation of critical realism’s positions on both natural and social science and his charges concerning its totalizing ontology, its arrogant epistemology and its naive methodology. The differences between critical realism and realist evaluation are not as significant as Pawson contends. The main differences between the two realisms lie in their approaches to the relationship between social structures and human agency, and between facts and values. I argue that evaluation scientists need to clearly distinguish structure and agency. They should also make their values explicit. The uncritical approach of realist evaluation, combined with its underplaying of the importance of agency, leaves it open to implication in the abuses of bureaucratic instrumentalism.

Music therapy for end-of-life care: an updated systematic review

Background: Music therapy during palliative and end-of-life care is well established and positive benefits for patients have been reported. Aim: Assess the effectiveness of music therapy versus standard care alone or standard care in combination with other therapies for improving psychological, physiological and social outcomes among adult patients in any palliative care setting. Data sources: In order to update an existing Cochrane systematic review, we searched MEDLINE, CINAHL, EMBASE, PsycINFO, CENTRAL, ClinicalTrials.gov register and Current Controlled Trials register to identify randomised or quasi-randomised controlled trials published between 2009 and April 2015. Nine electronic music therapy journals were searched from 2009 until April 2015, along with reference lists and contact was made with key experts in music therapy. Only studies published in English were eligible for inclusion. Two reviewers independently screened titles, abstracts, assessed relevant studies for eligibility, extracted data and judged risk of bias for included studies. Disagreements were resolved through discussion with a third reviewer. Data were synthesised in Revman using the random effects model. Heterogeneity was assessed using I2. Results: Three studies were included in the review. Findings suggest that music therapy may be effective for helping to reduce pain in palliative care patients (standard mean deviation = −0.42, 95% confidence interval = −0.68 to −0.17, p = 0.001). Conclusion: Available evidence did not support the use of music therapy to improve overall quality of life in palliative care. While this review suggests that music therapy may be effective for reducing pain, this is based on studies with a high risk of bias. Further high-quality research is required.

Realist evaluation: an immanent critique

This paper critically analyses realist evaluation, focussing on its primary analytical concepts: mechanisms, contexts, and outcomes. Noting that nursing investigators have had difficulty in operationalizing the concepts of mechanism and context, it is argued that their confusion is at least partially the result of ambiguities, inconsistencies, and contradictions in the realist evaluation model. Problematic issues include the adoption of empiricist and idealist positions, oscillation between determinism and voluntarism, subsumption of agency under structure, and categorical confusion between context and mechanism. In relation to outcomes, it is argued that realist evaluations adoption of the fact/value distinction prevents it from taking into account the concerns of those affected by interventions. The aim of the paper is to use these immanent critiques of realist evaluation to construct an internally consistent realist approach to evaluation that is more amenable to being operationalized by nursing researchers.

Music in mind, a randomized controlled trial of music therapy for young people with behavioural and emotional problems: study protocol.

AIMS This article is a report of a trial protocol to determine if improvizational music therapy leads to clinically significant improvement in communication and interaction skills for young people experiencing social, emotional or behavioural problems. BACKGROUND Music therapy is often considered an effective intervention for young people experiencing social, emotional or behavioural difficulties. However, this assumption lacks empirical evidence. STUDY DESIGN Music in mind is a multi-centred single-blind randomized controlled trial involving 200 young people (aged 8-16 years) and their parents. Eligible participants will have a working diagnosis within the ambit of international classification of disease 10 mental and behavioural disorders and will be recruited over 15 months from six centres within the Child and Adolescent Mental Health Services of a large health and social care trust in Northern Ireland. Participants will be randomly allocated in a 1:1 ratio to receive standard care alone or standard care plus 12 weekly music therapy sessions delivered by the Northern Ireland Music Therapy Trust. Baseline data will be collected from young people and their parents using standardized outcome measures for communicative and interaction skills (primary endpoint), self-esteem, social functioning, depression and family functioning. Follow-up data will be collected 1 and 13 weeks after the final music therapy session. A cost-effectiveness analysis will also be carried out. DISCUSSION This study will be the largest trial to date examining the effect of music therapy on young people experiencing social, emotional or behavioural difficulties and will provide empirical evidence for the use of music therapy among this population. Trial registration. This study is registered in the ISRCTN Register, ISRCTN96352204. Ethical approval was gained in October 2010.

Factors affecting the successful implementation and sustainability of the Liverpool Care Pathway for dying patients: a realist evaluation

Objectives The Liverpool Care Pathway (LCP) for the dying patient was designed to improve end-of-life care in generalist healthcare settings. Controversy has led to its withdrawal in some jurisdictions. The main objective of this research was to identify the influences that facilitated or hindered successful LCP implementation. Method An organisational case study using realist evaluation in one health and social care trust in Northern Ireland. Two rounds of semistructured interviews were conducted with two policymakers and 22 participants with experience and/or involvement in management of the LCP during 2011 and 2012. Results Key resource inputs included facilitation with a view to maintaining LCP ‘visibility’, reducing anxiety among nurses and increasing their confidence regarding the delivery of end-of-life care; and nurse and medical education designed to increase professional self-efficacy, and reduce misuse and misunderstanding of the LCP. Key enabling contexts were consistent senior management support; ongoing education and training tailored to the needs of each professional group; and an organisational cultural change in the hospital setting that encompassed end-of-life care. Conclusions There is a need to appreciate the organisationally complex nature of intervening to improve end-of-life care. Successful implementation of evidence-based interventions for end-of-life care requires commitment to planning, training and ongoing review that takes account of different perspectives, institutional hierarchies and relationships, and the educational needs of professional disciplines. There is a need also to recognise that medical consultants require particular support in their role as gatekeepers and as a lead communication channel with patients and their relatives.

Music therapy for palliative care: A realist review

OBJECTIVE Music therapy has experienced a rising demand as an adjunct therapy for symptom management among palliative care patients. We conducted a realist review of the literature to develop a greater understanding of how music therapy might benefit palliative care patients and the contextual mechanisms that promote or inhibit its successful implementation. METHOD We searched electronic databases (CINAHL, Embase, Medline, and PsychINFO) for literature containing information on music therapy for palliative care. In keeping with the realist approach, we examined all relevant literature to develop theories that could explain how music therapy works. RESULTS A total of 51 articles were included in the review. Music therapy was found to have a therapeutic effect on the physical, psychological, emotional, and spiritual suffering of palliative care patients. We also identified program mechanisms that help explain music therapys therapeutic effects, along with facilitating contexts for implementation. SIGNIFICANCE OF RESULTS Music therapy may be an effective nonpharmacological approach to managing distressing symptoms in palliative care patients. The findings also suggest that group music therapy may be a cost-efficient and effective way to support staff caring for palliative care patients. We encourage others to continue developing the evidence base in order to expand our understanding of how music therapy works, with the aim of informing and improving the provision of music therapy for palliative care patients.

Recruiting Participants for Randomized Controlled Trials of Music Therapy: A Practical Illustration

BACKGROUND Failure to recruit sufficient numbers of participants to randomized controlled trials is a common and serious problem. This problem may be additionally acute in music therapy research. OBJECTIVE To use the experience of conducting a large randomized controlled trial of music therapy for young people with emotional and behavioral difficulties to illustrate the strategies that can be used to optimize recruitment; to report on the success or otherwise of those strategies; and to draw general conclusions about the most effective approaches. METHODS Review of the methodological literature, and a narrative account and realist analysis of the recruitment process. RESULTS The strategies adopted led to the achievement of the recruitment target of 250 subjects, but only with an extension to the recruitment period. In the pre-protocol stage of the research, these strategies included the engagement of non-music therapy clinical investigators, and extensive consultation with clinical stakeholders. In the protocol development and initial recruitment stages, they involved a search of systematic reviews of factors leading to under-recruitment and of interventions to promote recruitment, and the incorporation of their insights into the research protocol and practices. In the latter stages of recruitment, various stakeholders including clinicians, senior managers and participant representatives were consulted in an attempt to uncover the reasons for the low recruitment levels that the research was experiencing. CONCLUSIONS The primary mechanisms to promote recruitment are education, facilitation, audit and feedback, and time allowed. The primary contextual factors affecting the effectiveness of these mechanisms are professional culture and organizational support.