Mary Godfrey

An evaluation tool to assess the quality of qualitative research studies

Critical appraisal of research studies forms a central role within the application and uptake of evidence‐based approaches within health and social care. While there are established checklists for evaluating quantitative research, this is not the case for qualitative research. This article outlines the process of developing an evaluative tool for qualitative studies, reflecting the uniqueness of the associated paradigm, and illustrates its use by reference to three qualitative research papers appraised within a systematic review of community‐based rehabilitation services. At its centre are concerns with the context of the study and the way the data are collected and analysed. Use of such an evaluative template opens the way for the quality of qualitative research to be judged in a systematic manner and for qualitative research to take its rightful place within debates over what works, where, when and how within health and social care policy and practice.

Heroines, villains and victims: older people's perceptions of others

This paper examines older peoples contrasting images of older people as ‘those like us’ and as ‘others’. It draws on data from a qualitative study about the experience of ageing that was undertaken in partnership with two local groups of older people in England. Whilst the informants acknowledged their chronological age, changes in appearance and physical limitations, most did not describe themselves as old. They challenged the idea of older people as being ‘past it’. Older people who personified their own values of inter-dependence, reciprocity and keeping going were seen as ‘heroines’ of old age, but negative stereotypes were ascribed simultaneously to others, ‘the villains’. Aspects of behaviour which evoked censure were ‘giving up’; ‘refusal to be helped’ and ‘taking without putting back’, and were usually attributed to acquaintances known only at a distance. The victims of old age were primarily people with dementia, who were perceived as ‘needing to be looked after’ and objects of pity and concern. The paper explores the ways in which these various images of old age related to peoples self-identity and management of the ageing process; especially in a society that has ambivalent conceptions of old age. The findings contribute to an understanding of how peoples values underpin their conception of ‘a good old age’ and how they shape their interpretation of societal stereotypes. They also indicate the importance of considering whose voices are heard in the context of exploring the identity and contributions of older people to achieve a more inclusive society.

Implementing a training intervention to support caregivers after stroke: a process evaluation examining the initiation and embedding of programme change

BackgroundMedical Research Council (MRC) guidance identifies implementation as a key element of the development and evaluation process for complex healthcare interventions. Implementation is itself a complex process involving the mobilization of human, material, and organizational resources to change practice within settings that have pre-existing structures, historical patterns of relationships, and routinized ways of working. Process evaluations enable researchers and clinicians to understand how implementation proceeds and what factors impact on intended program change. A qualitative process evaluation of the pragmatic cluster randomized controlled trial; Training Caregivers after Stroke was conducted to examine how professionals were engaged in the work of delivering training; how they reached and involved caregivers for whom the intervention was most appropriate; how did those on whom training was targeted experience and respond to it. Normalization Process Theory, which focuses attention on implementing and embedding program change, was used as a sensitizing framework to examine selected findings.ResultsContextual factors including organizational history and team relationships, external policy, and service development initiatives, impinged on implementation of the caregiver training program in unintended ways that could not have been predicted through focus on mechanisms of individual and collective action at unit level. Factors that facilitated or impeded the effectiveness of the cascade training model used, whether and how stroke unit teams made sense of and engaged individually and collectively with a complex caregiver training intervention, and what impact these factors had on embedding the intervention in routine stroke unit practice were identified.ConclusionsWhere implementation of complex interventions depends on multiple providers, time needs to be invested in reaching agreement on who will take responsibility for delivery of specific components and in determining how implementation and its effectiveness will be monitored. This goes beyond concern with intervention fidelity; explicit consideration also needs to be given to the implementation process in terms of how program change can be effected at organizational, practice, and service delivery levels. Normalization Process Theory’s constructs help identify vulnerable features of implementation processes in respect of the work involved in embedding complex interventions.

Developing and implementing an integrated delirium prevention system of care: a theory driven, participatory research study

BackgroundDelirium is a common complication for older people in hospital. Evidence suggests that delirium incidence in hospital may be reduced by about a third through a multi-component intervention targeted at known modifiable risk factors. We describe the research design and conceptual framework underpinning it that informed the development of a novel delirium prevention system of care for acute hospital wards. Particular focus of the study was on developing an implementation process aimed at embedding practice change within routine care delivery.MethodsWe adopted a participatory action research approach involving staff, volunteers, and patient and carer representatives in three northern NHS Trusts in England. We employed Normalization Process Theory to explore knowledge and ward practices on delirium and delirium prevention. We established a Development Team in each Trust comprising senior and frontline staff from selected wards, and others with a potential role or interest in delirium prevention. Data collection included facilitated workshops, relevant documents/records, qualitative one-to-one interviews and focus groups with multiple stakeholders and observation of ward practices. We used grounded theory strategies in analysing and synthesising data.ResultsAwareness of delirium was variable among staff with no attention on delirium prevention at any level; delirium prevention was typically neither understood nor perceived as meaningful. The busy, chaotic and challenging ward life rhythm focused primarily on diagnostics, clinical observations and treatment. Ward practices pertinent to delirium prevention were undertaken inconsistently. Staff welcomed the possibility of volunteers being engaged in delirium prevention work, but existing systems for volunteer support were viewed as a barrier.Our evolving conception of an integrated model of delirium prevention presented major implementation challenges flowing from minimal understanding of delirium prevention and securing engagement of volunteers alongside practice change. The resulting Prevention of Delirium (POD) Programme combines a multi-component delirium prevention and implementation process, incorporating systems and mechanisms to introduce and embed delirium prevention into routine ward practices.ConclusionsAlthough our substantive interest was in delirium prevention, the conceptual and methodological strategies pursued have implications for implementing and sustaining practice and service improvements more broadly.Study registrationISRCTN65924234

Getting inside acupuncture trials - Exploring intervention theory and rationale

BackgroundAcupuncture can be described as a complex intervention. In reports of clinical trials the mechanism of acupuncture (that is, the process by which change is effected) is often left unstated or not known. This is problematic in assisting understanding of how acupuncture might work and in drawing together evidence on the potential benefits of acupuncture. Our aim was to aid the identification of the assumed mechanisms underlying the acupuncture interventions in clinical trials by developing an analytical framework to differentiate two contrasting approaches to acupuncture (traditional acupuncture and Western medical acupuncture).MethodsBased on the principles of realist review, an analytical framework to differentiate these two contrasting approaches was developed. In order to see how useful the framework was in uncovering the theoretical rationale, it was applied to a set of trials of acupuncture for fatigue and vasomotor symptoms, identified from a wider literature review of acupuncture and early stage breast cancer.ResultsWhen examined for the degree to which a study demonstrated adherence to a theoretical model, two of the fourteen selected studies could be considered TA, five MA, with the remaining seven not fitting into any recognisable model. When examined by symptom, five of the nine vasomotor studies, all from one group of researchers, are arguably in the MA category, and two a TA model; in contrast, none of the five fatigue studies could be classed as either MA or TA and all studies had a weak rationale for the chosen treatment for fatigue.ConclusionOur application of the framework to the selected studies suggests that it is a useful tool to help uncover the therapeutic rationale of acupuncture interventions in clinical trials, for distinguishing between TA and MA approaches and for exploring issues of model validity. English language acupuncture trials frequently fail to report enough detail relating to the intervention. We advocate using this framework to aid reporting, along with further testing and refinement of the framework.

Introducing structured caregiver training in stroke care: findings from the TRACS process evaluation study

Objective To evaluate the process of implementation of the modified London Stroke Carers Training Course (LSCTC) in the Training Caregivers After Stroke (TRACS) cluster randomised trial and contribute to the interpretation of the TRACS trial results. The LSCTC was a structured competency-based training programme designed to help develop the knowledge and skills (eg, patient handling or transfer skills) essential for the day-to-day management of disabled survivors of stroke. The LSCTC comprised 14 components, 6 were mandatory (and delivered to all) and 8 non-mandatory, to be delivered based on individual assessment of caregiver need. Design Process evaluation using non-participant observation, documentary analysis and semistructured interviews. Participants Patients with stroke (n=38), caregivers (n=38), stroke unit staff (n=53). Settings 10 of the 36 stroke units participating in the TRACS trial in four English regions (Yorkshire, North West, South East and South West, Peninsula). Results Preparatory cascade training on delivery of the LSCTC did not reach all staff and did not lead to multidisciplinary team (MDT) wide understanding of, engagement with or commitment to the LSCTC. Although senior therapists in most intervention units observed developed ownership of the LSCTC, MDT working led to separation rather than integration of delivery of LSCTC elements. Organisational features of stroke units and professionals’ patient-focused practices limited the involvement of caregivers. Caregivers were often invited to observe therapy or care being provided by professionals but had few opportunities to make sense of, or to develop knowledge and stroke-specific skills provided by the LSCTC. Where provided, caregiver training came very late in the inpatient stay. Assessment and development of caregiver competence was not commonly observed. Conclusions Contextual factors including service improvement pressures and staff perceptions of the necessity for and work required in caregiver training impacted negatively on implementation of the caregiver training intervention. Structured caregiver training programmes such as the LSCTC are unlikely to be practical in settings with short inpatient stays. Stroke units where early supported discharge is in place potentially offer a more effective vehicle for introducing competency based caregiver training. LINKED TRACS Cluster randomised controlled trial number ISRCTN49208824.

The long-term effects of counselling: The process and mechanisms that contribute to ongoing change from a user perspective

Abstract Aims: This qualitative study aimed to expand the limited evidence base about the long-term effects of psychological therapies. Method: We conducted in-depth interviews with 15 people, 1–3 years after primary care counselling, to investigate whether they could identify enduring benefits and the mechanisms that brought about and maintained them. From their narratives, we developed a model of the change process of counselling and mechanisms that were perceived as essential to produce lasting benefit. The model conceptualised movement through distinct phases: engagement; exploration of internal and external worlds; consolidation and negotiated ending. Results: Mechanisms integral to sustained impact were: the active engagement of people during and between sessions to work toward their own solutions; and acquisition through the change process of skills which could be further built on after the counselling ended. These enabled ongoing, dynamic change in the way people conducted their lives and relation...

Patient and caregiver perspectives on managing pain in advanced cancer: A qualitative longitudinal study

Background: Despite advances in treatment of pain in advanced cancer, it remains a major source of suffering with adverse effects on patients’ life quality. There is increasing understanding of its multi-dimensional nature and the variable responsiveness of medication to complex pain. Less clear is how patients and their caregivers respond to and manage pain complexity. Aim: To explore patients’ and carers’ experiences of advanced cancer pain and the processes that they engage in to manage pain. Design: Qualitative study employing face-to-face interviews at two time points and audio diaries. Data were analysed using grounded theory strategies. Setting/participants: Purposive sample of 21 advanced cancer patients and 16 carers from oncology outpatients in a tertiary cancer centre and a hospice. Results: Three distinct patterns of pain were discerned in patients’ accounts, distinguishable in terms of complexity, severity, transiency and degree of perceived control over pain. Pain was dynamic reflecting changes in the disease process, access to and effectiveness of pain relief. For patients and carers, neither pain relief nor expertise in pain management is secured once and for all. The main drivers of help-seeking and action by patients to manage pain were the sensory experiences of pain and meaning attached to it, not beliefs about analgesia. Conclusion: The complex and dynamic nature of pain and how it was understood shaped help-seeking and pain management. Variable effectiveness of pain relief for different pain types were challenging for patients and professionals in achieving relief.

A Randomised Controlled Trial of complete denture impression materials

Objectives There is continuing demand for non-implant prosthodontic treatment and yet there is a paucity of high quality Randomised Controlled Trial (RCT) evidence for best practice. The aim of this research was to provide evidence for best practice in prosthodontic impressions by comparing two impression materials in a double-blind, randomised, crossover, controlled, clinical trial. Methods Eighty-five patients were recruited, using published eligibility criteria, to the trial at Leeds Dental Institute, UK. Each patient received two sets of dentures; made using either alginate or silicone impressions. Randomisations determined the order of assessment and order of impressions. The primary outcome was patient blinded preference for unadjusted dentures. Secondary outcomes were patient preference for the adjusted dentures, rating of comfort, stability and chewing efficiency, experience of each impression, and an OHIP-EDENT questionnaire. Results Seventy-eight (91.8%) patients completed the primary assessment. 53(67.9%) patients preferred dentures made from silicone impressions while 14(17.9%) preferred alginate impressions. 4(5.1%) patients found both dentures equally satisfactory and 7 (9.0%) found both equally unsatisfactory. There was a 50% difference in preference rates (in favour of silicone) (95%CI 32.7–67.3%, p < 0.0001). Conclusion There is significant evidence that dentures made from silicone impressions were preferred by patients. Clinical significance Given the strength of the clinical findings within this paper, dentists should consider choosing silicone rather than alginate as their material of choice for secondary impressions for complete dentures. Trial Registration: ISRCTN 01528038.

 This article forms part of a project for which the author (TPH) won the Senior Clinical Unilever Hatton Award of the International Assocation for Dental Research, Capetown, South Africa, June 2014.

Exploring the Needs and Concerns of Women with Early Breast Cancer during Chemotherapy: Valued Outcomes during a Course of Traditional Acupuncture

Women diagnosed with breast cancer experience symptom clusters in addition to existential issues from a life-threatening diagnosis during chemotherapy. A complementary therapy, such as traditional acupuncture (TA) with its whole-person orientation, may help to modify these effects, alongside inducing other patient benefits. Exploring the needs and concerns of women and perceived benefits of TA would add to knowledge about its integrative treatment potential. Methods. A longitudinal qualitative study recruited fourteen women to receive up to ten sessions of TA during chemotherapy. They were interviewed before, during, and after chemotherapy. Two practitioners of TA delivered treatment and were interviewed before and after the study, and kept treatment logs and diaries. Interviews were recorded and transcribed, and the data were analysed using grounded theory. Findings. Both broad and specific benefits were reported by the women; a highly valued outcome was enabling coping through the alleviation of symptoms and increased well-being. Practitioners dealt with the presented symptom clusters facilitating outcome patterns, including and beyond individual symptom changes. Further research on TA as a flexible intervention able to respond to the changing needs and concerns of woman during chemotherapy along with the measure of such outcome patterns is warranted.