Lynn Calman

The validity and reliability of methods to assess the competence to practise of pre-registration nursing and midwifery students.

This paper reports findings from a study funded by the National Board for Nursing, Midwifery and Health Visiting for Scotland to test selected nursing and midwifery clinical competence assessment tools for reliability and validity. The study, which took place over two years from July 1997, involved comparing items in the selected tools with statutory competencies for nurses and midwives, collecting assessment data from a sample of 257 nursing and 43 midwifery students in four educational institutions and administering additional assessment measures (the Nursing Competencies Questionnaire (NCQ) (Bartlett et al., An evaluation of pre-registration nursing education: a literature review and comparative study of graduate outcomes, Oxford Centre for Health Care Research & Development, Oxford Brookes University, Oxford, 1998) and the Key Areas Assessment Instrument-KAAI) to the total student sample (and to their lecturers and practice assessors) at two time points which were six months apart. Our focus was the programme-specific clinical competence assessment tools but by testing these tools we also provide evidence on the validity of other methods of competence assessment. Validity of the methods was assessed, primarily, by calculating multivariate and univariate correlation coefficients between them. The NCQ and KAAI were analysed for internal consistency. The NCQ and the versions of KAAI for lecturers and practice assessors were found to have good internal consistency. The version of the KAAI tool developed for students showed reasonable internal consistency for nursing students, but less consistency for midwifery students. Correlational analysis of data collected on students showed that there is little or no relationship between most of the clinical competence assessment methods in current use, or between these methods and those introduced by the research team. This finding supports previous research, particularly in medical education and confirms that the different methods address different abilities.A clear finding from this study is that no single method is appropriate for assessing clinical competence. A multi-method UK-wide strategy for clinical competence assessment for nursing and midwifery is needed if we are to be sure that assessment reveals whether or not students have achieved the complex repertoire of knowledge, skills and attitudes required for competent practice.

Assessing competence to practise in nursing: a review of the literature

Recent reforms of nursing education have led to calls for assessment of clinical performance to contribute to academic qualifications that incorporate professional awards. Questions then follow concerning the psychometric quality of methods available for assessing competence and performance and the ability of the methods to distinguish between different levels of practice. The purpose of this review of the literature is to analyse methods of assessing competence to practise in nursing and draw conclusions on their reliability and validity. The methods reviewed include questionnaire rating scales, ratings by observation, criterion-referenced rating scales, simulations including the objective structured clinical examination (OSCE), Benners model of skill acquisition, reflection in and on practice, self-assessment and multi-method approaches. Methodological challenges to competence assessment are raised. Findings of the review are as follows. Questionnaire rating scales used to assess competence in nursing have not been rigorously tested for reliability and validity. The methodological limitations of observation can be overcome with use of criterion-referenced scales or simulations such as the OSCE or its variations, as has been found in research on competence assessment in medicine. The Barts Nursing OSCE, designed for the end of the common foundation programme of the nursing diploma course, has promise because it provides a close simulation to real life and is grounded in an interpretive approach to skill acquisition. Reflection on practice using portfolios, learning contracts and self-assessment is valid if based on rigorous analysis of critical incidents rather than simple description. Reflective approaches have the advantage of being located in real-life settings and can integrate theory with practice but they need skilled collaboration between teachers, employers and practitioners. The conclusion is that a multimethod approach enhances validity and ensures comprehensive assessment of the complex repertoire of skills required of students in nursing.

Developing longitudinal qualitative designs : lessons learned and recommendations for health services research

BackgroundLongitudinal qualitative methods are becoming increasingly used in the health service research, but the method and challenges particular to health care settings are not well described in the literature.We reflect on the strategies used in a longitudinal qualitative study to explore the experience of symptoms in cancer patients and their carers, following participants from diagnosis for twelve months; we highlight ethical, practical, theoretical and methodological issues that need to be considered and addressed from the outset of a longitudinal qualitative study.ResultsKey considerations in undertaking longitudinal qualitative projects in health research, include the use of theory, utilizing multiple methods of analysis and giving consideration to the practical and ethical issues at an early stage. These can include issues of time and timing; data collection processes; changing the topic guide over time; recruitment considerations; retention of staff; issues around confidentiality; effects of project on staff and patients, and analyzing data within and across time.ConclusionsAs longitudinal qualitative methods are becoming increasingly used in health services research, the methodological and practical challenges particular to health care settings need more robust approaches and conceptual improvement. We provide recommendations for the use of such designs. We have a particular focus on cancer patients, so this paper will have particular relevance for researchers interested in chronic and life limiting conditions.

Skill-Mix and Policy Change in the Health Workforce

An important potential contribution to the efficient use of the health workforce, is the possibility of ‘skill mix’ changes. ‘Skill mix’ is a relatively broad term which can refer to the mix of staff in the workforce or the demarcation of roles and activities among different categories of staff. Most of the policy attention on using skill-mix changes to improve health system performance has been on the mix between physicians and nurses. Skill-mix changes may involve a variety of developments including enhancement of skills among a particular group of staff, substitution1 between different groups, delegation up and down a unidiscipliniary ladder, and innovation in roles. Such changes may be driven by a variety of motives including service innovation, shortages of particular categories of worker (especially in inner cities or rural areas), quality improvement, and a desire to improve the cost- effectiveness of service delivery. There are large differences in reported physician/nurse ... Il existe un moyen susceptible de contribuer de maniere importante a l’utilisation rationnelle des personnels de sante, a savoir la modification de « l’eventail des qualifications ». « L’eventail des qualifications » est un concept relativement vaste qui renvoie soit a l’eventail des personnels qualifies, soit a la separation des roles et des activites reserves aux differentes categories de personnel. Parmi les pistes envisagees dans l’utilisation des modifications de l’eventail des qualifications pour ameliorer les performances des systemes de sante, c’est la substitution du personnel infirmier aux medecins qui a le plus retenu l’attention. Les modifications de l’eventail des qualifications peuvent se traduire par des resultats divers, tels que le relevement des qualifications au sein d’un groupe professionnel donne, une substitution2 entre differents groupes, une delegation des actes vers le haut et vers le haut au sein de la hierarchie d’une meme discipline ou des innovations au ...

RESTORE: An exploratory trial of an online intervention to enhance self-efficacy to manage problems associated with cancer-related fatigue following primary cancer treatment: Study protocol for a randomized controlled trial

BackgroundThere are over 25 million people worldwide living with or beyond cancer and this number is increasing. Cancer survivors face a range of problems following primary treatment. One of the most frequently reported and distressing symptoms experienced by cancer survivors is fatigue. There is growing support for survivors who are experiencing problems after cancer treatment to engage in supported self-management. To date there is some evidence of effective interventions to manage fatigue in this population; however, to our knowledge there are no online resources that draw on this information to support self-management of fatigue. This paper describes the protocol for an exploratory randomized controlled trial of an online intervention to support self-management of cancer-related fatigue after primary cancer treatment.Methods/designThis is a parallel-group two-armed (1:1) exploratory randomized controlled trial including 125 cancer survivors experiencing fatigue (scoring ≥4 on a unidimensional 11-point numeric rating scale for fatigue intensity) within five years of primary treatment completion with curative intent. Participants will be recruited from 13 NHS Trusts across the UK and randomized to either the online intervention (RESTORE), or a leaflet comparator (Macmillan Cancer Backup, Coping with Fatigue). The primary outcome is a change in Perceived Self-Efficacy for Fatigue Self-Management (as measured by the Perceived Self-Efficacy for Fatigue Self-Management Instrument). Secondary outcomes include impact on perception and experience of fatigue (measured by the Brief Fatigue Inventory), and quality of life (measured by the Functional Assessment of Cancer Therapy - General and the Personal Wellbeing Index). Outcome measures will be collected at baseline, 6 weeks (completion of intervention), and 3 months. Process evaluation (including telephone interviews with recruiting staff and participants) will determine acceptability of the intervention and trial processes.DiscussionData from this trial will be used to refine the intervention and contribute to the design of an effectiveness trial. This intervention will be expanded to address other cancer-related problems important to cancer survivors following primary cancer treatment.Trial registrationISRCTN67521059

Protocol for a longitudinal qualitative interview study: maintaining psychological well-being in advanced cancer—what can we learn from patients’ and carers’ own coping strategies?

Introduction People with advanced cancer and their carers experience stress and uncertainty which affects the quality of life and physical and mental health. This study aims to understand how patients and carers recover or maintain psychological well-being by exploring the strategies employed to self-manage stress and uncertainty. Methods and analysis A longitudinal qualitative interview approach with 30 patients with advanced cancer and 30 associated family or informal carers allows the exploration of contexts, mechanisms and outcomes at an individual level. Two interviews, 4–12 weeks apart, will not only enable the exploration of individuals’ evolving coping strategies in response to changing contexts but also how patients’ and carers’ strategies inter-relate. Patient and Carer focus groups will then consider how the findings may be used in developing an intervention. Recruiting through two major tertiary cancer centres in the North West and using deliberately broad and inclusive criteria will enable the sample to capture demographic and experiential breadth. Ethics and dissemination The research team will draw on their considerable experience to ensure that the study is sensitive to a patient and carer group, which may be considered vulnerable but still values being able to contribute its views. Public and patient involvement (PPI) is integral to the design and is evidenced by: a research advisory group incorporating patient and carers, prestudy consultations with the PPI group at one of the study sites and a user as the named applicant. The study team will use multiple methods to disseminate the findings to clinical, policy and academic audiences. A key element will be engaging health professionals in patient and carer ideas for promoting self-management of psychological well-being. The study has ethical approval from the North West Research Ethics Committee and the appropriate NHS governance clearance. Registration National Institute for Health Research (NIHR) Clinical Studies Portfolio, UK Clinical Research Network (UKCRN) Study number 11725.

Managing fatigue after cancer treatment: development of RESTORE, a web-based resource to support self-management

The aim of this study is to co‐create an evidence‐based and theoretically informed web‐based intervention (RESTORE) designed to enhance self‐efficacy to live with cancer‐related fatigue (CRF) following primary cancer treatment.

Pre-surgery depression and confidence to manage problems predict recovery trajectories of health and wellbeing in the first two years following colorectal cancer: results from the CREW cohort study

Purpose This paper identifies predictors of recovery trajectories of quality of life (QoL), health status and personal wellbeing in the two years following colorectal cancer surgery. Methods 872 adults receiving curative intent surgery during November 2010 to March 2012. Questionnaires at baseline, 3, 9, 15, 24 months post-surgery assessed QoL, health status, wellbeing, confidence to manage illness-related problems (self-efficacy), social support, co-morbidities, socio-demographic, clinical and treatment characteristics. Group-based trajectory analyses identified distinct trajectories and predictors for QoL, health status and wellbeing. Results Four recovery trajectories were identified for each outcome. Groups 1 and 2 fared consistently well (scores above/within normal range); 70.5% of participants for QoL, 33.3% health status, 77.6% wellbeing. Group 3 had some problems (24.2% QoL, 59.3% health, 18.2% wellbeing); Group 4 fared consistently poorly (5.3% QoL, 7.4% health, 4.2% wellbeing). Higher pre-surgery depression and lower self-efficacy were significantly associated with poorer trajectories for all three outcomes after adjusting for other important predictors including disease characteristics, stoma, anxiety and social support. Conclusions Psychosocial factors including self-efficacy and depression before surgery predict recovery trajectories in QoL, health status and wellbeing following colorectal cancer treatment independent of treatment or disease characteristics. This has significant implications for colorectal cancer management as appropriate support may be improved by early intervention resulting in more positive recovery experiences.

RESTORE: an exploratory trial of a web-based intervention to enhance self-management of cancer-related fatigue: findings from a qualitative process evaluation

BackgroundCancer-related fatigue is a distressing symptom experienced by many after cancer treatment. An exploratory randomised controlled trial was conducted to test proof of concept of RESTORE: a web-based tool to enhance self-efficacy to manage cancer-related fatigue. This paper reports findings from a qualitative process evaluation to determine feasibility and acceptability of the intervention and trial processes.MethodQualitative process evaluation carried out at the end of the trial to explore participants’ experiences using semi-structured telephone interviews with a purposive sample of participants from both trial arms. Normalisation Process Theory informed data collection and analysis. Analysis involved directed content analysis within a Framework Approach.ResultsNineteen participants took part. They understood the purpose and requirements of the trial and identified beneficial outcomes from taking part. For the majority, the work of the trial was easily accommodated into daily routines and did not require new skills. There were mixed views about the value of the information provided by RESTORE, depending on time since diagnosis and treatment. Personal factors, constraints of the intervention, and environmental context inhibited the integration and embedding of RESTORE into everyday life. Access to the intervention at an early stage in the treatment trajectory was important to effective utilisation, as were individual preferences for delivery of information.ConclusionThe theoretical foundations of the intervention were sound. Participants derived benefits from the intervention but barriers to implementation and integration suggest that RESTORE and the trial processes require some modification before testing in a full trial.Trial registrationISRCTN67521059 (10th October 2012).

Coping well with advanced cancer : a serial qualitative interview study with patients and family carers

Objectives To understand successful strategies used by people to cope well when living with advanced cancer; to explore how professionals can support effective coping strategies; to understand how to support development of effective coping strategies for patients and family carers. Design Qualitative serial (4–12 week intervals) interview study with people with advanced cancer and their informal carers followed by focus groups. The iterative design had a novel focus on positive coping strategies. Interview analysis focused on patients and carers as individuals and pairs, exploring multiple dimensions of their coping experiences. Focus group analysis explored strategies for intervention development. Participants 26 people with advanced (stage 3–4) breast, prostate, lung or colorectal cancer, or in receipt of palliative care, and 24 paired nominated informal/family carers. Setting Participants recruited through outpatient clinics at two tertiary cancer centres in Merseyside and Manchester, UK, between June 2012 and July 2013. Results 45 patient and 41 carer interviews were conducted plus 4 focus groups (16 participants). People with advanced cancer and their informal/family carers develop coping strategies which enable effective management of psychological wellbeing. People draw from pre-diagnosis coping strategies, but these develop through responding to the experience of living with advanced cancer. Strategies include being realistic, indulgence, support, and learning from others, which enabled participants to regain a sense of wellbeing after emotional challenge. Learning from peers emerged as particularly important in promoting psychological wellbeing through the development of effective ‘everyday’, non-clinical coping strategies. Conclusions Our findings challenge current models of providing psychological support for those with advanced cancer which focus on professional intervention. It is important to recognise, enable and support peoples’ own resources and coping strategies. Peer support may have potential, and could be a patient-centred, cost effective way of managing the needs of a growing population of those living with advanced cancer.