Louca-Mai Brady

Developing the evidence base of patient and public involvement in health and social care research: the case for measuring impact

While patient and public involvement (PPI) in health and social care research has progressed successfully in the last decade, a range of difficulties with the evidence base exist, including poor understanding of the concept of impact, limited theorization and an absence of quantitative impact measurement. In this paper, we argue that a paradigm change towards robust measurement of the impact of involvement in research is needed to complement qualitative explorations. We argue that service users should be collaboratively involved in the conceptualization, theorization and development of instruments to measure PPI impact. We consider the key advantages measurement would bring in strengthening the PPI evidence base through a greater understanding of what works, for whom, in what circumstances and why.

Broadening public participation in systematic reviews: a case example involving young people in two configurative reviews

Background Arguments supporting the involvement of users in research have even more weight when involving the public in systematic reviews of research. We aimed to explore the potential for public involvement in systematic reviews of observational and qualitative studies. Methods Two consultative workshops were carried out with a group of young people (YP) aged 12–17 years to examine two ongoing reviews about obesity: one about childrens views and one on the link between obesity and educational attainment. YP were invited to comment on the credibility of themes, to propose elements of interventions, to suggest links between educational attainment and obesity and to comment on their plausibility. Results Researchers had more confidence in review findings, after checking that themes identified as important by YP were emphasised appropriately. Researchers were able to use factors linking obesity and attainment identified as important by YP to identify limitations in the scope of extant research. Conclusion Consultative workshops helped researchers draw on the perspectives of YP when interpreting and reflecting upon two systematic reviews. Involving users in judging synthesis credibility and identifying concepts was easier than involving them in interpreting findings. Involvement activities for reviews should be designed with review stage, purpose and group in mind.

Youth social behaviour and network therapy (Y-SBNT): adaptation of a family and social network intervention for young people who misuse alcohol and drugs - a randomised controlled feasibility trial.

BACKGROUND Family interventions appear to be effective at treating young peoples substance misuse. However, implementation of family approaches in UK services is low. This study aimed to demonstrate the feasibility of recruiting young people to an intervention based on an adaptation of adult social behaviour and network therapy. It also sought to involve young people with experience of using substance misuse services in the research process. OBJECTIVES To demonstrate the feasibility of recruiting young people to family and social network therapy and to explore ways in which young people with experience of using substance misuse services could be involved in a study of this nature. DESIGN A pragmatic, two-armed, randomised controlled open feasibility trial. SETTING Two UK-based treatment services for young people with substance use problems, with recruitment taking place from May to November 2014. PARTICIPANTS Young people aged 12-18 years, newly referred and accepted for structured interventions for drug and/or alcohol problems. INTERVENTIONS A remote, web-based computer randomisation system allocated young people to adapted youth social behaviour and network therapy (Y-SBNT) or treatment as usual (TAU). Y-SBNT participants were intended to receive up to six 50-minute sessions over a maximum of 12 weeks. TAU participants continued to receive usual care delivered by their service. MAIN OUTCOME MEASURES Feasibility was measured by recruitment rates, retention in treatment and follow-up completion rates. The main clinical outcome was the proportion of days on which the main problem substance was used in the preceding 90-day period as captured by the Timeline Follow-Back interview at 3 and 12 months. RESULTS In total, 53 young people were randomised (Y-SBNT, n = 26; TAU, n = 27) against a target of 60 (88.3%). Forty-two young people attended at least one treatment session [Y-SBNT 22/26 (84.6%); TAU 20/27 (74.1%)]; follow-up rates were 77.4% at month 3 and 73.6% at month 12. Data for nine young people were missing at both months 3 and 12, so the main clinical outcome analysis was based on 24 young people (92.3%) in the Y-SBNT group and 20 young people (74.1%) in the TAU group. At month 12, the average proportion of days that the main problem substance was used in the preceding 90 days was higher in the Y-SBNT group than in the TAU group (0.54 vs. 0.41; adjusted mean difference 0.13, 95% confidence interval -0.12 to 0.39; p = 0.30). No adverse events were reported. Seventeen young people with experience of substance misuse services were actively involved throughout the study. They informed key elements of the intervention and research process, ensuring that the intervention was acceptable and relevant to our target groups; contributing to the design of key trial documents, ideas for a new model of public involvement and this report. Two parents were also involved. CONCLUSIONS The adapted intervention could be delivered in young peoples services, and qualitative interviews found that Y-SBNT was acceptable to young people, family members and staff. Engagement of family and network members proved difficult within the intervention and research aspects. The study proved the feasibility of this work in routine services but outcome measurement based on narrow substance use variables may be limited and may fail to capture other important changes in wider areas of functioning for young people. Validation of the EuroQol-5 Dimensions for young people aged 12-18 years should be considered and flexible models for involvement of young people in research are required to achieve inclusive representation throughout all aspects of the research process. Although recommendation of a full trial of the Y-SBNT intervention compared with TAU is not supported, this study can inform future intervention development and UK research within routine addiction services. TRIAL REGISTRATION Current Controlled Trials ISRCTN93446265. FUNDING This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 21, No. 15. See the NIHR Journals Library website for further project information.

A randomised controlled feasibility trial of family and social network intervention for young people who misuse alcohol and drugs: study protocol (Y-SBNT)

BackgroundA growing body of research has identified family interventions to be effective in treating young people’s substance use problems. However, despite this evidence, take-up of family-based approaches in the UK has been low. Key factors for this appear to include the resource-intensive nature of most family interventions which challenges implementation and delivery in many service settings and the cultural adaptation of approaches developed in the USA to a UK setting. This study aims to demonstrate the feasibility of recruiting young people to a specifically developed family- and wider social network-based intervention by testing an adapted version of adult social behaviour and network therapy (SBNT).MethodsA pragmatic, randomised controlled, open feasibility trial delivered in two services for young people in the UK. Potential participants are aged 12–18 years referred for drug or alcohol problems to either service. The main purpose of this study is to demonstrate the feasibility of recruiting young people to a specifically developed family and social network-based intervention. The feasibility and acceptability of this intervention will be measured by recruitment rates, treatment retention, follow-up rates and qualitative interviews. The feasibility of training staff from existing services to deliver this intervention will be explored. Using this opportunity to compare the effectiveness of the intervention against treatment as usual, Timeline Follow-Back interviews will document the proportion of days on which the main problem substance was used in the preceding 90-day period at each assessment point. The economic component will examine the feasibility of conducting a full incremental cost-effectiveness analysis of the two treatments. The study will also explore and develop models of patient and public involvement which support the involvement of young people in a study of this nature.DiscussionAn earlier phase of work adapted social behaviour and network therapy (adult approach) to produce a purpose-designed youth version supported by a therapy manual and associated resources. This was achieved by consultation with young people with experience of services and professionals working in services for young people. This feasibility trial alongside ongoing consultations with young people will offer a meaningful understanding of processes of delivery and implementation.Trial registrationISRCTN93446265; Date ISRCTN assigned 31/05/2013.

Involving young people in drug and alcohol research

Purpose Young people’s involvement should lead to research, and ultimately services, that better reflect young people’s priorities and concerns. Young people with a history of treatment for alcohol and/or drug problems were actively involved in the youth social behaviour and network therapy study. The purpose of this paper is to explore the impact of that involvement on the study and what was learnt about involving young people in drug and alcohol research. Design/methodology/approach The initial plan was to form a young people’s advisory group (YPAG), but when this proved problematic the study explored alternative approaches in collaboration with researchers and young people. Input from 17 young people informed all key elements of the study. Findings Involvement of young people needs to be dynamic and flexible, with sensitivity to their personal experiences. Engagement with services was crucial both in recruiting young people and supporting their ongoing engagement. This research identified a need to critically reflect on the extent to which rhetorics of participation and involvement give rise to effective and meaningful involvement for young service users. It also highlights the need for researchers to be more flexible in response to young people’s personal circumstances, particularly when those young people are “less frequently heard”. Research limitations/implications This research highlights the need for researchers to be more flexible in response to young people’s personal circumstances, particularly when those young people are “less frequently heard”. It highlights the danger of young people in drug and alcohol research being unintentionally disaffected from involvement through conventional approaches and instead suggests ways in which young people could be involved in influencing if and how they participate in research. Practical implications There is an apparent contradiction between dominant discourses and cultures of health services research (including patient and public involvement) that often do not sit easily with ideas of co-production and young people-centred involvement. This paper provides an alternative approach to involvement of young people that can help to enable more meaningful and effective involvement. Originality/value The flexible and young people-centred model for involvement which emerged from this work provides a template for a different approach. This may be particularly useful for those who find current practice, such as YPAG, inaccessible.

Developing the evidence base of patient and public involvement in health and social care research: the case for measuring impact: Patient and public involvement in health and social care research

While patient and public involvement (PPI) in health and social care research has progressed successfully in the last decade, a range of difficulties with the evidence base exist, including poor understanding of the concept of impact, limited theorization and an absence of quantitative impact measurement. In this paper, we argue that a paradigm change towards robust measurement of the impact of involvement in research is needed to complement qualitative explorations. We argue that service users should be collaboratively involved in the conceptualization, theorization and development of instruments to measure PPI impact. We consider the key advantages measurement would bring in strengthening the PPI evidence base through a greater understanding of what works, for whom, in what circumstances and why.

Developing the evidence base of patient and public involvement in health and social care research

While patient and public involvement (PPI) in health and social care research has progressed successfully in the last decade, a range of difficulties with the evidence base exist, including poor understanding of the concept of impact, limited theorization and an absence of quantitative impact measurement. In this paper, we argue that a paradigm change towards robust measurement of the impact of involvement in research is needed to complement qualitative explorations. We argue that service users should be collaboratively involved in the conceptualization, theorization and development of instruments to measure PPI impact. We consider the key advantages measurement would bring in strengthening the PPI evidence base through a greater understanding of what works, for whom, in what circumstances and why.