Helen Burchett

Health outcomes of youth development programme in England: prospective matched comparison study

Objective To evaluate the effectiveness of youth development in reducing teenage pregnancy, substance use, and other outcomes. Design Prospective matched comparison study. Setting 54 youth service sites in England. Participants Young people (n=2724) aged 13-15 years at baseline deemed by professionals as at risk of teenage pregnancy, substance misuse, or school exclusion or to be vulnerable. Intervention Intensive, multicomponent youth development programme including sex and drugs education (Young People’s Development Programme) versus standard youth provision. Main outcome measures Various, including pregnancy, weekly cannabis use, and monthly drunkenness at 18 months. Results Young women in the intervention group more commonly reported pregnancy than did those in the comparison group (16% v 6%; adjusted odds ratio 3.55, 95% confidence interval 1.32 to 9.50). Young women in the intervention group also more commonly reported early heterosexual experience (58% v 33%; adjusted odds ratio 2.53, 1.09 to 5.92) and expectation of teenage parenthood (34% v 24%; 1.61, 1.07 to 2.43). Conclusions No evidence was found that the intervention was effective in delaying heterosexual experience or reducing pregnancies, drunkenness, or cannabis use. Some results suggested an adverse effect. Although methodological limitations may at least partly explain these findings, any further implementation of such interventions in the UK should be only within randomised trials.

How do we know when research from one setting can be useful in another? A review of external validity, applicability and transferability frameworks:

Objective: To review published frameworks that included criteria for the assessment of external validity, applicability and transferability in their assessment of health research. Methods: Five databases were searched for articles relating to the assessment of external validity or applicability and transferability in health research. A coding framework was developed inductively and used to assess which types of criteria were included in the frameworks. Results: Thirty-eight articles describing 25 frameworks were identified. Eleven focused solely on the assessment of applicability and transferability; 14 presented more general decision-making or evidence appraisal frameworks. The criteria were synthesized into four main categories: setting, intervention, outcomes and evidence. None of the frameworks covered all the criteria identified. A major limitation was the lack of empirical data used to develop many frameworks and the apparent lack of assessment of their perceived utility. Conclusion: A validated framework of applicability and transferability would help those aiming to encourage research use, as well as those conducting research. Greater understanding of applicability and transferability could help to encourage the appropriate use of research and the development of research that is more useful.

Maternal mortality in low‐income countries: What interventions have been evaluated and how should the evidence base be developed further?

This article reviews the evidence for the effectiveness of non‐clinical interventions to reduce maternal mortality in low‐income settings and identifies the gaps in the evidence base.

National decision-making on adopting new vaccines: a systematic review

In recent years numerous new vaccines have been developed, offering potential reductions in the morbidity and mortality caused by a range of diseases. This has led to increased interest in decision-making about the adoption of new vaccines into national immunization programmes. This paper aims to systematically review the literature on national decision-making around the adoption of new vaccines. A thematic framework was developed inductively through analysis of the vaccine adoption decision-making frameworks included in the review. This thematic framework was then applied to the remaining studies included in the review. In total, 85 articles were included in the review: 39 articles describing examples of vaccine adoption decision-making, 26 presenting vaccine decision-making frameworks, 21 empirical articles of decision-making relating to vaccine adoption and 19 theoretical essays. An analysis of vaccine adoption decision-making frameworks identified nine broad categories of criteria: the importance of the health problem; vaccine characteristics; immunization programme considerations; acceptability; accessibility, equity and ethics; financial/economic issues; impact; alternative interventions and the decision-making process. The quality of the empirical studies was varied. Although some of the issues included in the frameworks were similar to those considered in the studies, there were also some notable differences. On the whole, the frameworks were more comprehensive than the studies, including a greater range of criteria. The existing literature provides a good foundation for further research into vaccine adoption decision-making. The current review, in pulling together what is already known and by identifying strengths, weaknesses and gaps in the existing evidence base, aims to encourage a more focused and rigorous approach to the topic in future. This could help to identify the most appropriate ways to develop vaccine adoption decision-making, so as to improve decisions and, ultimately, health outcomes.

New vaccine adoption: qualitative study of national decision-making processes in seven low- and middle-income countries

As more new and improved vaccines become available, decisions on which to adopt into routine programmes become more frequent and complex. This qualitative study aimed to explore processes of national decision-making around new vaccine adoption and to understand the factors affecting these decisions. Ninety-five key informant interviews were conducted in seven low- and middle-income countries: Bangladesh, Cameroon, Ethiopia, Guatemala, Kenya, Mali and South Africa. Framework analysis was used to explore issues both within and between countries. The underlying driver for adoption decisions in GAVI-eligible countries was the desire to seize GAVI windows of opportunity for funding. By contrast, in South Africa and Guatemala, non-GAVI-eligible countries, the decision-making process was more rooted in internal and political dynamics. Decisions to adopt new vaccines are, by nature, political. The main drivers influencing decisions were the availability of funding, political prioritization of vaccination or the vaccine-preventable disease and the burden of disease. Other factors, such as financial sustainability and feasibility of introduction, were not as influential. Although GAVI procedures have established more formality in decision-making, they did not always result in consideration of all relevant factors. As familiarity with GAVI procedures increased, questioning by decision-makers about whether a country should apply for funding appeared to have diminished. This is one of the first studies to empirically investigate national processes of new vaccine adoption decision-making using rigorous methods. Our findings show that previous decision-making frameworks (developed to guide or study national decision-making) bore little resemblance to real-life decisions, which were dominated by domestic politics. Understanding the realities of vaccine policy decision-making is critical for developing strategies to encourage improved evidence-informed decision-making about new vaccine adoptions. The potential for international initiatives to encourage evidence-informed decision-making should be realised, not assumed.

Impact of introduction of rapid diagnostic tests for malaria on antibiotic prescribing: analysis of observational and randomised studies in public and private healthcare settings

Objectives To examine the impact of use of rapid diagnostic tests for malaria on prescribing of antimicrobials, specifically antibiotics, for acute febrile illness in Africa and Asia. Design Analysisof nine preselected linked and codesigned observational and randomised studies (eight cluster or individually randomised trials and one observational study). Setting Public and private healthcare settings, 2007-13, in Afghanistan, Cameroon, Ghana, Nigeria, Tanzania, and Uganda. Participants 522 480 children and adults with acute febrile illness. Interventions Rapid diagnostic tests for malaria. Main outcome measures Proportions of patients for whom an antibiotic was prescribed in trial groups who had undergone rapid diagnostic testing compared with controls and in patients with negative test results compared with patients with positive results. A secondary aim compared classes of antibiotics prescribed in different settings. Results Antibiotics were prescribed to 127 052/238 797 (53%) patients in control groups and 167 714/283 683 (59%) patients in intervention groups. Antibiotics were prescribed to 40% (35 505/89 719) of patients with a positive test result for malaria and to 69% (39 400/57 080) of those with a negative result. All but one study showed a trend toward more antibiotic prescribing in groups who underwent rapid diagnostic tests. Random effects meta-analysis of the trials showed that the overall risk of antibiotic prescription was 21% higher (95% confidence interval 7% to 36%) in intervention settings. In most intervention settings, patients with negative test results received more antibiotic prescriptions than patients with positive results for all the most commonly used classes: penicillins, trimethoprim-sulfamethoxazole (one exception), tetracyclines, and metronidazole. Conclusions Introduction of rapid diagnostic tests for malaria to reduce unnecessary use of antimalarials—a beneficial public health outcome—could drive up untargeted use of antibiotics. That 69% of patients were prescribed antibiotics when test results were negative probably represents overprescription.This included antibiotics from several classes, including those like metronidazole that are seldom appropriate for febrile illness, across varied clinical, health system, and epidemiological settings. It is often assumed that better disease specific diagnostics will reduce antimicrobial overuse, but they might simply shift it from one antimicrobial class to another. Current global implementation of malaria testing might increase untargeted antibiotic use and must be examined.

Measuring the health systems impact of disease control programmes: a critical reflection on the WHO building blocks framework

BackgroundThe WHO health systems Building Blocks framework has become ubiquitous in health systems research. However, it was not developed as a research instrument, but rather to facilitate investments of resources in health systems. In this paper, we reflect on the advantages and limitations of using the framework in applied research, as experienced in three empirical vaccine studies we have undertaken.DiscussionWe argue that while the Building Blocks framework is valuable because of its simplicity and ability to provide a common language for researchers, it is not suitable for analysing dynamic, complex and inter-linked systems impacts. In our three studies, we found that the mechanical segmentation of effects by the WHO building blocks, without recognition of their interactions, hindered the understanding of impacts on systems as a whole. Other important limitations were the artificial equal weight given to each building block and the challenge in capturing longer term effects and opportunity costs. Another criticism is not of the framework per se, but rather how it is typically used, with a focus on the six building blocks to the neglect of the dynamic process and outcome aspects of health systems.We believe the framework would be improved by making three amendments: integrating the missing “demand” component; incorporating an overarching, holistic health systems viewpoint and including scope for interactions between components. If researchers choose to use the Building Blocks framework, we recommend that it be adapted to the specific study question and context, with formative research and piloting conducted in order to inform this adaptation.SummaryAs with frameworks in general, the WHO Building Blocks framework is valuable because it creates a common language and shared understanding. However, for applied research, it falls short of what is needed to holistically evaluate the impact of specific interventions on health systems. We propose that if researchers use the framework, it should be adapted and made context-specific.

Lessons learnt from human papillomavirus (HPV) vaccination in 45 low- and middle-income countries.

Objective To synthesise lessons learnt and determinants of success from human papillomavirus (HPV) vaccine demonstration projects and national programmes in low- and middle-income countries (LAMICs). Methods Interviews were conducted with 56 key informants. A systematic literature review identified 2936 abstracts from five databases; after screening 61 full texts were included. Unpublished literature, including evaluation reports, was solicited from country representatives; 188 documents were received. A data extraction tool and interview topic guide outlining key areas of inquiry were informed by World Health Organization guidelines for new vaccine introduction. Results were synthesised thematically. Results Data were analysed from 12 national programmes and 66 demonstration projects in 46 countries. Among demonstration projects, 30 were supported by the GARDASIL® Access Program, 20 by Gavi, four by PATH and 12 by other means. School-based vaccine delivery supplemented with health facility-based delivery for out-of-school girls attained high coverage. There were limited data on facility-only strategies and little evaluation of strategies to reach out-of-school girls. Early engagement of teachers as partners in social mobilisation, consent, vaccination day coordination, follow-up of non-completers and adverse events was considered invaluable. Micro-planning using school/ facility registers most effectively enumerated target populations; other estimates proved inaccurate, leading to vaccine under- or over-estimation. Refresher training on adverse events and safe injection procedures was usually necessary. Conclusion Considerable experience in HPV vaccine delivery in LAMICs is available. Lessons are generally consistent across countries and dissemination of these could improve HPV vaccine introduction.

HPV vaccine introduction in Rwanda: Impacts on the broader health system

OBJECTIVES Rwanda was the first country in Africa to introduce the human papillomavirus (HPV) vaccine. This was achieved through multi-year school-based campaigns. Our study evaluated the impact of the HPV vaccine introduction on the countrys immunisation programme and health system. METHODS Thirty key informants were interviewed at national and district levels, and in participating schools. Twenty-seven health facilities completed a questionnaire exploring the effects of the new vaccine introduction on six health system building blocks, as defined by the World Health Organization. Routine service activity data were collected during a 90-day period around the introduction. RESULTS Routine vaccination activities were not disrupted during the delivery, likely due to a strong Expanded Program on Immunization, appropriate planning and a well-resourced operation. Opportunities were seized to co-deliver other interventions targeted at children and adolescents, such as health promotion. Collaboration with the Ministry of Education was strengthened at national level. Although there were some temporary increases in staff workload, no major negative effects were reported. CONCLUSION Despite its delivery through school-based campaigns, the HPV vaccine integrated well into the immunisation programme and health system. The introduction had no major negative effects. Some opportunities were seized to expand services and collaborations.

Improving prescribing practices with rapid diagnostic tests (RDTs): synthesis of 10 studies to explore reasons for variation in malaria RDT uptake and adherence

Objectives The overuse of antimalarial drugs is widespread. Effective methods to improve prescribing practice remain unclear. We evaluated the impact of 10 interventions that introduced rapid diagnostic tests for malaria (mRDTs) on the use of tests and adherence to results in different contexts. Design A comparative case study approach, analysing variation in outcomes across different settings. Setting Studies from the ACT Consortium evaluating mRDTs with a range of supporting interventions in 6 malaria endemic countries. Providers were governmental or non-governmental healthcare workers, private retail sector workers or community volunteers. Each study arm in a distinct setting was considered a case. Participants 28 cases from 10 studies were included, representing 148 461 patients seeking care for suspected malaria. Interventions The interventions included different mRDT training packages, supervision, supplies and community sensitisation. Outcome measures Analysis explored variation in: (1) uptake of mRDTs (% febrile patients tested); (2) provider adherence to positive mRDTs (% Plasmodium falciparum positive prescribed/given Artemisinin Combination Treatment); (3) provider adherence to negative mRDTs (% P. falciparum negative not prescribed/given antimalarial). Results Outcomes varied widely across cases: 12–100% mRDT uptake; 44–98% adherence to positive mRDTs; 27–100% adherence to negative mRDTs. Providers appeared more motivated to perform well when mRDTs and intervention characteristics fitted with their own priorities. Goodness of fit of mRDTs with existing consultation and diagnostic practices appeared crucial to maximising the impact of mRDTs on care, as did prior familiarity with malaria testing; adequate human resources and supplies; possible alternative treatments for mRDT-negative patients; a more directive intervention approach and local preferences for ACTs. Conclusions Basic training and resources are essential but insufficient to maximise the potential of mRDTs in many contexts. Programme design should respond to assessments of provider priorities, expectations and capacities. As mRDTs become established, the intensity of supporting interventions required seems likely to reduce.