Lawrence Doi

Six steps in quality intervention development (6SQuID)

Improving the effectiveness of public health interventions relies as much on the attention paid to their design and feasibility as to their evaluation. Yet, compared to the vast literature on how to evaluate interventions, there is little to guide researchers or practitioners on how best to develop such interventions in practical, logical, evidence based ways to maximise likely effectiveness. Existing models for the development of public health interventions tend to have a strong social-psychological, individual behaviour change orientation and some take years to implement. This paper presents a pragmatic guide to six essential Steps for Quality Intervention Development (6SQuID). The focus is on public health interventions but the model should have wider applicability. Once a problem has been identified as needing intervention, the process of designing an intervention can be broken down into six crucial steps: (1) defining and understanding the problem and its causes; (2) identifying which causal or contextual factors are modifiable: which have the greatest scope for change and who would benefit most; (3) deciding on the mechanisms of change; (4) clarifying how these will be delivered; (5) testing and adapting the intervention; and (6) collecting sufficient evidence of effectiveness to proceed to a rigorous evaluation. If each of these steps is carefully addressed, better use will be made of scarce public resources by avoiding the costly evaluation, or implementation, of unpromising interventions.

Alcohol brief interventions in Scottish antenatal care: A qualitative study of midwives' attitudes and practices

BackgroundInfants exposed to alcohol in the womb are at increased risk of experiencing health problems. However, mixed messages about the consequences of prenatal alcohol consumption have resulted in inconsistent attitudes and practices amongst some healthcare practitioners. Screening and alcohol brief interventions (ABIs) can reduce risky drinking in various clinical settings. Recently, a program of screening and ABIs have been implemented in antenatal care settings in Scotland. However, current evidence suggests that midwives’ involvement in alcohol brief interventions activities is patchy. This study explored midwives’ attitudes and practices regarding alcohol screening and ABIs in order to understand why they are relatively underutilized in antenatal care settings compared to other clinical settings.MethodsThis was a qualitative study, involving semi-structured interviews with 15 midwives and a focus group with a further six midwifery team leaders (21 participants in total) in Scotland. Interview transcripts were analysed using thematic analysis.ResultsMidwives were positive about their involvement in the screening and ABI program. However, they were not completely convinced about the purpose and value of the screening and ABIs in antenatal care. In the midst of competing priorities, the program was seen as having a low priority in their workload. Midwives felt that the rapport between them and pregnant women was not sufficiently established at the first antenatal appointment to allow them to discuss alcohol issues appropriately. They reported that many women had already given up drinking or were drinking minimal amounts prior to the first antenatal appointment.ConclusionsMidwives recognised the important role they could play in alcohol intervention activities in antenatal care. As the majority of women stop consuming alcohol in pregnancy, many will not need an ABI. Those who have not stopped are likely to need an ABI, but midwives were concerned that it was this group that they were most likely to alienate by discussing such concerns. Further consideration should be given to pre-pregnancy preventative measures as they are more likely to reduce alcohol-exposed pregnancies.

Seven key investments for health equity across the lifecourse: Scotland versus the rest of the UK

While widespread lip service is given in the UK to the social determinants of health (SDoH), there are few published comparisons of how the UKs devolved jurisdictions ‘stack up’, in terms of implementing SDoH-based policies and programmes, to improve health equity over the life-course. Based on recent SDoH publications, seven key societal-level investments are suggested, across the life-course, for increasing health equity by socioeconomic position (SEP). We present hard-to-find comparable analyses of routinely collected data to gauge the relative extent to which these investments have been pursued and achieved expected goals in Scotland, as compared with England and Wales, in recent decades. Despite Scotlands longstanding explicit goal of reducing health inequalities, it has recently been doing slightly better than England and Wales on only one broad indicator of health-equity-related investments: childhood poverty. However, on the following indicators of other ‘best investments for health equity’, Scotland has not achieved demonstrably more equitable outcomes by SEP than the rest of the UK: infant mortality and teenage pregnancy rates; early childhood education implementation; standardised educational attainment after primary/secondary school; health care system access and performance; protection of the population from potentially hazardous patterns of food, drink and gambling use; unemployment. Although Scotland did not choose independence on September 18th, 2014, it could still (under the planned increased devolution of powers from Westminster) choose to increase investments in the underperforming categories of interventions for health equity listed above. However, such discussion is largely absent from the current post-referendum debate. Without further significant investments in such policies and programmes, Scotland is unlikely to achieve the ‘healthier, fairer society’ referred to in the current Scottish Governments official aspirations for the nation.

Realist evaluation of an enhanced health visiting programme

Background The health visitors’ role in many countries is changing. In Scotland, the role has undergone substantial changes through the introduction of an enhanced health visiting programme, which includes increased, structured home visits. This evaluation was conducted within NHS Ayrshire and Arran, one of the 14 Scottish Health Boards. Our aim was to understand and explain how, and why, the programme could contribute to improving health and wellbeing outcomes for children and families. Methods We used a realist evaluation approach, conducted in three phases. In phase one, eight managerial staff involved in developing and implementing the programme provided data, which were used to develop initial programme theories. In phase two, the programme theories were tested using qualitative data from 25 health visitors and 22 parents. The programme theories were refined through analyses and interpretation of data in phase three. Results The home visiting context provided by the programme interacted with the mechanisms of the programme and produced outcomes such as early identification of health and wellbeing issues amongst families who needed more support, leading to referral and engagement with sources of additional help. The home visits facilitated development of parent-health visitor relationships, and parents considered health visitors as their first point of contact on children’s wellbeing and developmental-related issues. Moreover, the programme provided more clarity to health visitors’ role, which in turn enhanced partnership working. However, there were aspects of the programme that may require further development. For instance, both parents and health visitors were concerned about the wide gaps between some home visits. Conclusions The enhanced health visiting programme increased opportunities for monitoring and early identification of health and wellbeing concerns. It created structures for a more efficient partnership working and ensured that the needs of children and families were supported. These benefits need to be evaluated further in an effectiveness study.

A realist evaluation of an antenatal programme to change drinking behaviour of pregnant women

Objective to use realist evaluation to describe and explain how and in what circumstances screening and alcohol brief interventions work in routine antenatal care. Design a realist evaluation incorporating systematic reviews and qualitative data. Setting NHS Lothian, which is one of the 14 Scottish health boards. Participants participants were recruited from two maternity units. In phase one, interviews were conducted with four participants responsible for policy implementation. These data were supported by two systematic reviews. In phase two, 17 pregnant women and 15 midwives participated in interviews, with a further six midwifery team leaders involved in a focus group. Findings training and resources provided to midwives as part of the programme acted as facilitating mechanisms that improved their skills and confidence to screen and deliver alcohol brief interventions. The programme elicited positive change in attitudes to drinking in pregnancy and possibly stimulated drinking behaviour change amongst pregnant women. However, the small numbers of pregnant women being identified for alcohol brief interventions meant delivery was infrequent and resulted in the programme not working as anticipated. The findings also revealed contextual issues around midwife–pregnant woman relationship and the challenges of negotiating the timing of screening and alcohol brief interventions delivery. Conclusions Drinking in pregnancy is an emotive issue, therefore delivering alcohol brief interventions at the first antenatal appointment when they are more likely to achieve the most benefits poses challenges. When training midwives to screen and deliver alcohol brief interventions, special attention is needed to improve person-centred communication skills to overcome barriers associated with discussing sensitive prenatal alcohol use and enhance early identification and delivery of alcohol brief interventions at the first antenatal appointment.

Translating research into practice: a cross-sectional study using the Early Development Instrument to assess early years interventions in local level public health practice

Abstract Background Evidence that early years interventions can reduce inequalities has led to Scottish Government policy recommending that local areas implement initiatives to improve early child development. How best to measure the effects of these interventions is, however, unclear. We conducted a pilot study of the first UK use of the teacher-administered Early Development Instrument (EDI), an internationally validated measure of global child development now used at school entry in all children in Australia and most of Canada. Methods The study, conducted in the primary school setting in 2011–12, was cross-sectional in design and used qualitative and quantitative methods. During phase 1 the EDI was adapted for the Scottish context. 14 teachers assessed 154 pupils, using the instrument. Focus groups and semi-structured questionnaires were used to gather feedback from teacher participants on the instrument and the process. Phase 2 collected and analysed data from 1090 pupil participants, comprising 98% of eligible school-entrants in East Lothian local authority, assessed by 68 teachers. The 104-item EDI questionnaire has five domains of child development: physical, social, emotional, language and cognitive, and communication and general knowledge. Data were analysed with SPSS (version 17.0). The psychometric properties of the EDI were assessed with Cronbachs α. Mean scores in the domains were linked to levels of deprivation and results were mapped using Geographic Information System. Phase 3 monitored subsequent dissemination and use of EDI results. The study was approved by the School of Psychological Sciences and Health Ethics Committee of the University of Strathclyde, Glasgow, UK; the Education Authority of the relevant school district; and the Chief Scientist Office of the Scottish Government. In line with EDI data collection in other countries, opt-out consent was used for parents of pupils. All teachers provided written, informed consent. Findings Children in the most deprived quintile were 2·8 times more likely than the most affluent to be developmentally vulnerable in one or more domains; however, substantial developmental vulnerability was found across all five quintiles, not only in the most deprived. The EDI was found to be user friendly and acceptable to teachers, demonstrating high levels of internal reliability. Dissemination of results created a forum for multidisciplinary discussion and raised awareness about the importance of early child development, domains of development, and how inequalities can be tackled, leading to new initiatives based on EDI data. Interpretation The EDI is a robust instrument able to highlight developmental differences in children between socioeconomic groups and small-scale geographical areas. Its simplicity and usability lend themselves easily to community-wide implementation. Funding Medical Research Council and Chief Scientist Office of the Scottish Government.

Credibility of subgroup analyses by socioeconomic status in public health intervention evaluations: An underappreciated problem?

There is increasing interest amongst researchers and policy makers in identifying the effect of public health interventions on health inequalities by socioeconomic status (SES). This issue is typically addressed in evaluation studies through subgroup analyses, where researchers test whether the effect of an intervention differs according to the socioeconomic status of participants. The credibility of such analyses is therefore crucial when making judgements about how an intervention is likely to affect health inequalities, although this issue appears to be rarely considered within public health. The aim of this study was therefore to assess the credibility of subgroup analyses in published evaluations of public health interventions. An established set of 10 credibility criteria for subgroup analyses was applied to a purposively sampled set of 21 evaluation studies, the majority of which focussed on healthy eating interventions, which reported differential intervention effects by SES. While the majority of these studies were found to be otherwise of relatively high quality methodologically, only 8 of the 21 studies met at least 6 of the 10 credibility criteria for subgroup analysis. These findings suggest that the credibility of subgroup analyses conducted within evaluations of public health interventions’ impact on health inequalities may be an underappreciated problem.

Adolescents and health-related behaviour: using a framework to develop interventions to support positive behaviours

BackgroundExperimentation is a natural part of adolescent maturation. In conjunction with increased exposure to behaviours such as alcohol or substance use, and the potentially intensified influence of peer groups, unhealthy behaviour patterns may develop as part of this experimentation. However, the adolescent years also provide considerable opportunity for behaviour to be shaped in positive ways that may improve immediate and longer term health outcomes. A systematic review carried out by the authors concluded that physiological changes during adolescence need to be considered when designing or implementing interventions, due to their influence on health behaviours. The aim of the study is to demonstrate how the six steps in quality intervention development (6SQuID) framework can be used, in conjunction with research or review findings, to inform the development of pilot or feasibility studies. Using the synthesised findings from our adolescent systematic review, we sought to illustrate how adolescent interventions might be designed to target specific health behaviours and augment positive adolescent health outcomes.MethodsWe applied the 6SQuID framework to the findings from a review of adolescent physiological influences on health behaviour. This involved following the process defined within 6SQuID and applying the sequential steps to build a proposed pilot study, based on the pre-defined findings of our systematic review. We used the Social Learning Theory to assist in identifying how and why change can be influenced, with and for adolescents.ResultsWe devised a pilot study example, targeting teaching assistants, to illustrate how the detailed steps within the 6SQuID framework can assist the development and subsequent implementation of adolescent interventions that are likely to be effective.ConclusionsThis paper gives details of how the 6SQuID framework can be used for intervention development, using specific research findings, across a variety of adolescent health behaviours. This example provides details of how to operationalise 6SQuID in practical terms that are transferrable to other populations and situations. In this respect, we anticipate that this illustrative case may be of use in the design, development, and implementation of a wide variety of interventions.

Failures in reproductive Health Policy: Overcoming the consequences and causes of inaction

It is assumed that long-established research findings and internationally accepted evidence should, and will, be translated into policy and practice. Knowledge about what prevents harm and promotes health has, in fact, guided and resulted in numerous beneficial public health actions. However, such is not always the case. The authors examine three notable, and unwelcome, exceptions in the UK-all in the field of reproductive health and all focused on the period prior to pregnancy. The three examples of counterproductive inaction discussed are: fortifying flour with Vitamin B9 (folic acid); preventing foetal alcohol spectrum disorders; and reducing risks and better regulating a highly teratogenic medication (valproate). The adverse consequences, as well as the causes, of inaction are analysed for each example. Reasons for optimism, and recommendations for overcoming inaction, are also offered, in particular, greater priority should be accorded to preconception health, education and care.

Impact of early learning and child care on the parents of children pre-school children: results of a rapid systematic review

Abstract Background The Scottish Government aims to make Scotland the best place in the world to grow up in for children and families. To realise this vision, strategic policy changes intend to ensure that increased access to funded early learning and child care (ELC) is available. This will facilitate parental employment, or enable re-entry to education and training, while children are cared for in safe, stimulating environments. To inform this vision, the Public Health Evidence Network was asked to provide evidence on the impact of ELC on parental outcomes. This study aimed to investigate the impact of early learning and child care on parents with pre-school children across a broad range of countries. Methods A rapid systematic review was conducted from June 1 to Sept 30, 2016. Two reviewers independently assessed papers for eligibility, using a protocol aligned to the PRISMA-R guidelines. Databases searched were Medline, ERIC, EMBASE, EConLit, Education Abstracts, Education Source, Web of Science, ASSIA, Sociological Abstracts, IBSS, PsycINFO, and the British Education Index. Key and text words associated with early learning, child care, parents, young children, and employment were adapted for use across all databases. All English language publication types and research designs were sought, to enable inclusion of primary studies and expert (grey literature) reports. Because of heterogeneity of study type, methods, and outcome measures, meta-analysis and quality appraisal were not feasible. A narrative analysis, using a tabulated system that facilitated cross-checking of results across studies, was done to produce a fuller understanding of factors beyond cause and effect. Findings Of 5442 initial papers, 54 met the inclusion criteria. Analysis revealed two main areas of focus—namely, those pertaining to ELC provision (flexibility, availability, affordability, and quality), and those that related to parental impact (employability, socioeconomic issues, and health and wellbeing). Interpretation Our findings support the case that affordable and accessible ELC can potentially mitigate the impacts of economic and social disadvantage by facilitating parental, particularly maternal, employment and employability, thus serving a redistributive function. However, policy must ensure that affordability, flexibility, and availability meet the needs of a range of groups, including those at disadvantage. Funding UK Medical Research Council (MR/KO 023209/1), Chief Scientist Office, NHS Health Scotland.