Fiona L. Hamilton

The Effectiveness of Prompts to Promote Engagement With Digital Interventions: A Systematic Review

Background Digital interventions have been effective in improving numerous health outcomes and health behaviors; furthermore, they are increasingly being used in different health care areas, including self-management of long-term conditions, mental health, and health promotion. The full potential of digital interventions is hindered by a lack of user engagement. There is an urgent need to develop effective strategies that can promote users’ engagement with digital interventions. One potential method is the use of technology-based reminders or prompts. Objective To evaluate the effectiveness of technology-based strategies for promoting engagement with digital interventions. Methods Cochrane Collaboration guidelines on systematic review methodology were followed. The search strategy was executed across 7 electronic databases: the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, Web of Science, the Education Resources Information Center (ERIC), PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature (CINAHL). Databases were searched from inception to September 13, 2013, with no language or publication type restrictions, using three concepts: randomized controlled trials, digital interventions, and engagement. Gray literature and reference lists of included studies were also searched. Titles and abstracts were independently screened by 2 authors, then the full texts of potentially eligible papers were obtained and double-screened. Data from eligible papers were extracted by one author and checked for accuracy by another author. Bias was assessed using the Cochrane risk of bias assessment tool. Narrative synthesis was performed on all included studies and, where appropriate, data were pooled using meta-analysis. All findings were reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Results A total of 14 studies were included in the review with 8774 participants. Of the 14 studies, 9 had sufficient data to be included in the meta-analyses. The meta-analyses suggested that technology-based strategies can potentially promote engagement compared to no strategy for dichotomous outcomes (relative risk [RR] 1.27, 95% CI 1.01-1.60, I2=71%), but due to considerable heterogeneity and the small sample sizes in most studies, this result should be treated with caution. No studies reported adverse or economic outcomes. Only one study with a small sample size compared different characteristics; the study found that strategies promoting new digital intervention content and those sent to users shortly after they started using the digital intervention were more likely to engage users. Conclusions Overall, studies reported borderline positive effects of technology-based strategies on engagement compared to no strategy. However, the results have to be interpreted with caution. More research is needed to replicate findings and understand which characteristics of the strategies are effective in promoting engagement and how cost-effective they are.

The effectiveness of technology-based strategies to promote engagement with digital interventions: a systematic review protocol.

Background Digital interventions provide effective and potentially cost-effective models for improving health outcomes as they deliver health information and services that are widely disseminated, confidential, and can be tailored to needs of the individual user. Digital interventions have been used successfully for health promotion, mental health, and for enabling self-management of long-term conditions. However, their effectiveness is limited by low usage rates, with non-engagement a major challenge. Hence, it is crucial to find effective strategies to increase user engagement with digital interventions. Objective This systematic review will aim to evaluate the effectiveness of technology-based strategies to promote engagement with digital interventions. Methods We will follow Cochrane Collaboration guidelines on systematic review methodology. The search strategy will be executed across seven e-databases (including MEDLINE, EMBASE, PsycINFO, CINAHL) using the concepts “digital intervention” and “engagement”, limited by study type (randomized controlled trial). Grey literature and reference lists of included studies will be searched. Titles and abstracts will be independently screened by 2 authors. Then the full text of potentially eligible papers will be obtained and double screened. Data from eligible papers will be extracted by 1 author and checked for accuracy by another author. Bias will be assessed using the Cochrane bias assessment tool. Narrative synthesis will report on all included studies, and where appropriate, data will be pooled using meta-analysis. All findings will be reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Sources of heterogeneity will be further investigated if required. Results Our research is in progress. The final draft of the systematic review is being written and will be submitted before the end of 2015. Conclusions The review findings will inform researchers and digital intervention providers about optimal use of technology-based strategies to promote engagement with digital interventions. Trial Registration PROSPERO International Prospective Register of Systematic Reviews: CRD42014010164; http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42014010164#.VTZmmiFViko (Archived by WebCite at http://www.webcitation.org/6XxQC8fT8).

DIgital Alcohol Management ON Demand (DIAMOND) feasibility randomised controlled trial of a web-based intervention to reduce alcohol consumption in people with hazardous and harmful use versus a face-to-face intervention: protocol

Background“Hazardous and harmful” drinkers make up approximately 23xa0% of the adult population in England. However, only around 10xa0% of these people access specialist care, such as face-to-face extended brief treatment in community alcohol services. This may be due to stigma, difficulty accessing services during working hours, a shortage of trained counsellors and limited provision of services in many places. Web-based alcohol treatment programmes may overcome these barriers and may better suit people who are reluctant or unable to attend face-to-face services, but there is a gap in the evidence base for the acceptability, effectiveness and cost-effectiveness of these programmes compared with treatment as usual (TAU) in community alcohol services.This study aims investigate the feasibility of all parts of a randomised controlled trial (RCT) of a psychologically informed web-based alcohol treatment programme called Healthy Living for People who use Alcohol (HeLP-Alcohol) versus TAU in community alcohol services, e.g. recruitment and retention, online data collection methods, and the use and acceptability of the intervention to participants.MethodsA feasibility RCT delivered in north London community alcohol services, comparing HeLP-Alcohol with TAU. Potential participants are aged ≥18xa0years referred or self-referred for hazardous and harmful use of alcohol, without co-morbidities or other complex problems. The main purpose of this study is to demonstrate the feasibility of recruiting participants to the study and will test online methods for collecting baseline demographic and outcome questionnaire data, randomising participants and collecting 3-month follow-up data. The acceptability of this intervention will be measured by recruitment and retention rates, automated log-in data collection and an online service satisfaction questionnaire. The feasibility of using tailored text message, email or phone prompt to maintain engagement with the intervention will also be explored. Results of the study will inform a definitive Phase 3 RCT.ResultsRecruitment started on 26 September 2014 and will run for 1xa0year.ConclusionThe proposed trial will provide data to inform a fully powered non-inferiority effectiveness and cost-effectiveness RCT comparing HeLP-Alcohol with TAU.Trial registrationISRCTN31789096.

Quality of Publicly Available Physical Activity Apps: Review and Content Analysis

Background Within the new digital health landscape, the rise of health apps creates novel prospects for health promotion. The market is saturated with apps that aim to increase physical activity (PA). Despite the wide distribution and popularity of PA apps, there are limited data on their effectiveness, user experience, and safety of personal data. Objective The purpose of this review and content analysis was to evaluate the quality of the most popular PA apps on the market using health care quality indicators. Methods The top-ranked 400 free and paid apps from iTunes and Google Play stores were screened. Apps were included if the primary behavior targeted was PA, targeted users were adults, and the apps had stand-alone functionality. The apps were downloaded on mobile phones and assessed by 2 reviewers against the following quality assessment criteria: (1) users’ data privacy and security, (2) presence of behavior change techniques (BCTs) and quality of the development and evaluation processes, and (3) user ratings and usability. Results Out of 400 apps, 156 met the inclusion criteria, of which 65 apps were randomly selected to be downloaded and assessed. Almost 30% apps (19/65) did not have privacy policy. Every app contained at least one BCT, with an average number of 7 and a maximum of 13 BCTs. All but one app had commercial affiliation, 12 consulted an expert, and none reported involving users in the app development. Only 12 of 65 apps had a peer-reviewed study connected to the app. User ratings were high, with only a quarter of the ratings falling below 4 stars. The median usability score was excellent—86.3 out of 100. Conclusions Despite the popularity of PA apps available on the commercial market, there were substantial shortcomings in the areas of data safety and likelihood of effectiveness of the apps assessed. The limited quality of the apps may represent a missed opportunity for PA promotion.

Impact of Financial Incentives on Alcohol Consumption Recording in Primary Health Care Among Adults with Schizophrenia and Other Psychoses:A Cross-Sectional and Retrospective Cohort Study

AIMS: Lack of financial incentive is a frequently cited barrier to alcohol screening in primary care. The Quality and Outcomes Framework (QOF) pay for performance scheme has reimbursed UK primary care practices for alcohol screening in people with schizophrenia since April 2011. This study aimed to determine the impact of financial incentives on alcohol screening by comparing rates of alcohol recording in people with versus those without schizophrenia between 2000 and 2013. METHODS: Cross-sectional and retrospective cohort study. Alcohol data were extracted from The Health Improvement Network (THIN) database of UK primary care records using (a) Read Codes for level of alcohol consumption, (b) continuous measures of drinking (e.g. units a week) and (c) Read Codes for types of screening test. RESULTS: A total of 14,860 individuals (54% (8068) men and 46% (6792) women) from 409 general practices aged 18-99 years with schizophrenia were identified during April 2011-March 2013. Of these, 11,585 (78%) had an alcohol record, of which 99% (8150/8257) of Read Codes for level of consumption were eligible for recompense in the QOF. There was an 839% increase in alcohol recording among people with schizophrenia over the 13-year period (rate ratio per annum increase 1.19 (95% CI 1.18-1.20)) compared with a 62% increase among people without a severe mental illness (rate ratio per annum increase 1.04 (95% CI 1.03-1.05)). CONCLUSION: Financial incentives offered by the QOF appear to have a substantial impact on alcohol screening among people with schizophrenia in UK primary care. SHORT SUMMARY: Alcohol screening among people with schizophrenia increased dramatically in primary health care following the introduction of the UK pay for performance incentive scheme (Quality and Outcomes Framework) for severe mental illness, with an 839% rise (>8-fold increase) compared with a 62% increase among people without a over the 13-year study period (2000-2013).

Promoting Engagement With a Digital Health Intervention (HeLP-Diabetes) Using Email and Text Message Prompts: Mixed-Methods Study

Background Engagement with digital health interventions (DHIs) may be regarded as a prerequisite for the intervention to achieve positive health or behavior change outcomes. One method employed to promote engagement is the use of prompts such as emails and text messages. However, little is known about the characteristics of prompts that promote engagement. This study explored the association between the content and delivery mode of prompts and the users’ engagement with HeLP-Diabetes (Healthy Living for People with type 2 Diabetes), a DHI that aimed to promote self-management in adults with type 2 diabetes. Objective The objective of this study was to identify the characteristics of prompts, specifically the content and delivery mode, which were associated with increased engagement. Methods This was a mixed-methods study. Email and text message prompts were sent to the registered users of HeLP-Diabetes. Use of the intervention was recorded and examined to identify which email and text message prompts were associated with subsequent visits to the DHI. Characteristics of prompts that were identified as particularly effective or ineffective were explored through think-aloud interviews with the participants. Results Of a total of 39 email prompts, 49% (19/39) prompts showed a significant association with subsequent visits to the DHI. However, none of the text message prompts were associated with subsequent visits to the DHI. Furthermore, think-aloud interviews were carried out with 6 experienced participants with type 2 diabetes. The findings suggest that these participants preferred email prompts that were clear, relatively short, and empowering; used nondirective advice; included health professional references; were visually appealing; and contained news and updates. Conclusions The findings of this study contribute to the existing evidence supporting the role of email prompts in promoting and maintaining engagement with DHIs. This study described the content of prompts that may be engaging. However, the results should be interpreted with caution, as prompts may be context-specific interventions and the results may not be generalizable across other DHIs or other types of interventions targeting self-management of type 2 diabetes.

DIAMOND (DIgital Alcohol Management ON Demand): a mixed methods feasibility RCT and embedded process evaluation of a digital health intervention to reduce hazardous and harmful alcohol use

BackgroundAlcohol is a major risk factor for preventable illness, with huge cost to healthcare economies. There is a role for alcohol-specific digital health interventions (DHI), but there have been few randomised controlled trials (RCT) comparing DHI with face-to-face treatment. Such trials are complex and face obstacles in recruitment and retention.MethodsMixed-methods feasibility RCT of an alcohol DHI, testing recruitment, online data-collection and randomisation processes, with an embedded process evaluation. Recruitment ran from October 2014 for 9xa0months. Participants were adults drinking at hazardous and harmful levels, attending four community drug and alcohol services (CDAS) in London. Participants completed baseline demographic, alcohol-related and other psychological questionnaires online and were randomised to HeLP-Alcohol, a six-module DHI with weekly reminder prompts (phone, email or text message), which mirrors face-to-face treatment, or to face-to-face treatment at CDAS. Alcohol counsellors took part in qualitative interviews at the end of the study.ResultsAlcohol counsellors screened 1253 patients. One thousand one hundred eighty-nine did not meet inclusion criteria so were excluded: 579 were dependent drinkers, 548 had health conditions that made them ineligible to take part and 62 were ineligible for other reasons including homelessness. Of the 64 patients who were eligible to take part, 54 declined to participate, with 36 stating a preference for face-to-face treatment, 13 gave no reason, and 5 gave other reasons including not wanting to use a computer. Ten consented but then 3 changed their minds, so we were able to randomise 7 participants to the study (11% of eligible).Five alcohol counsellors agreed to be interviewed for the process evaluation and provided the following feedback: Although most of their colleagues were enthusiastic about the trial, some were not at equipoise in recruiting; potential participants also declared strong preference to intervention arm from the outset. These factors affected recruitment. Counsellors also lacked time to undertake the data inputting and follow-up of participants in addition to their everyday work.ConclusionsThis feasibility study aimed to test recruitment, randomisation, retention and data collection methods but recruited only 7 participants so these aims were not fully achieved. This illustrates to all researchers of complex interventions the importance of conducting feasibility studies and is generalisable to areas other than alcohol research.CDAS were seeing larger numbers of non-dependent drinkers with complex additional problems than alcohol commissioners expected. CDAS clients and some counsellors were not at equipoise for recruitment. Alternative settings for recruitment need to be explored in future trials.Trial registrationInternational Standard Randomized Controlled Trial Number: ISRCTN31789096, DOI 10.1186/ISRCTN31789096

Monitoring of alcohol consumption in primary care among adults with bipolar disorder: A cross-sectional and retrospective cohort study.

BACKGROUNDnScreening for alcohol use disorders is an important priority in the healthcare of people with bipolar disorder, incentivised in UK primary care since 2011, through the Quality and Outcomes Framework (QOF). The extent of alcohol monitoring in primary care, and impact of QOF, is unknown. The aim was to examine recording of alcohol consumption in primary care.nnnMETHODSnPoisson regression of biennial alcohol recording rates between 2000 and 2013 among 14,051 adults with bipolar disorder and 90,023 adults without severe mental illness (SMI), from 484 general practices contributing to The Health Improvement Network UK-wide primary care database.nnnRESULTSnAlcohol recording rates among people with bipolar disorder increased from 88.6 records per 1000 person-years (95% confidence interval 81.2-96.6) in 2000/2002 to 837.4 records per 1000 person-years (817.4-858.0) in 2011/2013; a more than nine-fold increase, mainly occurring after the introduction of the QOF incentive in 2011. In 2000/2002 alcohol recording levels among people with bipolar disorder were not statistically significantly different from those without SMI (adjusted rate ratio 0.96, 0.88-1.05). By 2011/2013, people with bipolar disorder were over four times as likely to have an alcohol record: adjusted rate ratio 4.45 (4.15-4.77).nnnLIMITATIONSnThe routinely collected data may be incomplete. Alcohol data entered as free-text was not captured.nnnCONCLUSIONSnThe marked rise in alcohol consumption recording highlights what can be achieved. It is most likely attributable to QOF, suggesting that QOF, or similar schemes, can be powerful tools in promoting aspects of healthcare.

DIAMOND (DIgital Alcohol Management ON Demand): a feasibility RCT and embedded process evaluation of a digital health intervention to reduce hazardous and harmful alcohol use recruiting in hospital emergency departments and online

BackgroundThe harmful use of alcohol is a causal factor in more than 200 disease and injury conditions and leads to over 3 million deaths every year worldwide. Relatively few problem alcohol users access treatment due to stigma and lack of services. Alcohol-specific digital health interventions (DHI) may help them, but trial data comparing DHI with face-to-face treatment are lacking.MethodsWe conducted a feasibility RCT of an alcohol DHI, testing recruitment, online data-collection and randomisation processes, with an embedded process evaluation. Recruitment ran from October 2015 for 12xa0months. Participants were adults, drinking at hazardous and harmful levels, recruited from hospital emergency departments (ED) in London or recruited online. Participants were randomised to HeLP-Alcohol, a six module DHI with weekly reminder prompts (phone, email or text message), or to face-to-face treatment as usual (TAU). Participants were invited to take part in qualitative interviews after the trial.ResultsThe trial website was accessed 1074 times: 420 people completed online eligibility questionnaires; 350 did not meet eligibility criteria, 51 declined to participate, and 19 were recruited and randomised. Follow-up data were collected from three participants (retention 3/19), and four agreed to be interviewed for the process evaluation. The main themes of the interviews were:Participants were not at equipoise. They wanted to try the website and were disappointed to be randomised to face-to-face, so they were less engaged and dropped out.Other reasons for drop out included not accepting that they had a drink problem; problem drinking interfering with their ability to take part in a trial or forgetting appointments; having a busy life and being randomised to TAU made it difficult to attend appointments.ConclusionsThis feasibility RCT aimed to test recruitment, randomisation, retention, and data collection methods, but recruited only 19 participants. This illustrates the importance of undertaking feasibility studies prior to fully powered RCTs. From the qualitative interviews we found that potential recruits were not at equipoise for recruitment. An alternative methodology, for example a preference RCT recruiting from multiple locations, needs to be explored in future trials.Trial registrationInternational Standard Randomized Controlled Trial Number: ISRCTN31789096

The Public Health Potential of the Current Health Apps for Increasing Physical Activity

I consider my PhD as having 2 distinctive parts: A) to ascertain the quality of physical activity (PA) applications (apps) on the market in terms of safety, effectiveness, and user experience (Studies 1, 2); B) to assessthe efficacy of selected PA apps with potential, physically inactive, users (Studies 3, 4). I am finalising part A of the PhD and I am writing the protocols for part B. It would be valuable to gain the views of experts to make sure I am considering the topic from both behaviour change discipline and user experience research.