Robin N. Kok

Persuasive System Design Does Matter: A Systematic Review of Adherence to Web-Based Interventions

Background Although web-based interventions for promoting health and health-related behavior can be effective, poor adherence is a common issue that needs to be addressed. Technology as a means to communicate the content in web-based interventions has been neglected in research. Indeed, technology is often seen as a black-box, a mere tool that has no effect or value and serves only as a vehicle to deliver intervention content. In this paper we examine technology from a holistic perspective. We see it as a vital and inseparable aspect of web-based interventions to help explain and understand adherence. Objective This study aims to review the literature on web-based health interventions to investigate whether intervention characteristics and persuasive design affect adherence to a web-based intervention. Methods We conducted a systematic review of studies into web-based health interventions. Per intervention, intervention characteristics, persuasive technology elements and adherence were coded. We performed a multiple regression analysis to investigate whether these variables could predict adherence. Results We included 101 articles on 83 interventions. The typical web-based intervention is meant to be used once a week, is modular in set-up, is updated once a week, lasts for 10 weeks, includes interaction with the system and a counselor and peers on the web, includes some persuasive technology elements, and about 50% of the participants adhere to the intervention. Regarding persuasive technology, we see that primary task support elements are most commonly employed (mean 2.9 out of a possible 7.0). Dialogue support and social support are less commonly employed (mean 1.5 and 1.2 out of a possible 7.0, respectively). When comparing the interventions of the different health care areas, we find significant differences in intended usage (p = .004), setup (p < .001), updates (p < .001), frequency of interaction with a counselor (p < .001), the system (p = .003) and peers (p = .017), duration (F = 6.068, p = .004), adherence (F = 4.833, p = .010) and the number of primary task support elements (F = 5.631, p = .005). Our final regression model explained 55% of the variance in adherence. In this model, a RCT study as opposed to an observational study, increased interaction with a counselor, more frequent intended usage, more frequent updates and more extensive employment of dialogue support significantly predicted better adherence. Conclusions Using intervention characteristics and persuasive technology elements, a substantial amount of variance in adherence can be explained. Although there are differences between health care areas on intervention characteristics, health care area per se does not predict adherence. Rather, the differences in technology and interaction predict adherence. The results of this study can be used to make an informed decision about how to design a web-based intervention to which patients are more likely to adhere.

The Effectiveness of Cognitive Bias Modification Interventions for Substance Addictions: A Meta-Analysis.

Background and Aims Cognitive bias modification (CBM) interventions, presumably targeting automatic processes, are considered particularly promising for addictions. We conducted a meta-analysis examining randomized controlled trials (RCTs) of CBM for substance addiction outcomes. Methods Studies were identified through systematic searches in bibliographical databases. We included RCTs of CBM interventions, alone or in combination with other treatments, for any type of addiction. We examined trial risk of bias, publication bias and possible moderators. Effects sizes were computed for post-test and follow-up, using a random-effects model. We grouped outcome measures and reported results for addiction (all related measures), craving and cognitive bias. Results We identified 25 trials, 18 for alcohol problems, and 7 for smoking. At post-test, there was no significant effect of CBM for addiction, g = 0.08 (95% CI -0.02 to 0.18) or craving, g = 0.05 (95% CI -0.06 to 0.16), but there was a significant, moderate effect on cognitive bias, g = 0.60 (95% CI 0.39 to 0.79). Results were similar for alcohol and smoking outcomes taken separately. Follow-up addiction outcomes were reported in 7 trials, resulting in a small but significant effect of CBM, g = 0.18 (95% CI 0.03 to 0.32). Results for addiction and craving did not differ by substance type, sample type, delivery setting, bias targeted or number of sessions. Risk of bias was high or uncertain in most trials, for most criteria considered. Meta-regression analyses revealed significant inverse relationships between risk of bias and effect sizes for addiction outcomes and craving. The relationship between cognitive bias and respectively addiction ESs was not significant. There was consistent evidence of publication bias in the form of funnel plot asymmetry. Conclusions Our results cast serious doubts on the clinical utility of CBM interventions for addiction problems, but sounder methodological trials are necessary before this issue can be settled. We found no indication that positive effects on biases translate into effects on addiction outcomes.

Short-Term Effectiveness of Web-Based Guided Self-Help for Phobic Outpatients: Randomized Controlled Trial

Background Internet-based guided self-help has been successfully used in the general population, but it is unknown whether this method can be effectively used in outpatient clinics for patients waiting for face-to-face psychotherapy for phobias. Objective The aim was to assess the clinical effectiveness of Phobias Under Control, an Internet-based intervention based on exposure therapy with weekly guidance. Methods We conducted a randomized controlled trial, recruiting 212 outpatients scheduled to receive face-to-face psychotherapy for any type of phobia at an outpatient clinic. Participants suffering from at least 1 DSM-IV or ICD-10 classified phobia (social phobia, agoraphobia with or without panic disorder, and/or specific phobia as ascertained by a telephone interview at baseline) were randomly allocated to either a 5-week Internet-based guided self-help program based on exposure therapy with weekly student support followed by face-to-face psychotherapy (n=105) or a wait-list control group followed by face-to-face psychotherapy (n=107). Primary outcome was the Fear Questionnaire (FQ). Secondary outcomes were the Beck Anxiety Inventory (BAI) and Center of Epidemiological Studies-Depression scale (CES-D). Assessments took place by telephone at baseline (T0) and on the Internet at posttest (T1, self-assessment at 5 weeks after baseline). Missing data at T1 were imputed. Results At posttest, analysis of covariance on the intention-to-treat sample showed significant but small effect sizes between intervention and control groups on the FQ (d=0.35, P=.02), CES-D (d=0.34, P=.03), and a nonsignificant effect size on the BAI (d=0.28. P=.05). Although initial acceptance was good, high nonresponse was observed, with 86 of 212 participants (40.5%) lost to follow-up at T1 and only 14 of 105 (13.3%) intervention participants finishing all 5 weeks. Conclusions Phobias Under Control is modestly effective in lowering phobic and depressive symptoms in a relatively short period and may be clinically beneficial when implemented in routine outpatient practice. Trial Registration Netherlands Trial Register NTR2233; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2233 (Archived by WebCite at http://www.webcitation.org/6O2ioOQSs).

Psychological treatment of anxiety in primary care: a meta-analysis

BACKGROUND Guidelines and mental healthcare models suggest the use of psychological treatment for anxiety disorders in primary care but systematic estimates of the effect sizes in primary care settings are lacking. The aim of this study was to examine the effectiveness of psychological therapies in primary care for anxiety disorders. METHOD The Cochrane Central Register of Controlled Trials (CENTRAL), EMBASE, Medline, PsycINFO and Pubmed databases were searched in July 2010. Manuscripts describing psychological treatment for anxiety disorders/increased level of anxiety symptoms in primary care were included if the research design was a randomized controlled trial (RCT) and if the psychological treatment was compared with a control group. RESULTS In total, 1343 abstracts were identified. Of these, 12 manuscripts described an RCT comparing psychological treatment for anxiety with a control group in primary care. The pooled standardized effect size (12 comparisons) for reduced symptoms of anxiety at post-intervention was d = 0.57 [95% confidence interval (CI) 0.29-0.84, p = 0.00, the number needed to treat (NNT) = 3.18]. Heterogeneity was significant among the studies (I 2 = 58.55, Q = 26.54, p < 0.01). The quality of studies was not optimal and missing aspects are summarized. CONCLUSIONS We found a moderate effect size for the psychological treatment of anxiety disorders in primary care. Several aspects of the treatment are related to effect size. More studies are needed to evaluate the long-term effects given the chronicity and recurrent nature of anxiety.

Effectiveness and cost-effectiveness of web-based treatment for phobic outpatients on a waiting list for psychotherapy: protocol of a randomised controlled trial

BackgroundPhobic disorders are highly prevalent and constitute a considerable burden for patients and society. As patients wait for face-to-face psychotherapy for phobic disorders in outpatient clinics, this time can be used for guided self-help interventions. The aim of this study is to investigate a five week internet-based guided self-help programme of exposure therapy in terms of clinical effectiveness and impact on speed of recovery in psychiatric outpatients, as well as the cost-effectiveness of this pre-treatment waiting list intervention.Methods/designA randomised controlled trial will be conducted among 244 Dutch adult patients recruited from waiting lists of outpatient clinics for face-to-face psychotherapy for phobic disorders. Patients suffering from at least one DSM-IV classified phobic disorder (social phobia, agoraphobia or specific phobia) are randomly allocated (at a 1:1 ratio) to either a five-week internet-based guided self-help program followed by face-to-face psychotherapy, or a control group followed by face-to-face psychotherapy. Waiting list status and duration are unchanged and actual need for further treatment is evaluated prior to face-to-face psychotherapy. Clinical and economic self-assessment measurements take place at baseline, post-test (five weeks after baseline) and at 3, 6, 9 and 12 months after baseline.DiscussionOffering pre-treatment internet-based guided self-help efficiently uses time otherwise lost on a waiting list and may increase patient satisfaction. Patients are expected to need fewer face-to-face sessions, reducing total treatment cost and increasing speed of recovery. Internet-delivered treatment for phobias may be a valuable addition to psychotherapy as demand for outpatient treatment increases while budgets decrease.Trial registrationNetherlands Trial Register NTR2233

Invited commentary on … Confusing procedures with process in cognitive bias modification research†

The notion that cognitive bias modification should be appraised exclusively on the basis of trials where its postulated mechanisms were successfully changed starkly contradicts the standards of evidence-based psychotherapy. In the laboratory or as a treatment, cognitive bias modification cannot continue to eschew the rigorous scrutiny applied to other interventions.

Technology and adherence in web-based interventions for weight control: a systematic review

While technology based health interventions can be effective, high attrition rates are commonly observed in research and practice and are a major issue in eHealth. Research on adherence has recently gained some scientific attention, but little has been done as to how technology itself engages users. It seems plausible that technology plays a role in persuading people to use an eHealth intervention and keep on using it. The present study seeks to apply the PSD-model with regard to this major issue in eHealth. A comprehensive literature search was conducted using the databases Web of Knowledge, EBSCOHOST, Picarta, Scopus and ScienceDirect. The following characteristics were coded: Health care domain, Study level, Sample size, Intended usage, Usage web-based intervention, Adherence, Predictors of adherence, Intervention, Interaction, Persuasive technology in the intervention. The search yielded 4939 unique titles, of which 460 articles were deemed relevant. After title, abstract and full text screening by two researchers, 109 articles were included. Concluding, we can say that it seems that when designing web-based interventions, most attention is given to support the primary task. Dialogue support and social support appear neglected. Taking into account that more extensive use of persuasive technology seems to be positively related to adherence, more attention should be paid to all forms of support through technology.

The Efficacy of Cognitive Bias Modification Interventions for Mental Health Problems: a Meta-analysis

Introduction Cognitive bias modification (CBM) interventions are strongly advocated in research and clinical practice. Objectives We aimed to examine the efficiency of CBM for clinically relevant outcomes, along with study quality, publication bias and potential moderators. Method We conducted two meta-analyses of randomized controlled trials of CBM interventions for clinically relevant outcomes, one for patients with mental health problems and one for all populations. We included randomized controlled trials of CBM interventions, which reported clinically relevant outcomes assessed with standardized instruments. We examined the quality of the trials, as well as possible publication bias and possible moderators. Results We identified 49 trials and grouped outcomes into anxiety and depression. ESs were small considering all the samples, and mostly non-significant for patient samples. ESs became non-significant when outliers were excluded and after adjustment for publication bias. The quality of the RCTs was sub-optimal. Publication year was consistently negatively associated with ESs. More sessions were associated with smaller ES, as were the absence of participant compensation and, respectively, the non-exclusively laboratory based delivery of the intervention. The quality of the RCTs was not optimal and quality was negatively associated to outcomes for depression and general anxiety. Conclusions Our results indicate that CBM may have small effects on mental health problems, but it is also very well possible that there are no significant effects. Research in this field is hampered by small and low-quality research, and by risk of publication bias, and much of the positive outcomes is driven by extreme outliers.

Body image concerns in patients with an implantable cardioverter defibrillator: A scoping review

Patients with an implantable cardioverter defibrillator (ICD) retain a scar and a bump at the site of implant. This may lead to body image concerns (BICs) that influence patients’ quality of life. Few studies have examined the prevalence and impact of BICs postimplant, prompting us to conduct a scoping review of the field.

Adherence to a web-based pre-treatment for phobias in outpatient clinics

Background Non-adherence in Internet interventions is a persistent and multifaceted issue and potentially limits the applicability and effectiveness of these interventions. Factors that influence non-adherence are poorly understood, especially in outpatient samples with more complex symptoms. Objective The current study is a secondary analysis of data from a randomised controlled trial that examined the cost-effectiveness of offering an Internet-based exposure treatment to phobic outpatients on a wait-list to receive face-to-face psychotherapy. Methods We collected baseline demographic and clinical information, and adherence data of the Internet-based intervention and conducted regression analyses to predict non-adherence to the intervention. Results The adherence to the intervention was low, with only 13.3% of 105 patients completing all five lessons of the intervention. The median number of exercises completed (out of a possible 8) was 3. In a multi-predictor model, a higher baseline score of anxiety (OR = 0.94, 95% CI 0.90–0.99) was a risk factor for low adherence. Higher age (OR = 1.05, 95% CI 1.00–1.09) was a protective factor against non-adherence. Participants who adhered to the intervention were more likely to complete post-test assessments, further biasing results. However, overall participant attrition was high. The results are based on a small subset of participants and should be interpreted with caution. Conclusions Poor baseline clinical status and age are factors to consider when deciding whether to offer an Internet-based intervention to outpatients. Low adherence among those patients might be related to intrinsic motivation and might even be lower in outpatient settings where participants expect to receive face-to-face treatment. It might be worthwhile to develop a concise instrument to assess intrinsic motivation and treatment expectations for using Internet-based interventions, and for the therapist to review the range of possible (Internet-based) intervention options to suit personal preferences and expectations. Trial registration Netherlands Trial Register, NTR2233.