Amit Baumel

Enlight: A Comprehensive Quality and Therapeutic Potential Evaluation Tool for Mobile and Web-Based eHealth Interventions

Background Studies of criteria-based assessment tools have demonstrated the feasibility of objectively evaluating eHealth interventions independent of empirical testing. However, current tools have not included some quality constructs associated with intervention outcome, such as persuasive design, behavior change, or therapeutic alliance. In addition, the generalizability of such tools has not been explicitly examined. Objective The aim is to introduce the development and further analysis of the Enlight suite of measures, developed to incorporate the aforementioned concepts and address generalizability aspects. Methods As a first step, a comprehensive systematic review was performed to identify relevant quality rating criteria in line with the PRISMA statement. These criteria were then categorized to create Enlight. The second step involved testing Enlight on 42 mobile apps and 42 Web-based programs (delivery mediums) targeting modifiable behaviors related to medical illness or mental health (clinical aims). Results A total of 476 criteria from 99 identified sources were used to build Enlight. The rating measures were divided into two sections: quality assessments and checklists. Quality assessments included usability, visual design, user engagement, content, therapeutic persuasiveness, therapeutic alliance, and general subjective evaluation. The checklists included credibility, privacy explanation, basic security, and evidence-based program ranking. The quality constructs exhibited excellent interrater reliability (intraclass correlations=.77-.98, median .91) and internal consistency (Cronbach alphas=.83-.90, median .88), with similar results when separated into delivery mediums or clinical aims. Conditional probability analysis revealed that 100% of the programs that received a score of fair or above (≥3.0) in therapeutic persuasiveness or therapeutic alliance received the same range of scores in user engagement and content—a pattern that did not appear in the opposite direction. Preliminary concurrent validity analysis pointed to positive correlations of combined quality scores with selected variables. The combined score that did not include therapeutic persuasiveness and therapeutic alliance descriptively underperformed the other combined scores. Conclusions This paper provides empirical evidence supporting the importance of persuasive design and therapeutic alliance within the context of a program’s evaluation. Reliability metrics and preliminary concurrent validity analysis indicate the potential of Enlight in examining eHealth programs regardless of delivery mediums and clinical aims.

A Randomized Controlled Pilot Trial of Different Mobile Messaging Interventions for Problem Drinking Compared to Weekly Drink Tracking.

Introduction Recent evidence suggests that text messaging may help to reduce problem drinking as an extension to in-person services, but very little is known about the effectiveness of remote messaging on problem drinking as a stand-alone intervention, or how different types of messages may improve drinking outcomes in those seeking to moderate their alcohol consumption. Methods We conducted an exploratory, single-blind randomized controlled pilot study comparing four different types of alcohol reduction-themed text messages sent daily to weekly drink self-tracking texts in order to determine their impact on drinking outcomes over a 12-week period in 152 participants (≈ 30 per group) seeking to reduce their drinking on the internet. Messaging interventions included: weekly drink self-tracking mobile assessment texts (MA), loss-framed texts (LF), gain-framed texts (GF), static tailored texts (ST), and adaptive tailored texts (TA). Poisson and least squares regressions were used to compare differences between each active messaging group and the MA control. Results When adjusting for baseline drinking, participants in all messaging groups except GF significantly reduced the number of drinks consumed per week and the number of heavy drinking days compared to MA. Only the TA and GF groups were significantly different from MA in reducing the number of drinking days. While the TA group yielded the largest effect sizes on all outcome measures, there were no significant differences between active messaging groups on any outcome measure. 79.6% of individuals enrolled in the study wanted to continue receiving messages for an additional 12 weeks at the end of the study. Discussion Results of this pilot study indicate that remote automated text messages delivered daily can help adult problem drinkers reduce drinking frequency and quantity significantly more than once-a-week self-tracking messages only, and that tailored adaptive texts yield the largest effect sizes across outcomes compared to MA. Larger samples are needed to understand differences between messaging interventions and to target their mechanisms of efficacy.

Heuristic Evaluation of Ehealth Interventions: Establishing Standards That Relate to the Therapeutic Process Perspective

In recent years, the number of available eHealth interventions aimed at treating behavioral and mental health challenges has been growing. From the perspective of health care providers, there is a need for eHealth interventions to be evaluated prior to clinical trials and for the limited resources allocated to empirical research to be invested in the most promising products. Following a literature review, a gap was found in the availability of eHealth interventions evaluation principles related to the patient experience of the therapeutic process. This paper introduces principles and concepts for the evaluation of eHealth interventions developed as a first step in a process to outline general evaluation guidelines that relate to the clinical context from health care providers’ perspective. Our approach was to conduct a review of literature that relates to the examination of eHealth interventions. We identified the literature that was most relevant to our study and used it to define guidelines that relate to the clinical context. We then compiled a list of heuristics we found to be useful for the evaluation of eHealth intervention products’ suitability for empirical examination. Four heuristics were identified with respect to the therapeutic process: (1) the product’s ease of use (ie, usability), (2) the eHealth intervention’s compatibility with the clinical setting, (3) the presence of tools that make it easier for the user to engage in therapeutic activities, and (4) the provision of a feasible therapeutic pathway to growth. We then used this set of heuristics to conduct a detailed examination of MyFitnessPal. This line of work could help to set the bar higher for product developers and to inform health care providers about preferred eHealth intervention designs.

Online emotional support delivered by trained volunteers: users' satisfaction and their perception of the service compared to psychotherapy.

Abstract Background: Technology could answer the substantial need in human resources available for supporting those who suffer from mental illness, by providing scalable methods to train and engage non-professionals to those who need their support. 7 Cups of Tea (7COT) platform was chosen for this study, because it provides a good case study for examining this kind of solution. Aim: The aim of this paper was to provide empirical findings regarding users’ satisfaction with online emotional support provided by trained volunteers and how it is perceived in comparison to psychotherapy. Methods: An online survey was conducted among a convenience sample of 7COT users. Results: The findings showed high user satisfaction with the support provided by 7COT listeners and, on average, users who indicated to receive psychotherapy in their past marked the listeners’ support to be as helpful as psychotherapy. Relating to psychotherapy and online emotional support advantages, different advantages were found. The findings suggest that receiving support from volunteers makes users feel that the support is more genuine. Conclusion: The paper provides preliminary evidence that people in emotional distress may find non-professionals support delivered through the use of technology to be helpful. Limitations and implications are discussed.

Making the Case for a Feasible Evaluation Method of Available E-Mental Health Products

It is often difficult for health providers to evaluate available e-mental health products because of the need to balance between obtaining reliable evidence of efficacy and the burdens associated with standard empirical evaluation. This paper makes the case for using a feasible method to investigate available e-mental health programs in order to promote knowledge and increase the uptake of e-mental health products.

Using Digital Media Advertising in Early Psychosis Intervention

OBJECTIVE Identifying and engaging youth with early-stage psychotic disorders in order to facilitate timely treatment initiation remains a major public health challenge. Although advertisers routinely use the Internet to directly target consumers, limited efforts have focused on applying available technology to proactively encourage help-seeking in the mental health community. This study explores how one might take advantage of Google AdWords in order to reach prospective patients with early psychosis. METHODS A landing page was developed with the primary goal of encouraging help-seeking individuals in New York City to contact their local early psychosis intervention clinic. In order to provide the best opportunity to reach the intended audience, Google AdWords was utilized to link more than 2,000 selected search terms to strategically placed landing page advertisements. The campaign ran for 14 weeks between April 11 and July 18, 2016 and had a total budget of

Technology-Assisted Parent Training Programs for Children and Adolescents With Disruptive Behaviors: A Systematic Review

1,427. RESULTS The ads appeared 191,313 times and were clicked on 4,350 times, at a per-click cost of

A Systematic Review and Taxonomy of Published Quality Criteria Related to the Evaluation of User-Facing eHealth Programs

.33. Many users took additional help-seeking steps, including obtaining psychosis-specific information/education (44%), completing a psychosis self-screener (15%), and contacting the local early treatment program (1%). CONCLUSIONS Digital ads appear to be a reasonable and cost-effective method to reach individuals who are searching for behavioral health information online. More research is needed to better understand the many complex steps between online search inquiries and making first clinical contact.

Summary of Key Issues Raised in the Technology for Early Awareness of Addiction and Mental Illness (TEAAM-I) Meeting

OBJECTIVE To systematically review digitally assisted parent training programs (DPTs) targeting the treatment of children and adolescents with disruptive behaviors. DATA SOURCES A search was conducted using PubMed, PsycINFO, and EMBASE databases for peer-reviewed studies published between January 1, 2000, and March 1, 2016. Reference lists of included and review articles were searched manually for additional references. STUDY SELECTION Broad search terms in varying combinations for parent, training, technologies, and disruptive behavior problems were used. We included English-language articles reporting on the effectiveness of DPTs targeting child or adolescent disruptive behaviors (eg, conduct disorder, oppositional defiant disorder). DPTs designed to use digital media or software programs not to be primarily used within a therapy setting (eg, group, face-to-face) were included. DATA EXTRACTION Study design, recruitment and sample characteristics, theoretical background, digital program features, users engagement, and measures of child behavior were extracted. RESULTS Fourteen intervention studies (n = 2,427, 58% male, 1,500 in DPT conditions, 12 randomized trials) examining 10 programs met inclusion criteria. Interventions included self-directed noninteractive (eg, podcasts; 3 studies) and interactive (eg, online software; 4 studies) DPTs, remotely administered DPTs combined with professional phone-based coaching (2 studies), and a smartphone enhancement of standard treatment. Interventions were delivered over a mean ± SD period of 8.7 ± 4.2 weeks, most (11/14; 78.6%) were remotely administered, and all recruitment procedures included an outreach for parents outside of mental health-care settings. For programs with > 5 sessions, the mean ± SD completion rate of available sessions was 68.6% ± 13.1%. In comparison to no treatment control, self-directed programs yielded significant improvements in child behavior for children (age < 9 years, Cohen d = 0.47-0.80, 4 studies) and adolescents (d = 0.17, 0.20, 2 studies). Overall, reduced professional support combined with DPT was not inferior to full-contact conditions and showed small improvement in comparison to usual care (d = 0.34). Preliminary indicators also suggested that technology enhancements may increase engagement and outcomes of standard treatment. CONCLUSIONS The current review indicates the efficacy of DPT across a range of therapy formats applied in real-world settings demonstrating the potential for increased accessibility of evidence-based treatment for youth with disruptive behaviors. Additional studies are needed to extend these findings and to determine moderating effects of different designs.

Attachment styles as contributors to dispositional envy and coping with contextual deficiency priming

The purpose of this review was to identify and classify key criteria concepts related to the evaluation of user-facing eHealth programs. In line with the PRISMA statement methodology, computer searches of relevant databases were conducted for studies published between January 1, 2000 and March 1, 2016 that contained explicit quality criteria related to mHealth and eHealth products. Reference lists of included articles, review articles, and grey literature (e.g., books, websites) were searched for additional sources. A team of nine experts led by the first author was gathered to support the classification of these criteria. Identified criteria were extracted, grouped and organized using an inductive thematic analysis. Eighty-four sources – emanating from 26 different courtiers – were included in this review. The team extracted 454 criteria that were grouped into 11 quality domains, 58 criteria concepts and 134 concepts’ sub-groups. Quality domains were: Usability, Visual Design, User Engagement, Content, Behavior Change/Persuasive Design, Influence of Social Presence, Therapeutic Alliance, Classification, Credibility/Accountability, and Privacy/Security. Findings suggest that authors around the globe agree on key criteria concepts when evaluating user-facing eHealth products. The high proportion of new published criteria in the second half of this review time-frame (2008–2016), and more specifically, the high proportion of criteria relating to persuasive design, therapeutic alliance and privacy/security within this time-frame, points to the advancements made in recent years within this field.