Michael Barkham

Service profiling and outcomes benchmarking using the CORE-OM: Toward practice-based evidence in the psychological therapies.

To complement the evidence-based practice paradigm, the authors argued for a core outcome measure to provide practice-based evidence for the psychological therapies. Utility requires instruments that are acceptable scientifically, as well as to service users, and a coordinated implementation of the measure at a national level. The development of the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) is summarized. Data are presented across 39 secondary-care services (n = 2,710) and within an intensively evaluated single service (n = 1,455). Results suggest that the CORE-OM is a valid and reliable measure for multiple settings and is acceptable to users and clinicians as well as policy makers. Baseline data levels of patient presenting problem severity, including risk, are reported in addition to outcome benchmarks that use the concept of reliable and clinically significant change. Basic quality improvement in outcomes for a single service is considered.

Effects of treatment duration and severity of depression on the effectiveness of cognitive-behavioral and psychodynamic-interpersonal psychotherapy

A total of 117 depressed clients, stratified for severity, completed 8 or 16 sessions of manualized treatment, either cognitive-behavioral psychotherapy (CB) or psychodynamic-interpersonal psychotherapy (PI). Each of 5 clinician-investigators treated clients in all 4 treatment conditions. On most measures, CB and PI were equally effective, irrespective of the severity of depression or the duration of treatment. However, there was evidence of some advantage to CB on the Beck Depression Inventory (Beck, Ward, Mendelson, Mock, & Erbaugh, 1961). There was no evidence that CBs effects were more rapid than those of PI, nor did the effects of each treatment method vary according to the severity of depression. There was no overall advantage to 16-session treatment over 8-session treatment. However, those presenting with relatively severe depression improved substantially more after 16 than after 8 sessions.

The contribution of reliable and clinically significant change methods to evidence-based mental health

Where outcomes are unequivocal (life or death; being able to walk v being paralysed) clinicians, researchers, and patients find it easy to speak the same language in evaluating results. However, in much of mental health work initial states and outcomes of treatments are measured on continuous scales and the distribution of the “normal” often overlaps with the range of the “abnormal.” In this situation, clinicians and researchers often talk different languages about change data, and both are probably poor at conveying their thoughts to patients. Researchers traditionally compare means between groups. Their statistical methods, using distributions of the scores before and after treatment to suggest whether change is a sampling artefact or a chance finding, have been known for many years.1 By contrast, clinicians are more often concerned with changes in particular individuals they are treating and often dichotomise outcome as “success” or “failure.” The number needed to treat (NNT) method of presenting results has gone some way to bridge this gap but often uses arbitrary criteria on which to dichotomise change into “success” and “failure.” A typical example is the criterion of a 50% drop on the Hamilton Depression Rating Scale score. A method bridging these approaches would assist the translation of research results into clinical practice. Jacobson et al proposed a method of determining reliable and clinically significant change (RCSC) that summarises changes at the level of the individual in the context of observed changes for the whole sample.2, 3–5 Their methods are applicable, in one form or another, to the measurement of change on any continuous scale for any clinical problem, although they have been reported primarily in the psychotherapy research literature. The broad concept of reliable and clinically significant change rests on 2 questions being addressed at the level of each …

Methods to identify postnatal depression in primary care: an integrated evidence synthesis and value of information analysis.

OBJECTIVES To provide an overview of methods to identify postnatal depression (PND) in primary care and to assess their validity, acceptability, clinical effectiveness and cost-effectiveness, to model estimates of cost, to assess whether any method meets UK National Screening Committee (NSC) criteria and to identify areas for future research. DATA SOURCES Searches of 20 electronic databases (including MEDLINE, CINAHL, PsycINFO, EMBASE, CENTRAL, DARE and CDSR), forward citation searching, personal communication with authors and searching of reference lists. REVIEW METHODS A generalised linear mixed model approach to the bivariate meta-analysis was undertaken for the validation review with quality assessment using QUADAS. Within the acceptability review, a textual narrative approach was employed to synthesise qualitative and quantitative research evidence. For the clinical and cost-effectiveness reviews methods outlined by the Centre for Reviews and Dissemination and the Cochrane Collaboration were followed. Probabilistic models were developed to estimate the costs associated with different identification strategies. RESULTS The Edinburgh Postnatal Depression Scale (EPDS) was the most frequently explored instrument across all of the reviews. In terms of test performance, postnatally the EPDS performed reasonably well: sensitivity ranged from 0.60 (specificity 0.97) to 0.96 (specificity 0.45) for major depression only; from 0.31 (specificity 0.99) to 0.91 (specificity 0.67) for major or minor depression; and from 0.38 (specificity 0.99) to 0.86 (specificity 0.87) for any psychiatric disorder. Evidence from the acceptability review indicated that, in the majority of studies, the EPDS was acceptable to women and health-care professionals when women were forewarned of the process, when the EPDS was administered in the home, with due attention to training, with empathetic skills of the health visitor and due consideration to positive responses to question 10 about self-harm. Suggestive evidence from the clinical effectiveness review indicated that use of the EPDS, compared with usual care, may lead to reductions in the number of women with depression scores above a threshold. In the absence of existing cost-effectiveness studies of PND identification strategies, a decision-analytic model was developed. The results of the base-case analysis suggested that use of formal identification strategies did not appear to represent value for money, based on conventional thresholds of cost-effectiveness used in the NHS. However, the scenarios considered demonstrated that this conclusion was primarily driven by the costs of false positives assumed in the base-case model. CONCLUSIONS In light of the results of our evidence synthesis and decision modelling we revisited the examination of PND screening against five of the NSC criteria. We found that the accepted criteria for a PND screening programme were not currently met. The evidence suggested that there is a simple, safe, precise and validated screening test, in principle a suitable cut-off level could be defined and that the test is acceptable to the population. Evidence surrounding clinical and cost-effectiveness of methods to identify PND is lacking. Further research should aim to identify the optimal identification strategy, in terms of key psychometric properties for postnatal populations. In particular, research comparing the performance of the Whooley and help questions, the EPDS and a generic depression measure would be informative. It would also be informative to identify the natural history of PND over time and to identify the clinical effectiveness of the most valid and acceptable method to identify postnatal depression. Further research within a randomised controlled trial would provide robust estimates of the clinical effectiveness.

The effectiveness of web-based interventions designed to decrease alcohol consumption – a systematic review

OBJECTIVE To review the published literature on the effectiveness of web-based interventions designed to decrease consumption of alcohol and/or prevent alcohol abuse. METHOD Relevant articles published up to, and including, May 2006 were identified through electronic searches of Medline, PsycInfo, Embase, Cochrane Library, ASSIA, Web of Science and Science Direct. Reference lists of all articles identified for inclusion were checked for articles of relevance. An article was included if its stated or implied purpose was to evaluate a web-based intervention designed to decrease consumption of alcohol and/or to prevent alcohol abuse. Studies were reliably selected and quality-assessed, and data were independently extracted and interpreted by two authors. RESULTS Initial searches identified 191 articles of which 10 were eligible for inclusion. Of these, five provided a process evaluation only, with the remaining five providing some pre- to post-intervention measure of effectiveness. In general the percentage quality criteria met was relatively low and only one of the 10 articles selected was a randomized control trial. CONCLUSION The current review provides inconsistent evidence on the effectiveness of eIectronic screening and brief intervention (eSBI) for alcohol use. Process research suggests that web-based interventions are generally well received. However further controlled trials are needed to fully investigate their efficacy, to determine which elements are keys to outcome and to understand if different elements are required in order to engage low- and high-risk drinkers.

Patterns of alliance development and the rupture-repair hypothesis: Are productive relationships U-shaped or V-shaped?

The authors attempted to replicate and extend D. M. Kivlighan and P. Shaughnessys (2000) findings of (a) 3 distinctive patterns of alliance development across sessions and (b) a differential association of one of these, a U-shaped quadratic growth pattern, with positive treatment outcome. In data drawn from a clinical trial of brief psychotherapies for depression (N = 79 clients), the authors distinguished 4 patterns of alliance development. These matched 2 of Kivlighan and Shaughnessys patterns, but not the U-shaped pattern, and none was differentially associated with outcome. However, further examination of the data identified a subset of clients (n = 17) who experienced rupture-repair sequences-brief V-shaped deflections rather than U-shaped profiles. These clients tended to make greater gains in treatment than did the other clients.

Clinical effectiveness of health visitor training in psychologically informed approaches for depression in postnatal women: pragmatic cluster randomised trial in primary care

Objective To evaluate benefits for postnatal women of two psychologically informed interventions by health visitors. Design Prospective cluster trial randomised by general practice, with 18 month follow-up. Setting 101 general practices in Trent, England. Participants 2749 women allocated to intervention, 1335 to control. Intervention Health visitors (n=89 63 clusters) were trained to identify depressive symptoms at six to eight weeks postnatally using the Edinburgh postnatal depression scale (EPDS) and clinical assessment and also trained in providing psychologically informed sessions based on cognitive behavioural or person centred principles for an hour a week for eight weeks. Health visitors in the control group (n=49 38 clusters) provided usual care. Main outcome measures Score ≥12 on the Edinburgh postnatal depression scale at six months. Secondary outcomes were mean Edinburgh postnatal depression scale, clinical outcomes in routine evaluation-outcome measure (CORE-OM), state-trait anxiety inventory (STAI), SF-12, and parenting stress index short form (PSI-SF) scores at six, 12, 18 months. Results 4084 eligible women consented and 595 women had a six week EPDS score ≥12. Of these, 418 had EPDS scores available at six weeks and six months. At six months, 34% women (93/271) in the intervention group and 46% (67/147) in the control group had an EPDS score ≥12. The odds ratio for score ≥12 at six months was 0.62 (95% confidence interval 0.40 to 0.97, P=0.036) for women in the intervention group compared with women in the control group. After adjustment for covariates, the odds ratio was 0.60 (0.38 to 0.95, P=0.028). At six months, 12.4% (234/1880) of all women in the intervention group and 16.7% (166/995) of all women in the control group had scores ≥12 (0.67, 0.51 to 0.87, P=0.003). Benefit for women in the intervention group with a six week EPDS score ≥12 and for all women was maintained at 12 months postnatally. There was no differential benefit for either psychological approach over the other. Conclusion Training health visitors to assess women, identify symptoms of postnatal depression, and deliver psychologically informed sessions was clinically effective at six and 12 months postnatally compared with usual care. Trial registration ISRCTN92195776.

Influence of initial severity of depression on effectiveness of low intensity interventions: meta-analysis of individual patient data

Objective To assess how initial severity of depression affects the benefit derived from low intensity interventions for depression. Design Meta-analysis of individual patient data from 16 datasets comparing low intensity interventions with usual care. Setting Primary care and community settings. Participants 2470 patients with depression. Interventions Low intensity interventions for depression (such as guided self help by means of written materials and limited professional support, and internet delivered interventions). Main outcome measures Depression outcomes (measured with the Beck Depression Inventory or Center for Epidemiologic Studies Depression Scale), and the effect of initial depression severity on the effects of low intensity interventions. Results Although patients were referred for low intensity interventions, many had moderate to severe depression at baseline. We found a significant interaction between baseline severity and treatment effect (coefficient −0.1 (95% CI −0.19 to −0.002)), suggesting that patients who are more severely depressed at baseline demonstrate larger treatment effects than those who are less severely depressed. However, the magnitude of the interaction (equivalent to an additional drop of around one point on the Beck Depression Inventory for a one standard deviation increase in initial severity) was small and may not be clinically significant. Conclusions The data suggest that patients with more severe depression at baseline show at least as much clinical benefit from low intensity interventions as less severely depressed patients and could usefully be offered these interventions as part of a stepped care model.

Dose-Effect Relations and Responsive Regulation of Treatment Duration: The Good Enough Level

This study examined rates of improvement in psychotherapy as a function of the number of sessions attended. The clients (N=1,868; 73.1% female; 92.4% White; average age=40), who were seen for a variety of problems in routine primary care mental health practices, attended 1 to 12 sessions, had planned endings, and completed the Clinical Outcomes in Routine Evaluation-Outcome Measure (CORE-OM) at the beginning and end of their treatment. The percentage of clients achieving reliable and clinically significant improvement (RCSI) on the CORE-OM did not increase with number of sessions attended. Among clients who began treatment above the CORE-OM clinical cutoff (n=1,472), the RCSI rate ranged from 88% for clients who attended 1 session down to 62% for clients who attended 12 sessions (r=-.91). Previously reported negatively accelerating aggregate curves may reflect progressive ending of treatment by clients who had achieved a good enough level of improvement.

Early sudden gains in psychotherapy under Routine clinic conditions: Practice-based evidence

Sudden gains--large, enduring reductions in symptom intensity from one session to the next--were identified by T. Z. Tang and R. J. DeRubeis (1999b) on the basis of data from 2 manualized clinical trials of cognitive therapy for depression. The authors found similar sudden gains among clients with a variety of disorders treated with a variety of approaches in routine clinic settings. Clients (N = 135 who met inclusion criteria) completed short forms of the Clinical Outcomes in Routine Evaluation (CORE-SF) preceding 7 to 74 individual sessions. Those who experienced sudden gains within their first 16 sessions (n = 23) had significantly lower CORE-SF scores in their final 3 sessions than did the other clients.