David A. Vermeersch

The Reliability and Validity of the Outcome Questionnaire

With the rise in efforts to evaluate the quality of mental health care and its outcomes, the measurement of change has become an important topic. This paper tracks the creation of a new instrument designed to assess psychotherapy outcome. The Outcome Questionnaire (OQ) was designed to include items relevant to three domains central to mental health: subjective discomfort, interpersonal relations, and social role performance. This study describes the theoretical development and psychometric properties of the OQ. Psychometric properties were assessed using clinical, community, and undergraduate samples. The OQ appears to have high reliability and evidence to suggest good concurrent and construct validity of the total score. The data presented show that it distinguishes patient from non-patient samples, is sensitive to change, and correlates with other measures of patient distress.

The Effects of Providing Therapists With Feedback on Patient Progress During Psychotherapy: Are Outcomes Enhanced?

Patient-focused research attempts to provide information that answers the question: Is this treatment benefiting this patient? Although several systems have been developed to monitor and provide feedback about a patients response to psychotherapy, few if any have been tested empirically. The current study divided 609 patients into four groups (two experimental and two control) to determine if feedback regarding patient progress, when provided to a therapist, affected patient outcome and number of sessions attended. Results showed that feedback increased the duration of treatment and improved outcome relative to patients in the control condition who were predicted to be treatment failures. Twice as many patients in the feedback group achieved clinically significant or reliable change and one-third as many were classified as deteriorated by the time treatment ended. For those patients who were predicted to have a positive response to treatment, feedback to therapists resulted in a reduction in the number of treatment sessions without reducing positive outcomes.

Improving the Effects of Psychotherapy: The Use of Early Identification of Treatment Failure and Problem-Solving Strategies in Routine Practice

Client-focused research systems have been developed to monitor and provide feedback information about clients’ progress in psychotherapy as a method of enhancing outcome for those who are predicted to be treatment failures. In the current study, the authors examined whether feedback regarding client progress and the use of clinical support tools (CSTs) affected client outcome and number of sessions attended. Results showed that clients in the feedback plus CST group stayed in therapy longer and had superior outcomes. Nearly twice as many clients in the feedback plus CST group achieved clinically significant or reliable change, and fewer were classified as deteriorated by the time treatment ended.

Outcome Questionnaire: item sensitivity to change.

Although high levels of reliability are emphasized in the construction of many measures of psychological traits, tests that are intended to measure patient change following psychotherapy need to emphasize sensitivity to change as a central and primary property. This study proposes 2 criteria for evaluating the degree to which an item on a test is sensitive to change: (a) that an item changes in the theoretically proposed direction following an intervention and (b) that the change measured on an item is significantly greater in treated than in untreated individuals. Outcome Questionnaire (Lambert et al., 1996) items were subjected to item analysis by examining change rates in 284 untreated control participants and in 1,176 individuals undergoing psychotherapy. Results analyzed through multilevel or hierarchical linear modeling suggest the majority of items on this frequently used measure of psychotherapy outcome meet both criteria. Implications for test development and future research are discussed.

Outcome Questionnaire: Is It Sensitive to Changes in Counseling Center Clients?

Sensitivity to change of the Outcome Questionnaire (OQ; M. J. Lambert et al., 1996) items, subscales, and total score was evaluated for clients receiving personal counseling in university counseling center settings. OQ data collected for 248 university students who did not receive treatment and 5,553 students who received treatment from 527 therapists employed in 40 university counseling centers nationwide were included in the analyses. Comparisons between the treated and untreated groups indicated that the OQ total score, all of the subscales, and 34 of the 45 items met 2 preset criteria for change sensitivity, providing support for the OQ as an appropriate index of outcome in counseling center clients. The 11 OQ items that failed to demonstrate change sensitivity were aimed at assessing aspects of interpersonal functioning, related to specific physical symptoms, or were susceptible to floor effects. The possibility of using change sensitivity results in revising the OQ for optimal use in counseling center settings is addressed, and general implications for outcome test development are discussed.

The Coronary Health Improvement Project (CHIP) for lowering weight and improving psychosocial health.

This study extends previous research evaluating the association between the CHIP intervention, change in body weight, and change in psychological health. A randomized controlled health intervention study lasting 4 wk. was used with 348 participants from metropolitan Rockford, Illinois; ages ranged from 24 to 81 yr. Participants were assessed at baseline, 6 wk., and 6 mo. The Beck Depression Inventory (BDI) and three selected psychosocial measures from the SF–36 Health Survey were used. Significantly greater decreases in Body Mass Index (BMI) occurred after 6 wk. and 6 mo. follow-up for the intervention group compared with the control group, with greater decreases for participants in the overweight and obese categories. Significantly greater improvements were observed in BDI scores, role-emotional and social functioning, and mental health throughout follow-up for the intervention group. The greater the decrease in BMI through 6 wk., the better the chance of improved BDI score, role-emotional score, social functioning score, and mental health score, with odds ratios of 1.3 to 1.9. Similar results occurred through 6 mo., except the mental health variable became nonsignificant. These results indicate that the CHIP intervention significantly improved psychological health for at least six months afterwards, in part through its influence on lowering BMI.