Fridtjof W. Nussbeck

Structural equation modeling of multitrait-multimethod data: Different models for different types of methods.

The question as to which structural equation model should be selected when multitrait-multimethod (MTMM) data are analyzed is of interest to many researchers. In the past, attempts to find a well-fitting model have often been data-driven and highly arbitrary. In the present article, the authors argue that the measurement design (type of methods used) should guide the choice of the statistical model to analyze the data. In this respect, the authors distinguish between (a) interchangeable methods, (b) structurally different methods, and (c) the combination of both kinds of methods. The authors present an appropriate model for each type of method. All models allow separating measurement error from trait influences and trait-specific method effects. With respect to interchangeable methods, a multilevel confirmatory factor model is presented. For structurally different methods, the correlated trait-correlated (method-1) model is recommended. Finally, the authors demonstrate how to appropriately analyze data from MTMM designs that simultaneously use interchangeable and structurally different methods. All models are applied to empirical data to illustrate their proper use. Some implications and guidelines for modeling MTMM data are discussed.

Cognitive Change Predicts Symptom Reduction With Cognitive Therapy for Posttraumatic Stress Disorder

Objective: There is a growing body of evidence for the effectiveness of trauma-focused cognitive behavior therapy (TF-CBT) for posttraumatic stress disorder (PTSD), but few studies to date have investigated the mechanisms by which TF-CBT leads to therapeutic change. Models of PTSD suggest that a core treatment mechanism is the change in dysfunctional appraisals of the trauma and its aftermath. If this is the case, then changes in appraisals should predict a change in symptoms. The present study investigated whether cognitive change precedes symptom change in Cognitive Therapy for PTSD, a version of TF-CBT. Method: The study analyzed weekly cognitive and symptom measures from 268 PTSD patients who received a course of Cognitive Therapy for PTSD, using bivariate latent growth modeling. Results: Results showed that (a) dysfunctional trauma-related appraisals and PTSD symptoms both decreased significantly over the course of treatment, (b) changes in appraisals and symptoms were correlated, and (c) weekly change in appraisals significantly predicted subsequent reduction in symptom scores (both corrected for the general decrease over the course of therapy). Changes in PTSD symptom severity did not predict subsequent changes in appraisals. Conclusions: The study provided preliminary evidence for the temporal precedence of a reduction in negative trauma-related appraisals in symptom reduction during trauma-focused CBT for PTSD. This supports the role of change in appraisals as an active therapeutic mechanism.

Analysing multitrait–multimethod data with structural equation models for ordinal variables applying the WLSMV estimator: What sample size is needed for valid results?

Convergent and discriminant validity of psychological constructs can best be examined in the framework of multitrait-multimethod (MTMM) analysis. To gain information at the level of single items, MTMM models for categorical variables have to be applied. The CTC(M-1) model is presented as an example of an MTMM model for ordinal variables. Based on an empirical application of the CTC(M-1) model, a complex simulation study was conducted to examine the sample size requirements of the robust weighted least squares mean- and variance-adjusted chi(2) test of model fit (WLSMV estimator) implemented in Mplus. In particular, the simulation study analysed the chi(2) approximation, the parameter estimation bias, the standard error bias, and the reliability of the WLSMV estimator depending on the varying number of items per trait-method unit (ranging from 2 to 8) and varying sample sizes (250, 500, 750, and 1000 observations). The results showed that the WLSMV estimator provided a good -- albeit slightly liberal -- chi(2) approximation and stable and reliable parameter estimates for models of reasonable complexity (2-4 items) and small sample sizes (at least 250 observations). When more complex models with 5 or more items were analysed, larger sample sizes of at least 500 observations were needed. The most complex model with 9 trait-method units and 8 items (72 observed variables) requires sample sizes of at least 1000 observations.

Analyzing True Change in Longitudinal Multitrait-Multimethod Studies: Application of a Multimethod Change Model to Depression and Anxiety in Children

The authors show how structural equation modeling can be applied to analyze change in longitudinal multitrait-multimethod (MTMM) studies. For this purpose, an extension of latent difference models (McArdle, 1988; Steyer, Eid, & Schwenkmezger, 1997) to multiple constructs and multiple methods is presented. The model allows investigators to separate true change from measurement error and to analyze change simultaneously for different methods. The authors also show how Campbell and Fiskes (1959) guidelines for analyzing convergent and discriminant validity can be applied to the measurement of latent change. The practical application of the multimethod change model is illustrated in a reanalysis of child depression and anxiety scores (N = 906 American children) that were assessed by self- and parent reports on three measurement occasions. The analyses revealed that (a) the convergent validity of change was low for both constructs and (b) sex was a significant predictor of self-reported, but not of parent reported, anxiety states. Finally, the authors discuss advantages and limitations and compare the model with other approaches for analyzing longitudinal MTMM data.

Analyzing the convergent and discriminant validity of states and traits: Development and applications of multimethod latent state-trait models.

The analysis of convergent and discriminant validity is an integral part of the construct validation process. Models for analyzing the convergent and discriminant validity have typically been developed for cross-sectional data. There exist, however, only a few approaches for longitudinal data that can be applied for analyzing the construct validity of fluctuating states. In this article, the authors show how models of latent state-trait theory can be combined with models of multitrait-multimethod analysis to develop a model that allows for analyzing convergent and discriminant validity in time: the multimethod latent state-trait model. The model allows for identifying different sources of variance (trait consistency, trait-method specificity, occasion-specific consistency, occasion-specific method specificity, and unreliability). It is applied to the repeated measurement of depression and anxiety in children, which was assessed by self and teacher reports (N = 375). The application shows that the proposed models fit the data well and allow a deeper understanding of method effects in clinical assessment.

Higher emotional distress in female partners of cancer patients: prevalence and patient–partner interdependencies in a 3-year cohort

Assessment and treatment of psychological distress in cancer patients was recognized as a major challenge. The role of spouses, caregivers, and significant others became of salient importance not only because of their supportive functions but also in respect to their own burden. The purpose of this study was to assess the amount of distress in a mixed sample of cancer patients and their partners and to explore the dyadic interdependence.

A comparison of method effects in two confirmatory factor models for structurally different methods

Multimethod data analysis is a complex procedure that is often used to examine the degree to which different measures of the same construct converge in the assessment of this construct. Several authors have called for a greater understanding of the definition and meaning of method effects in different models for multimethod data. In this article, we compare 2 recently proposed approaches for modeling data with structurally different methods with regard to the definition and meaning of method effects, the restricted CT-C(M – 1) model (Geiser, Eid, & Nussbeck, 2008) and the latent difference model (Lischetzke, Eid, & Nussbeck, 2002). We also introduce the concepts of individual, conditional, and general method bias and show how these types of biases are represented in the models. An application to a multirater data set (N = 199) as well as recommendations for the application and interpretation of each model are provided.

Mixture distribution latent state-trait analysis : Basic ideas and applications

Extensions of latent state-trait models for continuous observed variables to mixture latent state-trait models with and without covariates of change are presented that can separate individuals differing in their occasion-specific variability. An empirical application to the repeated measurement of mood states (N=501) revealed that a model with 2 latent classes fits the data well. The larger class (76%) consists of individuals whose mood is highly variable, whose general well-being is comparatively lower, and whose mood variability is influenced by daily hassles and uplifts. The smaller class (24%) represents individuals who are rather stable and happier and whose mood is influenced only by daily uplifts but not by daily hassles. A simulation study on the model without covariates with 5 sets of sample sizes and 5 sets of number of occasions revealed that the appropriateness of the parameter estimates of this model depends on number of observations (the higher the better) and number of occasions (the higher the better). Another simulation study estimated Type I and II errors of the Lo-Mendell-Rubin test.

Enhancement of couples' communication and dyadic coping by a self-directed approach: a randomized controlled trial.

Although prevention of relationship distress and dissolution has potential to strengthen the well-being of partners and any children they are raising, dissemination of prevention programs can be limited because couples face many barriers to in-person participation. An alternative strategy, providing couples with an instructional DVD, is tested in the present study, in which 330 Caucasian couples (N = 660 participants; mean age: men 41.4 years, women 40.0 years) were randomly assigned to a DVD group without any further support, a DVD group with technical telephone coaching, or a wait-list control group. Couples completed questionnaires at pretest, posttest, and 3 and 6 months after completion of the intervention. Self-report measures of dyadic coping, communication quality, ineffective arguing, and relationship satisfaction were used to test whether the intervention groups improved in comparison with the control group. Women in both intervention groups increased in dyadic coping, reduced conflict behavior, and were more satisfied with their relationship 6 months after the intervention. Effects for men were mixed. Participants with poorer skills reported stronger improvement. Intimate relationships can, within limits, be positively influenced by a self-directed approach. Effective dissemination of principles underlying successful relationships can be facilitated through the use of emerging low-cost tools and technologies.

Effects of Stress on the Social Support Provided by Men and Women in Intimate Relationships

Although evolutionary and social-structural models predict that women will be more supportive than men in relationships, behavioral studies fail to confirm this difference. We predicted instead that gender differences in support will be moderated by stress, and that men will provide lower-quality support primarily when their stress is high. We predicted further that the detrimental effects of stress on men’s support will be more evident when men are responding to women’s emotionally toned expressions of stress than when men are responding to women’s affectively neutral expressions of stress. Stressed and unstressed men and women were observed providing support to a stressed relationship partner. While unstressed, men and women generally provided similar support to the stressed partner. While stressed, men provided lower-quality support than did comparably stressed women, but only in response to emotionally toned expressions of stress. Thus, gender differences in support may arise because women are better able than men to regulate other people’s emotional distress while managing stresses of their own.