Cinzia Viroli

Heteroscedastic factor mixture analysis

When data come from an unobserved heterogeneous population, common factor analysis is not appropriate to estimate the underlying constructs of interest. By replacing the traditional assumption of Gaussian distributed factors by a finite mixture of multivariate Gaussians, the unobserved heterogeneity can be modelled by latent classes. In so doing, we obtain a particular factor mixture analysis with heteroscedastic components. In this paper, the model is presented and a maximum likelihood estimation procedure via the expectation–maximization algorithm is developed. We also show that the approach well performs as a dimensionally reduced model-based clustering. Two real applications are illustrated and performances are compared to standard model-based clustering methods.

Heterogeneity and symptom structure of schizophrenia

Previous studies failed to identify a consistent factor structure of the BPRS-24 in schizophrenia. Our aims were to examine the fit of all previously published factor models and then to explore unobserved population heterogeneity and identify salient latent classes. Two hundred thirty-nine patients with ICD-10 schizophrenia admitted to a random sample of all Italian public and private acute inpatient units during an index period were administered the BPRS-24. Confirmatory factor analysis (CFA) was used to test all factor models derived in previous studies. Then, factor mixture analysis (FMA) with heteroscedastic components was carried out to explore unobserved population heterogeneity. No previously reported factor solution showed adequate fit in CFA. FMA indicated the presence of three heterogeneous groups and yielded a 5-factor solution (Depression, Positive Symptoms, Disorganization, Negative Symptoms, Activation). Group 1 was characterized by higher Disorganization, lower Activation, lower psychosocial functioning, greater lifetime number of admissions, more frequent history of compulsory admission. Group 2 displayed lower Disorganization. Group 3 showed higher Activation and more frequent history of recent self-harming behavior. Our finding that a reliable factor structure for the BPRS-24 could be obtained only after assuming population heterogeneity suggests that the difficulty in identifying a consistent factor structure may be ascribed to the clinical heterogeneity of schizophrenia. As compared with clinical subtypes, the psychopathological dimensions displayed much greater discriminatory power between groups identified by FMA. Though preliminary, our findings corroborate that a dimensional approach to psychopathology can facilitate the assessment of the clinical heterogeneity of schizophrenia.

A skew-normal factor model for the analysis of student satisfaction towards university courses

Classical factor analysis relies on the assumption of normally distributed factors that guarantees the model to be estimated via the maximum likelihood method. Even when the assumption of Gaussian factors is not explicitly formulated and estimation is performed via the iterated principal factors’ method, the interest is actually mainly focussed on the linear structure of the data, since only moments up to the second ones are involved. In many real situations, the factors could not be adequately described by the first two moments only. For example, skewness characterizing most latent variables in social analysis can be properly measured by the third moment: the factors are not normally distributed and covariance is no longer a sufficient statistic. In this work we propose a factor model characterized by skew-normally distributed factors. Skew-normal refers to a parametric class of probability distributions, that extends the normal distribution by an additional shape parameter regulating the skewness. The model estimation can be solved by the generalized EM algorithm, in which the iterative Newthon–Raphson procedure is needed in the M-step to estimate the factor shape parameter. The proposed skew-normal factor analysis is applied to the study of student satisfaction towards university courses, in order to identify the factors representing different aspects of the latent overall satisfaction.

A factor mixture analysis model for multivariate binary data

The paper proposes a latent variable model for binary data coming from an unobserved heterogeneous population. The heterogeneity is taken into account by replacing the traditional assumption of Gaussian distributed factors by a finite mixture of multivariate Gaussians. The aim of the proposed model is twofold: it allows to achieve dimension reduction when the data are dichotomous and, simultaneously, it performs model based clustering in the latent space. Model estimation is obtained by means of a maximum likelihood method via a generalized version of the EM algorithm. In order to evaluate the performance of the model a simulation study and two real applications are illustrated.

Finite mixtures of matrix normal distributions for classifying three-way data

Matrix-variate distributions represent a natural way for modeling random matrices. Realizations from random matrices are generated by the simultaneous observation of variables in different situations or locations, and are commonly arranged in three-way data structures. Among the matrix-variate distributions, the matrix normal density plays the same pivotal role as the multivariate normal distribution in the family of multivariate distributions. In this work we define and explore finite mixtures of matrix normals. An EM algorithm for the model estimation is developed and some useful properties are demonstrated. We finally show that the proposed mixture model can be a powerful tool for classifying three-way data both in supervised and unsupervised problems. A simulation study and some real examples are presented.

Penalized factor mixture analysis for variable selection in clustered data

A model-based clustering approach which contextually performs dimension reduction and variable selection is presented. Dimension reduction is achieved by assuming that the data have been generated by a linear factor model with latent variables modeled as Gaussian mixtures. Variable selection is performed by shrinking the factor loadings though a penalized likelihood method with an L1 penalty. A maximum likelihood estimation procedure via the EM algorithm is developed and a modified BIC criterion to select the penalization parameter is illustrated. The effectiveness of the proposed model is explored in a Monte Carlo simulation study and in a real example.

Maximum likelihood estimation of mixtures of factor analyzers

Mixtures of factor analyzers have been receiving wide interest in statistics as a tool for performing clustering and dimension reduction simultaneously. In this model it is assumed that, within each component, the data are generated according to a factor model. Therefore, the number of parameters on which the covariance matrices depend is reduced. Several estimation methods have been proposed for this model, both in the classical and in the Bayesian framework. However, so far, a direct maximum likelihood procedure has not been developed. This direct estimation problem, which simultaneously allows one to derive the information matrix for the mixtures of factor analyzers, is solved. The effectiveness of the proposed procedure is shown on a simulation study and on a toy example.

Dimensionally Reduced Model-Based Clustering Through Mixtures of Factor Mixture Analyzers

Dimensionally reduced model-based clustering methods are recently receiving a wide interest in statistics as a tool for performing simultaneously clustering and dimension reduction through one or more latent variables. Among these, Mixtures of Factor Analyzers assume that, within each component, the data are generated according to a factor model, thus reducing the number of parameters on which the covariance matrices depend. In Factor Mixture Analysis clustering is performed through the factors of an ordinary factor analysis which are jointly modelled by a Gaussian mixture. The two approaches differ in genesis, parameterization and consequently clustering performance. In this work we propose a model which extends and combines them. The proposed Mixtures of Factor Mixture Analyzers provide a unified class of dimensionally reduced mixture models which includes the previous ones as special cases and could offer a powerful tool for modelling non-Gaussian latent variables.

Independent factor discriminant analysis

In the general classification context the recourse to the so-called Bayes decision rule requires to estimate the class conditional probability density functions. A mixture model for the observed variables which is derived by assuming that the data have been generated by an independent factor model is proposed. Independent factor analysis is in fact a generative latent variable model whose structure closely resembles the one of the ordinary factor model, but it assumes that the latent variables are mutually independent and not necessarily Gaussian. The method therefore provides a dimension reduction together with a semiparametric estimate of the class conditional probability density functions. This density approximation is plugged into the classic Bayes rule and its performance is evaluated both on real and simulated data.

Covariance pattern mixture models for the analysis of multivariate heterogeneous longitudinal data

We propose a novel approach for modeling multivariate longitudinal data in the presence of unobserved heterogeneity for the analysis of the Health and Retirement Study (HRS) data. Our proposal can be cast within the framework of linear mixed models with discrete individual random intercepts; however, differently from the standard formulation, the proposed Covariance Pattern Mixture Model (CPMM) does not require the usual local independence assumption. The model is thus able to simultaneously model the heterogeneity, the association among the responses and the temporal dependence structure. We focus on the investigation of temporal patterns related to the cognitive functioning in retired American respondents. In particular, we aim to understand whether it can be affected by some individual socio-economical characteristics and whether it is possible to identify some homogenous groups of respondents that share a similar cognitive profile. An accurate description of the detected groups allows government policy interventions to be opportunely addressed. Results identify three homogenous clusters of individuals with specific cognitive functioning, consistent with the class conditional distribution of the covariates. The flexibility of CPMM allows for a different contribution of each regressor on the responses according to group membership. In so doing, the identified groups receive a global and accurate phenomenological characterization.