Dana L. Joseph

Emotional intelligence is a second-stratum factor of intelligence: evidence from hierarchical and bifactor models.

This article examines the status of emotional intelligence (EI) within the structure of human cognitive abilities. To evaluate whether EI is a 2nd-stratum factor of intelligence, data were fit to a series of structural models involving 3 indicators each for fluid intelligence, crystallized intelligence, quantitative reasoning, visual processing, and broad retrieval ability, as well as 2 indicators each for emotion perception, emotion understanding, and emotion management. Unidimensional, multidimensional, hierarchical, and bifactor solutions were estimated in a sample of 688 college and community college students. Results suggest adequate fit for 2 models: (a) an oblique 8-factor model (with 5 traditional cognitive ability factors and 3 EI factors) and (b) a hierarchical solution (with cognitive g at the highest level and EI representing a 2nd-stratum factor that loads onto g at λ = .80). The acceptable relative fit of the hierarchical model confirms the notion that EI is a group factor of cognitive ability, marking the expression of intelligence in the emotion domain. The discussion proposes a possible expansion of Cattell-Horn-Carroll theory to include EI as a 2nd-stratum factor of similar standing to factors such as fluid intelligence and visual processing.

Saving lives: A meta-analysis of team training in healthcare.

As the nature of work becomes more complex, teams have become necessary to ensure effective functioning within organizations. The healthcare industry is no exception. As such, the prevalence of training interventions designed to optimize teamwork in this industry has increased substantially over the last 10 years (Weaver, Dy, & Rosen, 2014). Using Kirkpatricks (1956, 1996) training evaluation framework, we conducted a meta-analytic examination of healthcare team training to quantify its effectiveness and understand the conditions under which it is most successful. Results demonstrate that healthcare team training improves each of Kirkpatricks criteria (reactions, learning, transfer, results; d = .37 to .89). Second, findings indicate that healthcare team training is largely robust to trainee composition, training strategy, and characteristics of the work environment, with the only exception being the reduced effectiveness of team training programs that involve feedback. As a tertiary goal, we proposed and found empirical support for a sequential model of healthcare team training where team training affects results via learning, which leads to transfer, which increases results. We find support for this sequential model in the healthcare industry (i.e., the current meta-analysis) and in training across all industries (i.e., using meta-analytic estimates from Arthur, Bennett, Edens, & Bell, 2003), suggesting the sequential benefits of training are not unique to medical teams. Ultimately, this meta-analysis supports the expanded use of team training and points toward recommendations for optimizing its effectiveness within healthcare settings. (PsycINFO Database Record

Discriminant Validity of Self-Reported Emotional Intelligence: A Multitrait–Multisource Study

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor model for Goldberg’s International Personality Item Pool (IPIP). After demonstrating measurement equivalence between self-report and peer-report for both scales, the authors show discriminant validity between the four EI subfacets and Big Five personality traits. This is accomplished through a series of structural equation models fit to the mutitrait-multimethod matrix. Despite their conclusion of discriminant validity, the authors note strong latent correlations between Others’ Emotion Appraisal and trait Agreeableness (φ = .87), between Use of Emotion and trait Conscientiousness (φ = .73), between Regulation of Emotion and trait Neuroticism (φ = −.66), and between Self Emotion Appraisal and trait Neuroticism (φ = −.66). There is also post hoc evidence of potential leniency in self-reported emotion regulation. Results point to the utility of peer-report methods as well as the relative construct validity of various subfacets of self-reported emotional competence.

Leader–Member Exchange (LMX) Measurement: Evidence for Consensus, Construct Breadth, and Discriminant Validity

Purpose – This chapter (a) summarizes leader–member exchange (LMX) measurement practices since the influential reviews by Schriesheim, Castro, and Cogliser (1999) and Gerstner and Day (1997), (b) clarifies the status of LMX as a broad construct from a hierarchical factor model, (c) conducts multitrait-multimethod (MTMM) analyses on leader and follower reports of multidimensional LMX, and (d) investigates discriminant validity between Member LMX and satisfaction with supervisor. Methodology/Approach – We used (a) a literature search of LMX measurement practices, (b) a combination of meta-analysis and factor analysis to specify the broad LMX construct underlying Liden and Maslyns (1998) (LMX-MDM) multidimensional instrument, (c) MTMM analyses of leader and member ratings of the LMX-MDM, and (d) a combination of meta-analysis and multiple regression to assess incremental validity of Member LMX beyond satisfaction with supervisor. Findings – Since 1999, 85% of LMX studies now use one of two dominant LMX scales (LMX-7, Scandura, & Graen, 1984; LMX-MDM, Liden & Maslyn, 1998). These two measures are correlated (rcorrected=.9), suggesting the LMX-7 and the LMX-MDM are alternate forms of the same instrument. 94% of studies that used these two measures treat LMX as a single, broad construct rather than as a multidimensional set of constructs. MTMM analyses suggest Leader LMX and Member LMX are two, separate-but-related constructs (i.e., confirming two source factors and no lower-order trait factors). Last, Member LMX meta-analytically correlates with satisfaction with supervisor at rcorrected=.8. There is some incremental validity of LMX, but the pattern is inconsistent across samples. Social Implications – We point out that LMX researchers have now moved toward standard measurement of LMX – as a broad, higher-order factor that varies between leader and follower. By doing so, we reveal that the stage is set for cumulative and replicable research on leadership as a dyadic, follower-specific phenomenon. Originality/Value of Paper – Our chapter is the first to reveal consensus in LMX measurement across studies; to summarize the standard treatment of LMX as a single, broad factor; and to apply MTMM analyses to demonstrate separate Leader LMX and Member LMX source factors.

More than g: Selection quality and adverse impact implications of considering second stratum cognitive abilities

When using cognitive tests, personnel selection practitioners typically face a trade-off between the expected job performance and diversity of new hires. We review the increasingly mainstream evidence that cognitive ability is a multidimensional and hierarchically ordered set of concepts, and examine the implications for both composite test validity and subgroup differences. Ultimately, we recommend a strategy for differentially weighting cognitive subtests (i.e., second-stratum abilities) in a way that minimizes overall subgroup differences without compromising composite test validity. Using data from 2 large validation studies that included a total of 15 job families, we demonstrate that this strategy could lead to substantial improvement in diversity hiring (e.g., doubling the number of job offers extended to minority applicants) and to at least 8% improvement in job offers made to minority applicants, without decrements in expected selection quality compared to a unit-weighted cognitive test composite. Finally, we conduct a sensitivity analysis to examine whether the technique continues to perform well when applied to applicant pools of smaller size. We discuss prerequisites for the application of this strategy, potential limitations, and extensions.

Measurement Invariance of the Social Phobia and Anxiety Inventory

The Social Phobia and Anxiety Inventory (SPAI) is a commonly used self-report measure of social phobia that has demonstrated adequate reliability, convergent validity, discriminant validity, and criterion-related validity. However, research has yet to address whether this measure functions equivalently in (a) individuals with and without a diagnosis of social phobia and (b) males and females. Evaluating measurement equivalence/invariance is necessary in order to determine that the construct of social anxiety is interpreted similarly across these populations. The results of the current investigation, using a series of nested factorial models proposed by Vandenberg and Lance (2000), provide evidence for strong equivalence across 420 individuals with and without diagnoses of social phobia and across male and female samples. Accordingly, these results provide psychometric justification for comparison of SPAI scores across the symptom continuum and sexes.

Never Say "always"? Extreme Item Wording Effects on Scalar Invariance and Item Response Curves

When writing items for survey measures, common advice dictates that one should avoid using extreme words like ‘‘always.’’ However, the systematic study of extreme wording effects is rare. The current study applies confirmatory factor analysis (CFA) and item response theory (IRT) methods to assess the effects of extreme item wording (i.e., the word ‘‘always’’) on item-level, response option-level, and scale- (or test) level invariance. The authors hypothesized that including the word ‘‘always’’ in an item stem would affect responses such that individuals would be less likely to strongly agree with these items. To test this hypothesis, six items with extreme wording from the Wong and Law Emotional Intelligence Scale (WLEIS) were compared with more moderately worded versions of the same items. Although an effect was found for item wording, the magnitude of nonequivalence was small and is unlikely to have a strong influence on scale-level measurement outcomes. Implications for evaluating survey psychometric properties are discussed.

Leadership training design, delivery, and implementation: A meta-analysis.

Recent estimates suggest that although a majority of funds in organizational training budgets tend to be allocated to leadership training (Ho, 2016; O’Leonard, 2014), only a small minority of organizations believe their leadership training programs are highly effective (Schwartz, Bersin, & Pelster, 2014), calling into question the effectiveness of current leadership development initiatives. To help address this issue, this meta-analysis estimates the extent to which leadership training is effective and identifies the conditions under which these programs are most effective. In doing so, we estimate the effectiveness of leadership training across four criteria (reactions, learning, transfer, and results; Kirkpatrick, 1959) using only employee data and we examine 15 moderators of training design and delivery to determine which elements are associated with the most effective leadership training interventions. Data from 335 independent samples suggest that leadership training is substantially more effective than previously thought, leading to improvements in reactions (&dgr; = .63), learning (&dgr; = .73), transfer (&dgr; = .82), and results (&dgr; = .72), the strength of these effects differs based on various design, delivery, and implementation characteristics. Moderator analyses support the use of needs analysis, feedback, multiple delivery methods (especially practice), spaced training sessions, a location that is on-site, and face-to-face delivery that is not self-administered. Results also suggest that the content of training, attendance policy, and duration influence the effectiveness of the training program. Practical implications for training development and theoretical implications for leadership and training literatures are discussed.

The SPAIC-11 and SPAICP-11: Two brief child- and parent-rated measures of social anxiety

The Social Phobia and Anxiety Inventory for Children-11 (SPAIC-11) and Social Phobia and Anxiety Inventory for Childrens Parents-11 (SPAICP-11) were developed as brief versions of the Social Phobia and Anxiety Inventory--Child and Parent Versions via item response theory (IRT) using child and parent reports of social anxiety. A sample of 496 children was analyzed using IRT analyses, revealing 11 items that exhibit measurement equivalence across parent and child reports. Descriptive and psychometric data are provided for the child, parent, and combined total scores. Discriminant validity was demonstrated using logistic regression and receiver operating characteristic curve analyses. The SPAIC-11 and SPAICP-11 are psychometrically sound measures that are able to measure social anxiety invariantly across children and their parents. These brief measures which include combined parent and child perception of the childs social anxiety may provide notable benefits to clinical research.

The Overlap Between Emotional Intelligence and Post-Industrial Leadership Capacity: A Construct Validity Analysis

A sample of 276 students enrolled in campus leadership programs completed the Emotional Competence Inventory-University Edition (ECI-U) and the Socially Responsible Leadership Scale (SRLS) as a means to determine the relatedness in college students of emotional intelligence (EI) to the practice of post-industrial leadership skills. Confirmatory factor analysis (CFA) supported current use of subscales within the SRLS and showed that EI and post-industrial leadership skills represent distinct, yet related, constructs. Results also suggest the ECI-U may better represent one overall concept of Emotional Competence rather than four distinct areas of EI. Implications and directions for future research are discussed.