Michael C. Sturman

A Tale of Three Perspectives: Examining Post Hoc Statistical Techniques for Detection and Correction of Common Method Variance

Many researchers who use same-source data face concerns about common method variance (CMV). Although post hoc statistical detection and correction techniques for CMV have been proposed, there is a lack of empirical evidence regarding their efficacy. Because of disagreement among scholars regarding the likelihood and nature of CMV in self-report data, the current study evaluates three post hoc strategies and the strategy of doing nothing within three sets of assumptions about CMV: that CMV does not exist, that CMV exists and has equal effects across constructs, and that CMV exists and has unequal effects across constructs. The implications of using each strategy within each of the three assumptions are examined empirically using 691,200 simulated data sets varying factors such as the amount of true variance and the amount and nature of CMV modeled. Based on analyses of these data, potential benefits and likely risks of using the different techniques are detailed.

Searching for the Inverted U-Shaped Relationship Between Time and Performance: Meta-Analyses of the Experience/Performance, Tenure/Performance, and Age/Performance Relationships

Theoretical and empirical research suggests that job experience, organizational tenure, and age have non-linear relationships with performance. Considered simultaneously, there should exist an inverted U-shaped relationship between time and performance. Furthermore, the nature of this inverted U-shaped relationship should be affected by characteristics of the sample and measurement of performance. Using meta-analysis, this paper seeks to confirm the existence of the inverted U-shaped relationship between time and performance, and to demonstrate the moderating effects of performance measurement (objective versus subjective measures of performance) and job complexity. The results have implications for theory, research on dynamic performance, and human resource management practice.

The Impact of Job Complexity and Performance Measurement on the Temporal Consistency, Stability, and Test-Retest Reliability of Employee Job Performance Ratings

Although research has shown that individual job performance changes over time, the extent of such changes is unknown. In this article, the authors define and distinguish between the concepts of temporal consistency, stability, and test-retest reliability when considering individual job performance ratings over time. Furthermore, the authors examine measurement type (i.e., subjective and objective measures) and job complexity in relation to temporal consistency, stability, and test-retest reliability. On the basis of meta-analytic results, the authors found that the test-retest reliability of these ratings ranged from .83 for subjective measures in low-complexity jobs to .50 for objective measures in high-complexity jobs. The stability of these ratings over a 1-year time lag ranged from .85 to .67. The analyses also reveal that correlations between performance measures decreased as the time interval between performance measurements increased, but the estimates approached values greater than zero.

Does the Measure of Dispersion Matter in Multilevel Research? A Comparison of the Relative Performance of Dispersion Indexes

Within the context of climate strength, this simulation study examines the validity of various dispersion indexes for detecting meaningful relationships between variability in group member perceptions and outcome variables. We used the simulation to model both individual-and group-level phenomena, vary appropriate population characteristics, and test the proclivity of standard and average deviation, interrater agreement indexes (rwg, r*wg, awg), and coefficient of variation (both normed and unnormed) for Type I and Type II errors. The results show that the coefficient of variation was less likely to detect interaction effects although it outperformed other measures when detecting level effects. Standard deviation was shown to be inferior to other indexes when no level effect is present although it may be an effective measure of dispersion when modeling strength or interaction effects. The implications for future research, in which dispersion is a critical component of the theoretical model, are discussed.

The Implications of Linking the Dynamic Performance and Turnover Literatures

This article examines how the literatures of dynamic performance and the performance-turnover relationship inform each other. The nonrandom performance turnover relationship suggests that dynamic performance studies may be biased by their elimination of participants who do not remain for the entire study period. The authors demonstrated that the performance slopes of those who leave an organization differ from the performance slopes of those who remain. This finding suggests that studies of the performance-turnover relationship need to consider employee performance trends when predicting turnover. Replicating and extending the research of D. A. Harrison, M. Virick, and S. William (1996), the authors found that performance changes from the previous month and performance trends measured over a longer time period explained variance in voluntary turnover beyond current performance. Finally, the authors showed that performance trends interacted with current performance in the prediction of voluntary turnover.

Comparison of Three Meta-Analytic Procedures for Estimating Moderating Effects of Categorical Variables

The authors conducted Monte Carlo simulations to compare the Hedges and Olkin, the Hunter and Schmidt, and a refinement of the Aguinis and Pierce meta-analytic approaches for estimating moderating effects of categorical variables. The simulation examined binary moderator variables (e.g., gender—male, female; ethnicity—majority, minority). The authors compared the three meta-analytic methods in terms of their point estimation accuracy and Type I and Type II error rates. Results provide guidelines to help researchers choose among the three meta-analytic techniques based on theory (i.e., exploratory vs. confirmatory research) and research design considerations (i.e., degree of range restriction and measurement error).

The Effect of Culture on the Curvilinear Relationship Between Performance Turnover

Although researchers have theorized that there exists a curvilinear relationship between job performance and voluntary turnover, their research has been tested in the United States or culturally similar Switzerland. Through a study of the performance-turnover relationship from a multinational service-oriented organization in 24 countries, we demonstrate that the general relationship between performance and turnover is similar across countries but the details of that relationship change across countries. Using 4 cultural dimensions--in-group collectivism, power distance, uncertainty avoidance, and performance orientation--we find that cultural factors alter the overall probability of voluntary turnover and influence the degree of curvilinearity in the performance-turnover relationship. Our findings have implications for research on the performance-turnover relationship, turnover research, and practice.

Justice as a Dynamic Construct: Effects of Individual Trajectories on Distal Work Outcomes

Despite an amassing organizational justice literature, few studies have directly addressed the temporal patterning of justice judgments and the effects that changes in these perceptions have on important work outcomes. Drawing from Gestalt characteristics theory (Ariely & Carmon, 2000, 2003), we examine the concept of justice trajectories (i.e., levels and trends of individual fairness perceptions over time) and offer empirical evidence to highlight the value of considering fairness within a dynamic context. Participants included 523 working adults who completed surveys about their work experiences on 4 occasions over the course of 1 year. Results indicate that justice trends explained additional variance in distal work outcomes (job satisfaction, organizational commitment, and turnover intentions) after controlling for end-state levels of justice, demonstrating the cumulative effects of justice over time. Findings also reveal that change in procedural justice perceptions affected distal work outcomes more strongly than any other justice dimension. Implications for theory and future investigations of justice as a dynamic construct are discussed.

The differential effects of the quality and quantity of online reviews on hotel room sales

While it is generally accepted that hotel reviews and ratings posted on travel websites drive hotel sales and revenue, the effects of reviews can be parsed into volume (the number of reviews about a hotel) and valence (the ratings in those reviews). This study finds that the two chief aspects of reviews—volume and valence—have different effects on hotels in various chain scale segments. Industry reports and academic studies show that online reviews influence customers’ choice of hotel and thus drive hotels’ revenue per available room (RevPAR). However, the valence of those reviews has a greater effect on luxury hotels’ RevPAR, while the volume of reviews has a greater effect on lower-tier hotels. Based on a study of 319 hotels in the London metropolitan market, these effects apply equally to urban and suburban hotels, as well as chain and independent hotels. The results further indicate that the rating score effect on RevPAR has little impact on the economy and midscale segments, while an increasing number of reviews actually has negative effects on higher-end hotels.

What Matters More? Contrasting the Effects of Job Satisfaction and Service Climate on Hotel Food and Beverage Managers’ Job Performance

Research has provided little empirical support for the concept that employee job satisfaction is a causal driver of employee job performance, customer satisfaction, and company performance. This concept is an enduring one, however, and it has been codified as the starting point in the widely espoused service profit chain. Using a sample of eighty-four food and beverage (F&B) manager groups from forty Asian hotel properties owned and managed by a single multinational hotel chain, we examine the effect of job satisfaction, and contrast this effect with that of group service climate, on supervisor ratings of group job performance behaviors (group task performance and organizational citizenship behaviors). The findings underscore the weak connection between job satisfaction and job performance. However, group service climate was found to have a positive effect on supervisor ratings of group job performance behaviors. Consistent with prior research, this study’s findings indicate that managers may improve their employees’ job performance (and job satisfaction) by ensuring that employees understand what is expected of them and how their performance will be appraised and rewarded by the organization.