Joshua M. Sacco

Understanding pretest and posttest reactions to cognitive ability and personality tests.

To understand the nature of test reactions and their relationship to test performance, the relationships among belief in tests, pretest reactions, test performance, and posttest reactions were modeled for cognitive ability and personality tests. Results from structural equation models that were fitted to responses from 197 undergraduate examinees supported the hypothesized relationships. On the cognitive ability test, pretest reactions affected test performance and mediated the relationship between belief in tests and test performance. Test performance affected posttest reactions even after taking into account the effect of pretest reactions. On the personality test, belief in tests affected pretest and posttest reactions, but the three variables were unrelated to test performance (Conscientiousness scores). Conceptual, methodological, and practical implications of the findings are discussed in the context of research on test reactions and test performance.

An investigation of race and sex similarity effects in interviews: A multilevel approach to relational demography.

This research studied the effects of race and sex similarity on ratings in one-on-one highly structured college recruiting interviews (N = 708 interviewers and 12203 applicants for 7 different job families). A series of hierarchical linear models provided no evidence for similarity effects, although the commonly used D-score and analysis-of-variance-based interaction approaches conducted at the individual level of analysis yielded different results. The disparate results demonstrate the importance of attending to nested data structures and levels of analysis issues more broadly. Practically, the results suggest that organizations using carefully administered highly structured interviews may not need to be concerned about bias due to the mismatch between interviewer and applicant race or sex.

Regional White Matter Pathology in Mild Cognitive Impairment. Differential Influence of Lesion Type on Neuropsychological Functioning

Background and Purpose— Associations between regional white matter lesion pathology and neuropsychological performance across the aging spectrum are not well understood and, to date, research has been largely contradictory and inconclusive. The current study set out to clarify some of the inconsistencies in the literature by relating volumetric analyses of white matter lesions (deep white matter lesions and periventricular lesions) to neuropsychological performance in a large clinical sample of older adults diagnosed with mild cognitive impairment. Methods— Seventy older adults with mild cognitive impairment were administered a comprehensive neuropsychological battery. White matter lesions identified on T2-weighted FLAIR images were quantified using a semi-automated volumetric approach (pixel thresholding). Results— Results showed that, in contrast to performance on memory and naming tasks, total white matter lesions strongly predicted executive impairments, slowed processing speed, and visuospatial/construction difficulties. In addition, separate regression analyses demonstrated that results were primarily accounted for by deep white matter lesions (but not periventricular lesions), most likely due to frontal-subcortical circuitry disruption. Moreover, deep white matter lesions, but not periventricular lesions, significantly predicted overall poorer neuropsychological functioning after controlling for age, education, and level of depression. Conclusions— Taken together, findings demonstrate a differential influence of lesion type on cognitive impairment in mild cognitive impairment and implicate deep white matter lesions as being most detrimental in terms of neuropsychological functioning. Clinical, theoretical, and methodological implications of these results are discussed.

Heterogeneity in mild cognitive impairment: differences in neuropsychological profile and associated white matter lesion pathology.

This study examined whether distinct neuropsychological profiles could be delineated in a sample with Mild Cognitive Impairment (MCI) and whether white matter lesion (WML) burden contributed to MCI group differences. A heterogeneous, clinical sample of 70 older adults diagnosed with MCI was assessed using cognitive scores, and WML was quantified using a semi-automated, volumetric approach on T2-weighted fluid-attenuated inversion recovery (FLAIR) images. Using cluster and discriminant analyses, three distinct groups (Memory/Language, Executive/Processing Speed, and Pure Memory) were empirically derived based on cognitive scores. Results also showed a dose dependent relationship of WML burden to MCI subgroup, with the Executive/Processing Speed subgroup demonstrating significantly higher levels of WML pathology when compared to the other subgroups. In addition, there was a dissociation of lesion type by the two most impaired subgroups (Memory/Language and Executive/Processing Speed) such that the Memory/Language subgroup showed higher periventricular lesion (PVL) and lower deep white matter lesion (DWML) volumes, whereas the Executive/Processing Speed demonstrated higher DWML and lower PVL volumes. Results demonstrate that distinct MCI subgroups can be empirically derived and reliably differentiated from a heterogeneous MCI sample, and that these profiles differ according to WML burden. Overall, findings suggest different underlying pathologies within MCI and contribute to our understanding of MCI subtypes.

Correlates of Person Fit and Effect of Person Fit on Test Validity

Person-fit indices (lz and multitest lzm) derived from item response theory and used to identify misfitting examinees were computed based on responses to cognitive ability and personality tests. lz indices from different ability domains within the cognitive tests were uncorrelated with each other; lz indices from different tests within the personality domain were moderately intercorrelated. Cross-domain correlations were near 0. Test-taking motivation and conscientiousness were correlated moderately with multitest lzm for personality tests and to a lesser extent for cognitive tests. Test reactions were uncorrelated with any of the lz measures. Males had higher mean lz s than females. This difference could be partly attributed to differences in conscientiousness. African-Americans had higher mean lz than Whites. This effect could not be accounted for by test-taking motivation or conscientiousness. High values of lz affected the criterion-related validity of the set of cognitive tests such that the validity estimate decreased as lz increased.

The Cross-Cultural Equivalence of Job Performance Ratings

The primary purpose of this study was to assess the cross-cultural invariance of job performance ratings. A secondary purpose was to examine potential cross-cultural differences in correlates of performance ratings (i.e., ratee sex, age, tenure; supervisors opportunity to observe ratee). Fast-food supervisors from Canada, South Korea, and Spain rated employees on their technical proficiency, customer service, and teamwork. Results show that these ratings demonstrate a basic level of measurement invariance, although the error variances of the ratings and pattern of construct variances and covariances were largely culture-specific. This suggests that supervisors across cultures may use and interpret the ratings similarly, but perceive differences in performance. Furthermore, age, tenure, and the supervisors opportunity to observe the ratee were found to affect ratings differently across cultures. Overall, this study suggests that although job performance ratings are at least partially invariant across cultures, latent performance may not be, and we present some preliminary data as to why latent invariance may not exist.

Parental employment, school climate, and children's academic and social development.

Longitudinal data were used to examine the effects of parental employment status and school climate on childrens academic and social development. Hierarchical regression, analyses of covariance, and latent growth modeling were used to assess various aspects of change as a function of work status and school climate with family income and education as control variables. Parental employment was associated with positive changes in social and academic progress even after controlling for prior developmental level, climate, and family income although effects were small and complex. School climate had minimal effect on the outcome variables. Income and education were related to various school outcomes.

Examination of Structured Interview Ratings Across Time: The Effects of Applicant Race, Rater Race, and Panel Composition

This study examined the relationship between race and interview ratings in a structured selection panel interview. Data from 1,334 police officer applicants who were interviewed by three-person panels were examined to explore how applicant race, rater race, and panel racial composition related to interview ratings and change from initial to final ratings. Results revealed the largest effect was for panel racial composition, such that predominately White panels provided significantly more favorable ratings to applicants of all races compared to panels composed of predominately Black raters. However, a significant three-way interaction between rater race, applicant race, and panel composition was also found. Specifically, Black raters evaluated Black applicants more favorably than White applicants only when they were on a predominately Black panel. These results may help explain past inconsistencies in the literature regarding the effects of rater race and applicant race on ratings.

The Estimation of Reliability in Longitudinal Models

Despite the increasing attention devoted to the study and analysis of longitudinal data, relatively little consideration has been directed toward understanding the issues of reliability and measurement error. Perhaps one reason for this neglect has been that traditional methods of estimation (e.g. generalisability theory) require assumptions that are often not tenable in longitudinal designs. This paper first examines applications of generalisability theory to the estimation of m easurement error and reliability in longitudinal research, and notes how factors such as missing data, correlated errors, and true score instability prohibit traditional variance com ponent estimation. Next, we discuss how estimation methods using restricted maximum likelihood can account for these factors, thereby providing m any advantages over traditional estimation methods. Finally, we provide a substantive exam ple illustrating these advantages, and include brief discussions of programming and software considerations.

Anticipated work/family conflict and family member views: role in police recruiting

Research on police officer recruiting has not focused on anticipated work/family conflict, the amount of conflict an applicant thinks will be in a police job. The influence of anticipated work/family conflict on applicant and family member opinions and applicant behavior wasexamined. Also, gender and family role differences were examined. We found congruence in applicant and family member views, and a lack of relation of anticipated work/family conflict to applicant behavior. Future research needs on how work/family issues are viewed by applicants are discussed.