Thomas W. Shaffer

Toward International Normative Reference Data for the Comprehensive System

We build on the work of all the authors contributing to this Special Supplement by summarizing findings across their samples of data, and we also draw on samples published elsewhere. Using 21 samples of adult data from 17 countries we create a composite set of internationally-based reference means and standard deviations from which we compute T-scores for each sample. Figures illustrate how the scores in each sample are distributed and how the samples compare across variables in eight Rorschach Comprehensive System (CS; Exner, 2003) clusters. The adult samples from around the world are generally quite similar, and thus we encourage clinicians to integrate the composite international reference values into their clinical interpretation of protocols. However, the 31 child and adolescent samples from 5 countries produce unstable and often quite extreme values on many scores. Until the factors contributing to the variability among these samples are more fully understood, we discourage clinicians from using many CS scores to make nomothetic, score-based inferences about psychopathology in children and adolescents.

Current nonpatient data for the Rorschach, WAIS-R, and MMPI-2

A literature review yields a surprisingly small number of nonpatient studies focusing on three widely used assessment tools: the WAIS-R, Rorschach, and MMPI-2. In this study, 123 nonpatient adults residing in central California were administered these three instruments. We performed intercoder reliability statistics on 52 of the 123 Rorschach records. WAIS-R and MMPI-2 results are similar to current standardization data for these instruments, whereas many of the Rorschach variables are quite different from those published in the manual for the Comprehensive System (Exner, 1995). We discuss these findings and offer recommendations for further normative research.

The Risk and Protective Factors of Violent Juvenile Offending An Examination of Gender Differences

Understanding the etiology of violent juvenile offending is critical for prevention and intervention efforts. The risk factors examined included marital status of parents, marital conflict, substance use, age of first substance use, learning difficulties, and school failure. The protective factors assessed included parenting styles, academic achievement, attitudes unfavorable toward violence, having a mentor, positive relationships with peers, and being involved in extracurricular activities. One hundred and twenty-four participants between the ages 14 and 18 years were assessed. A discriminant functions analysis revealed that multiple risk and protective factors were significant in predicting group membership. The nondelinquent group had significantly more protective factors than the other two groups. Significant gender differences were also found.

A study of nonpatient preadolescent Rorschach protocols.

There is a paucity of peer-reviewed, nonpatient Rorschach studies in psychological journals, particularly for children. This study examined 100 preteenage children, using the Comprehensive System to code their Rorschach protocols. The participants were also evaluated with the Conners Parent Rating Scale-93 (Conners, 1989) and 5 exclusionary behavior criteria. The 100 participants demonstrated better than average behaviors. The results presented include all the ratios and indexes found in the nonpatient statistics for the Comprehensive System. We discuss interrater reliability issues and offer recommendations for further cross-validating research.

Introduction to the JPA Special Supplement on International Reference Samples for the Rorschach Comprehensive System

This Introduction provides an overview to the JPA Special Supplement on International Reference Samples for the Rorschach Comprehensive System (CS; Exner, 2001). It contains a history of this project and a table including all of the lead authors, their country and the type and size of their sample. Suggestions for conducting this type of research are offered, including information on normative vs. nonpatient samples, inclusion/exclusion criteria, the use of collateral instruments, and concerns relative to representativeness. Reliability and coding concerns are addressed, and information on the Popular response in Japan are reviewed. Finally, trends within and across the data are highlighted.

Rorschach Comprehensive System Data for a Sample of 283 Adult Nonpatients From the United States

This article presents an update on adult nonpatients living in central California previously described by Shaffer, Erdberg, and Haroian (1999). In this study an additional 160 nonpatients were administered the Rorschach for a total sample size of 283. Graduate students enrolled in a 2-year Rorschach research seminar administered the Rorschach (Exner, 1995), WAIS–R (Weschler, 1981), and MMPI–2 (Butcher, Dahlstrom, Graham, Tellegen, & Kaemmer, 1989), and were provided with extensive supervision and ongoing quality control. All protocols were recoded by the first two authors and a psychologist with extensive Rorschach experience. Exclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for Rorschach Comprehensive System (CS), WAIS–R, and MMPI–2 variables.

Addressing Issues in the Development and Use of the Composite International Reference Values as Rorschach Norms for Adults

This article describes 3 studies evaluating normative reference data for the Rorschach Comprehensive System (CS; Exner, 2003, 2007), with a particular focus on the viability of the Composite International Reference Values (CIRVs) that were compiled from 21 adult studies by Meyer, Erdberg, and Shaffer (2007). Study 1 documented how the CIRV norms are virtually identical when organized into 3 groups differentiated by the quality of their data collection effort, including an optimal group of 4 samples that relied on multiple experienced examiners and provided ongoing quality control over administration and coding. Analyses also showed that relative to the group of more optimal samples, the group of less optimal samples did not produce more variability in summary scores within or across samples or lower interrater reliability for coding. Study 2 used the existing CS reference norms to generate T scores for the CIRV means and documented how the CS norms make other samples of healthy nonpatients look psychologically impaired in multiple domains. Study 3 documented with examples from 4 different countries how 2 sets of within-country local norms produced notably different results on some variables, which compromises the ability of local norms to be used instead of the CIRVs. Taken together, the 3 studies provide support for the use of CIRVs in clinical practice as norms that are generalizable across samples, settings, languages, and cultures and that account for the natural variability that is present when clinicians and researchers contend with the ambiguity contained in the standard CS reference materials concerning the proper ways to administer and code. We conclude by urging CS users to rely on the CIRVs when making clinical inferences and to adopt alternative methods of ensuring they are following cohesively standardized administration and coding guidelines.

Rorschach Comprehensive System Data for a Sample of 37 Nonpatient/Nondelinquent Adolescents From the United States

This study is composed of 37 American adolescents, ages 15 to 17 years of age, all from the United States. The principal author was the sole examiner. Inclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for the Rorschach Comprehensive System (CS; Exner, 2003). The results revealed differences from the published norms on variables that reflect poor form quality, fewer popular responses, more attention to detail, more poor human relationship responses, and a more simplistic, affective-free approach to the environment, among others.

Rorschach Comprehensive System Data for a Sample of 42 Nonpatient Mexican American Children From the United States

This study is composed of 42 Mexican American children, ages 8 to 10 years, all from the United States. In addition to the children being administered the Rorschach, they also were administered the Childrens Hispanic Background Scale (CHBS) and the Childrens Personality Questionnaire (CPQ). The principal author was the sole examiner. Inclusion criteria are described. Interrater reliability statistics at the response level are presented along with scores for the Rorschach Comprehensive System (CS; Exner, 1995).

Rorschach intercoder reliability for protocol-level comprehensive system variables in an international sample.

This study examines the intercoder reliability of Rorschach Comprehensive System (CS; Exner, 2001) protocol-level variables. A large international sample was combined to obtain intercoder agreement for 489 Rorschach protocols coded using the CS. Intercoder agreement was calculated using an Iota coefficient, a statistical coefficient similar to kappa that is corrected for chance. Iota values for the variables analyzed ranged from .31 to 1.00, with 2 in the poor range of agreement, 4 in the fair range, 25 in the good range, and 116 in the excellent range of agreement. Discrepancies between variables are discussed.