Nathan C. Weed

Development and validation of the Delaying Gratification Inventory

Deficits in gratification delay are associated with a broad range of public health problems, such as obesity, risky sexual behavior, and substance abuse. However, 6 decades of research on the construct has progressed less quickly than might be hoped, largely because of measurement issues. Although past research has implicated 5 domains of delay behavior, involving food, physical pleasures, social interactions, money, and achievement, no published measure to date has tapped all 5 components of the content domain. Existing measures have been criticized for limitations related to efficiency, reliability, and construct validity. Using an innovative Internet-mediated approach to survey construction, we developed the 35-item 5-factor Delaying Gratification Inventory (DGI). Evidence from 4 studies and a large, diverse sample of respondents (N = 10,741) provided support for the psychometric properties of the measure. Specifically, scores on the DGI demonstrated strong internal consistency and test-retest reliability for the 35-item composite, each of the 5 domains, and a 10-item short form. The 5-factor structure fit the data well and had good measurement invariance across subgroups. Construct validity was supported by correlations with scores on closely related self-control measures, behavioral ratings, Big Five personality trait measures, and measures of adjustment and psychopathology, including those on the Minnesota Multiphasic Personality Inventory-2-Restructured Form. DGI scores also showed incremental validity in accounting for well-being and health-related variables. The present investigation holds implications for improving public health, accelerating future research on gratification delay, and facilitating survey construction research more generally by demonstrating the suitability of an Internet-mediated strategy.

Dyadic agreement on the MMPI-2

Abstract Research in behavior genetics has documented assortative mating with respect to physical, demographic, sociocultural, and personality variables. The present study examined patterns of dyadic similarity on personality characteristics reflected on MMPI-2 items and scales in a sample of 982 couples. MMPI-2 scales with high dyadic correlations appear to entail the following broad domains: attitudes about substance use (MMPI-2 scales AAS, APS, and MAC-R), domestic satisfaction (MSD, FAM, and Pd), and mistrust (ASP, CYN, and Re). Principal components analysis of a matrix of 60 items possessing strong dyadic correlations revealed nine underlying dimensions: Cynical Mistrust, Substance Abuse, Domestic Dissatisfaction, Sensation-Seeking, Financial Worry, Stereotypic Masculinity, Self-Confidence, Piety, and Deviant Ideation. Years of acquaintance did not moderate dyadic similarity. Couples receiving counseling demonstrated less dyadic similarity than couples not in counseling.

Development of a scale to assess Hwa-Byung, a Korean culture-bound syndrome, using the Korean MMPI-2

This study documents the development of an MMPI-2 scale designed to assess features of the Korean culture-bound syndrome, Hwa-Byung (HB). An American research team and psychiatric practitioners in Korea created an 18-item HB scale via rational item selection and psycho-metric refinement. Principal components analysis of scale items revealed four components, reflecting content domains of general health, gastrointestinal symptoms, hopelessness, and anger. This four-component solution applied well to both Korean men and women, but not to an American sample. Although some findings were encouraging, future studies employing clinical samples are needed to provide further validation of this scale.

Evaluation of an Observer Form of the Coping Inventory for Stressful Situations

The present study evaluates a prospective observer form of the Coping Inventory for Stressful Situations (CISS) by comparing the two forms in terms of factor structure, mean differences, reliability, and examining correlations between self-report and peer ratings. A total of 163 pairs of friends complete the CISS and an observer form of the CISS. Confirmatory factor analysis results indicate that for both rating forms, the four-factor solution fits better. Although self-rating data fit the theoretical model better, the peer ratings show higher reliability. The correlation between self and peer latent factors is moderate for Avoidance-oriented coping and for its subscales, but low for Task- and Emotion-oriented coping. Internal consistency coefficients for the CISS scales are high across type of rating, and a significant cross-form mean difference is found on the Task latent factor. Overall, the results provide evidence of substantial measurement equivalence between the self-rating form and the observer form, and the authors propose its use in dispositional coping research.

Effects of Augmenting Response Options on MMPI–2 RC Scale Psychometrics

A number of empirical investigations indicate that tests with a greater number of response options tend to yield better psychometric performance. We hypothesized that a version of the MMPI–2 with a polytomous response format would outperform the standard dichotomous format in terms of observed score reliability and validity. Two versions of the MMPI–2 RC scales were administered consecutively in counterbalanced order to 199 undergraduate students attending a large Midwestern university: the standard true–false version, and an experimental version containing 4 response options (very true, mainly true, slightly true, and false, not at all true). After participants completed both versions, 2 scales from the Multidimensional Personality Questionnaire (MPQ) were administered to assess differences in convergent validity. Results showed enhancements in reliability for all RC scale scores and increases in the convergent validity of scores. Directions for further investigation and potential implications for future test development are discussed.

Validation of a Korean MMPI-2 Hwa-Byung scale using a Korean normative sample.

The psychometric properties of a recently developed measure of Hwa-Byung (HB), a Korean culture bound syndrome, using an updated version of the Korean Minnesota Multiphasic Personality Inventory-2, were examined in Korean normative sample. Confirmatory factor analyses indicated that both the first-order four-factor model and the single second-order factor model fit the data well, but the latter may be superior because of its parsimony. The HB scale correlated modestly with age, sex, SES, and problems with family and finance. However, it showed substantial correlations with spouse ratings items that were identified a priori as prospective HB correlates, indicating excellent concurrent validity. The limitations of the study and the need for future studies employing HB patients were discussed.

Review of computer-based test interpretation software for the MMPI-2.

The use of computer-based test interpretation (CBTI) has increased over the last several decades (Butcher, Perry, & Atlis, 2000). CBTIs provide a quick and easy way for a clinician to review likely implications of test results. However, clinical psychologists who wish to use a CBTI of the MMPI–2 are currently confronted with a choice between eight commercially available choices of CBTI programs and many more choices of types of reports. These reports differ in many respects, including the MMPI–2 scales used in the interpretation, the degree to which interpretive statements are based on clinical expertise or actuarial formulas, and the style of presentation (integrated report vs. list of descriptive statements). Of the eight MMPI–2 CBTI programs available, six are desktop programs that can be run on any standard PC. The other two programs, one by BehaviorData (2003) and the other by Alex Caldwell (2004), both involve transmittal of the MMPI–2 protocol and CBTI report via mail or fax. Although these two CBTI reports are comparable to the others in terms of output, this review is limited to software that a clinician can purchase and use in the office. Butcher (2002) identified nine issues to consider when evaluating CBTIs: validity of the underlying test, expertise of the developers, availability of documentation, availability of updates and revisions, adherence to American Psychological Association guidelines, detection of response sets, relationship to published test interpretation research, quality of technical support, and inclusion of appropriate interpretive cautions in regard to interpretation. Of course, there are any number of additional features of a CBTI program, both structural and substantive, of potential importance to a prospective user. However, to date, there has been no published comparative review of extant CBTI programs. In this review, we give an overview the six PC-based MMPI–2 CBTI programs and compare them in terms of features of the software and of the CBTI report. The software features reviewed include the operating system required, hard drive space required, the ability to print and edit the CBTI reports, number of uses allowed, user interface, and cost. Features of the CBTI report reviewed include MMPI–2 scales used in the interpretation, possible diagnosis provided, and report sections (e.g., profile validity, interpersonal descriptors, treatment recommendations, etc.).

Relative User Ratings of MMPI-2 Computer-Based Test Interpretations:

There are eight commercially available computer-based test interpretations (CBTIs) for the Minnesota Multiphasic Personality Inventory-2 (MMPI-2), of which few have been empirically evaluated. Prospective users of these programs have little scientific data to guide choice of a program. This study compared ratings of these eight CBTIs. Test users were randomly assigned to rate either a single authentic CBTI report on one of their clients or a single CBTI report generated from a modal MMPI-2 profile for their clinical setting. In all, 257 authentic and modal CBTI reports were rated by 41 clinicians on 10 dimensions. Each of the authentic reports received substantially higher ratings than the modal reports, with ratings of perceived accuracy and opinion confirmation best differentiating between authentic and modal reports. Automated Assessment Associates’ report received the highest overall ratings; reports published by Western Psychological Services, Pearson Assessments, and the Caldwell Report were also distinguished on one or more ratings dimensions.

External validity of the new Devereux adolescent behavior rating scales

The discriminant and concurrent validity of the five new scales for the Devereux Adolescent Behavior Rating Scale (DAB) was explored using a heterogeneous sample of psychiatric and substance abuse patients. Consistent with predictions, the substance abuse patients scored higher on the Acting Out Behaviors (AOB) and Heterosexual Interests (HI) scales, and psychiatric patients scored higher on the Psychotic Behaviors scale. Gender differences also were found, including boys being rated higher on Acting Out Behaviors, and girls higher on Heterosexual Interests. The new DAB scales demonstrated sufficient concurrent validity using a thorough record review and a patient rating scale (the Child Behavior Checklist [CBCL]). The Neurotic/Dependent Behaviors scale (NDB) showed a consistent relationship with substance abuse and several other measures of more externalizing behaviors, in addition to the predicted relationships with anxious, tense, and dependent behaviors. The Withdrawn/Timid Behaviors scale (WTB) proved to be a purer measure of internalizing behaviors in both sexes.

Interpretive reliability of two common MMPI-2 profiles

Abstract Users of multi-scale tests like the MMPI-2 tend not to interpret scales one at a time in a way that would correspond to standard scale-level reliability information. Instead, clinicians integrate inferences from a multitude of scales simultaneously, producing a descriptive narrative that is thought to characterize the examinee. This study was an attempt to measure the reliability of such integrated interpretations using a q-sort research methodology. Participants were 20 MMPI-2 users who responded to E-mail solicitations on professional listservs and in personal emails. Each participant interpreted one of two common MMPI-2 profiles using a q-set of 100 statements designed for MMPI-2 interpretation. To measure the “interpretive reliability” of the MMPI-2 profile interpretations, q-sort descriptions were intercorrelated. Mean pairwise interpretive reliability was .39, lower than expected, and there was no significant difference in reliability between profiles. There was also not a significant difference between within-profile and cross-profile correlations. Q-set item analysis was conducted to determine which individual statements had the most impact on interpretive reliability. Although sampling in this study was limited, implications for the field reliability of MMPI-2 interpretation are sobering.