Marjorie Kleinman

Seeking help from the internet during adolescence.

OBJECTIVE To assess the prevalence and demographic and psychological correlates of Internet use as a help-seeking resource for emotional problems in a community sample of adolescents. METHOD A self-report survey was completed by 9th-through 12th-grade students ( = 519) enrolled in health courses in six New York State high schools in the fall/winter of 1999. The relationship between Internet help-seeking behavior and demographic characteristics, hopelessness, functional impairment, and use of various treatment services was examined. RESULTS Nearly one fifth (18.2%) of the adolescents sought help on the Internet for emotional problems in the previous year. The proportions of males and females seeking help on the Internet did not significantly differ (15.6% and 20.8%, respectively). Internet help-seekers were significantly more likely than non-help-seekers to score above the clinical threshold on the Columbia Impairment Scale (34% versus 20.6%; chi(2)(1) = 7.4, <.01) or Beck Depression Inventory (16.1% versus 9.1%; chi(2)(1) = 3.8, <.05). These at-risk youths tended to combine Internet help-seeking with other sources of help, rather than substituting it for other resources. More than 20% of Internet help-seekers were dissatisfied with the help they received, and only 14% thought it had helped them very much. CONCLUSIONS For the Internet to realize its potential as an effective resource for teenagers struggling with emotional problems, further development is needed.

Sudden Death and Use of Stimulant Medications in Youths

OBJECTIVE The authors sought to determine whether a significant association exists between the use of stimulants and the rare event of sudden unexplained death in children and adolescents. METHOD A matched case-control design was performed. Mortality data from 1985-1996 state vital statistics were used to identify 564 cases of sudden death occurring at ages 7 through 19 years across the United States along with a matched group of 564 young people who died as passengers in motor vehicle traffic accidents. The primary exposure measure was the presence of amphetamine, dextroamphetamine, methamphetamine, or methylphenidate according to informant reports or as noted in medical examiner records, toxicology results, or death certificates. RESULTS In 10 (1.8%) of the sudden unexplained deaths it was determined that the youths were taking stimulants, specifically methylphenidate; in contrast, use of stimulants was found in only two subjects in the motor vehicle accident comparison group (0.4%), with only one involving methylphenidate use. A significant association of stimulant use with sudden unexplained death emerged from the primary analysis, which was based on exact conditional logistic regression (odds ratio=7.4, 95% CI=1.4 to 74.9). A comprehensive series of sensitivity analyses yielded qualitatively similar findings. CONCLUSIONS This case-control study provides support for an association between the use of stimulants and sudden unexplained death among children and adolescents. Although sudden unexplained death is a rare event, this finding should be considered in the context of other data about the risk and benefit of stimulants in medical treatment.

Modern psychometric methods for detection of differential item functioning: application to cognitive assessment measures

Cognitive screening tests and items have been found to perform differently across groups that differ in terms of education, ethnicity and race. Despite the profound implications that such bias holds for studies in the epidemiology of dementia, little research has been conducted in this area. Using the methods of modern psychometric theory (in addition to those of classical test theory), we examined the performance of the Attention subscale of the Mattis Dementia Rating Scale. Several item response theory models, including the two- and three-parameter dichotomous response logistic model, as well as a polytomous response model were compared. (Log-likelihood ratio tests showed that the three-parameter model was not an improvement over the two-parameter model.) Data were collected as part of the ten-study National Institute on Aging Collaborative investigation of special dementia care in institutional settings. The subscale KR-20 estimate for this sample was 0.92. IRT model-based reliability estimates, provided at several points along the latent attribute, ranged from 0.65 to 0.97; the measure was least precise at the less disabled tail of the distribution. Most items performed in similar fashion across education groups; the item characteristic curves were almost identical, indicating little or no differential item functioning (DIF). However, four items were problematic. One item (digit span backwards) demonstrated a large error term in the confirmatory factor analysis; item-fit chi-square statistics developed using BIMAIN confirm this result for the IRT models. Further, the discrimination parameter for that item was low for all education subgroups. Generally, persons with the highest education had a greater probability of passing the item for most levels of theta. Model-based tests of DIF using MULTILOG identified three other items with significant, albeit small, DIF. One item, for example, showed non-uniform DIF in that at the impaired tail of the latent distribution, persons with higher education had a higher probability of correctly responding to the item than did lower education groups, but at less impaired levels, they had a lower probability of a correct response than did lower education groups. Another method of detection identified this item as having DIF (unsigned area statistic=3.05, p<0.01, and 2.96, p<0.01). On average, across the entire score range, the lower education groups probability of answering the item correctly was 0.11 higher than the higher education groups probability. A cross-validation with larger subgroups confirmed the overall result of little DIF for this measure. The methods used for detecting differential item functioning (which may, in turn, be indicative of bias) were applied to a neuropsychological subtest. These methods have been used previously to examine bias in screening measures across education and ethnic and racial subgroups. In addition to the important epidemiological applications of ensuring that screening measures and neuropsychological tests used in diagnoses are free of bias so that more culture-fair classifications will result, these methods are also useful for the examination of site differences in large multi-site clinical trials. It is recommended that these methods receive wider attention in the medical statistical literature.

Peer Victimization, Depression, and Suicidiality in Adolescents

The association between specific types of peer victimization with depression, suicidal ideation, and suicide attempts among adolescents was examined. A self-report survey was completed by 2,342 high-school students. Regression analyses indicated that frequent exposure to all types of peer victimization was related to high risk of depression, ideation, and attempts compared to students not victimized. Infrequent victimization was also related to increased risk, particularly among females. The more types of victimization the higher the risk for depression and suicidality among both genders. Specific types of peer victimization are a potential risk factor for adolescent depression and suicidality. It is important to assess depression and suicidality among victimized students in order to develop appropriate intervention methods.

Item bias in cognitive screening measures: Comparisons of elderly white, Afro-American, Hispanic and high and low education subgroups

A study of item bias in standard cognitive screening measures was conducted in a sample of Afro-American, Hispanic and non-Hispanic white elderly respondents who were part of a dementia case registry study. The methods of item-response theory were applied to identify biased items. Both cross-cultural and high and low education groups were examined to determine which items were biased. Out of 50 cognitive items examined from six widely used cognitive screening measures, 16 were identified as biased for either high and low education groups or ethnic/racial group membership.

Identification of differential item functioning using item response theory and the likelihood-based model comparison approach. Application to the Mini-Mental State Examination.

Background:An important part of examining the adequacy of measures for use in ethnically diverse populations is the evaluation of differential item functioning (DIF) among subpopulations such as those administered the measure in different languages. A number of methods exist for this purpose. Objective:The objective of this study was to introduce and demonstrate the identification of DIF using item response theory (IRT) and the likelihood-based model comparison approach. Methods:Data come from a sample of community-residing elderly who were part of a dementia case registry. A total of 1578 participants were administered either an English (n = 913) or Spanish (n = 665) version of the 21-item Mini-Mental State Examination. IRT was used to identify language DIF in these items with the likelihood-based model comparison approach. Results:Fourteen of the 21 items exhibited significant DIF according to language of administration. However, because the direction of the identified DIF was not consistent for one language version over the other, the impact at the scale level was negligible. Conclusions:IRT and the likelihood-based model comparison approach comprise a powerful tool for DIF detection that can aid in the development, refinement, and evaluation of measures for use in ethnically diverse populations.

High School Bullying as a Risk for Later Depression and Suicidality

This is the first study to examine whether high school students experiencing frequent bullying behaviors are at risk for later depression and suicidality. A total of 236 students who reported frequent bullying behavior without depression or suicidality during a suicide screening were interviewed 4 years later to reassess depression, suicidal ideation, attempts, substance problems, and functional impairment and were compared to at-risk youth identified during the screen, including 96 youth who also experienced bullying behavior. Youth who only reported frequent bullying behaviors (as bullies, victims, or both) did not develop later depression or suicidality and continued to have fewer psychiatric problems than students identified as at-risk for suicide. Students who experienced bullying behaviors and depression or suicidality were more impaired 4 years later than those who had only reported depression or suicidality. Thus, assessment of bullying behaviors in screening protocols is recommended.

Service Use by At-Risk Youths After School-Based Suicide Screening

OBJECTIVE We sought to examine follow-up service use by students identified at risk for suicidal behavior in a school-based screening program and assess barriers to seeking services as perceived by youths and parents. METHOD We conducted a longitudinal study of 317 at-risk youths identified by a school-based suicide screening in six high schools in New York State. The at-risk teenagers and their parents were interviewed approximately 2 years after the initial screen to assess service use during the intervening period and identify barriers that may have interfered with seeking treatment. RESULTS At the time of the screening, 72% of the at-risk students were not receiving any type of mental health service. Of these students, 51% were deemed in need of services and subsequently referred by us to a mental health professional. Nearly 70% followed through with the screenings referral recommendations. The youths and their parents reported perceptions about mental health problems, specifically relating to the need for treatment, as the primary reasons for not seeking service. CONCLUSIONS Screening seems to be effective in enhancing the likelihood that students at risk for suicidal behavior will get into treatment. Well-developed and systematic planning is needed to ensure that screening and referral services are coordinated so as to facilitate access for youths into timely treatment.

Item and Scale Differential Functioning of the Mini-mental State Exam Assessed Using the Differential Item and Test Functioning (dfit) Framework

Objectives:To illustrate the application of the Differential Item and Test Functioning (DFIT) method using English and Spanish versions of the Mini-Mental State Examination (MMSE). Subjects:Study participants were 65 years of age or older and lived in North Manhattan, New York. Of the 1578 study participants who were administered the MMSE 665 completed it in Spanish. Measures:The MMSE contains 20 items that measure the degree of cognitive impairment in the areas of orientation, attention and calculation, registration, recall and language, as well as the ability to follow verbal and written commands. Research Design:After assessing the dimensionality of the MMSE scale, item response theory person and item parameters were estimated separately for the English and Spanish sample using Samejimas 2-parameter graded response model. Then the DFIT framework was used to assess differential item functioning (DIF) and differential test functioning (DTF). Results:Nine items were found to show DIF; these were items that ask the respondent to name the correct season, day of the month, city, state, and 2 nearby streets, recall 3 objects, repeat the phrase no ifs, no ands, no buts, follow the command, “close your eyes,” and the command, “take the paper in your right hand, fold the paper in half with both hands, and put the paper down in your lap.” At the scale level, however, the MMSE did not show differential functioning. Conclusions:Respondents to the English and Spanish versions of the MMSE are comparable on the basis of scale scores. However, assessments based on individual MMSE items may be misleading.

Evaluating measurement equivalence using the item response theory log-likelihood ratio (IRTLR) method to assess differential item functioning (DIF): applications (with illustrations) to measures of physical functioning ability and general distress

Background Methods based on item response theory (IRT) that can be used to examine differential item functioning (DIF) are illustrated. An IRT-based approach to the detection of DIF was applied to physical function and general distress item sets. DIF was examined with respect to gender, age and race. The method used for DIF detection was the item response theory log-likelihood ratio (IRTLR) approach. DIF magnitude was measured using the differences in the expected item scores, expressed as the unsigned probability differences, and calculated using the non-compensatory DIF index (NCDIF). Finally, impact was assessed using expected scale scores, expressed as group differences in the total test (measure) response functions. Methods The example for the illustration of the methods came from a study of 1,714 patients with cancer or HIV/AIDS. The measure contained 23 items measuring physical functioning ability and 15 items addressing general distress, scored in the positive direction. Results The substantive findings were of relatively small magnitude DIF. In total, six items showed relatively larger magnitude (expected item score differences greater than the cutoff) of DIF with respect to physical function across the three comparisons: “trouble with a long walk” (race), “vigorous activities” (race, age), “bending, kneeling stooping” (age), “lifting or carrying groceries” (race), “limited in hobbies, leisure” (age), “lack of energy” (race). None of the general distress items evidenced high magnitude DIF; although “worrying about dying” showed some DIF with respect to both age and race, after adjustment. Conclusions The fact that many physical function items showed DIF with respect to age, even after adjustment for multiple comparisons, indicates that the instrument may be performing differently for these groups. While the magnitude and impact of DIF at the item and scale level was minimal, caution should be exercised in the use of subsets of these items, as might occur with selection for clinical decisions or computerized adaptive testing. The issues of selection of anchor items, and of criteria for DIF detection, including the integration of significance and magnitude measures remain as issues requiring investigation. Further research is needed regarding the criteria and guidelines appropriate for DIF detection in the context of health-related items.