Jeremy D. Franklin

Psychometric properties of the PROMIS physical function item bank in patients with spinal disorders.

Study Design. Patient-reported outcomes provide vital information when assessing effectiveness of clinical care. Yet, most patient-reported outcome instruments are limited by lack of validation and reliability to measure PF adequately. As part of the Patient-Reported Outcomes Measurement Information System (PROMIS), a PF item bank consisting of 124 items has been developed. Objective. There is validation evidence for the PROMIS PF item bank in the general orthopedic patient population in general, but has yet to be validated in the patient with spinal disorders. This study aims to evaluate the psychometric properties of the PROMIS PF item bank specifically for patients presenting with spine-related complaints. Summary of Background Data. Data were collected from adult patients visiting a university spine clinic for back and neck problems. All patients older than 18 years were eligible to participate. A total of 438 patients (49% male) were enrolled in this prospective study. Patients were 18- to 89-year old and presented with back problems (n = 286) and neck problems (n = 152). All patients were administered a 131 item questionnaire. Methods. Conventional descriptive statistics such as means, standard deviations, and proportions were conducted to examine patient characteristics. A Rasch model was used to examine the psychometric properties of the instrument including dimensionality, floor/ceiling effects, reliabilities, and item bias. Results. Results showed that a single PF dimension was supported by the data (i.e., unexplained variance was 2.9%). The instrument had 1.7% ceiling effect and 0.2% floor effect. Item reliability was 1.00 and person reliability was 0.99. We found evidence of item response bias associated with sex, age, and education in some items. Conclusion. The PROMIS PF item bank adequately addressed outcomes of patients with spinal disorders as reliabilities were excellent, minimal ceiling/floor effect existed, and item bias was limited. Future effort should be focused on eliminating, rescaling, or modifying those items that had item bias. Level of Evidence: 2

Psychometric Comparison of the PROMIS Physical Function CAT With the FAAM and FFI for Measuring Patient-Reported Outcomes

Background: Selecting optimal patient-reported outcome (PRO) instruments is critical to improving the quality of health care. The purpose of this study was to compare the reliability, responsiveness, and efficiency of three PRO measures: the Foot and Ankle Ability Measure–Activity of Daily Living subscale (FAAM_ADL), the Foot Function Index 5-point verbal rating scale (FFI-5pt), and the PROMIS Physical Function computerized adaptive test (PF CAT). Methods: Data were aggregated from 10 clinical sites in the AOFAS’s National Orthopaedic Foot and Ankle Research (OFAR) Network from 311 patients who underwent elective surgery for a disorder of the foot or ankle. Patients were administered the FAAM_ADL, FFI-5pt, and PF CAT at their preoperative visit and at 6 months after surgery. Reliabilities were evaluated using a Rasch model. Responsiveness was calculated using paired samples t test and efficiency was recorded as number of seconds to complete the instrument. Results: Similar reliabilities were found for the three instruments. Item reliabilities for FAAM_ADL, FFI-5pt, and PF CAT were all .99. Pearson reliabilities for FAAM_ADL, FFI-5pt, and PF CAT were .95, .93, and .96, respectively. On average, patients completed the FAAM_ADL in 179 seconds, the FFI-5pt in 194 seconds, and the PF CAT in 44 seconds, (P < .001). The PF CAT and FAAM_ADL showed significant improvement (P = .01 and P = .001, respectively) in patients’ physical function after treatment; the FFI-5pt did not show improvement. Conclusions: Overall, the PF CAT performed best in terms of reliability, responsiveness, and efficiency in this broad sample of foot and ankle patients. It can be a potential replacement for the conventional PRO measures, but further validation is needed in conjunction with the PROMIS Pain instruments. Level of Evidence: Level I, prospective comparative outcome study.

Time for a paradigm shift with computerized adaptive testing of general physical function outcomes measurements.

Background: Patient-reported outcomes (PRO) are critical to understanding the value of orthopedic treatments. We hypothesized that use of the computerized adaptive testing from a well-characterized physical function item bank would show superiority in assessing all levels of physical function compared to current standard generic physical function outcomes instruments for foot and ankle patients. Methods: In a population of 126 foot and ankle patients we compared the psychometric properties for three PROs: the Physical Function subscale of the Medical Outcomes General Health Survey (SF-36 PF) version 2, the Patient-Reported Outcomes Measurement Information System (PROMIS) Physical Function (PF) Computerized Adaptive Test (CAT), and the Lower Extremity (LE) CAT. A Rasch item response theory (IRT) model was applied to assess and compare the fit, dimensionality, reliability, validity, and coverage. Results: The unexplained variance for the PF CAT was 3.9% and the LE CAT was 2.1%, suggesting each instrument explained a single concept. The SF-36 PF had more concerning unexplained variance of 7.6%. We found no floor or ceiling effects for the PF CAT, a minimal floor effect (1.6%) but no ceiling effect for the LE CAT, and an 11.1% floor effect and 9.5% ceiling effect for the SF-36 PF. Conclusion: Foot and ankle clinicians and researchers interested in measuring patient perceived functional outcomes with a generic instrument should consider using either the PF CAT or the LE CAT rather than the SF-36 PF. Further studies comparing these CATs to anatomic specific instruments are needed. Level of Evidence: Level I, diagnostic study.

Racial Battle Fatigue for Latina/o Students: A Quantitative Perspective

Previous literature demonstrates that as a result of racial microaggressions and hostile campus racial climates, Latina/o students often state they experience psychological, physiological, and behavioral stress responses during and after racialized incidents on campuses. The purpose of this study is to quantitatively test the racial battle fatigue framework for Latina/o students using structural equation modeling. Findings suggest that psychological stress responses for Latinas/os are most impacted by racial microaggressions in the racial battle fatigue framework.

Psychometric Evaluation of the Lower Extremity Computerized Adaptive Test, the Modified Harris Hip Score, and the Hip Outcome Score

Background: The applicability and validity of many patient-reported outcome measures in the high-functioning population are not well understood. Purpose: To compare the psychometric properties of the modified Harris Hip Score (mHHS), the Hip Outcome Score activities of daily living subscale (HOS-ADL) and sports (HOS-sports), and the Lower Extremity Computerized Adaptive Test (LE CAT). The hypotheses was that all instruments would perform well but that the LE CAT would show superiority psychometrically because a combination of CAT and a large item bank allows for a high degree of measurement precision. Study Design: Cohort study (diagnosis); Level of evidence, 2. Methods: Data were collected from 472 advanced-age, active participants from the Huntsman World Senior Games in 2012. Validity evidences were examined through item fit, dimensionality, monotonicity, local independence, differential item functioning, person raw score to measure correlation, and instrument coverage (ie, ceiling and floor effects), and reliability evidences were examined through Cronbach alpha and person separation index. Results: All instruments demonstrated good item fit, unidimensionality, monotonicity, local independence, and person raw score to measure correlations. The HOS-ADL had high ceiling effects of 36.02%, and the mHHS had ceiling effects of 27.54%. The LE CAT had ceiling effects of 8.47%, and the HOS-sports had no ceiling effects. None of the instruments had any floor effects. The mHHS had a very low Cronbach alpha of 0.41 and an extremely low person separation index of 0.08. Reliabilities for the LE CAT were excellent and for the HOS-ADL and HOS-sports were good. Conclusion: The LE CAT showed better psychometric properties overall than the HOS-ADL, HOS-sports, and mHHS for the senior population. The mHHS demonstrated pronounced ceiling effects and poor reliabilities that should be of concern. The high ceiling effects for the HOS-ADL were also of concern. The LE CAT was superior in all psychometric aspects examined in this study. Future research should investigate the LE CAT for wider use in different populations.

Racial arrested development: A critical whiteness analysis of the campus ecology

This paper analyzes the campus ecology (Renn, 2003, 2004) literature from the perspective of Critical Whiteness specifically problematizing perceptions of safety and inclusion on the college campus. Relying upon Sullivan’s (2006) ontological expansiveness, Mills’s (1997) epistemology of ignorance, and Leonardo and Porter’s (2010) Fanonian interpretation of racial safety, we argue that there is too high a premium placed on social comfort during the undergraduate experience which actually leaves White students at predominantly White institutions in perpetual states of racial arrested development. We conclude that intentional, targeted racial dissonance is necessary for both White students to develop their racial selves while concurrently being aware of the ugly realities of contemporary racism.

Challenging the Norm: Further Psychometric Investigation of the Neck Disability Index

BACKGROUND CONTEXT The neck disability index (NDI) was the first patient-reported outcome (PRO) instrument specific to patients with neck pain, and it remains one of the most widely used PROs for the neck population. The NDI is an appealing measure as it is a short and well-known PRO measure. Currently, there are conflicting data on the performance and applicability of the NDI in patients undergoing either operative or nonoperative treatment for neck-related conditions. PURPOSE This study investigates the psychometric properties, performance, and applicability of the NDI in the spine patient population. STUDY DESIGN A total of 865 patients visiting a university-based spine clinic with neck complaints, with or without radiating upper extremity pain, numbness, or weakness were enrolled in the study. Visit types included new and follow-up visits to both operative and nonoperative treatments. Questionnaires were administered electronically on a tablet computer, and all patients answered all 10 questions of the NDI. METHODS Standard descriptive statistics were performed to describe the demographic characteristics of the patients. Rasch modeling was applied to examine the psychometric properties of the NDI. RESULTS The NDI demonstrated insufficient unidimensionality (ie, unexplained variance after accounting for the first dimension=9.4%). Person reliability was 0.85 and item reliability was 1.00 for the NDI. The overall item fit for the NDI was good with an outfit mean square of 1.03. The NDI had a floor effect of 35.5% and ceiling effect of 4.6%. The raw score to measure correlation of the NDI was 0.019. CONCLUSIONS Although the NDI had good person and item reliability, it did not demonstrate strong evidence of unidimensionality. The NDI exhibited a very large floor effect. Because of the poor raw score to measure correlation, the sum score should not be used in interpretation of findings. Despite great investment by physicians and other stakeholders in the NDI, this evaluation and previous research have demonstrated that the NDI needs further investigation and refinement.

Patient-Reported Outcomes and Total Health Care Expenditure in Prediction of Patient Satisfaction: Results From a National Study.

Background Health care quality is often linked to patient satisfaction. Yet, there is a lack of national studies examining the relationship between patient satisfaction, patient-reported outcomes, and medical expenditure. Objective The aim of this study is to examine the contribution of physical health, mental health, general health, and total health care expenditures to patient satisfaction using a longitudinal, nationally representative sample. Methods Using data from the 2010-2011 Medical Expenditure Panel Survey, analyses were conducted to predict patient satisfaction from patient-reported outcomes and total health care expenditures. The study sample consisted of adult participants (N=10,157), with sampling weights representative of 233.26 million people in the United States. Results The results indicated that patient-reported outcomes and total health care expenditure were associated with patient satisfaction such that higher physical and mental function, higher general health status, and higher total health care expenditure were associated with higher patient satisfaction. Conclusions We found that patient-reported outcomes and total health care expenditure had a significant relationship with patient satisfaction. As more emphasis is placed on health care value and quality, this area of research will become increasingly needed and critical questions should be asked about what we value in health care and whether we can find a balance between patient satisfaction, outcomes, and expenditures. Future research should apply big data analytics to investigate whether there is a differential effect of patient-reported outcomes and medical expenditures on patient satisfaction across different medical specialties.

Effectiveness of the extended parallel process model in promoting colorectal cancer screening

Relatives of colorectal cancer (CRC) patients are at increased risk for the disease, yet screening rates still remain low. Guided by the Extended Parallel Process Model, we examined the impact of a personalized, remote risk communication intervention on behavioral intention and colonoscopy uptake in relatives of CRC patients, assessing the original additive model and an alternative model in which each theoretical construct contributes uniquely.

Validation of a measure of children's perceptions of their oncology camp experience: a national study

Yelena P. Wu*, Man Hung, Jeremy D. Franklin, Mahasen Samhouri, Laura E. Simons and Michael D. Amylon Division of Public Health, Department of Family and Preventive Medicine, University of Utah, Salt Lake City, Utah, USA Huntsman Cancer Institute, University of Utah, Salt Lake City, Utah, USA Division of Epidemiology, Department of Internal Medicine, University of Utah, Salt Lake City, Utah, USA Department of Orthopaedic Surgery Operations, University of Utah, Salt Lake City, Utah, USA Department of Education, Culture, & Society, University of Utah, Salt Lake City, Utah, USA University of Utah, Salt Lake City, Utah, USA Department of Psychiatry, Harvard Medical School, Boston, Massachusetts, USA Division of Pain Medicine, Department of Anesthesia, Perioperative, and Pain Medicine, Boston Children’s Hospital, Boston, Massachusetts, USA Department of Pediatrics, Stanford University School of Medicine, Stanford, California, USA