Dana B. DiBenedetti

The development and validation of the daily electronic Endometriosis Pain and Bleeding Diary

BackgroundThe objective of this study was to develop and validate a daily electronic Endometriosis Pain and Bleeding Diary (EPBD) for assessing treatment-related changes in endometriosis symptoms from the patients perspective in a clinical trial setting.MethodsThe EPBD items were developed based on clinician input and the results of 5 focus groups (N = 38) and 3 iterative sets of cognitive interviews (N = 22). The psychometric properties were evaluated using data collected in a usual-practice, non-intervention study conducted at 4 sites in the United States. Existing questionnaires were also administered to explore the construct validity of the EPBD. The development and validation processes were consistent with the recommendations in the 2009 FDA Patient Reported Outcomes Guidance to Industry.ResultsFocus group participants described 2 distinct types of pain (intermittent and continuous), which they felt were relevant and important to monitor. Participants also indicated that pain and bleeding/spotting associated with intercourse were important symptoms related to endometriosis. Cognitive interviews with additional endometriosis patients served to optimize item content, wording, and response options. Psychometric analyses found the EPBD items to behave as expected, for example, item-level means for subjects with severe endometriosis symptoms were higher (i.e., worse) compared with subjects with mild symptoms. Item-total correlations for the EPBD pain items (range 0.40-0.89) indicated that the items were related but not redundant. EPBD pain ratings correlated highly with the modified Brief Pain Inventory-Short Form Pain Intensity score (range 0.46-0.61). Women with severe endometriosis symptoms reported significantly higher intermittent and continuous dysmenorrhea and intermittent and continuous pelvic pain ratings and greater interference with daily activities compared with women with mild symptoms (all p < 0.01).ConclusionsThe results of this study show that the 17-item EPBD reliably and validly characterizes the types of pain that endometriosis patients identified as being important. As a daily patient-reported assessment, it overcomes the significant potential for intra- and inter-rater variability and rater and recall bias that is inherent in the Biberoglu and Behrman Scale. Additional studies are required to confirm the dimensionality and optimal scoring of the EPBD, to corroborate the present results, and to assess other important measurement properties, such as responsiveness.

Dissociable effect of acute varenicline on tonic versus cue-provoked craving in non-treatment-motivated heavy smokers

RATIONALE The effectiveness of varenicline for smoking cessation has been established, but little is known about the psychological processes that mediate this clinical outcome. OBJECTIVES This study evaluated the effect of a single dose of varenicline on tonic and cue-provoked changes in craving, withdrawal, and affect using a randomized, double-blind, placebo-controlled, cross-over design. METHODS Following overnight abstinence, 38 non-treatment-motivated smokers received either varenicline 2mg or matched placebo, then tonic measures of craving, withdrawal, and positive and negative affect were obtained at 30-min intervals. At 4-h post-administration, a cue exposure session obtained the same subjective measures at three time-points following the physical handling of a lit cigarette versus the sharpening and handling of a pencil. RESULTS At 4-h post-administration, varenicline reduced tonic craving as well as craving across the smoking and neutral cue conditions, relative to placebo. By contrast, the capacity of the smoking cue to enhance craving relative to the neutral cue was unaffected by varenicline. Measures of withdrawal and positive and negative affect produced mixed results. CONCLUSIONS Acute varenicline selectively attenuates tonic but not cue-provoked craving. This dissociation provides insight into the specific psychological processes that might mediate the effectiveness of varenicline, and highlights cue-provoked craving as a discrete target for advancing smoking cessation pharmacotherapy.

Patient-centered assessment of cognitive symptoms of depression.

OBJECTIVE To identify and explore concepts important to patients with cognitive symptoms of major depressive disorder (MDD) and adapt an existing patient-reported outcome (PRO) measure to assess these symptoms. METHODS Four focus groups were conducted with MDD patients (n = 33) to elicit relevant concepts and determine whether one of several PRO scales could be used to assess cognitive symptoms of depression. Following selection and minor modification of the Perceived Deficits Questionnaire (PDQ), cognitive debriefing interviews were conducted with additional patients (n = 17) to further refine and adapt this measure for use in MDD. Minor revisions based on patient input yielded the PDQ for Depression (PDQ-D). RESULTS Focus group participants reported a variety of cognitive symptoms that were classified into 7 general categories: lack of focus and clear thought, memory problems, difficulty with lexical access, difficulty with divided attention, difficulty with decision making, difficulty thinking quickly, and difficulty learning new things. Limitations in work productivity were the most commonly reported impacts of cognitive symptoms. While suggesting a few modifications, focus group participants reacted positively to the PDQ based on the breadth, specificity, and relevance of the items. Cognitive debriefing participants indicated that the modified PDQ items were generally easy to understand and relevant to their experiences with MDD. CONCLUSION Because cognitive symptoms are burdensome to patients with MDD, their assessment is important to optimize treatment outcomes. The PDQ-D has the potential to supplement existing assessment methods, providing unique information important for both comprehensive evaluation of individuals with MDD and evaluation of new treatments.

Psychometric evaluation of the Satisfaction with Oral Anti-Diabetic Agent Scale (SOADAS)

In this study we developed and evaluated the psychometric properties of the Satisfaction with Oral Anti-Diabetic Agent Scale (SOADAS), the first treatment satisfaction instrument specific to oral anti-diabetic agents (OADs). Three focus groups and three rounds of cognitive debriefing interviews with type 2 diabetes patients using OADs informed the development of the six-item SOADAS. The measurement properties of the SOADAS were evaluated in a US cross-sectional study. Patients completed the SOADAS, Treatment Satisfaction for Medication Questionnaire (TSQM), the Short Form-12 (SF-12) Health Survey and a demographic questionnaire. The first half of the recruited patient population was asked to return at 7 days follow-up to complete the SOADAS again. An exploratory factor analysis on the SOADAS yielded a one-factor solution, indicating that the SOADAS was uni-dimensional. The SOADAS had high internal consistency reliability (Cronbachs alpha=0.86) and acceptable test-retest reliability (ICC=0.79). It was correlated most highly with the TSQM (r=0.71, p<0.001) and least with the mental summary component score of the SF-12 (r=0.24, p=0.014). Mean SOADAS scores were approximately two points higher for participants with lower HbA(1c) values (<7%) versus those with higher values, and for participants without versus with selected symptoms (p<0.05). The findings from this study suggest that the SOADAS is a valid and reliable measure of patient satisfaction with oral anti-diabetic medications. This questionnaire may be useful for assessing outcomes in future clinical studies of oral anti-diabetic medications.

Development and psychometric evaluation of the Endometriosis Treatment Satisfaction Questionnaire

PurposeTo develop and psychometrically evaluate the Endometriosis Treatment Satisfaction Questionnaire, a patient-reported assessment of satisfaction with endometriosis treatment.MethodsThe Endometriosis Treatment Satisfaction Questionnaire was developed based on the results of five focus groups and three iterative sets of cognitive interviews along with expert opinion and a review of the literature. The psychometric properties were assessed using data collected during a multicenter, randomized, proof-of-concept trial. The development and validation processes followed the guidance recommended by the United States FDA for patient-reported outcome instruments.ResultsThe Endometriosis Treatment Satisfaction Questionnaire’s reliability, validity, and utility as a measure of patient satisfaction with their endometriosis treatment were supported. The results of the item-level analyses showed no evidence of distributional anomalies or response scale biases. The Endometriosis Treatment Satisfaction Questionnaire is unidimensional, has excellent internal consistency reliability, and discriminates well between known groups. Scores correlated well with other patient-reported outcome measures of endometriosis without being redundant.ConclusionsThe Endometriosis Treatment Satisfaction Questionnaire has utility for assessing patient satisfaction with endometriosis treatment and may be useful in clinical trials that are assessing new treatments for endometriosis, especially when deciding between competing treatments or regimens that are found to have similar tolerability and efficacy.

Successful implementation of cognitive interviews in special populations

The cognitive interview, with a focus on debriefing methods, was developed in the 1980s to identify sources of potential response error in surveys or questionnaires. With the release of the final US FDA guidance, titled ‘Patient-Reported Outcome Measures: Use in Medical Product Development to Support Labeling Claims’, cognitive interviews have gained importance and relevance both for concept elicitation and debriefing purposes in the context of instrument development. This article is intended as a guide for the researcher working with special populations in methods to foster successful cognitive interviews that meet FDA standards. While many of these techniques are broadly applicable, specific recommendations are provided for working with pediatric and cognitively challenged populations, as well as with individuals with communication difficulties.

Cognitive interviewing in risk minimization survey development: patient and healthcare professional surveys

Risk minimization programs are often required for selected drugs and other products to ensure that the benefits of these prescription products outweigh their risks. Regulators in the USA and Europe have recently called for more rigorous standards in developing measures for risk minimization program assessment. Cognitive pretesting interviews are a critical step in the development of survey instruments used to evaluate patients’ and healthcare professionals’ knowledge and behaviors associated with the safe use of products requiring a risk minimization program. This article is intended as a guide for the researcher who is charged with the development of survey instruments used in these programs and focuses on the role of cognitive pretesting interviews in successful survey instrument design, data analysis and interpretation.

Development of a family functioning scale for major depressive disorder

Abstract Objective: To better understand depression’s impact on family functioning from the perspectives of patients with major depressive disorder (MDD) and their partners; to develop and test patient and partner versions of a new self-reported measure, the Depression and Family Functioning Scale (DFFS), for use in clinical trials. Methods: Concept elicitation interviews were conducted with 32 adults with clinician-diagnosed moderate-to-severe MDD and their respective partners. Twenty-six items were drafted to address relevant aspects of family functioning and were then tested and refined through two iterative sets of cognitive debriefing interviews, each conducted by the same pair of highly experienced researchers, including a licensed clinical psychologist. Results: Depression negatively affects family functioning through poorer communication, increased conflicts, decreased family interaction, and decreased intimacy. No existing instrument measured all domains of interest, or had been rigorously developed and psychometrically validated in the target populations. The draft DFFS items generally tested well and only minor modifications were made to the items after the second set of interviews. Both patients and partners indicated that the final set of 15 DFFS items addresses all concepts of importance. Conclusions: The DFFS evaluates the impact of depression on family functioning and has the potential to provide important information that can facilitate a more comprehensive evaluation of new treatments in clinical trial settings. Although MDD severity was not confirmed with a standardized interview, in clinical practice in the US, MDD is generally not diagnosed with the use of a structured clinical interview or clinician-administered tool. In the current study, depression severity had little (if any) impact on the specific concepts elicited as being important to family functioning. In fact, patients with milder depression had more insight and were able to better articulate changes in family functioning with treatment.

Understanding the patient experience with carcinoid syndrome: Exit interviews from a randomized, placebo-controlled study of telotristat ethyl

PURPOSE Telotristat ethyl, an oral tryptophan hydroxylase inhibitor, is intended to treat carcinoid syndrome by reducing serotonin production. Telotristat ethyl was evaluated in TELESTAR, a Phase III study for patients who had carcinoid syndrome with at least 4 bowel movements (BMs) per day and who were receiving somatostatin analogue therapy. This interview substudy was conducted to provide insight into the patient experience in TELESTAR and to help understand whether reductions in BM frequency (the primary end point) and other symptoms were clinically meaningful. METHODS Participating sites were asked to invite (before randomization) all eligible patients to telephone interviews scheduled at the end of the double-blind treatment period. Patients and interviewers were blinded to treatment. FINDINGS All 35 interviewed participants reported diarrhea and/or excessive BMs at baseline. Patients reported that these symptoms negatively affected emotional, social, physical, and occupational well-being. Prespecified criteria for treatment response (achieving ≥30% reduction in BM frequency for at least 50% of the days) were met by 8 of 26 patients taking telotristat ethyl and 1 of 9 patients taking placebo. All 8 patients taking telotristat ethyl described clinically meaningful reductions in BM frequency and were very satisfied with the ability of the study drug to control their carcinoid syndrome symptoms. Overall, reports of being very satisfied were observed in 12 patients taking telotristat ethyl and 0 taking placebo. IMPLICATIONS Patient interviews revealed that TELESTAR patients, at baseline, were significantly affected by their high BM frequency. Patient reports of their clinical trial experience supported the significance of the primary end point and clinical responder analysis in TELESTAR, helping identify and understand clinically meaningful change produced by telotristat ethyl.

Development and Validation of the ADHD Benefits of Coaching Scale (ABCS)

Objective: Develop and validate the ADHD Benefits of Coaching Scale (ABCS), a self-report instrument designed to measure benefits of ADHD coaching in college students. Method: Concepts were elicited from interviews with ADHD coaches and college students receiving ADHD coaching. Draft items were tested in cognitive interviews among ADHD students. Item and scale reliability and validity of ABCS were evaluated using web-survey data from students reporting ADHD. Mean ABCS scores for coached and noncoached groups were compared. Results: Five coaches and 14 students participated in concept elicitation interviews; 10 students participated in the cognitive interviews; 209 students completed the web-survey. The 10-item ABCS showed satisfactory internal consistency reliability and validity and differentiated between coached (n = 17) and noncoached groups (n = 192; p < .01). Conclusion: To assess benefits of ADHD coaching in college students, the ABCS was developed and psychometrically validated in accordance with Food and Drug Administration’s (FDA) patient-reported outcome guidance.