Nicola Bonner

Development and validation of the living with pulmonary hypertension questionnaire in pulmonary arterial hypertension patients

BackgroundThe Living with Pulmonary Hypertension questionnaire (LPH) was adapted from the Minnesota Living with Heart Failure Questionnaire for use in patients with pulmonary arterial hypertension (PAH). Study objectives were to confirm the face and content validity, to assess the structure and psychometric properties, and provide guidance for the interpretation of the LPH.MethodsA qualitative interview study was conducted with PAH patients in the US (n=12), Germany (n=14) and France (n=12) to evaluate the face and content validity of the LPH. Psychometric validation was performed using blinded data from a double blind, Phase III, clinical trial (n=196). Validation analyses were performed on baseline and week 12 (visit 6/last visit) data and included evaluation of: item response distributions, quality of completion, construct validity, reliability, clinical validity and responsiveness. Analyses to provide an estimation of the Minimal Important Difference (MID) for the LPH scores were performed.ResultsCognitive debriefing interviews with 38 PAH patients indicated that the most commonly reported PAH symptoms and impacts are covered by LPH items. Patients found the LPH questionnaire relevant and comprehensive to their experience. Some suggestions were made to enhance the face validity of the LPH. The content validity of the questionnaire was supported. Results of the psychometric validation analyses (n=190) indicated that the LPH Emotional and Physical scores met the criteria for convergent and discriminant validity; for the total score all but two items met the test for item convergent validity. Internal consistency reliability was demonstrated by Cronbach’s alpha values of >0.70 for all LPH scores. The LPH Physical and Total scores discriminated between World Health Organisation (WHO) Functional classes and 6 Minute walk test distances, indicating clinical validity and were also responsive to change in clinical severity, as measured by change in WHO functional class and Borg CR 10 Scale. Further investigation is required to confirm the responsiveness of the Emotional score. Estimation of MID using distribution-based methods indicated a change of 3 points for the sub-scales and 7 for the total score to be clinically meaningful.ConclusionThe LPH is a valid and reliable instrument that meets FDA criteria.

Development and content validity testing of a patient-reported outcomes questionnaire for the assessment of hereditary angioedema in observational studies

BackgroundHereditary Angioedema (HAE), a rare genetic disease, manifests as intermittent, painful attacks of angioedema. Attacks vary in frequency and severity and include skin, abdominal and life-threatening laryngeal swellings. This study aimed to develop a patient reported outcome (PRO) tool for the assessment of HAE attacks, including their management and impact on patients’ lives, for use in clinical studies, or by physicians in general practice.MethodsThe results of open-ended face to face concept elicitation interviews with HAE patients in Argentina (n = 10) and the US (n = 33) were used to develop the first draft questionnaire of the HAE patient reported outcomes questionnaire (HAE PRO). Subsequently, in-depth cognitive debriefing interviews were performed with HAE patients in the UK (n = 10), Brazil (n = 10), Germany (n = 11) and France (n = 12). Following input from eight multinational clinical experts further cognitive interviews were conducted in the US (n = 12) and Germany (n = 12). Patients who experienced abdominal, cutaneous or laryngeal attacks of varying severity levels were included in all rounds of interviews. Across the rounds of interviews patients discussed their HAE attack symptoms, impacts and treatments. Cognitive debriefing interviews explored patient understanding and relevance of questionnaire items. All interviews were conducted face to face following a pre-defined semi-structured interview guide in the patient’s native language.ResultsPatients reported a variety of HAE symptoms, attack triggers, warning signs, attack impacts and treatment options which were used to develop the HAE PRO. The HAE PRO was revised and refined following input from patients and clinical experts. The final 18-item HAE PRO provides an assessment of the HAE attack experience including symptoms, impacts, treatment requirements, healthcare resource use and loss of productivity caused by HAE attacks.ConclusionsPatient and expert input has contributed to the development of a content valid questionnaire that assesses concepts important to HAE patients globally. HAE patients across cultures consider the HAE PRO a relevant and appropriate assessment of HAE attacks and treatment.

Item Reduction and Psychometric Validation of the Oily Skin Self Assessment Scale (OSSAS) and the Oily Skin Impact Scale (OSIS)

INTRODUCTION Developed using focus groups, the Oily Skin Self Assessment Scale (OSSAS) and Oily Skin Impact Scale (OSIS) are patient-reported outcome measures of oily facial skin. OBJECTIVE The aim of this study was to finalize the item-scale structure of the instruments and perform psychometric validation in adults with self-reported oily facial skin. METHODS The OSSAS and OSIS were administered to 202 adult subjects with oily facial skin in the United States. A subgroup of 152 subjects returned, 4 to 10 days later, for test–retest reliability evaluation. RESULTS Of the 202 participants, 72.8% were female; 64.4% had self-reported nonsevere acne. Item reduction resulted in a 14-item OSSAS with Sensation (five items), Tactile (four items) and Visual (four items) domains, a single blotting item, and an overall oiliness item. The OSIS was reduced to two three-item domains assessing Annoyance and Self-Image. Confirmatory factor analysis supported the construct validity of the final item-scale structures. The OSSAS and OSIS scales had acceptable item convergent validity (item-scale correlations >0.40) and floor and ceiling effects (<20%). Cronbachs alpha coefficients ranged from 0.83 to 0.89 for the OSSAS and 0.82 to 0.87 for the OSIS, demonstrating excellent internal consistency. The a priori test–retest reliability criterion (intraclass correlation [ICC] ≥0.7) was met for one of the three OSSAS domains and one of the two OSIS domains. OSSAS and OSIS domains distinguished among groups that differed in patient-reported facial oily skin severity (P < 0.0001), and bother associated with oily skin (P < 0.0001). CONCLUSIONS The OSSAS and OSIS versions tested in this study have been found to have strong psychometric properties in this patient sample (adults with self-reported oily facial skin), as assessments of self-reported oily facial skin severity and its emotional impact, respectively.

Qualitative cross-cultural exploration of vaginal bleeding/spotting symptoms and impacts associated with hormone therapy in post-menopausal women to inform the development of new patient-reported measurement tools

OBJECTIVES To understand the vaginal bleeding/spotting experiences of postmenopausal (PM) women taking estrogen plus progestin therapies (EPT) and develop measures to assess these symptoms and their impact on womens daily lives in four countries. DESIGN (1) Concept elicitation interviews were conducted with PM women in the US (n=14), Italy (n=15), Mexico (n=15) and China (n=15) to explore vaginal bleeding/spotting symptoms associated with EPT. The Post-Menopausal Bleeding Questionnaire (PMBQ) was also debriefed to evaluate understanding and comprehensiveness. (2) Based on concept elicitation, a single item electronic daily diary was developed and the PMBQ modified to form a 12-item impact measure. (3) The measures were pilot-tested and then cognitively debriefed with US women receiving EPT. All qualitative data was subject to thematic analysis. MAIN OUTCOME MEASURES The Vaginal Bleeding/Spotting Daily Diary, (VBS-DD) and Post-Menopausal Bleeding Impact Questionnaire (PMBIQ) were developed in this study. RESULTS Concept elicitation identified vaginal bleeding and spotting as important symptoms for women taking EPT, impacting their emotional wellbeing, social life, ability to move freely, clothing and sexual activity. Based on pilot testing and cognitive debriefing, women demonstrated good understanding of the VBS-DD and the PMBQ was reduced to 10 items due to conceptual redundancy. CONCLUSIONS Women taking EPT in the US, China, Mexico and Italy reported vaginal bleeding/spotting symptoms that have a detrimental impact on their quality of life. Two new measures were developed to assess the severity and impact of vaginal bleeding/spotting specific to EPT. This work highlights the need for EPT-related symptoms to be a part of treatment decision-making.

Qualitative cross-cultural exploration of breast symptoms and impacts associated with hormonal treatments for menopausal symptoms to inform the development of new patient-reported measurement tools

To explore cross-cultural experiences of women taking estrogen plus progestin therapies (EPT) and develop a symptom-based electronic diary and impact questionnaire for EPT-related breast symptoms. (1) Concept elicitation interviews were conducted with women in the US (n=14), Italy (n=15), Mexico (n=15) and China (n=15) to explore breast symptoms associated with EPT. Patients completed the Breast Sensitivity Questionnaire (BSQ) to evaluate understanding and comprehensiveness. (2) Based on concept elicitation, a 6-item eDiary (Breast Pain/Tenderness Daily Diary - BPT-DD) was generated and the BSQ modified forming the 18-item Breast Sensations Impact Questionnaire (BSIQ). (3) The measures were pilot-tested and then cognitively debriefed with US women receiving EPT. All qualitative data was subject to thematic analysis. Concept elicitation identified breast pain/tenderness, swollen breasts and sensitivity to contact as important symptoms, impacting womens emotional well-being, relationships with family/friends, social life, sleep, ability to move freely, contact, clothing and sexual activity. Experiences were relatively consistent across the country samples. Based on pilot testing and cognitive debriefing, the BPT-DD was reduced to 4 items (and renamed the Breast Pain Daily Diary - BP-DD) and the BSIQ was reduced to 13 items due to conceptual redundancy. Women taking EPT in the US, China, Mexico and Italy reported breast sensations that have a detrimental impact on quality of life. Two new measures were developed to assess the severity and impact of breast pain specific to EPT. This work highlights that EPT-related symptoms should be part of treatment decision-making, and treatments with less burdensome side effects are needed.

Development and preliminary evidence of the psychometric properties of the GNE myopathy functional activity scale

AIM GNE myopathy, a rare, severe, progressive myopathy, presents with lower extremity distal muscle weakness. The GNE myopathy functional activity scale (GNEM-FAS) evaluates the impact of GNE myopathy on functioning in adults. This paper presents the psychometric validation of the GNEM-FAS. PATIENTS & METHODS Validation of the GNEM-FAS was performed using data from a randomized, double-blind, placebo-controlled Phase-II study (n = 46). RESULTS Domain score distributions were acceptable. Moderate inter-item correlations (typical range, 0.40-0.70), strong item convergent and discriminant validity and high internal consistency reliability (α = 0.88-0.92) supported the instrument structure. Test-retest reliability was strong (ICC range: 0.87-0.95). Scale scores distinguished among subjects with differing disease severity (p < 0.05). CONCLUSION This study provides preliminary evidence of the GNEM-FAS as a valid, reliable assessment.

Assessing Asthma Symptoms in Adolescents and Adults: Qualitative Research Supporting Development of the Asthma Daily Symptom Diary

BACKGROUND Despite the widespread availability of patient-reported asthma questionnaires, instruments developed in accordance with present regulatory expectations are lacking. To address this gap, the Patient-Reported Outcome (PRO) Consortiums Asthma Working Group has developed a patient-reported asthma daily symptom diary (ADSD) for use in clinical research to assess outcomes and support medical product labeling claims in adults and adolescents with asthma. OBJECTIVES To summarize the qualitative research conducted to inform the initial development of the ADSD and to provide evidence for content validity of the instrument in accordance with the Food and Drug Administrations PRO Guidance. METHODS Research informing the initial development and confirming the content validity of the ADSD is summarized. This comprised a review of published qualitative research, semi-structured concept elicitation interviews (n = 55), and cognitive interviews (n = 65) with a diverse and representative sample of adults and adolescents with a clinician-confirmed diagnosis of asthma in the United States to understand the asthma symptom experience and to assess the relevance and understanding of the newly developed ADSD. RESULTS From the qualitative literature review and concept elicitation interviews, eight core asthma symptoms emerged. These were broadly categorized as breathing symptoms (difficulty breathing, shortness of breath, and wheezing), chest symptoms (chest tightness, chest pain, and pressure/weight on chest), and cough symptoms (cough and the presence of mucus/phlegm). Conceptual saturation was achieved and differences in the experience of participants according to socio-demographic or clinical characteristics were not observed. Subsequent testing of the ADSD confirmed participant relevance and understanding. CONCLUSIONS The ADSD is a new patient-reported asthma symptom diary developed in accordance with the Food and Drug Administrations PRO Guidance. Evidence to date supports the content validity of the instrument. Item performance, reliability, and construct validity will be assessed in future quantitative research.

Qualitative Research to Explore the Patient Experience of X-Linked Hypophosphatemia and Evaluate the Suitability of the BPI-SF and WOMAC® as Clinical Trial End Points

BACKGROUND X-linked hypophosphatemia (XLH) is a rare genetic disorder characterized by renal phosphate wasting and defective bone mineralization. Symptoms include bone pain, joint pain, stiffness, and fatigue. Published evidence regarding the patient experience of XLH is sparse and no XLH-specific outcome measures have been validated. OBJECTIVES To understand the symptoms, impacts, and patient experience of XLH and to evaluate the face and content validity of the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC®) and the Brief Pain Inventory Short Form (BPI-SF) for use as end points in XLH clinical trials. METHODS Face-to-face, qualitative, semistructured interviews were conducted with 18 adults with XLH in the United States using concept elicitation and cognitive debriefing techniques. Open-ended questioning elicited spontaneous concepts focusing on XLH-associated symptoms and functional limitations. Cognitive debriefing of the WOMAC® and BPI-SF assessed the relevance and patient understanding of item wording, recall period, and response options. RESULTS Various distinct symptom concepts were elicited including pain symptoms, dental symptoms, sensory symptoms, tiredness/fatigue symptoms, and musculoskeletal symptoms. Participants reported experiencing significant bone and joint pain, stiffness, mobility limitations, and an impact on their ability to work. Cognitive interviewing found both instruments to be relevant and well understood by most patients. CONCLUSIONS The interviews generated rich, qualitative insights into the patient experience of XLH. Cognitive debriefing of the BPI-SF and WOMAC® supported their value as XLH clinical trial end points. Future research will assess the psychometric properties of these instruments for use in the XLH population.

Development and validation of the angiotensin-converting enzyme inhibitor (ACEI) induced angioedema investigator rating scale and proposed discharge criteria

BackgroundThe use of angiotensin-converting enzyme inhibitors (ACEI) has been associated with the development of bradykinin-mediated angioedema. With ever-widening indications for ACEI in diseases including hypertension, congestive heart failure and diabetic nephropathy, a concomitant increase in ACEI-Angioedema (ACEI-A) has been reported. At present there is no validated severity scoring or discharge criteria for ACEI-A. We sought to develop and validate an investigator rating scale with corresponding discharge criteria using clinicians experienced in treating ACEI-A.MethodsIn-depth, 60-min qualitative telephone interviews were conducted with 12 US-based emergency physicians. Beforehand, clinicians were sent four case studies describing patients experiencing different severities of angioedema attacks. Clinicians were initially asked open-ended questions about their experience of patients’ symptoms, treatment and discharge decisions. Clinicians then rated each patient case study and discussed patient diagnoses, ratings of symptom severity and discharge evaluation. The ratings were used to assess inter-rater reliability of the scale using the intra-class correlation coefficient (ICC) using IBM SPSS analysis Version 19 software.ResultsThe findings provide support focusing on four key symptoms of airway compromise scored on a 0–4 scale: 1) Difficulty Breathing, 2) Difficulty Swallowing, 3) Voice Changes and 4) Tongue Swelling and the corresponding discharge criteria of a score of 0 or ‘No symptoms’ for Difficulty Breathing and Difficulty Swallowing and a score of 0 or 1 indicating mild or absence of symptoms for Voice Change and Tongue Swelling. Eleven clinicians agreed the absence of standardized discharge criteria supported the use of this scale. All physicians concurred with the recommended discharge criteria. The clinician ratings provided evidence of strong inter-rater reliability for the rating scale (ICC > 0.80).ConclusionThe investigator rating scale and discharge criteria are clinically valid, relevant and reliable. Moreover, both address the current unmet need for standardized ED discharge criteria.