Lena Ring

Content Validity—Establishing and Reporting the Evidence in Newly Developed Patient-Reported Outcomes (PRO) Instruments for Medical Product Evaluation: ISPOR PRO Good Research Practices Task Force Report: Part 2—Assessing Respondent Understanding

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts developers or users purport it to assess. A PRO instrument measures the concepts most relevant and important to a patients condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Part 1 of this task force report covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Building on qualitative interviews and focus groups used to elicit concepts, cognitive interviews help developers craft items that can be understood by respondents in the target population and can ultimately confirm that the final instrument is appropriate, comprehensive, and understandable in the target population. Part 2 details: 1) the methods for conducting cognitive interviews that address patient understanding of items, instructions, and response options; and 2) the methods for tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. The task force reports two parts are meant to be read together. They are intended to offer suggestions for good practice in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation.

Content Validity—Establishing and Reporting the Evidence in Newly Developed Patient-Reported Outcomes (PRO) Instruments for Medical Product Evaluation: ISPOR PRO Good Research Practices Task Force Report: Part 1—Eliciting Concepts for a New PRO Instrument

The importance of content validity in developing patient reported outcomes (PRO) instruments is stressed by both the US Food and Drug Administration and the European Medicines Agency. Content validity is the extent to which an instrument measures the important aspects of concepts that developers or users purport it to assess. A PRO instrument measures the concepts most significant and relevant to a patients condition and its treatment. For PRO instruments, items and domains as reflected in the scores of an instrument should be important to the target population and comprehensive with respect to patient concerns. Documentation of target population input in item generation, as well as evaluation of patient understanding through cognitive interviewing, can provide the evidence for content validity. Developing content for, and assessing respondent understanding of, newly developed PRO instruments for medical product evaluation will be discussed in this two-part ISPOR PRO Good Research Practices Task Force Report. Topics include the methods for generating items, documenting item development, coding of qualitative data from item generation, cognitive interviewing, and tracking item development through the various stages of research and preparing this tracking for submission to regulatory agencies. Part 1 covers elicitation of key concepts using qualitative focus groups and/or interviews to inform content and structure of a new PRO instrument. Part 2 covers the instrument development process, the assessment of patient understanding of the draft instrument using cognitive interviews and steps for instrument revision. The two parts are meant to be read together. They are intended to offer suggestions for good practices in planning, executing, and documenting qualitative studies that are used to support the content validity of PRO instruments to be used in medical product evaluation.

Response shift masks the treatment impact on patient reported outcomes (PROs): the example of individual quality of life in edentulous patients

BackgroundQuality of life (QoL) is now established as an important outcome for evaluating the impact of disease, and for assessing the efficacy of treatments. However, individuals change with time and the basis on which they make a QoL judgement may also change, a phenomenon increasingly referred to as response shift. Here, the individual may change his or her internal standards, values, and/or conceptualization on the target construct as a result of external factors such as a treatment or a change in health status. This has important implications for assessing the effects of treatments as a change in QoL may reflect a response shift, a treatment effect, or a complex combination of both. In this study, we used an individualised quality of life (IQoL) measure, the SEIQoL, together with a then-test to determine whether response shift would influence the measurement of treatment efficacy in edentulous patients.MethodsData are reported here for the first phase of a randomised controlled clinical trial designed to assess the impact, on IQoL, of implant supported dentures compared with high quality conventional dentures. IQoL was measured using the SEIQoL-DW in 117 patients (mean age 64.8; 32% male) at baseline (T1) and 3 months (T2) after receiving high quality conventional dentures. The work was carried out in dental teaching hospitals in Dublin and Belfast.ResultsUnadjusted SEIQoL index scores revealed no significant impact of treatment at three months (baseline: 75.0; 3 months: 73.2, p = .33, n.s.). However, the then-test at 3 months revealed that patients retrospectively rated their baseline IQoL as significantly lower (P < .001) than they had rated it at the time (then-test baseline: 69.2). Comparison of the 3 month scores with this readjusted baseline indicated a significant treatment effect (then-test baseline: 69.2; 3 months: 73.2, p = 0.016). 81% of patients nominated at least one different IQoL domain at 3 months.ConclusionThe positive impact of denture treatment for edentulous patients on IQoL was seen only when response shifts were taken into consideration. The nature of the response shifts was highly complex but the data indicated a degree of re-conceptualisation and reprioritisation. Assessment of the impact of treatments using patient-generated reports must take account of the adaptive nature of patients.

Assessing Safety Culture in Pharmacies: The psychometric validation of the Safety Attitudes Questionnaire (SAQ) in a national sample of community pharmacies in Sweden

BackgroundSafety culture assessment is increasingly recognized as an important component in healthcare quality improvement, also in pharmacies. One of the most commonly used and rigorously validated tools to measure safety culture is the Safety Attitudes Questionnaire; SAQ. This study presents the validation of the SAQ for use in Swedish pharmacies. The psychometric properties of the translated questionnaire are presentedMethodsThe original English language version of the SAQ was translated and adapted to the Swedish context and distributed by e-mail. The survey was carried out on a national basis, covering all 870 Swedish community pharmacies. In total, 7,244 questionnaires were distributed. Scale psychometrics were analysed using Cronbach alphas and intercorrelations among the scales. Multiple group confirmatory factor analysis (CFA) was conducted.ResultsSAQ data from 828 community pharmacies in Sweden, including 4,090 (60.22%) pharmacy personnel out of 6,683 eligible respondents, were received. There were 252 (28.97%) pharmacies that met the inclusion criteria of having at least 5 respondents and a minimum response rate of 60% within that pharmacy.The coefficient alpha value for each of the SAQ scales ranged from .72 to .89. The internal consistency results, in conjunction with the confirmatory factor analysis results, demonstrate that the Swedish translation of the SAQ has acceptable to good psychometric properties. Perceptions of the pharmacy (Teamwork Climate, Job Satisfaction, Perceptions of Management, Safety Climate, and Working Conditions) were moderately to highly correlated with one another whereas attitudes about stress (Stress Recognition) had only low correlations with other factors. Perceptions of management showed the most variability across pharmacies (SD = 26.66), whereas Stress Recognition showed the least (SD = 18.58). There was substantial variability ranging from 0% to 100% in the percent of positive scores for each of the factors across the 252 pharmacies.ConclusionsThe Swedish translation of the SAQ demonstrates acceptable construct validity, for capturing the frontline perspective of safety culture of community pharmacy staff. The psychometric results reported here met or exceeded standard guidelines, which is consistent with previous studies using the SAQ in other healthcare settings and other languages.

To follow or not to follow dermatological treatment : A review of the literature

Creams, ointments and solutions applied to the skin surface by patients as part of a daily routine might be expected to provide a more variable dosage than do standard tablets. However, adherence to treatment in dermatology has been little studied. This article reviews recent publications in the field. These are dominated by questionnaire-based studies, which tend to over-estimate adherence. Reduced adherence to dermatological treatment is noted in 34-45% of patients. It is likely that the percentage of patients who practice truly optimal treatment in their daily life is even lower considering the variable practice of self-treatment. Self-reported psychiatric morbidity contributes to poor adherence to dermatological treatment, while a well-functioning doctor-patient interaction is a major determinant of good adherence, as is patient satisfaction. In conclusion, adherence to dermatological treatment is unsatisfactory and there is a need for intervention and change in clinical routines. The therapeutic and economic benefits may be considerable. The immediate challenge is to stimulate a change in patient behaviour and improve self-treatment at home.

Perceptions of potential donors in the Swedish public towards information and consent procedures in relation to use of human tissue samples in biobanks: A population-based study

Aims: To assess the Swedish publics preferences for information and consent procedures when being asked for permission to use previously collected tissue samples for new research studies. Methods: Cross-sectional study employing postal questionnaires to a random sample of the Swedish general public (n=6,000) in October 2002—February 2003. The response rate was 49% (n=2,928). This paper includes only respondents who reportedly would approve of samples being taken and stored (n=2,122). Results: When potential tissue sample donors in the general public have to strike a balance between the values at stake, i.e. the autonomy of the donor versus the research value, most (72%) prefer general consent, i.e. where consent is asked for at the outset only. They want the research ethics committee (REC) alone to decide on the use of stored samples, and they would allow storage as long as the sample is useful for research. The minority of respondents who were in favour of specific consent were more likely to be young, well educated, have negative experiences of healthcare and low trust in healthcare authorities. Conclusions: The majority of the Swedish general public prefer general consent, and are thus willing to delegate some decisions to the RECs. However, preferences for information and consent procedures depend on the context, e.g. the risks for the donor and the purpose of the research. If feasible, procedures should be differentiated according to the preferences of individual donors, thus protecting the interests of both the minority and the majority.

Factors Associated with Multiple Medication Use in Different Age Groups

Background: Multiple medicine use among elderly persons is likely to be the result of treatment regimens developed over a long period of time. By learning more about how multiple medication use develops, the quality of prescribing may be improved across the adult lifespan. Objective: To describe patterns of multiple medicine use in the general Swedish population and its association with sociodemographic, lifestyle, and health status factors. Methods: Data from a cross-sectional population health survey collected during 2001-2005 from 2816 randomly selected Swedish residents (age 30–75 y; response rate 76%) were analyzed. Multiple medicine use was restricted to prescription drugs and defined as the 75th percentile; that is, the 25% of the study group using the highest number of drugs per individual. Results: Seventy-one percent of the respondents used some kind of drug, 51.5% used one or more prescription drug, 38.4% used one or more over-the-counter (OTC) medication, and 8.3% used one or more herbal preparation. The cutoff amounts defining multiple medicine use were: 2 or more medications for 30- to 49-year-olds, 3 or more for 50- to 64-year-olds, and 5 or more for 65- to 75-year-olds. No association between use of multiple medicines and use of OTC drugs or herbal preparations was found. When drugs were classified into therapeutic subgroups, 76.3% of those aged 30–49 years, 97.9% of those aged 50–64 years, and 100% of those aged 65–75 years were taking a unique combination of drugs. Multivariate analyses showed that diabetes and poor self-rated health were associated with multiple medicine use in all age cohorts. Female sex and hypertension were associated with multiple medicine use among those aged 30–49 and 50–64 years, current smoking among those aged 50–64 years, and obesity among those aged 65–75 years. Conclusions: Multiple medicine use was associated with morbidity and poor self-rated health across all age groups. The vast majority of users of multiple drugs are taking a unique combination of medications.

The use, feasibility and psychometric properties of an individualised quality-of-life instrument: a systematic review of the SEIQoL-DW

PurposeTo review published studies regarding the use, feasibility and psychometric performance of the schedule for the evaluation of individual quality of life—direct weighting (SEIQoL-DW) in clinical research.MethodsSystematic literature review. Studies using the SEIQoL-DW were included if they were published in English and employed a quantitative design. A pre-defined checklist was used to analyse the reported results.ResultsThirty-nine relevant articles were identified. The SEIQoL-DW has been included in studies relating to a variety of populations, including those who are severely ill. The results of convergent and discriminant validity support our hypotheses in which SEIQoL-DW was expected to correlate moderately to high with measures of global QoL, life satisfaction and mental health and weakly with measures of functional status and health.ConclusionThe SEIQoL-DW appears to be a feasible and valid instrument. The lack of association between the Index score and health, functional status, demographic and clinical parameters may be explained by the instrument’s focus on global QoL and by that of the idiographic measurement approach reflecting the capacity of a patient to value domains other than health in life, despite having health problems. Nevertheless, continued psychometric evaluation in large populations with a longitudinal design is recommended.

Patient-physician communication during oncology consultations.

Objective: The aim of this study was to characterize the content of patient‐physician communication in standard oncology care.

Focus on the individual--quality of life assessments in oncology.

In this review we investigate how assessments of quality of life (QoL) can be used in daily clinical practice. The focus is on individualized QoL assessments, but computerized-adaptive testing and interpretation of QoL scores are also considered. Quality of life (QoL) measurements have been used relatively infrequently in clinical practice, although individualized care planning and follow-up based on QoL information may lead to better outcomes of treatment and informed and autonomous decision-making by patients. A recent approach in assessing QoL is by individualized measures, which tap QoL as defined by the individual patient. Individualized QoL instruments, such as the Schedule for the Evaluation of Individual Quality of Life (SEIQoL) and the Patient-Generated Index (PGI), have obvious appeal for use in clinical practice, since they incorporate topics of greatest concern to the individual patient, while also capturing their ratings and weightings. However, before general use in daily clinical practice can be recommended, some aspects of these instruments require further research, particularly issues concerning reliability, feasibility, interpretation and effectiveness.