Juan Manuel Ramos-Goñi

Valuation and Modeling of EQ-5D-5L Health States Using a Hybrid Approach.

Background: The EQ-5D instrument is the most widely used preference-based health-related quality of life questionnaire in cost-effectiveness analysis of health care technologies. Recently, a version called EQ-5D-5L with 5 levels on each dimension was developed. This manuscript explores the performance of a hybrid approach for the modeling of EQ-5D-5L valuation data. Methods: Two elicitation techniques, the composite time trade-off, and discrete choice experiments, were applied to a sample of the Spanish population (n=1000) using a computer-based questionnaire. The sampling process consisted of 2 stages: stratified sampling of geographic area, followed by systematic sampling in each area. A hybrid regression model combining composite time trade-off and discrete choice data was used to estimate the potential value sets using main effects as starting point. The comparison between the models was performed using the criteria of logical consistency, goodness of fit, and parsimony. Results: Twenty-seven participants from the 1000 were removed following the exclusion criteria. The best-fitted model included 2 significant interaction terms but resulted in marginal improvements in model fit compared to the main effects model. We therefore selected the model results with main effects as a potential value set for this methodological study, based on the parsimony criteria. The results showed that the main effects hybrid model was consistent, with a range of utility values between 1 and −0.224. Conclusion: This paper shows the feasibility of using a hybrid approach to estimate a value set for EQ-5D-5L valuation data.

Dealing with the health state 'dead' when using discrete choice experiments to obtain values for EQ-5D-5L heath states

ObjectiveTo evaluate two different methods to obtain a dead (0)—full health (1) scale for EQ-5D-5L valuation studies when using discrete choice (DC) modeling.MethodThe study was carried out among 400 respondents from Barcelona who were representative of the Spanish population in terms of age, sex, and level of education. The DC design included 50 pairs of health states in five blocks. Participants were forced to choose between two EQ-5D-5L states (A and B). Two extra questions concerned whether A and B were considered worse than dead. Each participant performed ten choice exercises. In addition, values were collected using lead-time trade-off (lead-time TTO), for which 100 states in ten blocks were selected. Each participant performed five lead-time TTO exercises. These consisted of DC models offering the health state ‘dead’ as one of the choices—for which all participants’ responses were used (DCdead)—and a model that included only the responses of participants who chose at least one state as worse than dead (WTD) (DCWTD). The study also estimated DC models rescaled with lead-time TTO data and a lead-time TTO linear model.ResultsThe DCdead and DCWTD models produced relatively similar results, although the coefficients in the DCdead model were slightly lower. The DC model rescaled with lead-time TTO data produced higher utility decrements. Lead-time TTO produced the highest utility decrements.ConclusionsThe incorporation of the state ‘dead’ in the DC models produces results in concordance with DC models that do not include ‘dead’.

Avoidable costs of physical treatments for chronic back, neck and shoulder pain within the Spanish National Health Service: a cross-sectional study

BackgroundBack, neck and shoulder pain are the most common causes of occupational disability. They reduce health-related quality of life and have a significant economic impact. Many different forms of physical treatment are routinely used. The objective of this study was to estimate the cost of physical treatments which, despite the absence of evidence supporting their effectiveness, were used between 2004 and 2007 for chronic and non-specific neck pain (NP), back pain (BP) and shoulder pain (SP), within the Spanish National Health Service in the Canary Islands (SNHSCI).MethodsChronic patients referred from the SNHSCI to private physical therapy centres for NP, BP or SP, between 2004 and 2007, were identified. The cost of providing physical therapies to these patients was estimated. Systematic reviews (SRs) and clinical practice guidelines (CPGs) for NP, BP and SP available in the same period were searched for and rated according to the Oxman and AGREE criteria, respectively. Those rated positively for ≥70% of the criteria, were used to categorise physical therapies as Effective; Ineffective; Inconclusive; and Insufficiently Assessed. The main outcome was the cost of physical therapies included in each of these categories.Results8,308 chronic cases of NP, 4,693 of BP and 5,035 of SP, were included in this study. Among prescribed treatments, 39.88% were considered Effective (physical exercise and manual therapy with mobilization); 23.06% Ineffective; 13.38% Inconclusive, and 23.66% Insufficiently Assessed. The total cost of treatments was € 5,107,720. Effective therapies accounted for € 2,069,932.ConclusionsSixty percent of the resources allocated by the SNHSCI to fund physical treatment for NP, BP and SP in private practices are spent on forms of treatment proven to be ineffective, or for which there is no evidence of effectiveness.

Quality Control Process for EQ-5D-5L Valuation Studies

BACKGROUND The values of the five-level EuroQol five-dimensional questionnaire (EQ-5D-5L) are elicited using composite time trade-off and discrete choice experiments. Unfortunately, data quality issues and interviewer effects were observed in the first few EQ-5D-5L valuation studies. To prevent these issues from occurring in later studies, the EuroQol Group established a cyclic quality control (QC) process. OBJECTIVES To describe this QC process and show its impact on data quality. METHODS A newly developed QC tool provided information about protocol compliance, interviewer effects, and mean values by health state severity. In a cyclic process, this information is initially used to evaluate whether new interviewers meet minimal quality requirements and later to provide feedback about how their performance may be improved. To investigate the impact of this cyclic process, we compared the quality of the data in Dutch and Spanish valuation studies that did not have this QC process with that in the follow-up studies in the same countries that used the QC process. Data quality was measured using protocol violations, variability between interviewers, the proportion of inconsistent responders, and clustering of composite time trade-off values. RESULTS In Spain, protocol violations were reduced from 87% in the valuation study to 5% in the follow-up study and in the Netherlands from 20% to 8%. In both countries, interviewers performed more homogeneously in the follow-up studies. The number of inconsistent respondents was reduced by 23.2% in Spain and 23.6% in the Netherlands. Values were less clustered in the follow-up studies. CONCLUSIONS The implementation of a strict QC process in EQ-5D-5L valuation studies increases interviewer protocol compliance and promotes data quality.

Handling Data Quality Issues to Estimate the Spanish EQ-5D-5L Value Set Using a Hybrid Interval Regression Approach.

BACKGROUND The Spanish five-level EuroQol five-dimensional questionnaire (EQ-5D-5L) valuation study was the first to use the EuroQol Valuation Technology protocol, including composite time trade-off (C-TTO) and discrete choice experiments (DCE). In this study, its investigators noticed that some interviewers did not fully explain the C-TTO task to respondents. Evidence from a follow-up study in 2014 confirmed that when interviewers followed the protocol, the distribution of C-TTO responses widened. OBJECTIVES To handle the data quality issues in the C-TTO responses by estimating a hybrid interval regression model to produce a Spanish EQ-5D-5L value set. METHODS Four different models were tested. Model 0 integrated C-TTO and DCE responses in a hybrid model and models 1 to 3 altered the interpretation of the C-TTO responses: model 1 allowed for censoring of the C-TTO responses, whereas model 2 incorporated interval responses and model 3 included the interviewer-specific protocol violations. For external validation, the predictions of the four models were compared with those of the follow-up study using the Lins concordance correlation coefficient. RESULTS This stepwise approach to modeling C-TTO and DCE responses improved the concordance between the valuation and follow-up studies (concordance correlation coefficient: 0.948 [model 0], 0.958 [model 1], 0.952 [model 2], and 0.989 [model 3]). We recommend the estimates from model 3, because its hybrid interval regression model addresses the data quality issues found in the valuation study. CONCLUSIONS Protocol violations may occur in any valuation study; handling them in the analysis can improve external validity. The resulting EQ-5D-5L value set (model 3) can be applied to inform Spanish health technology assessments.

Does the Introduction of the Ranking Task in Valuation Studies Improve Data Quality and Reduce Inconsistencies? The Case of the EQ-5D-5L

BACKGROUND Time trade-off (TTO)-based valuation studies for the three-level version of the EuroQol five-dimensional questionnaire (EQ-5D) typically started off with a ranking task (ordering the health states by preference). This was not included in the protocol for the five-level EQ-5D (EQ-5D-5L) valuation study. OBJECTIVES To test whether reintroducing a ranking task before the composite TTO (C-TTO) could help to reduce inconsistencies in C-TTO responses and improve the data quality. METHODS Respondents were randomly assigned to three study arms. The control arm was the present EQ-5D-5L study protocol, without ranking. The second arm (ranking without sorting) preceded the present protocol by asking respondents to rank the target health states using physical cards. The states were then valued in random order using C-TTO. In the third arm (ranking and sorting), the ranked states remained visible through the C-TTO tasks and the order of valuation was determined by the ranking. The study used only 10 EQ-5D-5L health states. We compared the C-TTO-based inconsistent pairs of health states and ties. RESULTS The final sample size was 196 in the control arm, 205 in the ranking without sorting arm, and 199 in the ranking and sorting arm. The percentages of ties by respondents were 15.1%, 12.5%, and 12.6% for the control arm, the ranking without sorting arm, and the ranking and sorting arm, respectively. The extra cost for adding the ranking task was about 15%. CONCLUSIONS The benefit does not justify the effort involved in the ranking task. For this reason, the addition of the ranking task to the present EQ-5D-5L valuation protocol is not an attractive option.

Learning and satisficing: An analysis of sequence effects in health valuation

OBJECTIVE To estimate the effect of sequence on response precision and response behavior in health valuation studies. METHODS Time trade-off (TTO) and paired comparison responses from six health valuation studies-four US, one Spanish, and one Dutch-were examined (22,225 respondents) to test whether task sequence influences response precision (e.g., rounding), response changes, and median response times. Each study used a computer-based instrument that randomized task sequence among a national sample of adults, age 18 years or older, from the general population. RESULTS For both TTO and paired comparisons, median response times decreased with sequence (i.e., learning), but tended to flatten after the first three tasks. Although the paired comparison evidence demonstrated that sequence had no effect on response precision, the frequency of rounded TTO responses (to either 1-year or 5-year units) increased with sequence. CONCLUSIONS Based on these results, randomizing or reducing the number of paired comparison tasks does not appear to influence response precision; however, generalizability, practicality, and precautionary considerations remain. Overall, participants learned to respond efficiently within the first three tasks and did not resort to satisficing, but may have rounded their TTO responses.

Assessing the Use of a Feedback Module to Model EQ-5D-5L Health States Values in Hong Kong

BackgroundAn international valuation protocol exists for obtaining societal values for each of the 3125 health states of the five-level EuroQol-five dimensions (EQ-5D-5L) questionnaire. A feedback module (FM) that can be related to theoretical models used in behavioral economics was recently included in this protocol.ObjectivesOur objective was to assess the impact of using an FM to estimate an EQ-5D-5L value set in Hong Kong.MethodsEQ-5D-5L health states were elicited using a composite time trade-off (C-TTO) and a discrete-choice (DC) experiment. Use of the FM according to participant characteristics and the impact of the FM on the number of inconsistent C-TTO responses were assessed. We employed a main-effects hybrid model that combined data from both elicitation techniques.ResultsIn total, 1014 individuals completed the survey. The sample was representative of the general Chinese Hong Kong population in terms of sex, educational attainment, marital status, and most age groups but not for employment status. The use of the FM reduced the number of C-TTO inconsistencies. Participant characteristics differed significantly between those who used and did not use the FM. The model without a constant resulted in logical consistent coefficients and was therefore selected as the model to produce the value set. The predicted EQ-5D-5L values ranged from −0.864 to 1.ConclusionsThe use of an FM to allow participants to exclude C-TTO responses reduced the number of inconsistent responses and improved the quality of the data when estimating an EQ-5D-5L value set in Hong Kong.

Valuation of EuroQol Five-Dimensional Questionnaire, Youth Version (EQ-5D-Y) and EuroQol Five-Dimensional Questionnaire, Three-Level Version (EQ-5D-3L) Health States: The Impact of Wording and Perspective

BACKGROUND Valuations of health states were affected by the wording of the two instruments (EQ-5D-3L and EQ-5D-Y) and by the perspective taken (child or adult). OBJECTIVES There is a growing demand for value sets for the EQ-5D-Y (EQ-5D instrument for younger populations). Given the similarities between EQ-5D-Y and EQ-5D-3L, we investigated whether valuations of health states were affected by the differences in wording between the two instruments and by the perspective taken in the valuation exercise (child or adult). STUDY DESIGN Respondents were randomly assigned to EQ-5D-3L or EQ-5D-Y (instrument) and further into two groups that either valued health states for an adult or for a 10-year-old child (perspective). The valuation tasks were composite time trade-off (C-TTO) and discrete choice experiments (DCE), including comparisons with death (DCE + death). Members of the adult general population in four countries (Germany, Netherlands, Spain, England) participated in computer-assisted personal interviews. METHODS Two-way multivariate analysis of variance (MANOVA) and post hoc tests were used to compare C-TTO responses and chi-square tests were conducted to compare DCE + death valuations. RESULTS A significant interaction effect between instrument and perspective for C-TTO responses was found. Significant differences by perspective (adult and child) occurred only for the EQ-5D-3L. Significant differences in values between instruments (EQ-5D-3L and EQ-5D-Y) occurred only for the adult perspective. Both significant results were confirmed by the DCE + death results. When comparing EQ-5D-3L for adult perspective and EQ-5D-Y for child perspective, values were also significantly different. CONCLUSIONS The results identified an interaction effect between wording of the instrument and perspective on elicited values, suggesting that current EQ-5D-3L value sets should not be employed to assign values to EQ-5D-Y health states.