Kei Long Cheung

Understanding the stakeholders' intention to use economic decision-support tools: A cross-sectional study with the tobacco return on investment tool

BACKGROUND Despite an increased number of economic evaluations of tobacco control interventions, the uptake by stakeholders continues to be limited. Understanding the underlying mechanism in adopting such economic decision-support tools by stakeholders is therefore important. By applying the I-Change Model, this study aims to identify which factors determine potential uptake of an economic decision-support tool, i.e., the Return on Investment tool. METHODS Stakeholders (decision-makers, purchasers of services/pharma products, professionals/service providers, evidence generators and advocates of health promotion) were interviewed in five countries, using an I-Change based questionnaire. MANOVAs were conducted to assess differences between intenders and non-intenders regarding beliefs. A multiple regression analysis was conducted to identify the main explanatory variables of intention to use an economic decision-support tool. FINDINGS Ninety-three stakeholders participated. Significant differences in beliefs were found between non-intenders and intenders: risk perception, attitude, social support, and self-efficacy towards using the tool. Regression showed that demographics, pre-motivational, and motivational factors explained 69% of the variation in intention. DISCUSSION This study is the first to provide a theoretical framework to understand differences in beliefs between stakeholders who do or do not intend to use economic decision-support tools, and empirically corroborating the framework. This contributes to our understanding of the facilitators and barriers to the uptake of these studies.

Similarities and differences between stakeholders' opinions on using Health Technology Assessment (HTA) information across five European countries: results from the EQUIPT survey.

BackgroundThe European-study on Quantifying Utility of Investment in Protection from Tobacco (EQUIPT) project aimed to study transferability of economic evidence by co-creating the Tobacco Return On Investment (ROI) tool, previously developed in the United Kingdom, for four sample countries (Germany, Hungary, Spain and the Netherlands). The EQUIPT tool provides policymakers and stakeholders with customized information about the economic and wider returns on the investment in evidence-based tobacco control, including smoking cessation interventions. A Stakeholder Interview Survey was developed to engage with the stakeholders in early phases of the development and country adaptation of the ROI tool. The survey assessed stakeholders’ information needs, awareness about underlying principles used in economic analyses, opinion about the importance, effectiveness and cost-effectiveness of tobacco control interventions, and willingness to use a Health Technology Assessment (HTA) tool such as the ROI tool.MethodsA cross sectional study using a mixed method approach was conducted among participating stakeholders in the sample countries and the United Kingdom. The individual questionnaire contained open-ended questions as well as single choice and 7- or 3-point Likert-scale questions. The results corresponding to the priority and needs assessment and to the awareness of stakeholders about underlying principles used in economic analysis are analysed by country and stakeholder categories.ResultsStakeholders considered it important that the decisions on the investments in tobacco control interventions should be supported by scientific evidence, including prevalence of smoking, cost of smoking, quality of life, mortality due to smoking, and effectiveness, cost-effectiveness and budget impact of smoking cessation interventions. The proposed ROI tool was required to provide this granularity of information. The majority of the stakeholders were aware of the general principles of economic analyses used in decision making contexts but they did not appear to have in-depth knowledge about specific technical details. Generally, stakeholders’ answers showed larger variability by country than by stakeholder category.ConclusionsStakeholders across different European countries viewed the use of HTA evidence to be an important factor in their decision-making process. Further, they considered themselves to be capable of interpreting the results from a ROI tool and were highly motivated to use it.

Model-based economic evaluations in smoking cessation and their transferability to new contexts: A systematic review†

Abstract Aims To identify different types of models used in economic evaluations of smoking cessation, analyse the quality of the included models examining their attributes and ascertain their transferability to a new context. Methods A systematic review of the literature on the economic evaluation of smoking cessation interventions published between 1996 and April 2015, identified via Medline, EMBASE, National Health Service (NHS) Economic Evaluation Database (NHS EED), Health Technology Assessment (HTA). The checklist‐based quality of the included studies and transferability scores was based on the European Network of Health Economic Evaluation Databases (EURONHEED) criteria. Studies that were not in smoking cessation, not original research, not a model‐based economic evaluation, that did not consider adult population and not from a high‐income country were excluded. Findings Among the 64 economic evaluations included in the review, the state‐transition Markov model was the most frequently used method (n = 30/64), with quality adjusted life years (QALY) being the most frequently used outcome measure in a life‐time horizon. A small number of the included studies (13 of 64) were eligible for EURONHEED transferability checklist. The overall transferability scores ranged from 0.50 to 0.97, with an average score of 0.75. The average score per section was 0.69 (range = 0.35–0.92). The relative transferability of the studies could not be established due to a limitation present in the EURONHEED method. Conclusion All existing economic evaluations in smoking cessation lack in one or more key study attributes necessary to be fully transferable to a new context.

The impact of non-response bias due to sampling in public health studies: A comparison of voluntary versus mandatory recruitment in a Dutch national survey on adolescent health

BackgroundIn public health monitoring of young people it is critical to understand the effects of selective non-response, in particular when a controversial topic is involved like substance abuse or sexual behaviour. Research that is dependent upon voluntary subject participation is particularly vulnerable to sampling bias. As respondents whose participation is hardest to elicit on a voluntary basis are also more likely to report risk behaviour, this potentially leads to underestimation of risk factor prevalence. Inviting adolescents to participate in a home-sent postal survey is a typical voluntary recruitment strategy with high non-response, as opposed to mandatory participation during school time. This study examines the extent to which prevalence estimates of adolescent health-related characteristics are biased due to different sampling methods, and whether this also biases within-subject analyses.MethodsCross-sectional datasets collected in 2011 in Twente and IJsselland, two similar and adjacent regions in the Netherlands, were used. In total, 9360 youngsters in a mandatory sample (Twente) and 1952 youngsters in a voluntary sample (IJsselland) participated in the study. To test whether the samples differed on health-related variables, we conducted both univariate and multivariable logistic regression analyses controlling for any demographic difference between the samples. Additional multivariable logistic regressions were conducted to examine moderating effects of sampling method on associations between health-related variables.ResultsAs expected, females, older individuals, as well as individuals with higher education levels, were over-represented in the voluntary sample, compared to the mandatory sample. Respondents in the voluntary sample tended to smoke less, consume less alcohol (ever, lifetime, and past four weeks), have better mental health, have better subjective health status, have more positive school experiences and have less sexual intercourse than respondents in the mandatory sample. No moderating effects were found for sampling method on associations between variables.ConclusionsThis is one of first studies to provide strong evidence that voluntary recruitment may lead to a strong non-response bias in health-related prevalence estimates in adolescents, as compared to mandatory recruitment. The resulting underestimation in prevalence of health behaviours and well-being measures appeared large, up to a four-fold lower proportion for self-reported alcohol consumption. Correlations between variables, though, appeared to be insensitive to sampling bias.

A Review of the Theoretical Basis, Effects, and Cost Effectiveness of Online Smoking Cessation Interventions in the Netherlands: A Mixed-Methods Approach

Background Tobacco smoking is a worldwide public health problem. In 2015, 26.3% of the Dutch population aged 18 years and older smoked, 74.4% of them daily. More and more people have access to the Internet worldwide; approximately 94% of the Dutch population have online access. Internet-based smoking cessation interventions (online cessation interventions) provide an opportunity to tackle the scourge of tobacco. Objective The goal of this paper was to provide an overview of online cessation interventions in the Netherlands, while exploring their effectivity, cost effectiveness, and theoretical basis. Methods A mixed-methods approach was used to identify Dutch online cessation interventions, using (1) a scientific literature search, (2) a grey literature search, and (3) expert input. For the scientific literature, the Cochrane review was used and updated by two independent researchers (n=651 identified studies), screening titles, abstracts, and then full-text studies between 2013 and 2016 (CENTRAL, MEDLINE, and EMBASE). For the grey literature, the researchers conducted a Google search (n=100 websites), screening for titles and first pages. Including expert input, this resulted in six interventions identified in the scientific literature and 39 interventions via the grey literature. Extracted data included effectiveness, cost effectiveness, theoretical factors, and behavior change techniques used. Results Overall, many interventions (45 identified) were offered. Of the 45 that we identified, only six that were included in trials provided data on effectiveness. Four of these were shown to be effective and cost effective. In the scientific literature, 83% (5/6) of these interventions included changing attitudes, providing social support, increasing self-efficacy, motivating smokers to make concrete action plans to prepare their attempts to quit and to cope with challenges, supporting identity change and advising on changing routines, coping, and medication use. In all, 50% (3/6) of the interventions included a reward for abstinence. Interventions identified in the grey literature were less consistent, with inclusion of each theoretical factor ranging from 31% to 67% and of each behavior change technique ranging from 28% to 54%. Conclusions Although the Internet may provide the opportunity to offer various smoking cessation programs, the user is left bewildered as far as efficacy is concerned, as most of these data are not available nor offered to the smokers. Clear regulations about the effectiveness of these interventions need to be devised to avoid disappointment and failed quitting attempts. Thus, there is a need for policy regulations to regulate the proliferation of these interventions and to foster their quality in the Netherlands.

Estimates of costs for modelling return on investment from smoking cessation interventions

Abstract Background and aims Modelling return on investment (ROI) from smoking cessation interventions requires estimates of their costs and benefits. This paper describes a standardized method developed to source both economic costs of tobacco smoking and costs of implementing cessation interventions for a Europe‐wide ROI model [European study on Quantifying Utility of Investment in Protection from Tobacco model (EQUIPTMOD)]. Design Focused search of administrative and published data. A standardized checklist was developed in order to ensure consistency in methods of data collection. Setting and participants Adult population (15+ years) in Hungary, Netherlands, Germany, Spain and England. For passive smoking‐related costs, child population (0–15 years) was also included. Measurements Costs of treating smoking‐attributable diseases; productivity losses due to smoking‐attributable absenteeism; and costs of implementing smoking cessation interventions. Findings Annual costs (per case) of treating smoking attributable lung cancer were between €5074 (Hungary) and €52 106 (Germany); coronary heart disease between €1521 (Spain) and €3955 (Netherlands); chronic obstructive pulmonary disease between €1280 (England) and €4199 (Spain); stroke between €1829 (Hungary) and €14 880 (Netherlands). Costs (per recipient) of smoking cessation medications were estimated to be: for standard duration of varenicline between €225 (England) and €465 (Hungary); for bupropion between €25 (Hungary) and €220 (Germany). Costs (per recipient) of providing behavioural support were also wide‐ranging: one‐to‐one behavioural support between €34 (Hungary) and €474 (Netherlands); and group‐based behavioural support between €12 (Hungary) and €257 (Germany). The costs (per recipient) of delivering brief physician advice were: €24 (England); €9 (Germany); €4 (Hungary); €33 (Netherlands); and €27 (Spain). Conclusions Costs of treating smoking‐attributable diseases as well as the costs of implementing smoking cessation interventions vary substantially across Hungary, Netherlands, Germany, Spain and England. Estimates for the costs of these diseases and interventions can contribute to return on investment estimates in support of national or regional policy decisions.

Cost-effectiveness of possible future smoking cessation strategies in Hungary: results from the EQUIPTMOD: CE analysis of smoking cessation in Hungary

Abstract Aims To evaluate potential health and economic returns from implementing smoking cessation interventions in Hungary. Methods The EQUIPTMOD, a Markov‐based economic model, was used to assess the cost‐effectiveness of three implementation scenarios: (a) introducing a social marketing campaign; (b) doubling the reach of existing group‐based behavioural support therapies and proactive telephone support; and (c) a combination of the two scenarios. All three scenarios were compared with current practice. The scenarios were chosen as feasible options available for Hungary based on the outcome of interviews with local stakeholders. Life‐time costs and quality‐adjusted life years (QALYs) were calculated from a health‐care perspective. The analyses used various return on investment (ROI) estimates, including incremental cost‐effectiveness ratios (ICERs), to compare the scenarios. Probabilistic sensitivity analyses assessed the extent to which the estimated mean ICERs were sensitive to the model input values. Results Introducing a social marketing campaign resulted in an increase of 0.3014 additional quitters per 1 000 smokers, translating to health‐care cost‐savings of €0.6495 per smoker compared with current practice. When the value of QALY gains was considered, cost‐savings increased to €14.1598 per smoker. Doubling the reach of existing group‐based behavioural support therapies and proactive telephone support resulted in health‐care savings of €0.2539 per smoker (€3.9620 with the value of QALY gains), compared with current practice. The respective figures for the combined scenario were €0.8960 and €18.0062. Results were sensitive to model input values. Conclusions According to the EQUIPTMOD modelling tool, it would be cost‐effective for the Hungarian authorities introduce a social marketing campaign and double the reach of existing group‐based behavioural support therapies and proactive telephone support. Such policies would more than pay for themselves in the long term.

Relevance of barriers and facilitators in the use of health technology assessment in Colombia

Abstract Objectives: Several studies, mostly from developed countries, have identified barriers and facilitators with regard to the uptake of health technology assessment (HTA). This study elicited, using best-worst scaling (BWS), what HTA experts in Colombia consider to be the most important barriers and facilitators in the use of HTA, and makes a comparison to results from the Netherlands. Methods: Two object case surveys (one for barriers, one for facilitators) were conducted among 18 experts (policymakers, health professionals, PhD students, senior HTA-researchers) from Colombia. Seven respondents were employees of the national HTA agency Instituto de Evaluación Tecnológica de Salud (IETS). In total, 22 barriers and 19 facilitators were included. In each choice task, participants were asked to choose the most and least important barrier/facilitator from a set of five. Hierarchical Bayes modeling was used to compute the mean relative importance scores (RIS) for each factor, and a subgroup analysis was conducted to assess differences between IETS and non-IETS respondents. The final ranking was further compared to the results from a similar study conducted in the Netherlands. Results: The three most important barriers (RIS >6.00) were “Inadequate presentation format”, “Absence of policy networks”, and “Insufficient legal support”. The six most important facilitators (RIS >6.00) were “Appropriate timing”, “Clear presentation format”, “Improving longstanding relation”, “Appropriate incentives”, “Sufficient qualified human resources”, and “Availability to relevant HTA research”. The perceived relevance of the barriers and facilitators differed slightly between IETS and non-IETS employees, while the differences between the rankings in Colombia and the Netherlands were substantial. Conclusion: The study suggests that barriers and facilitators related to technical aspects of processing HTA reports and to the contact and interaction between researchers and policymakers had the greatest importance in Colombia.

Serious gaming as a method for changing stakeholders’ perspectives on integrated care

Purpose Serious gaming provides opportunities to harmonize the views of stakeholders regarding integrated care. In order to provide first insights on the effects and stakeholders’ satisfaction of serious gaming, the purpose of this paper is to explore what effects serious gaming has on the perceptions of different stakeholders regarding integrated care, and to evaluate a trial case of serious gaming on integrated care. Design/methodology/approach A pre- and post-test design was used, with two questionnaires. The first questionnaire focused on integrated care, based on the integrated change model, and was given to participants twice, once before and once after the serious game “Long Life Lab” was completed, to assess changes in perception. The second questionnaire focused on the evaluation of serious gaming, and was given to the participants only after the serious game. Findings With nine participants, the results yielded no statistical effects with the exception of three salient beliefs. Despite the small sample, differences in specific beliefs were found for knowledge, attitude and self-efficacy. Furthermore, the game was positively evaluated, but participants indicated that there is room for improvement. Originality/value Participants have positive beliefs toward the use of serious gaming as a tool for changing stakeholders’ perspectives on integrated care. Further studies in greater sample size are needed to confirm the potential value of serious gaming to improve integrated care.

Understanding perceived availability and importance of tobacco control interventions to inform European adoption of a UK economic model: a cross-sectional study

BackgroundThe evidence on the extent to which stakeholders in different European countries agree with availability and importance of tobacco-control interventions is limited. This study assessed and compared stakeholders’ views from five European countries and compared the perceived ranking of interventions with evidence-based ranking using cost-effectiveness data.MethodsAn interview survey (face-to-face, by phone or Skype) was conducted between April and July 2014 with five categories of stakeholders - decision makers, service purchasers, service providers, evidence generators and health promotion advocates - from Germany, Hungary, the Netherlands, Spain, and the United Kingdom. A list of potential stakeholders drawn from the research team’s contacts and snowballing served as the sampling frame. An email invitation was sent to all stakeholders in this list and recruitment was based on positive replies. Respondents were asked to rate availability and importance of 30 tobacco control interventions. Kappa coefficients assessed agreement of stakeholders’ views. A mean importance score for each intervention was used to rank the interventions. This ranking was compared with the ranking based on cost-effectiveness data from a published review.ResultsNinety-three stakeholders (55.7% response rate) completed the survey: 18.3% were from Germany, 17.2% from Hungary, 30.1% from the Netherlands, 19.4% from Spain, and 15.1% from the UK. Of those, 31.2% were decision makers, 26.9% evidence generators, 19.4% service providers, 15.1% health-promotion advocates, and 7.5% purchasers of services/pharmaceutical products. Smoking restrictions in public areas were rated as the most important intervention (mean score = 1.89). The agreement on availability of interventions between the stakeholders was very low (kappa = 0.098; 95% CI = [0.085, 0.111] but the agreement on the importance of the interventions was fair (kappa = 0.239; 95% CI = [0.208, 0.253]). A correlation was found between availability and importance rankings for stage-based interventions. The importance ranking was not statistically concordant with the ranking based on published cost-effectiveness data (Kendall rank correlation coefficient = 0.40; p-value = 0.11; 95% CI = [− 0.09, 0.89]).ConclusionsThe intrinsic differences in stakeholder views must be addressed while transferring economic evidence Europe-wide. Strong engagement with stakeholders, focussing on better communication, has a potential to mitigate this challenge.