Praveen Thokala

Multiple Criteria Decision Analysis for Health Technology Assessment

OBJECTIVES Multicriteria decision analysis (MCDA) has been suggested by some researchers as a method to capture the benefits beyond quality adjusted life-years in a transparent and consistent manner. The objectives of this article were to analyze the possible application of MCDA approaches in health technology assessment and to describe their relative advantages and disadvantages. METHODS This article begins with an introduction to the most common types of MCDA models and a critical review of state-of-the-art methods for incorporating multiple criteria in health technology assessment. An overview of MCDA is provided and is compared against the current UK National Institute for Health and Clinical Excellence health technology appraisal process. A generic MCDA modeling approach is described, and the different MCDA modeling approaches are applied to a hypothetical case study. RESULTS A comparison of the different MCDA approaches is provided, and the generic issues that need consideration before the application of MCDA in health technology assessment are examined. CONCLUSIONS There are general practical issues that might arise from using an MCDA approach, and it is suggested that appropriate care be taken to ensure the success of MCDA techniques in the appraisal process.

The Effectiveness and Cost-Effectiveness of Donepezil, Galantamine, Rivastigmine and Memantine for the Treatment of Alzheimer's Disease (Review of Technology Appraisal No. 111): A Systematic Review and Economic Model

BACKGROUND Alzheimer’s disease (AD) is the most commonly occurring form of dementia. It is predominantly a disease of later life, affecting 5% of those over 65 in the UK. OBJECTIVES Review and update guidance to the NHS in England and Wales on the clinical effectiveness and cost-effectiveness of donepezil, galantamine, rivastigmine [acetylcholinesterase inhibitors (AChEIs)] and memantine within their licensed indications for the treatment of AD, which was issued in November 2006 (amended September 2007 and August 2009). DATA SOURCES Electronic databases were searched for systematic reviews and/or metaanalyses, randomised controlled trials (RCTs) and ongoing research in November 2009 and updated in March 2010; this updated search revealed no new includable studies. The databases searched included The Cochrane Library (2009 Issue 4, Cochrane Database of Systematic Reviews and Cochrane Central Register of Controlled Trials), MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, PsycINFO, EconLit, ISI Web of Science Databases--Science Citation Index, Conference Proceedings Citation Index, and BIOSIS; the Centre for Reviews and Dissemination (CRD) databases--NHS Economic Evaluation Database, Health Technology Assessment, and Database of Abstracts of Reviews of Effects. REVIEW METHODS The clinical effectiveness systematic review was undertaken following the principles published by the NHS CRD. We included RCTs whose population was people with AD. The intervention and comparators depended on disease severity, measured by the Mini Mental State Examination (MMSE). INTERVENTIONS mild AD (MMSE 21-26)--donepezil, galantamine and rivastigmine; moderate AD (MMSE 10-20)--donepezil, galantamine, rivastigmine and memantine; severe AD (MMSE < 10)--memantine. Comparators: mild AD (MMSE 21-26)--placebo or best supportive care (BSC); moderate AD (MMSE 10-20)--donepezil, galantamine, rivastigmine, memantine, placebo or BSC; severe AD (MMSE < 10)--placebo or BSC. The outcomes were clinical, global, functional, behavioural, quality of life, adverse events, costs and cost-effectiveness. Where appropriate, data were pooled using pair-wise meta-analysis, multiple outcome measures, metaregression and mixedtreatment comparisons. The decision model was based broadly on the structure of the three-state Markov model described in the previous technology assessment report, based upon time to institutionalisation, parameterised with updated estimates of effectiveness, costs and utilities. RESULTS Notwithstanding the uncertainty of our results, we found in the base case that the AChEIs are probably cost saving at a willingness-to-pay (WTP) of £’30,000 per qualityadjusted life-year (QALY) for people with mild-to-moderate AD. For this class of drugs, there is a > 99% probability that the AChEIs are more cost-effective than BSC. These analyses assume that the AChEIs have no effect on survival. For the AChEIs, in people with mild to moderate AD, the probabilistic sensitivity analyses suggested that donepezil is the most cost-effective, with a 28% probability of being the most cost-effective option at a WTP of £’30,000 per QALY (27% at a WTP of £’20,000 per QALY). In the deterministic results, donepezil dominates the other drugs and BSC, which, along with rivastigmine patches, are associated with greater costs and fewer QALYs. Thus, although galantamine has a slightly cheaper total cost than donepezil (£’69,592 vs £’69,624), the slightly greater QALY gains from donepezil (1.616 vs 1.617) are enough for donepezil to dominate galantamine.The probability that memantine is cost-effective in a moderate to severe cohort compared with BSC at a WTP of £’30,000 per QALY is 38% (and 28% at a WTP of £’20,000 per QALY). The deterministic ICER for memantine is £’32,100 per/QALY and the probabilistic ICER is £’36,700 per/QALY. LIMITATIONS Trials were of 6 months maximum follow-up, lacked reporting of key outcomes, provided no subgroup analyses and used insensitive measures. Searches were limited to English language, The model does not include behavioural symptoms and there is uncertainty about the model structure and parameters. CONCLUSIONS The additional clinical effectiveness evidence identified continues to suggest clinical benefit from the AChEIs in alleviating AD symptoms, although there is debate about the magnitude of the effect. Although there is also new evidence on the effectiveness of memantine, it remains less supportive of this drug’s use than the evidence for AChEIs. The conclusions concerning cost-effectiveness are quite different from the previous assessment. This is because both the changes in effectiveness and costs between drug use and non-drug use underlying the ICERs are very small. This leads to highly uncertain results, which are very sensitive to change. RESEARCH PRIORITIES: RCTs to include mortality, time to institutionalisation and quality of life, powered for subgroup analysis. FUNDING The National Institute for Health Research Health Technology Assessment programme.

High-sensitivity troponin assays for the early rule-out or diagnosis of acute myocardial infarction in people with acute chest pain: a systematic review and cost-effectiveness analysis

BACKGROUND Early diagnosis of acute myocardial infarction (AMI) can ensure quick and effective treatment but only 20% of adults with emergency admissions for chest pain have an AMI. High-sensitivity cardiac troponin (hs-cTn) assays may allow rapid rule-out of AMI and avoidance of unnecessary hospital admissions and anxiety. OBJECTIVE To assess the clinical effectiveness and cost-effectiveness of hs-cTn assays for the early (within 4 hours of presentation) rule-out of AMI in adults with acute chest pain. METHODS Sixteen databases, including MEDLINE and EMBASE, research registers and conference proceedings, were searched to October 2013. Study quality was assessed using QUADAS-2. The bivariate model was used to estimate summary sensitivity and specificity for meta-analyses involving four or more studies, otherwise random-effects logistic regression was used. The health-economic analysis considered the long-term costs and quality-adjusted life-years (QALYs) associated with different troponin (Tn) testing methods. The de novo model consisted of a decision tree and Markov model. A lifetime time horizon (60 years) was used. RESULTS Eighteen studies were included in the clinical effectiveness review. The optimum strategy, based on the Roche assay, used a limit of blank (LoB) threshold in a presentation sample to rule out AMI [negative likelihood ratio (LR-) 0.10, 95% confidence interval (CI) 0.05 to 0.18]. Patients testing positive could then have a further test at 2 hours; a result above the 99th centile on either sample and a delta (Δ) of ≥ 20% has some potential for ruling in an AMI [positive likelihood ratio (LR+) 8.42, 95% CI 6.11 to 11.60], whereas a result below the 99th centile on both samples and a Δ of < 20% can be used to rule out an AMI (LR- 0.04, 95% CI 0.02 to 0.10). The optimum strategy, based on the Abbott assay, used a limit of detection (LoD) threshold in a presentation sample to rule out AMI (LR- 0.01, 95% CI 0.00 to 0.08). Patients testing positive could then have a further test at 3 hours; a result above the 99th centile on this sample has some potential for ruling in an AMI (LR+ 10.16, 95% CI 8.38 to 12.31), whereas a result below the 99th centile can be used to rule out an AMI (LR- 0.02, 95% CI 0.01 to 0.05). In the base-case analysis, standard Tn testing was both most effective and most costly. Strategies considered cost-effective depending upon incremental cost-effectiveness ratio thresholds were Abbott 99th centile (thresholds of < £6597), Beckman 99th centile (thresholds between £6597 and £30,042), Abbott optimal strategy (LoD threshold at presentation, followed by 99th centile threshold at 3 hours) (thresholds between £30,042 and £103,194) and the standard Tn test (thresholds over £103,194). The Roche 99th centile and the Roche optimal strategy [LoB threshold at presentation followed by 99th centile threshold and/or Δ20% (compared with presentation test) at 1-3 hours] were extendedly dominated in this analysis. CONCLUSIONS There is some evidence to suggest that hs-CTn testing may provide an effective and cost-effective approach to early rule-out of AMI. Further research is needed to clarify optimal diagnostic thresholds and testing strategies. STUDY REGISTRATION This study is registered as PROSPERO CRD42013005939. FUNDING The National Institute for Health Research Health Technology Assessment programme.

Multiple Criteria Decision Analysis for Health Care Decision Making—Emerging Good Practices: Report 2 of the ISPOR MCDA Emerging Good Practices Task Force

Health care decisions are complex and involve confronting trade-offs between multiple, often conflicting objectives. Using structured, explicit approaches to decisions involving multiple criteria can improve the quality of decision making. A set of techniques, known under the collective heading, multiple criteria decision analysis (MCDA), are useful for this purpose. In 2014, ISPOR established an Emerging Good Practices Task Force. The task forces first report defined MCDA, provided examples of its use in health care, described the key steps, and provided an overview of the principal methods of MCDA. This second task force report provides emerging good-practice guidance on the implementation of MCDA to support health care decisions. The report includes: a checklist to support the design, implementation and review of an MCDA; guidance to support the implementation of the checklist; the order in which the steps should be implemented; illustrates how to incorporate budget constraints into an MCDA; provides an overview of the skills and resources, including available software, required to implement MCDA; and future research directions.

Systematic review, meta-analysis and economic modelling of diagnostic strategies for suspected acute coronary syndrome

BACKGROUND Current practice for suspected acute coronary syndrome (ACS) involves troponin testing 10-12 hours after symptom onset to diagnose myocardial infarction (MI). Patients with a negative troponin can be investigated further with computed tomographic coronary angiography (CTCA) or exercise electrocardiography (ECG). OBJECTIVES We aimed to estimate the diagnostic accuracy of early biomarkers for MI, the prognostic accuracy of biomarkers for major adverse cardiac adverse events (MACEs) in troponin-negative patients, the diagnostic accuracy of CTCA and exercise ECG for coronary artery disease (CAD) and the prognostic accuracy of CTCA and exercise ECG for MACEs in patients with suspected ACS. We then aimed to estimate the cost-effectiveness of using alternative biomarker strategies to diagnose MI, and using biomarkers, CTCA and exercise ECG to risk-stratify troponin-negative patients. DATA SOURCES We searched MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations; Cumulative Index of Nursing and Allied Health Literature (CINAHL), EMBASE, Web of Science, Cochrane Central Database of Controlled Trials (CENTRAL), Cochrane Database of Systematic Reviews (CDSR), NHS Database of Abstracts of Reviews of Effects (DARE) and the Health Technology Assessment database from 1985 (CTCA review) or 1995 (biomarkers review) to November 2010, reviewed citation lists and contacted experts to identify relevant studies. REVIEW METHODS Diagnostic studies were assessed using the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool and prognostic studies using a framework adapted for the project. Meta-analysis was conducted using bayesian Markov chain Monte Carlo simulation. We developed a decision-analysis model to evaluate the cost-effectiveness of alternative biomarker strategies to diagnose MI, and the cost-effectiveness of biomarkers, CTCA or exercise ECG to risk-stratify patients with a negative troponin. Strategies were applied to a theoretical cohort of patients with suspected ACS. Cost-effectiveness was estimated as the incremental cost per quality-adjusted life-year (QALY) of each strategy compared with the next most effective, taking a health-service perspective and a lifetime horizon. RESULTS Sensitivity and specificity (95% predictive interval) were 77% (29-96%) and 93% (46-100%) for troponin I, 80% (33-97%) and 91% (53-99%) for troponin T (99th percentile threshold), 81% (50-95%) and 80% (26-98%) for quantitative heart-type fatty acid-binding protein (H-FABP), 68% (11-97%) and 92% (20-100%) for qualitative H-FABP, 77% (19-98%) and 39% (2-95%) for ischaemia-modified albumin and 62% (35-83%) and 83% (35-98%) for myoglobin. CTCA had 94% (61-99%) sensitivity and 87% (16-100%) specificity for CAD. Positive CTCA and positive-exercise ECG had relative risks of 5.8 (0.6-24.5) and 8.0 (2.3-22.7) for MACEs. In most scenarios in the economic analysis presentation, high-sensitivity troponin measurement was the most effective strategy with an incremental cost-effectiveness ratio (ICER) of less than the £20,000-30,000/QALY threshold (ICER £7487-17,191/QALY). CTCA appeared to be the most cost-effective strategy for patients with a negative troponin, with an ICER of £11,041/QALY. However, when a lower MACE rate was assumed, CTCA had a high ICER (£262,061/QALY) and the no-testing strategy was optimal. LIMITATIONS There was substantial variation between the primary studies and heterogeneity in their results. Findings of the economic model were dependent on assumptions regarding the value of detecting and treating positive cases. CONCLUSIONS Although presentation troponin has suboptimal sensitivity, measurement of a 10-hour troponin level is unlikely to be cost-effective in most scenarios compared with a high-sensitivity presentation troponin. CTCA may be a cost-effective strategy for troponin-negative patients, but further research is required to estimate the effect of CTCA on event rates and health-care costs. FUNDING The National Institute for Health Research Health Technology Assessment programme.

Home telemonitoring or structured telephone support programmes after recent discharge in patients with heart failure: systematic review and economic evaluation

BACKGROUND Remote monitoring (RM) strategies have the potential to deliver specialised care and management to patients with heart failure (HF). OBJECTIVE To determine the clinical effectiveness and cost-effectiveness of home telemonitoring (TM) or structured telephone support (STS) strategies compared with usual care for adult patients who have been recently discharged (within 28 days) from acute care after a recent exacerbation of HF. DATA SOURCES Fourteen electronic databases (including MEDLINE, EMBASE, PsycINFO and The Cochrane Library) and research registers were searched to January 2012, supplemented by hand-searching relevant articles and contact with experts. The review included randomised controlled trials (RCTs) or observational cohort studies with a contemporaneous control group that included the following RM interventions: (1) TM (including cardiovascular implanted monitoring devices) with medical support provided during office hours or 24/7; (2) STS programmes delivered by human-to-human contact (HH) or human-to-machine interface (HM). REVIEW METHODS A systematic review and network meta-analysis (where appropriate) of the clinical evidence was carried out using standard methods. A Markov model was developed to evaluate the cost-effectiveness of different RM packages compared with usual care for recently discharged HF patients. TM 24/7 or using cardiovascular monitoring devices was not considered in the economic model because of the lack of data and/or unsuitability for the UK setting. Given the heterogeneity in the components of usual care and RM interventions, the cost-effectiveness analysis was performed using a set of costing scenarios designed to reflect the different configurations of usual care and RM in the UK. RESULTS The literature searches identified 3060 citations. Six RCTs met the inclusion criteria and were added to the 15 trials identified from the previous systematic reviews giving a total of 21 RCTs included in the systematic review. No trials of cardiovascular implanted monitoring devices or observational studies met the inclusion criteria. The methodological quality of the studies varied widely and reporting was generally poor. Compared with usual care, RM was beneficial in reducing all-cause mortality for STS HH [hazard ratio (HR) 0.77, 95% credible interval (CrI) 0.55 to 1.08], TM during office hours (HR 0.76, 95% CrI 0.49 to 1.18) and TM 24/7 (HR 0.49, 95% CrI 0.20 to 1.18); however, these results were statistically inconclusive. The results for TM 24/7 should be treated with caution because of the poor methodological quality of the only included study in this network. No favourable effect on mortality was observed with STS HM. Similar reductions were observed in all-cause hospitalisations for TM interventions, whereas STS interventions had no major effect. A sensitivity analysis, in which a study was excluded because it provided better-than-usual support to the control group, showed larger beneficial effects for most outcomes, particularly for TM during office hours. In the cost-effectiveness analyses, TM during office hours was the most cost-effective strategy with an estimated incremental cost-effectiveness ratio (ICER) of £11,873 per quality-adjusted life-year (QALY) compared with usual care, whereas STS HH had an ICER of £228,035 per QALY compared with TM during office hours. STS HM was dominated by usual care. Similar results were observed in scenario analyses performed using higher costs of usual care, higher costs of STS HH and lower costs of TM during office hours. LIMITATIONS The RM interventions included in the review were heterogeneous in terms of monitored parameters and HF selection criteria and lacked detail in the components of the RM care packages and usual care (e.g. communication protocols, routine staff visits and resources used). As a result, the economic model developed scenarios for different RM classifications and their costs were estimated using bottom-up costing methods. Although the users can decide which of these scenarios is most representative of their setting, uncertainties still remain about the assumptions made in the estimation of these costs. In addition, the model assumed that the effectiveness of the interventions was constant over time, irrespective of the duration of deployment, and that the intervention was equally effective in different age/severity groups. CONCLUSION Despite wide variation in usual care and RM strategies, cost-effectiveness analyses suggest that TM during office hours was an optimal strategy (in most costing scenarios). However, clarity was lacking among descriptions of the components of RM packages and usual care and there was a lack of robust estimation of costs. Further research is needed in these areas. STUDY REGISTRATION PROSPERO registration no. CRD42011001368. FUNDING The National Institute for Health Research Health Technology Assessment programme.

Telemonitoring after discharge from hospital with heart failure: cost-effectiveness modelling of alternative service designs.

Objectives To estimate the cost-effectiveness of remote monitoring strategies versus usual care for adults recently discharged after a heart failure (HF) exacerbation. Design Decision analysis modelling of cost-effectiveness using secondary data sources. Setting Acute hospitals in the UK. Patients Patients recently discharged (within 28 days) after a HF exacerbation. Interventions Structured telephone support (STS) via human to machine (STS HM) interface, (2) STS via human to human (STS HH) contact and (3) home telemonitoring (TM), compared with (4) usual care. Main outcome measures The incremental cost per quality-adjusted life year (QALY) gained by each strategy compared to the next most effective alternative and the probability of each strategy being cost-effective at varying willingness to pay per QALY gained. Results TM was the most cost-effective strategy in the scenario using these base case costs. Compared with usual care, TM had an estimated incremental cost effectiveness ratio (ICER) of £11 873/QALY, whereas STS HH had an ICER of £228 035/QALY against TM. STS HM was dominated by usual care. Threshold analysis suggested that the monthly cost of TM has to be higher than £390 to have an ICER greater than £20 000/QALY against STS HH. Scenario analyses performed using higher costs of usual care, higher costs of STS HH and lower costs of TM do not substantially change the conclusions. Conclusions Cost-effectiveness analyses suggest that TM was an optimal strategy in most scenarios, but there is considerable uncertainty in relation to clear descriptions of the interventions and robust estimation of costs.

Cost-effectiveness of presentation versus delayed troponin testing for acute myocardial infarction

Objectives To estimate the cost-effectiveness of delayed troponin testing for myocardial infarction compared with troponin testing at presentation. Design Decision analysis modelling of cost-effectiveness using secondary data sources. Setting Acute hospitals in the UK. Population Patients attending hospital with suspected myocardial infarction but a normal or non-diagnostic ECG and no major comorbidities requiring admission. Interventions Delayed troponin testing (10 h after symptom onset) compared with standard and high-sensitivity troponin testing at presentation and no testing. Sensitivity analysis evaluated high-sensitivity troponin testing 3 h after initial assessment. Main outcome measures The incremental cost per quality-adjusted life year (QALY) gained by each strategy, compared with the next most effective alternative, and the probability of each strategy being cost-effective at varying willingness-to-pay per QALY gained. Results In all scenarios tested, presentation high-sensitivity troponin testing was the most effective strategy with an incremental cost-effectiveness ratio below the £20 000/QALY threshold. 10 h troponin testing was only likely to be cost-effective if a discharge decision could be made as soon as a negative result was available and the £30 000/QALY threshold was used, or if a lower sensitivity estimate for presentation high-sensitivity troponin was assumed. Sensitivity analysis showed that including high-sensitivity troponin testing at presentation and 3 h in the analysis makes this the most cost-effective strategy. Conclusions Delayed troponin testing is unlikely to be cost-effective compared with high-sensitivity troponin testing at presentation in most scenarios. Current NICE chest pain guidelines do not promote cost-effective care.

The cost-effectiveness of the Dose Adjustment for Normal Eating (DAFNE) structured education programme: an update using the Sheffield Type 1 Diabetes policy model

To estimate the cost‐effectiveness of training in flexible intensive insulin therapy [as provided in the Dose Adjustment for Normal Eating (DAFNE) structured education programme] compared with no training for adults with Type 1 diabetes mellitus in the UK using the Sheffield Type 1 Diabetes Policy Model.

Variable-complexity optimization applied to airfoil design

Variable-complexity methods are applied to aerodynamic shape design problems with the objective of reducing the total computational cost of the optimization process. Two main strategies are employed: the use of different levels of fidelity in the analysis models (variable fidelity) and the use of different sets of design variables (variable parameterization). Variable-fidelity methods with three different types of corrections are implemented and applied to a set of two-dimensional airfoil optimization problems that use computational fluid dynamics for the analysis. Variable parameterization is also used to solve the same problems. Both strategies are shown to reduce the computational cost of the optimization.