Chris Hyde

Assessing the value of diagnostic tests: a framework for designing and evaluating trials

The value of a diagnostic test is not simply measured by its accuracy, but depends on how it affects patient health. This article presents a framework for the design and interpretation of studies that evaluate the health consequences of new diagnostic tests

Screening to prevent spontaneous preterm birth: systematic reviews of accuracy and effectiveness literature with economic modelling

OBJECTIVES To identify combinations of tests and treatments to predict and prevent spontaneous preterm birth. DATA SOURCES Searches were run on the following databases up to September 2005 inclusive: MEDLINE, EMBASE, DARE, the Cochrane Library (CENTRAL and Cochrane Pregnancy and Childbirth Group trials register) and MEDION. We also contacted experts including the Cochrane Pregnancy and Childbirth Group and checked reference lists of review articles and papers that were eligible for inclusion. REVIEW METHODS Two series of systematic reviews were performed: (1) accuracy of tests for the prediction of spontaneous preterm birth in asymptomatic women in early pregnancy and in women symptomatic with threatened preterm labour in later pregnancy; (2) effectiveness of interventions with potential to reduce cases of spontaneous preterm birth in asymptomatic women in early pregnancy and to reduce spontaneous preterm birth or improve neonatal outcome in women with a viable pregnancy symptomatic of threatened preterm labour. For the health economic evaluation, a model-based analysis incorporated the combined effect of tests and treatments and their cost-effectiveness. RESULTS Of the 22 tests reviewed for accuracy, the quality of studies and accuracy of tests was generally poor. Only a few tests had LR+ > 5. In asymptomatic women these were ultrasonographic cervical length measurement and cervicovaginal prolactin and fetal fibronectin screening for predicting spontaneous preterm birth before 34 weeks. In this group, tests with LR- < 0.2 were detection of uterine contraction by home uterine monitoring and amniotic fluid C-reactive protein (CRP) measurement. In symptomatic women with threatened preterm labour, tests with LR+ > 5 were absence of fetal breathing movements, cervical length and funnelling, amniotic fluid interleukin-6 (IL-6), serum CRP for predicting birth within 2-7 days of testing, and matrix metalloprotease-9, amniotic fluid IL-6, cervicovaginal fetal fibronectin and cervicovaginal human chorionic gonadotrophin (hCG) for predicting birth before 34 or 37 weeks. In this group, tests with LR- < 0.2 included measurement of cervicovaginal IL-8, cervicovaginal hCG, cervical length measurement, absence of fetal breathing movement, amniotic fluid IL-6 and serum CRP, for predicting birth within 2-7 days of testing, and cervicovaginal fetal fibronectin and amniotic fluid IL-6 for predicting birth before 34 or 37 weeks. The overall quality of the trials included in the 40 interventional topics reviewed for effectiveness was also poor. Antibiotic treatment was generally not beneficial but when used to treat bacterial vaginosis in women with intermediate flora it significantly reduced the incidence of spontaneous preterm birth. Smoking cessation programmes, progesterone, periodontal therapy and fish oil appeared promising as preventative interventions in asymptomatic women. Non-steroidal anti-inflammatory agents were the most effective tocolytic agent for reducing spontaneous preterm birth and prolonging pregnancy in symptomatic women. Antenatal corticosteroids had a beneficial effect on the incidence of respiratory distress syndrome and the risk of intraventricular haemorrhage (28-34 weeks), but the effects of repeat courses were unclear. For asymptomatic women, costs ranged from 1.08 pounds for vitamin C to 1219 pounds for cervical cerclage, whereas costs for symptomatic women were more significant and varied little, ranging from 1645 pounds for nitric oxide donors to 2555 pounds for terbutaline; this was because the cost of hospitalisation was included. The best estimate of additional average cost associated with a case of spontaneous preterm birth was approximately 15,688 pounds for up to 34 weeks and 12,104 pounds for up to 37 weeks. Among symptomatic women there was insufficient evidence to draw firm conclusions for preventing birth at 34 weeks. Hydration given to women testing positive for amniotic fluid IL-6 was the most cost-effective test-treatment combination. Indomethacin given to all women without any initial testing was the most cost-effective option for preventing birth before 37 weeks among symptomatic women. For a symptomatic woman, the most cost-effective test-treatment combination for postponing delivery by at least 48 h was the cervical length (15 mm) measurement test with treatment with indomethacin for all those testing positive. This combination was also the most cost-effective option for postponing delivery by at least 7 days. Antibiotic treatment for asymptomatic bacteriuria of all women without any initial testing was the most cost-effective option for preventing birth before 37 weeks among asymptomatic women but this does not take into account the potential side effects of antibiotics or issues such as increased resistance. CONCLUSIONS For primary prevention, an effective, affordable and safe intervention applied to all mothers without preceding testing is likely to be the most cost-effective approach in asymptomatic women in early pregnancy. For secondary prevention among women at risk of preterm labour in later pregnancy, a management strategy based on the results of testing is likely to be more cost-effective. Implementation of a treat-all strategy with simple interventions, such as fish oils, would be premature for asymptomatic women. Universal provision of high-quality ultrasound machines in labour wards is more strongly indicated for predicting spontaneous preterm birth among symptomatic women than direct management, although staffing issues and the feasibility and acceptability to mothers and health providers of such strategies need to be explored. Further research should include investigations of low-cost and effective tests and treatments to reduce and delay spontaneous preterm birth and reduce the risk of perinatal mortality arising from preterm birth.

The Effectiveness and Cost-Effectiveness of Donepezil, Galantamine, Rivastigmine and Memantine for the Treatment of Alzheimer's Disease (Review of Technology Appraisal No. 111): A Systematic Review and Economic Model

BACKGROUND Alzheimer’s disease (AD) is the most commonly occurring form of dementia. It is predominantly a disease of later life, affecting 5% of those over 65 in the UK. OBJECTIVES Review and update guidance to the NHS in England and Wales on the clinical effectiveness and cost-effectiveness of donepezil, galantamine, rivastigmine [acetylcholinesterase inhibitors (AChEIs)] and memantine within their licensed indications for the treatment of AD, which was issued in November 2006 (amended September 2007 and August 2009). DATA SOURCES Electronic databases were searched for systematic reviews and/or metaanalyses, randomised controlled trials (RCTs) and ongoing research in November 2009 and updated in March 2010; this updated search revealed no new includable studies. The databases searched included The Cochrane Library (2009 Issue 4, Cochrane Database of Systematic Reviews and Cochrane Central Register of Controlled Trials), MEDLINE, MEDLINE In-Process & Other Non-Indexed Citations, EMBASE, PsycINFO, EconLit, ISI Web of Science Databases--Science Citation Index, Conference Proceedings Citation Index, and BIOSIS; the Centre for Reviews and Dissemination (CRD) databases--NHS Economic Evaluation Database, Health Technology Assessment, and Database of Abstracts of Reviews of Effects. REVIEW METHODS The clinical effectiveness systematic review was undertaken following the principles published by the NHS CRD. We included RCTs whose population was people with AD. The intervention and comparators depended on disease severity, measured by the Mini Mental State Examination (MMSE). INTERVENTIONS mild AD (MMSE 21-26)--donepezil, galantamine and rivastigmine; moderate AD (MMSE 10-20)--donepezil, galantamine, rivastigmine and memantine; severe AD (MMSE < 10)--memantine. Comparators: mild AD (MMSE 21-26)--placebo or best supportive care (BSC); moderate AD (MMSE 10-20)--donepezil, galantamine, rivastigmine, memantine, placebo or BSC; severe AD (MMSE < 10)--placebo or BSC. The outcomes were clinical, global, functional, behavioural, quality of life, adverse events, costs and cost-effectiveness. Where appropriate, data were pooled using pair-wise meta-analysis, multiple outcome measures, metaregression and mixedtreatment comparisons. The decision model was based broadly on the structure of the three-state Markov model described in the previous technology assessment report, based upon time to institutionalisation, parameterised with updated estimates of effectiveness, costs and utilities. RESULTS Notwithstanding the uncertainty of our results, we found in the base case that the AChEIs are probably cost saving at a willingness-to-pay (WTP) of £’30,000 per qualityadjusted life-year (QALY) for people with mild-to-moderate AD. For this class of drugs, there is a > 99% probability that the AChEIs are more cost-effective than BSC. These analyses assume that the AChEIs have no effect on survival. For the AChEIs, in people with mild to moderate AD, the probabilistic sensitivity analyses suggested that donepezil is the most cost-effective, with a 28% probability of being the most cost-effective option at a WTP of £’30,000 per QALY (27% at a WTP of £’20,000 per QALY). In the deterministic results, donepezil dominates the other drugs and BSC, which, along with rivastigmine patches, are associated with greater costs and fewer QALYs. Thus, although galantamine has a slightly cheaper total cost than donepezil (£’69,592 vs £’69,624), the slightly greater QALY gains from donepezil (1.616 vs 1.617) are enough for donepezil to dominate galantamine.The probability that memantine is cost-effective in a moderate to severe cohort compared with BSC at a WTP of £’30,000 per QALY is 38% (and 28% at a WTP of £’20,000 per QALY). The deterministic ICER for memantine is £’32,100 per/QALY and the probabilistic ICER is £’36,700 per/QALY. LIMITATIONS Trials were of 6 months maximum follow-up, lacked reporting of key outcomes, provided no subgroup analyses and used insensitive measures. Searches were limited to English language, The model does not include behavioural symptoms and there is uncertainty about the model structure and parameters. CONCLUSIONS The additional clinical effectiveness evidence identified continues to suggest clinical benefit from the AChEIs in alleviating AD symptoms, although there is debate about the magnitude of the effect. Although there is also new evidence on the effectiveness of memantine, it remains less supportive of this drug’s use than the evidence for AChEIs. The conclusions concerning cost-effectiveness are quite different from the previous assessment. This is because both the changes in effectiveness and costs between drug use and non-drug use underlying the ICERs are very small. This leads to highly uncertain results, which are very sensitive to change. RESEARCH PRIORITIES: RCTs to include mortality, time to institutionalisation and quality of life, powered for subgroup analysis. FUNDING The National Institute for Health Research Health Technology Assessment programme.

Cost-Effectiveness of Pharmacological Interventions for Smoking Cessation: A Literature Review and a Decision Analytic Analysis

To evaluate the relative cost-effectiveness of nicotine replacement therapy (NRT) and bupropion SR for smoking cessation, the authors reviewed published studies and developed a decision analytic model from the UK National Health Services perspective. Irrespective of the methods or assumptions involved, the results of published studies consistently indicated that NRT for smoking cessation is cost-effective. No published studies have evaluated the relative cost-effectiveness of bupropion SR for smoking cessation. The results of the decision analyses indicated that, as compared with advice or counseling alone, the incremental cost per life-years saved is about

Diagnostic accuracy of single baseline measurement of Elecsys Troponin T high-sensitive assay for diagnosis of acute myocardial infarction in emergency department: systematic review and meta-analysis

1,441~

Reporting standards for studies of diagnostic test accuracy in dementia: The STARDdem Initiative

3,455 for NRT,

A systematic review of positron emission tomography (PET) and positron emission tomography/computed tomography (PET/CT) for the diagnosis of breast cancer recurrence

920~

The acute management of trauma hemorrhage: a systematic review of randomized controlled trials

2,150 for bupropion SR, and

Community Programs for the Prevention of Cardiovascular Disease: A Systematic Review

1,282~

A systematic review and economic evaluation of diagnostic strategies for Lynch syndrome.

2,836 for NRT plus bupropion SR. The cost-effectiveness of adding NRT and bupropion SR to advice or counseling for smoking cessation is better than many other accepted health care interventions.