Helen Weatherly

Methods for assessing the cost-effectiveness of public health interventions: Key challenges and recommendations

RATIONALE Increasing attention is being given to the evaluation of public health interventions. Methods for the economic evaluation of clinical interventions are well established. In contrast, the economic evaluation of public health interventions raises additional methodological challenges. The paper identifies these challenges and provides suggestions for overcoming them. METHODS To identify the methodological challenges, five reviews that explored the economics of public health were consulted. From these, four main methodological challenges for the economic evaluation of public health interventions were identified. A review of empirical studies was conducted to explore how the methodological challenges had been approached in practice and an expert workshop convened to discuss how they could be tackled in the future. RESULTS The empirical review confirmed that the four methodological challenges were important. In all, 154 empirical studies were identified, covering areas as diverse as alcohol, drug use, obesity and physical activity, and smoking. However, the four methodological challenges were handled badly, or ignored in most of the studies reviewed. DISCUSSION The empirical review offered few insights into ways of addressing the methodological challenges. The expert workshop suggested a number of ways forward for overcoming the methodological challenges. CONCLUSION Although the existing empirical literature offers few insights on how to respond to these challenges, expert opinion suggests a number of ways forward. Much of what is suggested here has not yet been applied in practice, and there is an urgent need both for pilot studies and more methodological research.

Measuring population health: A comparison of three generic health status measures

Objectives. The relative performance of three widely used generic health status measures (EQ-5D, a modified HUI3 [mHUI3], and SF-12) was compared within a general population sample. Materials and methods. Data were taken from a cohort of persons identified from the patient list of a large general practice in York, UK. Two-way comparisons were made between EQ-5D and mHUI3 and EQ-5D and SF-12. The measures were assessed in terms of their practical viability, coverage, and discrimination. Practical viability was evaluated in terms of the extent of missing responses and the proportion indicating difficulty with a measure. Coverage examined the range of responses across the items in the measures. Discrimination examined the capacity of the measures to discriminate between persons according to their self-reported morbidity and socioeconomic status. Results. One thousand one hundred twenty-six persons completed a postal questionnaire containing EQ-5D and either mHUI3 (n = 593) or SF-12 (n = 533). Missing responses were low across all three instruments. SF-12 showed a broad distribution of responses across its items however, responses on the mHUI3 hearing, speech and dexterity dimensions and the EQ-5D self-care dimension were highly skewed, with few persons reporting problems. In terms of summary scores, mHUI3 identified more mild health states than EQ-5D. EQ-5D and mHUI3 showed slightly better discrimination than SF-12. Conclusions. Despite the inherent differences in their descriptive systems and scoring functions, no one instrument performed better or worse than the other with respect to the criteria applied in this study. Some of the issues to be considered when choosing a population health measure are discussed.

A systematic review of continuous positive airway pressure for obstructive sleep apnoea–hypopnoea syndrome

We conducted a systematic review of current evidence on the effectiveness of continuous positive airway pressure (CPAP) for treatment of obstructive sleep apnoea-hypopnoea syndrome (OSAHS). The primary outcomes were subjective sleepiness, using Epworth Sleepiness Scale (ESS) and objective sleepiness using Maintenance of Wakefulness Test (MWT) and Multiple Sleep Latency Test (MSLT). Mean difference (MD) in endpoints was used to compare CPAP to usual care, placebo and dental devices. The analysis was stratified by symptom and disease severity at baseline. CPAP significantly reduced ESS score compared to control (MD -2.7, 95% CI -3.45, -1.96). The benefit was greatest in patients whose symptoms were severe at baseline: severely symptomatic population (MD -5.0, -6.5, -3.5); moderate (MD -2.3, -3.0, -1.6); mild (MD -1.1, -1.8, -0.3). CPAP significantly improved MWT score compared to control (MD 3.3, 1.3, 5.3) but not on the MSLT. There was no statistically significant difference between CPAP and dental devices on the ESS, MWT or MSLT, in a population with moderate symptoms. There was some evidence of benefit for blood pressure with CPAP compared to control. CPAP is an effective treatment for OSAHS in moderate to severe symptomatic patients and there may be benefits for mild symptoms. Dental devices may be a treatment option for moderate symptoms.

Stapled haemorrhoidopexy for the treatment of haemorrhoids: a systematic review

Objective  This systematic review aimed to evaluate the short‐ and long‐term safety, efficacy and costs of stapled haemorrhoidopexy (SH) compared with conventional haemorrhoidectomy.

Implementing the findings of health technology assessments. If the CAT got out of the bag, can the TAIL wag the dog?

OBJECTIVE To explore whether more could be done to increase the implementation of health technology assessment (HTA) findings. METHODS A literature review was undertaken to identify the main barriers to implementation, the mechanisms that influence the diffusion and use of health technologies, and evidence of the successful implementation of findings. RESULTS Numerous barriers to the implementation of HTA findings exist at the public policy, healthcare professional, and general public levels. Several mechanisms for influencing the use of health technologies exist, and there are some examples of findings being implemented through these mechanisms. However, there are also concerns about the aggressive implementation of findings. A balanced approach to the implementation of HTAs is required. CONCLUSION The main elements of a successful implementation strategy are: a) defining a clear policy question; b) defining a clear research question; c) making recommendations commensurate with the evidence; d) identifying the implementation mechanism; e) paying attention to incentives and disincentives; and f) clarifying the roles and responsibilities of the various parties. Further research is also required into several aspects of implementation.

The Effectiveness and Cost‐Effectiveness of Respite for Caregivers of Frail Older People

The proportion of frail elderly people in the industrialized world is increasing. Respite care is a potentially important way of maintaining the quality of life for these people and their caregivers. The objective of this systematic review was to determine the effectiveness and cost‐effectiveness of different models of community‐based respite care for frail older people and their caregivers. To identify relevant studies, 37 databases were searched, and reference checking and citation searches were undertaken. Well‐controlled effectiveness studies were eligible for inclusion, with uncontrolled studies admissible only in the absence of higher‐quality evidence. Studies assessed the effect of community‐based respite on caregivers of frail elderly people relative to usual care or to another support intervention. Eligible economic evaluations also addressed costs. Where appropriate, data were synthesized using standard meta‐analytic techniques. Ten randomized, controlled trials, seven quasi‐experimental studies and five uncontrolled studies were included in the review. For all types of respite, the effects upon caregivers were generally small, with better‐controlled studies finding modest benefits only for certain subgroups, although many studies reported high levels of caregiver satisfaction. No reliable evidence was found that respite care delays entry to residential care or adversely affects frail older people. The economic evaluations all assessed day care, which tended to be associated with similar or higher costs than usual care. Given the increasing numbers of frail elderly people and the lack of up‐to‐date, good‐quality evidence for all types of respite care, better‐quality evidence is urgently needed to inform current policy and practice.

Economic evaluation of health interventions

A broader perspective is needed that includes potential costs and benefits for all stakeholders

USING EVIDENCE IN THE DEVELOPMENT OF LOCAL HEALTH POLICIES Some Evidence from the United Kingdom

OBJECTIVES This paper explores the use of evidence, focusing on economic evidence in particular, in the development of local health policies through an in-depth study of Health Improvement Programmes (HImPs) in England. METHODS A questionnaire was sent to the person responsible for coordinating the development of the HImP in each of the 102 English health authorities. In addition, semi-structured interviews were conducted with 10 HImP leaders, and a random sample of 26 HImP documents was reviewed using a standard pro forma. RESULTS Of the 102 mail questionnaires sent out, 68 (67%) were returned. It was found that those developing HImPs had multiple objectives, only some of which (e.g., efficiency in healthcare provision) would necessarily require evidence. Where evidence was used, this was a mixture of internal (experiential) and external (empirical) evidence, with the balance (66%) being in favor of the latter. Government reports and guidance from the National Institute for Clinical Excellence (NICE), were the main sources of external evidence, rather than published papers. Key barriers to the use of economic evidence were lack of time and availability and the difficulties in synthesizing information at the local level. CONCLUSIONS Based on responses to our survey, the main ways of increasing the use of evidence in the development of local health policies in England are to produce more evidence-based national guidance and to produce accessible summaries of the available literature for local decision makers.

Cost-effectiveness of interventions to support self-care: A systematic review

OBJECTIVES Interventions to support patient self-care of their condition aim to improve patient health and reduce health service costs. Consequently, they have attracted considerable policy interest. There is some evidence of clinical effectiveness but less attention has been paid to whether these interventions are cost-effective. This study examines the quality and quantity of existing evidence of the cost-effectiveness. METHODS A systematic review was carried out to assess the extent and quality of economic evaluations of self-care support interventions. Thirty-nine economic evaluations were assessed against a quality checklist developed to reflect the special features of these interventions. RESULTS The majority of the studies claimed that self-care support interventions were cost-effective or cost saving. The overall quality of economic evaluations was poor because of flaws in study designs, especially a narrow definition of relevant costs and short follow-up periods. CONCLUSIONS The current evidence base does not support any general conclusion that self-care support interventions are cost-effective, but ongoing trials may provide clearer evidence.

An economic analysis of continuous positive airway pressure for the treatment of obstructive sleep apnea-hypopnea syndrome.

OBJECTIVES An important option for the medical treatment of obstructive sleep apnea-hypopnea syndrome (OSAHS) is continuous positive airway pressure (CPAP) during sleep. This study reports on the cost-effectiveness of CPAP compared with dental devices and lifestyle advice. The work was commissioned by the NHS HTA Programme to inform the National Institute of Health and Clinical Excellences (NICE) appraisal of CPAP. METHODS A Markov model compared the interventions over the expected patient lifetime. The primary measure of cost-effectiveness was the incremental cost per quality-adjusted life-year (QALY) gained. The QALY incorporated the impact of treatments on daytime sleepiness, blood pressure and health-related quality of life (HRQoL). RESULTS On average, CPAP was associated with higher costs and QALYs compared with dental devices or lifestyle advice. In the base-case analysis, the incremental cost-effectiveness ratio (ICER) for CPAP compared with dental devices was around 4,000 pounds per QALY (2005--06 prices). The probability that CPAP is more cost-effective than dental devices or lifestyle advice at a threshold value of 20,000 pounds per QALY was 0.78 for men and 0.80 for women. Several sensitivity analyses were undertaken and it was found that the ICER for CPAP consistently fell below 20,000 pounds per QALY gained, apart from in a subgroup with mild disease. CONCLUSIONS The model suggests that CPAP is cost-effective compared with dental devices and lifestyle advice for adults with moderate or severe symptomatic OSAHS at the cost-effectiveness thresholds used by NICE. This finding is reflected in the NICE guidance.