R Andrew Moore

Assessing the quality of reports of randomized clinical trials: Is blinding necessary?

It has been suggested that the quality of clinical trials should be assessed by blinded raters to limit the risk of introducing bias into meta-analyses and systematic reviews, and into the peer-review process. There is very little evidence in the literature to substantiate this. This study describes the development of an instrument to assess the quality of reports of randomized clinical trials (RCTs) in pain research and its use to determine the effect of rater blinding on the assessments of quality. A multidisciplinary panel of six judges produced an initial version of the instrument. Fourteen raters from three different backgrounds assessed the quality of 36 research reports in pain research, selected from three different samples. Seven were allocated randomly to perform the assessments under blind conditions. The final version of the instrument included three items. These items were scored consistently by all the raters regardless of background and could discriminate between reports from the different samples. Blind assessments produced significantly lower and more consistent scores than open assessments. The implications of this finding for systematic reviews, meta-analytic research and the peer-review process are discussed.

Opioids in chronic non-cancer pain: systematic review of efficacy and safety

&NA; Opioids are used increasingly for chronic non‐cancer pain. Controversy exists about their effectiveness and safety with long‐term use. We analysed available randomised, placebo‐controlled trials of WHO step 3 opioids for efficacy and safety in chronic non‐cancer pain. The Oxford Pain Relief Database (1950–1994) and Medline, EMBASE and the Cochrane Library were searched until September 2003. Inclusion criteria were randomised comparisons of WHO step 3 opioids with placebo in chronic non‐cancer pain. Double‐blind studies reporting on pain intensity outcomes using validated pain scales were included. Fifteen randomised placebo‐controlled trials were included. Four investigations with 120 patients studied intravenous opioid testing. Eleven studies (1025 patients) compared oral opioids with placebo for four days to eight weeks. Six of the 15 included trials had an open label follow‐up of 6–24 months. The mean decrease in pain intensity in most studies was at least 30% with opioids and was comparable in neuropathic and musculoskeletal pain. About 80% of patients experienced at least one adverse event, with constipation (41%), nausea (32%) and somnolence (29%) being most common. Only 44% of 388 patients on open label treatments were still on opioids after therapy for between 7 and 24 months. The short‐term efficacy of opioids was good in both neuropathic and musculoskeletal pain conditions. However, only a minority of patients in these studies went on to long‐term management with opioids. The small number of selected patients and the short follow‐ups do not allow conclusions concerning problems such as tolerance and addiction.

Cannabinoids for control of chemotherapy induced nausea and vomiting: quantitative systematic review.

Abstract Objective: To quantify the antiemetic efficacy and adverse effects of cannabis used for sickness induced by chemotherapy. Design: Systematic review. Data sources: Systematic search (Medline, Embase, Cochrane library, bibliographies), any language, to August 2000. Studies: 30 randomised comparisons of cannabis with placebo or antiemetics from which dichotomous data on efficacy and harm were available (1366 patients). Oral nabilone, oral dronabinol (tetrahydrocannabinol), and intramuscular levonantradol were tested. No cannabis was smoked. Follow up lasted 24 hours. Results: Cannabinoids were more effective antiemetics than prochlorperazine, metoclopramide, chlorpromazine, thiethylperazine, haloperidol, domperidone, or alizapride: relative risk 1.38 (95% confidence interval 1.18 to 1.62), number needed to treat 6 for complete control of nausea; 1.28 (1.08 to 1.51), NNT 8 for complete control of vomiting. Cannabinoids were not more effective in patients receiving very low or very high emetogenic chemotherapy. In crossover trials, patients preferred cannabinoids for future chemotherapy cycles: 2.39 (2.05 to 2.78), NNT 3. Some potentially beneficial side effects occurred more often with cannabinoids: “high” 10.6 (6.86 to 16.5), NNT 3; sedation or drowsiness 1.66 (1.46 to 1.89), NNT 5; euphoria 12.5 (3.00 to 52.1), NNT 7. Harmful side effects also occurred more often with cannabinoids: dizziness 2.97 (2.31 to 3.83), NNT 3; dysphoria or depression 8.06 (3.38 to 19.2), NNT 8; hallucinations 6.10 (2.41 to 15.4), NNT 17; paranoia 8.58 (6.38 to 11.5), NNT 20; and arterial hypotension 2.23 (1.75 to 2.83), NNT 7. Patients given cannabinoids were more likely to withdraw due to side effects 4.67 (3.07 to 7.09), NNT 11. Conclusions: In selected patients, the cannabinoids tested in these trials may be useful as mood enhancing adjuvants for controlling chemotherapy related sickness. Potentially serious adverse effects, even when taken short term orally or intramuscularly, are likely to limit their widespread use. What is already known on this topic Requests have been made for legalisation of cannabis (marijuana) for medical use Long term smoking of cannabis can have physical and neuropsychiatric adverse effects Cannabis may be useful in the control of chemotherapy related sickness What this study adds Oral nabilone and dronabinol and intramuscular levonantradol are superior to conventional antiemetics (such as prochlorperazine or metoclopramide) in chemotherapy Side effects are common with cannabinoids, and although some may be potentially beneficial (euphoria, “high,” sedation), others are harmful (dysphoria, depression, hallucinations) Many patients have a strong preference for cannabinoids

Using Numerical Results from Systematic Reviews in Clinical Practice

As professionals, we want to use the best treatments; as patients, we want to be given them. Knowing whether an intervention works (or does not work) is fundamental to clinical decision making. However, clinical decision making involves more than simply taking published results of research directly to the bedside. Physicians need to consider how similar their patients are to those in the published studies, to take the values and preferences of their patients into account, and to consider their own experience with a given test or treatment. Evidence from clinical research is becoming increasingly important in medical-practice decisions as more and better evidence is published. But when is the evidence strong enough to justify changing a practice? Individual studies that involve only small numbers of patients may have results that are distorted by the random play of chance and thus lead to less than optimal decisions. As is clear from other papers in this series, systematic reviews identify, critically appraise, and review all the relevant studies on a clinical question and are more likely to give a valid answer. They use explicit methods and quality standards to reduce bias. Their results are the closest we can come to reaching the truth given our current state of knowledge. The questions about an intervention that a systematic review should answer are the following: 1. Does it work? 2. If it works, how well does it work in general and compared with placebo, no treatment, or other interventions that are currently in use? 3. Is it safe? 4. Will it be safe and effective for my patients? Whereas the critical appraisal and qualitative synthesis provided by review articles can be interpreted directly, the numerical products of quantitative reviews can be more difficult to understand and apply in daily clinical practice. This paper provides guidance on how to interpret the numerical and statistical results of systematic reviews, translate these results into more understandable terms, and apply them directly to individual patients. Many of these principles can also be used to interpret the numerical results of individual clinical studies. They are particularly relevant to systematic reviews, however, because such reviews contain more information than do primary studies and often exert greater influence than do individual studies. Making Sense of the Numerical Results of Clinical Studies Although the results of clinical studies can be expressed in intuitively meaningful ways, such results do not always easily translate into clinical decision making. For example, results are frequently expressed in terms of risk, which is an expression of the frequency of a given outcome. (Risks are probabilities, which can vary between 0.0 and 1.0. A probability of 0.0 means that the event will never happen, and a probability of 1.0 means that it always happens.) Consider a hypothetical study of the recurrence of migraine headaches in a control group receiving placebo and a treatment group receiving a new antimigraine preparation, drug M (a secondary prevention trial). Suppose that at the end of the trial, migraines recurred in 30% of the control group (the risk for recurrence was 0.30) but in only 5% of the drug M group (risk of 0.05) (Table 1). Table 1. Numerical Expression of Hypothetical Clinical Trial Results The outcomes of the study are clear enough for the two groups when they are examined separately. But clinicians and patients are more interested in the comparative results, that is, the outcome in one group relative to the outcome in the other group. This overall (comparative) result can be expressed in various ways. For example, the relative risk, which is the risk in the treatment group relative to that in the control group, is simply the ratio of the risks in the two groups. In other words, relative risk is the risk in the treatment group divided by that in the control group, 0.05 0.30, or 0.17. The comparison can also be expressed as the reduction in relative risk, which is the ratio between the decrease in risk (in the treatment group) and the risk in the control group, 0.25 0.30, or 0.83 (Table 1). (The relative risk reduction can also be calculated as 1 relative risk). Although the clinical meaning of relative risk (and relative risk reduction) is reasonably clear, relative risk has the distinct disadvantage that a given value (for example, 0.17) is the same whether the risk with treatment decreases from 0.80 to 0.14, from 0.30 to 0.05, from 0.001 to 0.00017, and so forth. The clinical implications of these changes clearly differ from one another enormously and depend on the specific disease and intervention. An important alternate expression of comparative results, therefore, is the absolute risk reduction. Absolute risk reduction is determined by subtracting the risk in one group from the risk in the other (for example, the risk in the treatment group is subtracted from the risk in the placebo group). In the case of our migraine study, the absolute risk reduction would be 0.30 0.05, which equals 0.25, or 25 percentage points. In contrast, for a study in which the risk decreased from 0.001 to 0.00017, the absolute risk reduction would be only 0.00083, or 0.083 percentage points, which is a trivial change in comparison (Table 1). This arithmetic emphasizes the difficulty of expressing the results of clinical studies in meaningful ways. Relative risk and relative risk reduction clearly give a quantitative sense of the effects of an intervention in proportional terms but provide no clue about the size of an effect on an absolute scale. In contrast, although it tells less about proportional effects, absolute risk says a great deal about whether an effect is likely to be clinically meaningful. Despite this benefit, even absolute risk is problematic because it is a dimensionless, abstract number; that is, it lacks a direct connection with the clinical situation in which the patient and physician exist. However, another way of expressing clinical research results can provide that clinical link: the number needed to treat (NNT). Number Needed To Treat The NNT for a given therapy is simply the reciprocal of the absolute risk reduction for that treatment [1, 2]. In the case of our hypothetical migraine study (in which risk decreased from 0.30 without treatment with drug M to 0.05 with treatment with drug M, for a relative risk of 0.17, a relative risk reduction of 0.83, and an absolute risk reduction of 0.25), the NNT would be 1 0.25, or 4. In concrete clinical terms, an NNT of 4 means that you would need to treat four patients with drug M to prevent migraine from recurring in one patient. To emphasize the difference between the concepts embodied in NNT and relative risk, recall the various situations mentioned above, in all of which the relative risk was 0.17 but in which the absolute risk decreased from 0.80 to 0.14 in one case and from 0.001 to 0.00017 in another. Note that the corresponding NNTs in these two other cases are 1.5 and 1204, respectively: that is, you would need to treat 1.5 and 1204 patients to obtain a therapeutic result in these two situations compared with 4 patients with drug M (Table 1). The NNT can be calculated easily and kept as a single numerical reminder of the effectiveness (or, as we will see, the potential for harm) of a particular therapy. As we suggested, the NNT has the crucial advantage of direct applicability to clinical practice because it shows the effort that is required to achieve a particular therapeutic target. The NNT has the additional advantage that it can be applied to any beneficial outcome or any adverse event (when it becomes the number needed to harm [NNH]). The concept of NNT always refers to a comparison group (in which patients receive placebo, no treatment, or some other treatment), a particular treatment outcome, and a defined period of treatment. In other words, the NNT is the number of patients that you will need to treat with drug or treatment A to achieve an improvement in outcome compared with drug or treatment B for a treatment period of C weeks (or other unit of time). To be fully specified, NNT and NNH must always specify the comparator, the therapeutic outcome, and the duration of treatment that is necessary to achieve the outcome. Important Qualities of the Number Needed To Treat The NNT is treatment specific. It describes the difference between treatment and control in achieving a particular clinical outcome. Table 2 shows NNTs from a selection of systematic reviews and large randomized, controlled trials. Table 2. Numbers Needed To Treat from Systematic Reviews and Randomized, Controlled Trials A very small NNT (that is, one that approaches 1) means that a favorable outcome occurs in nearly every patient who receives the treatment and in few patients in a comparison group. Although NNTs close to 1 are theoretically possible, they are almost never found in practice. However, small NNTs do occur in some therapeutic trials, such as those comparing antibiotics with placebo in the eradication of Helicobacter pylori infection or those examining the use of insecticide for head lice (Table 2). An NNT of 2 or 3 indicates that a treatment is quite effective. In contrast, such prophylactic interventions as adding aspirin to streptokinase to reduce 5-week vascular mortality rates after myocardial infarction may have NNTs as high as 20 to 40 and still be considered clinically effective. Limitations of the Number Needed To Treat Although NNTs are powerful instruments for interpreting clinical effects, they also have important limitations. First, an NNT is generally expressed as a single number, which is known as its point estimate. As with all experimental measurements, however, the true value of the NNT can be higher or lower than the point estimate determined through clinical studies. The 95% CIs of the NNT are useful in this regard because they provide an indication that,

Are cannabinoids an effective and safe treatment option in the management of pain? A qualitative systematic review.

Abstract Objective: To establish whether cannabis is an effective and safe treatment option in the management of pain. Design: Systematic review of randomised controlled trials. Data sources: Electronic databases Medline, Embase, Oxford Pain Database, and Cochrane Library; references from identified papers; hand searches. Study selection: Trials of cannabis given by any route of administration (experimental intervention) with any analgesic or placebo (control intervention) in patients with acute, chronic non-malignant, or cancer pain. Outcomes examined were pain intensity scores, pain relief scores, and adverse effects. Validity of trials was assessed independently with the Oxford score. Data extraction: Independent data extraction; discrepancies resolved by consensus. Data synthesis: 20 randomised controlled trials were identified, 11 of which were excluded. Of the 9 included trials (222 patients), 5 trials related to cancer pain, 2 to chronic non-malignant pain, and 2 to acute postoperative pain. No randomised controlled trials evaluated cannabis; all tested active substances were cannabinoids. Oral delta-9-tetrahydrocannabinol (THC) 5-20 mg, an oral synthetic nitrogen analogue of THC 1 mg, and intramuscular levonantradol 1.5-3 mg were about as effective as codeine 50-120 mg, and oral benzopyranoperidine 2-4 mg was less effective than codeine 60-120 mg and no better than placebo. Adverse effects, most often psychotropic, were common. Conclusion: Cannabinoids are no more effective than codeine in controlling pain and have depressant effects on the central nervous system that limit their use. Their widespread introduction into clinical practice for pain management is therefore undesirable. In acute postoperative pain they should not be used. Before cannabinoids can be considered for treating spasticity and neuropathic pain, further valid randomised controlled studies are needed. What is already known on this topic Three quarters of British doctors surveyed in 1994 wanted cannabis available on prescription Humans have cannabinoid receptors in the central and peripheral nervous system In animal testing cannabinoids are analgesic and reduce signs of neuropathic pain Some evidence exists that cannabinoids may be analgesic in humans What this study adds No studies have been conducted on smoked cannabis Cannabinoids give about the same level of pain relief as codeine in acute postoperative pain They depress the central nervous system

Quantitative estimation of rare adverse events which follow a biological progression: a new model applied to chronic NSAID use.

Abstract Randomised controlled trials (RCTs) alone are unlikely to provide reliable estimates of the incidence of rare events because of their limited size. Cohort, case control, and other observational studies have large numbers but are vulnerable to various kinds of bias. Wanting to estimate the risk of death from bleeding or perforated gastroduodenal ulcers with chronic usage of non‐steroidal anti‐inflammatory drugs (NSAIDs) with greater precision, we developed a model to quantify the frequency of rare adverse events which follow a biological progression. The model combined data from both RCTs and observational studies. We searched systematically for any report of chronic (≥2 months) use of NSAIDs which gave information on gastroduodenal ulcer, bleed or perforation, death due to these complications, or progression from one level of harm to the next. Fifteen RCTs (19 364 patients exposed to NSAIDs for 2–60 months), three cohort studies (215 076 patients redeeming a NSAID prescription over a 3–12 month period), six case‐control studies (2957 cases) and 20 case series (7406), and case reports (4447) were analysed. In RCTs the incidence of bleeding or perforation in 6822 patients exposed to NSAIDs was 0.69%; two deaths occurred. Of 11 040 patients with bleeding or perforation with or without NSAID exposure across all reports, 6–16% (average 12%) died; the risk was lowest in RCTs and highest in case reports. Death from bleeding or perforation in all controls not exposed to NSAIDs occurred in 18 out of 849 489 (0.002%). From these numbers we calculated the number‐needed‐to‐treat for one patient to die due to gastroduodenal complications with chronic (≥2 months) NSAIDs as 1/((0.69×{6–16%, average 12%})−0.002%))=909–2500 (average 1220). On average 1 in 1200 patients taking NSAIDs for at least 2 months will die from gastroduodenal complications who would not have died had they not taken NSAIDs. This extrapolates to about 2000 deaths each year in the UK.

Antidepressants and anticonvulsants for diabetic neuropathy and postherpetic neuralgia: A quantitative systematic review

To determine the relative efficacy and adverse effects of antidepressants and anticonvulsants in the treatment of diabetic neuroapathy and postherpetic neuralgia, published reports were identified from a variety of electronic databases, including Medline, EMBASE, the Cochrane Library and the Oxford Pain Relief Database, and from two previously published reviews. Additional studies were identified from the reference lists of retrieved reports. The relative benefit (RB) and number-needed-to-treat (NNT) for one patient to achieve at least 50 % pain relief was calculated from available dichotomous data, as was the relative risk (RR) and number-needed-to-harm (NH) for minor adverse effects and drug related study withdrawal. In diabetic neuropathy, 16 reports compared antidepressants with placebo (491 patient episodes) and three compared anticonvulsants with placebo (321). The NNT for at least 50 % pain relief with antidepressants was 3.4 (95 % confidence interval 2.6-4. 7) and with anticonvulsants 2. 7 (2. 2-3. 8). In postherpetic neuralgia, three reports compared antidepressants with placebo (145 patient episodes) and one compared anticonvulsants with placebo (225), giving an NNT with antidepressants of 2.1 (1. 7-3) and with anticonvulsants 3.2 (2.4-5). There was little difference in the incidence of minor adverse effects with either antidepressants or anticonvulsants compared with placebo, with 1VH (minor) values of about 3. For drug-related study withdrawal, antidepressants had an NNH (major) of 17 (11-43) compared with placebo, whereas with anticonvulsants there was no significant difference from placebo. Antidepressants and anticonvulsants had the same efficacy and incidence of minor adverse effects in these tzoo neuropathic pain conditions. There was no evidence that selective serotonin reuptake inhibitors (SSRIs) were better than older antidepressants, and no evidence that gabapentin was better than older anticonvulsants. In these trials patients were more likely to stop taking antidepressants than anticonvulsants because of adverse effects.

Systematic review of topical capsaicin for the treatment of chronic pain

Abstract Objective To determine the efficacy and safety of topically applied capsaicin for chronic pain from neuropathic or musculoskeletal disorders. Data sources Cochrane Library, Medline, Embase, PubMed, an in-house database, and contact with manufacturers of topical capsaicin. Study selection Randomised controlled trials comparing topically applied capsaicin with placebo or another treatment in adults with chronic pain. Data extraction Primary outcome was dichotomous information for the number of patients with about a 50% reduction in pain. Outcomes were extracted at four weeks for musculoskeletal conditions and eight weeks for neuropathic conditions. Secondary outcomes were adverse events and withdrawals due to adverse events. Data synthesis Six double blind placebo controlled trials (656 patients) were pooled for analysis of neuropathic conditions. The relative benefit from topical capsaicin 0.075% compared with placebo was 1.4 (95% confidence interval 1.2 to 1.7) and the number needed to treat was 5.7 (4.0 to 10.0). Three double blind placebo controlled trials (368 patients) were pooled for analysis of musculoskeletal conditions. The relative benefit from topical capsaicin 0.025% or plaster compared with placebo was 1.5 (1.1 to 2.0) and the number needed to treat was 8.1 (4.6 to 34). Around one third of patients experienced local adverse events with capsaicin, which would not have been the case with placebo. Conclusions Although topically applied capsaicin has moderate to poor efficacy in the treatment of chronic musculoskeletal or neuropathic pain, it may be useful as an adjunct or sole therapy for a small number of patients who are unresponsive to, or intolerant of, other treatments.

Prevalence of anaemia in older persons: systematic review

BackgroundAgeing populations will impact on healthcare provision, especially since extra years are not necessarily spent in good health. It is important to identify and understand the significance of common medical problems in older people. Anaemia may be one such problem. We report on the prevalence of anaemia in cohorts of elderly people in the general population. The presence of anaemia is associated with a worse prognosis for both morbidity and mortality.MethodsElectronic searching and reference lists of published reports were used to identify studies that reported on prevalence of anaemia in cohorts of at least 100 individuals predominantly aged 65 years and over living in developed countries, together with criteria used to define anaemia. Studies of anaemia prevalence in specific disease groups or published before 1980 were excluded. Prevalence data for the entire cohort, for men and women separately and for different age bands were extracted.ResultsForty-five studies contributed data. Thirty-four studies (n = 85,409) used WHO criteria to define anaemia. The weighted mean prevalence was 17% (3–50%) overall, and 12% (3–25%) in studies based in the community (27, n = 69,975), 47% (31–50%) in nursing homes (3, n = 1481), and 40% (40–72%) in hospital admissions (4, n = 13,953). Anaemia prevalence increased with age, was slightly higher in men than women, and was higher in black people than white. Most individuals classified as anaemic using WHO criteria were only mildly anaemic.ConclusionAnaemia, as defined by WHO criteria, is common in older people living in the community and particularly common in nursing home residents and hospital admissions. Predicted demographic changes underline the need to understand more about anaemia in older people.

Pain relief from intra-articular morphine after knee surgery: a qualitative systematic review

Abstract Reduction of postoperative pain by injecting opioid into the knee joint is believed to support the hypothesis of peripheral opioid receptor activation in inflammation. The study design consisted of a systematic review of randomised controlled trials (RCTs). Main outcomes were pain intensity and the use of supplementary analgesics. Efficacy of intra‐articular bupivacaine against placebo was used as an index of internal sensitivity. Evidence of efficacy was sought in both early (0–6 h after intra‐articular injection) and late (6–24 h) periods. Thirty‐six RCTs in knee surgery were found. Six had both a local anaesthetic control and placebo; four showed internal sensitivity. All four sensitive studies had at least one outcome showing efficacy of intra‐articular morphine against placebo. Six studies compared intra‐articular morphine with intravenous or intramuscular morphine or with intra‐articular saline without a bupivacaine control. Four of the six studies showed greater efficacy for intra‐articular morphine. There was no dose‐response evident. No quantitative analysis of pooled data was done. We conclude that intra‐articular morphine may have some effect in reducing postoperative pain intensity and consumption of analgesics. These studies had significant problems in design, data collection, statistical analysis and reporting. Trials of better methodological quality are needed for a conclusive answer that intra‐articular morphine is analgesic, and that any analgesia produced is clinically useful.