Diana Papaioannou

Literature searching for social science systematic reviews: consideration of a range of search techniques.

BACKGROUND Literature for a systematic review on the student experience of e-learning is located across a range of subject areas including health, education, social science, library and information science. OBJECTIVES To assess the merits and shortcomings of using different search techniques in retrieval of evidence in the social science literature. METHODS A conventional subject search was undertaken as the principal method of identifying the literature for the review. Four supplementary search methods were used including citation searching, reference list checking, contact with experts and pearl growing. RESULTS The conventional subject search identified 30 of 41 included references; retrieved from 10 different databases. References were missed by this method and a further 11 references were identified via citation searching, reference list checking and contact with experts. Pearl growing was suspended as the nominated pearls were dispersed across numerous databases, with no single database indexing more than four pearls. CONCLUSIONS Searching within the social sciences literature requires careful consideration. Conventional subject searching identified the majority of references, but additional search techniques were essential and located further high quality references.

Positron emission tomography (PET) for assessment of axillary lymph node status in early breast cancer: A systematic review and meta-analysis

PURPOSE Sentinel lymph node biopsy (SLNB) and axillary lymph node dissection (ALND) are used to assess axillary nodal status in breast cancer, but are invasive procedures associated with morbidity, including lymphoedema. This systematic review evaluates the diagnostic accuracy of positron emission tomography (PET), with or without computed tomography (CT), for assessment of axillary nodes in early breast cancer. METHODS Eleven databases including MEDLINE, EMBASE and the Cochrane Library, plus research registers and conference proceedings, were searched in April 2009. Study quality was assessed using the QUality Assessment of Diagnostic Accuracy Studies (QUADAS) checklist. Sensitivity and specificity were meta-analysed using a bivariate random effects approach. RESULTS Across 26 studies evaluating PET or PET/CT (n = 2591 patients), mean sensitivity was 63% (95% CI: 52-74%; range 20-100%) and mean specificity 94% (95% CI: 91-96%; range 75-100%). Across 7 studies of PET/CT (n = 862), mean sensitivity was 56% (95% CI: 44-67%) and mean specificity 96% (90-99%). Across 19 studies of PET-only (n = 1729), mean sensitivity was 66% (50-79%) and mean specificity 93% (89-96%). Mean sensitivity was 11% (5-22%) for micrometastases (≤2 mm; five studies; n = 63), and 57% (47-66%) for macrometastases (>2 mm; four studies; n = 111). CONCLUSIONS PET had lower sensitivity and specificity than SLNB. Therefore, replacing SLNB with PET would avoid the adverse effects of SLNB, but lead to more false negative patients at risk of recurrence and more false positive patients undergoing unnecessary ALND. The present evidence does not support the routine use of PET or PET-CT for the assessment of the clinically negative axilla.

Dabigatran etexilate for the prevention of venous thromboembolism in patients undergoing elective hip and knee surgery: A Single Technology Appraisal

This paper presents a summary of the evidence review group (ERG) report into the clinical effectiveness and cost-effectiveness of dabigatran etexilate (DBG) for the prevention of venous thromboembolism (VTE) in patients undergoing elective hip and knee surgery based upon a review of the manufacturers submission to the NICE as part of the single technology appraisal (STA) process. The submissions evidence came from three reasonable-quality trials comparing DBG with enoxaparin, and a comparison of DBG with fondaparinux based on the relative efficacy and safety as derived from a mixed treatment comparison (MTC) meta-analysis. DBG (220 mg and 150 mg once daily) is not inferior to enoxaparin (40 mg once daily and 30 mg twice daily) in terms of major VTE or VTE-related events (secondary outcome). Meta-analysis shows that 220 mg DBG is not inferior to enoxaparin (40 mg once daily or 30 mg twice daily) in reducing total VTE and all-cause mortality (primary outcome) in total hip or knee replacement, whereas there is uncertainty around the clinical effectiveness of 150 mg DBG for this outcome. In the MTC analysis DBG compared favourably with the other interventions, with the exception of extended enoxaparin and fondaparinux. The adverse event profile was not significantly different in those receiving DBG and those receiving enoxaparin. The submitted two-phase economic model compares DBG with enoxaparin and fondaparinux in total hip and knee replacement. The model structure is appropriate and the model assumptions are reasonable. The health states, costs, utilities and recurrence rates used are considered to be appropriate for the required analysis. The model estimated that at the licensed dose of 220 mg once daily DBG dominates enoxaparin in both total hip replacement and total knee replacement and that at the lower dose of 150 mg once daily DBG dominates enoxaparin in total hip replacement and enoxaparin dominates DBG in total knee replacement. DBG is less cost-effective than fondaparinux in total hip replacement at both doses; the cost per quality-adjusted life-year of fondaparinux versus DBG is 11,111 pounds and 6857 pounds for the higher and lower doses of DBG respectively. In total knee replacement, both DBG doses are dominated by fondaparinux. For DBG versus all comparators in all cases the cost-effectiveness results are based on small incremental cost and health benefits. Weaknesses of the submitted evidence include that methods used for screening studies, data extraction and applying quality assessment criteria to included studies, as well as key details of trials included in the MTC, were not adequately described. In addition, some input parameters into the modelling process are incorrect. The ERG was unable to correct all of these mistakes and the impact on the model results is therefore unknown. The National Institute for Health and Clinical Excellence guidance issued as a result of the STA states that DBG is recommended as an option for the primary prevention of VTE events in adults who have undergone elective total hip or knee replacement surgery.

How valid and responsive are generic health status measures, such as EQ-5D and SF-36, in schizophrenia? A systematic review.

Objectives Generic health status measures such as the short form health survey (SF-36) and EuroQol-5D (EQ-5D) are increasingly being used to inform health policy. They are claimed to be applicable across disease areas and have started to be used within mental health research. This review aims to assess the construct validity and responsiveness of four generic health status measures in schizophrenia, including the preference-based SF-6D and EQ-5D. Method A systematic review of the literature was undertaken. Ten databases were searched from inception to August 2009 and reference lists scrutinized to identify relevant studies. Studies were appraised and data extracted. A narrative synthesis was performed of the evidence on construct validity including known groups validity (detecting a difference in health-related quality of life (HRQL) scores between two different groups such as samples from the general population and people with schizophrenia), convergent validity (strength of association between generic HRQL and other measures (e.g., symptom or functional), and responsiveness. Responsiveness was considered by: 1) differences in generic HRQL measure scores in responders/non-responders and 2) correlation between changes on generic HRQL measures and changes in specific measures obtained from patients and clinicians. Results Thirty-three studies were identified that provided data on the validity and/or responsiveness of the instruments. Most of the evidence concerns the SF-36 and EQ-5D, and for these instruments there was evidence for known group validity. The evidence for convergent validity and responsiveness was mixed, with studies presenting contradictory results. Conclusion Although the evidence base is limited in a number of important respects, including problems with the measures used to develop constructs in the validation studies, it is sufficient to raise doubts about the use of generic measures of health like the EQ-5D and SF-36 in patients with schizophrenia.

A systematic review, psychometric analysis and qualitative assessment of generic preference-based measures of health in mental health populations and the estimation of mapping functions from widely used specific measures

BACKGROUND Generic preference-based measures of health like the EQ-5D and SF-6D(®) are increasingly being used in economic evaluation and outcome assessment. However, there are concerns as to whether or not these generic measures are appropriate for use in people with mental health problems. OBJECTIVES The EQ-5D and SF-36(®) (including its derivatives the SF-12(®) and SF-6D) were assessed using the psychometric criteria of validity and responsiveness using quantitative and qualitative methods. Another aim was to estimate mapping functions between the EQ-5D and SF-6D and condition-specific measures, where appropriate. DESIGN Four studies were undertaken to examine the appropriateness of the measures: (1) a systematic review of quantitative evidence on validity and responsiveness; (2) a further quantitative assessment of these criteria using existing data sets; (3) a review of qualitative research on the quality of life of people with mental health problems; and (4) qualitative semistructured interviews of people with a full range of problems. A fifth study estimated mapping functions between mental health-specific measures and the EQ-5D and SF-6D. SETTING A choice of venue was offered for the interviews including the participants own home, a room at the university or a centre frequently used by mental health services. PARTICIPANTS The interviews were undertaken with 19 people with a broad range of mental health problems at varying levels of severity. MAIN OUTCOME MEASURES The reviews included the EQ-5D and SF-36 (and the SF-12 and SF-6D). The psychometric analysis included the Hospital Anxiety and Depression Scale (HADS), Clinical Outcomes in Routine Evaluation - Outcome Measure (CORE-OM), Generalised Anxiety Disorder Assessment (GAD-7), General Health Questionnaire (GHQ-12) and Patient Health Questionnaire (PHQ-9). RESULTS (1) and (2) The EQ-5D and SF-36 achieved an adequate level of performance in depression, and to some extent in anxiety and personality disorder. Results from the psychometric analyses in schizophrenia and bipolar disorder have been more mixed. (3) A framework analysis of 13 studies identified six major themes. (4) The interview data fitted the themes from the review well and resulted in minor modifications to the themes. The final set of themes comprised: well-being and ill-being; control, autonomy and choice; self-perception; belonging; activity; hope and hopelessness; and physical health. CONCLUSIONS The EQ-5D and SF-36 achieved mixed results in the quantitative testing against psychometric criteria. The qualitative analysis suggests this is because they provide a very limited coverage of themes identified by people with mental health problems. Recommendations for future work include the development of new preference-based measures in mental health that are based on, or substantially revise, an existing measure. FUNDING The Medical Research Council.

Supplemental calcium in the chemoprevention of colorectal cancer: a systematic review and meta-analysis

OBJECTIVE The aim of the review was to assess the evidence for the effectiveness of calcium in reducing the recurrence of adenomas and the occurrence of colorectal cancer among populations at high, intermediate, and low risk of the disease. METHODS A systematic review of randomized controlled trials (RCTs) was performed to compare calcium alone, and with other agents, versus placebo. Nine databases (Cochrane Library, MEDLINE, PreMEDLINE, CINAHL, EMBASE, Web of Science, Biological Abstracts, the National Research Register, and Current Controlled Trials) were searched for published and unpublished trials. Searches were not restricted by either language or date of publication. All searches were completed in January 2010. Database thesaurus and free text terms for calcium and adenomas or colorectal cancer were used to search for trial reports; additional terms were used to search for other agents of interest, such as NSAIDs and folic acid. Search terms consisted of a combination of terms for colorectal cancer (eg, colon or colorectal and neoplasm or cancer or adenoma) and terms for calcium and RCTs. The initial searches were conducted in June 2008, with update searches in January 2010 to identify more recent studies. The reference lists of relevant studies were also searched for additional papers not identified by the search of electronic databases. Studies had to satisfy the following criteria to be included: RCTs about calcium, with or without other chemopreventive agents, in adults with familial adenomatous polyposis (FAP), hereditary nonpolyposis colorectal cancer, or a history of colorectal adenomas, or with no increased baseline risk of colorectal cancer. Meta-analysis was performed. For discrete and numerical outcomes, relative risks (RRs) and risk differences were reported with 95% CIs. The random-effects model was used to account for clinical and methodologic variations between trials. RESULTS The original and update searches of electronic databases produced 3835 citations, of which 6 studies (8 papers) met the inclusion criteria. Supplemental calcium had no effect on the number of adenomas in 1 small trial of patients with FAP. Meta-analysis of 3 trials in individuals with a history of adenomas showed a statistically significant reduction in the RR for adenoma recurrence (RR = 0.80 [95% CI, 0.69-0.94], P = 0.006) for those receiving calcium 1200 to 2000 mg/d, but no effect was seen in advanced adenoma (RR = 0.77 [95% CI, 0.501.17], P = NS). Meta-analysis of 2 trials in populations with no increased baseline risk for colorectal cancer suggested that calcium, with or without vitamin D, had no effect on the RR for colorectal cancer (RR = 0.62 [95% CI, 0.11-3.40], P = NS). CONCLUSION Published reports indicated that supplemental calcium was effective for the prevention of adenoma recurrence in populations with a history of adenomas, but no similar effect was apparent in populations at higher or lower risk.

Magnetic Resonance for assessment of axillary lymph node status in early breast cancer: a systematic review and meta-analysis

INTRODUCTION Current methods of identifying axillary node metastases in breast cancer patients are highly accurate, but are associated with several adverse events. This review evaluates the diagnostic accuracy of magnetic resonance imaging (MRI) techniques for identification of axillary metastases in early stage newly diagnosed breast cancer patients. METHODS Comprehensive searches were conducted in April 2009. Study quality was assessed. Sensitivity and specificity were meta-analysed using a bivariate random effects approach, utilising pathological diagnosis via node biopsy as the comparative gold standard. RESULTS Based on the highest sensitivity and specificity reported in each of the nine studies evaluating MRI (n = 307 patients), mean sensitivity was 90% (95% CI: 78-96%; range 65-100%) and mean specificity 90% (95% CI: 75-96%; range 54-100%). Across five studies evaluating ultrasmall super-paramagnetic iron oxide (USPIO)-enhanced MRI (n = 93), mean sensitivity was 98% (95% CI: 61-100%) and mean specificity 96% (95% CI: 72-100%). Across three studies of gadolinium-enhanced MRI (n = 187), mean sensitivity was 88% (95% CI: 78-94%) and mean specificity 73% (95% CI: 63-81%). In the single study of in-vivo proton MR spectroscopy (n = 27), sensitivity was 65% (95% CI: 38-86%) and specificity 100% (95% CI: 69-100%). CONCLUSIONS USPIO-enhanced MRI showed a trend towards higher sensitivity and specificity and may make a useful addition to the current diagnostic pathway. Additional larger studies with standardised methods and standardised criteria for classifying a node as positive are needed. Current estimates of sensitivity and specificity do not support replacement of SLNB with any current MRI technology in this patient group.

Positron Emission Tomography (PET) and Magnetic Resonance Imaging (MRI) for the Assessment of Axillary Lymph Node Metastases in Early Breast Cancer: Systematic Review and Economic Evaluation

BACKGROUND Breast cancer is the most common type of cancer in women. Evaluation of axillary lymph node metastases is important for breast cancer staging and treatment planning. OBJECTIVES To evaluate the diagnostic accuracy, cost-effectiveness and effect on patient outcomes of positron emission tomography (PET), with or without computed tomography (CT), and magnetic resonance imaging (MRI) in the evaluation of axillary lymph node metastases in patients with newly diagnosed early-stage breast cancer. DATA SOURCES A systematic review of literature and an economic evaluation were carried out. Key databases (including MEDLINE, EMBASE and nine others) plus research registers and conference proceedings were searched for relevant studies up to April 2009. A decision-analytical model was developed to determine cost-effectiveness in the UK. REVIEW METHODS One reviewer assessed titles and abstracts of studies identified by the search strategy, obtained the full text of relevant papers and screened them against inclusion criteria. Data from included studies were extracted by one reviewer using a standardised data extraction form and checked by a second reviewer. Discrepancies were resolved by discussion. Quality of included studies was assessed using the quality assessment of diagnostic accuracy studies (QUADAS) checklist, applied by one reviewer and checked by a second. RESULTS Forty-five citations relating to 35 studies were included in the clinical effectiveness review: 26 studies of PET and nine studies of MRI. Two studies were included in the cost-effectiveness review: one of PET and one of MRI. Of the seven studies evaluating PET/CT (n = 862), the mean sensitivity was 56% [95% confidence interval (CI) 44% to 67%] and mean specificity 96% (95% CI 90% to 99%). Of the 19 studies evaluating PET only (n = 1729), the mean sensitivity was 66% (95% CI 50% to 79%) and mean specificity 93% (95% CI 89% to 96%). PET performed less well for small metastases; the mean sensitivity was 11% (95% CI 5% to 22%) for micrometastases (≤ 2 mm; five studies; n = 63), and 57% (95% CI 47% to 66%) for macrometastases (> 2 mm; four studies; n = 111). The smallest metastatic nodes detected by PET measured 3 mm, while PET failed to detect some nodes measuring > 15 mm. Studies in which all patients were clinically node negative showed a trend towards lower sensitivity of PET compared with studies with a mixed population. Across five studies evaluating ultrasmall super-paramagnetic iron oxide (USPIO)-enhanced MRI (n = 93), the mean sensitivity was 98% (95% CI 61% to 100%) and mean specificity 96% (95% CI 72% to 100%). Across three studies of gadolinium-enhanced MRI (n = 187), the mean sensitivity was 88% (95% CI 78% to 94%) and mean specificity 73% (95% CI 63% to 81%). In the single study of in vivo proton magnetic resonance spectroscopy (n = 27), the sensitivity was 65% (95% CI 38% to 86%) and specificity 100% (95% CI 69% to 100%). USPIO-enhanced MRI showed a trend towards higher sensitivity and specificity than gadolinium-enhanced MRI. Results of the decision modelling suggest that the MRI replacement strategy is the most cost-effective strategy and dominates the baseline 4-node sampling (4-NS) and sentinel lymph node biopsy (SLNB) strategies in most sensitivity analyses undertaken. The PET replacement strategy is not as robust as the MRI replacement strategy, as its cost-effectiveness is significantly affected by the utility decrement for lymphoedema and the probability of relapse for false-negative (FN) patients. LIMITATIONS No included studies directly compared PET and MRI. CONCLUSIONS Studies demonstrated that PET and MRI have lower sensitivity and specificity than SLNB and 4-NS but are associated with fewer adverse events. Included studies indicated a significantly higher mean sensitivity for MRI than for PET, with USPIO-enhanced MRI providing the highest sensitivity. However, sensitivity and specificity of PET and MRI varied widely between studies, and MRI studies were relatively small and varied in their methods; therefore, results should be interpreted with caution. Decision modelling based on these results suggests that the most cost-effective strategy may be MRI rather than SLNB or 4-NS. This strategy reduces costs and increases quality-adjusted life-years (QALYs) because there are fewer adverse events for the majority of patients. However, this strategy leads to more FN cases at higher risk of cancer recurrence and more false- positive (FP) cases who would undergo unnecessary axillary lymph node dissection. Adding MRI prior to SLNB or 4-NS has little effect on QALYs, though this analysis is limited by lack of available data. Future research should include large, well-conducted studies of MRI, particularly using USPIO; data on the long-term impacts of lymphoedema on cost and patient utility; studies of the comparative effectiveness and cost-effectiveness of SLNB and 4-NS; and more robust UK cost data for 4-NS and SLNB as well as the cost of MRI and PET techniques. FUNDING This study was funded by the Health Technology Assessment programme of the National Institute of Health Research.

Factors associated with outcomes for looked-after children and young people: a correlates review of the literature.

In 2008, the Department of Health made a referral to the National Institute for Health and Clinical Excellence and the Social Care Institute for Excellence to develop joint public health guidance on improving the physical and emotional health and well-being of children and young people looked after by the local authority/state. To help inform the decision-making process by identifying potential research questions pertinent to the outcomes of looked-after children and young people (LACYP), a correlates review was undertaken. Iterative searches of health and social science databases were undertaken; searches of reference lists and citation searches were conducted and all included studies were critically appraised. The correlates review is a mapping review conducted using systematic and transparent methodology. Interventions and factors that are associated (or correlated) with outcomes for LACYP were identified and presented as conceptual maps. This review maps the breadth (rather than depth) of the evidence and represents an attempt to use the existing evidence base to map associations between potential risk factors, protective factors, interventions and outcomes for LACYP. Ninety-two studies were included: four systematic reviews, five non-systematic reviews, eight randomized controlled trials, 66 cohort studies and nine cross-sectional studies. The conceptual maps provide an overview of the key relationships addressed in the current literature, in particular, placement stability and emotional and behavioural factors in mediating outcomes. From the maps, there appear to be some key factors that are associated with a range of outcomes, in particular, number of placements, behavioural problems and age at first placement. Placement stability seems to be a key mediator of directional associations. The correlates review identified key areas where sufficient evidence to conduct a systematic review might exist. These were: transition support, training and support for carers and access to services.

Antioxidants in the chemoprevention of colorectal cancer and colorectal adenomas in the general population: a systematic review and meta‐analysis

Aim  Antioxidants, such as vitamin A, C and E, selenium and β‐carotene, have been proposed as possible agents in the chemoprevention of colorectal cancer and have been the subject of recent trials and reviews. This review aimed to assess the present evidence on the effect of antioxidants on the incidence of colorectal neoplasms in the general population.