Ruth Garside

Using qualitative evidence in decision making for health and social interventions: an approach to assess confidence in findings from qualitative evidence syntheses (GRADE-CERQual).

Simon Lewin and colleagues present a methodology for increasing transparency and confidence in qualitative research synthesis.

The harmful health effects of recreational ecstasy: a systematic review of observational evidence

OBJECTIVES To investigate the harmful health effects of taking ecstasy (3,4-methylenedioxymethamphetamine, MDMA) for recreational purposes. DATA SOURCES MEDLINE, EMBASE, PsycINFO and Web of Knowledge were searched. Additional information on deaths was collected from the General Mortality Register (GMR) and the Special Mortality Register collated by the National Programme on Substance Abuse Deaths (np-SAD). REVIEW METHODS Studies were categorised according to design, with systematic research syntheses (Level I evidence) the most valid and least open to bias. Where Level I evidence was not available, controlled observational studies (Level II evidence) were systematically reviewed. If neither Level I nor Level II evidence was available, uncontrolled case series and case reports (Level III evidence) were systematically surveyed. Data were extracted by one reviewer and a sample checked by a second. The heterogeneity of Level II evidence was addressed by undertaking stratified analyses for current and former ecstasy users and comparing them either with control groups using other illegal drugs but not ecstasy (polydrug controls) or with controls naïve to illegal drugs (drug-naïve controls). Statistical heterogeneity was minimised by using a random-effects model throughout and investigated using study-level regression analysis (metaregression). RESULTS Five Level I syntheses were identified; for each it was difficult to ascertain the exact methods adopted and evidence included. Small but significant deficits for ecstasy users compared to controls were reported in areas relating to attention, memory, psychomotor speed, executive systems functioning, and self-reported depressive symptoms. Data from Level II studies were directly pooled for seven individual outcomes, suggesting that ecstasy users performed worse than controls on common measures of immediate and delayed verbal recall (RAVLT, RBMT, digit span). No difference was seen in IQ (NART). The 915 outcome measures identified in Level II studies were analysed in broad domains: immediate and delayed verbal and visual memory, working memory, two measures of attention, three measures of executive function, perceptual organisation, self-rated depression, memory and anxiety, and impulsivity measured objectively and subjectively. Ecstasy users performed significantly worse than polydrug controls in 13/16 domains and significantly worse than drug-naïve controls in 7/12 domains for which sufficient data were available. The largest, most consistent exposure effects were seen in meta-analyses of memory (especially verbal and working memory, with less marked effects seen in visual memory). Former ecstasy users frequently showed deficits that matched or exceeded those seen amongst current users. At aggregate level, the effects do not appear to be dose-related, but are variably confounded by other drug use, particularly alcohol. Of Level III evidence, in the 10 years to 2006, the np-SAD and the GMR recorded an average of around 50 drug-related deaths per year involving ecstasy; it was the sole drug implicated in around 10 cases per year. Retrospective case series, based on hospital emergency department records, reported a death rate of 0-2% from emergency admissions related to ecstasy. Two major syndromes are most commonly reported as the immediate cause of death in fatal cases: hyperthermia and hyponatraemia. CONCLUSIONS A broad range of relatively low-quality literature suggests that recreational use of ecstasy is associated with significant deficits in neurocognitive function (particularly immediate and delayed verbal memory) and increased psychopathological symptoms. The clinical significance of the exposure effect in individual cases will be variable but, on average, deficits are likely to be relatively small. Ecstasy is associated with a range of acute harms but appears to be a rare cause of death in isolation.OBJECTIVES To provide an evidence-based perspective on the prognostic value of novel markers in localised prostate cancer and to identify the best prognostic model including the three classical markers and investigate whether models incorporating novel markers are better. DATA SOURCES Eight electronic bibliographic databases were searched during March-April 2007. The reference lists of relevant articles were checked and various health services research-related resources consulted via the internet. The search was restricted to publications from 1970 onwards in the English language. METHODS Selected studies were assessed, data extracted using a standard template, and quality assessed using an adaptation of published criteria. Because of the heterogeneity regarding populations, outcomes and study type, meta-analyses were not undertaken and the results are presented in tabulated format with a narrative synthesis of the results. RESULTS In total 30 papers met the inclusion criteria, of which 28 reported on prognostic novel markers and five on prognostic models. A total of 21 novel markers were identified from the 28 novel marker studies. There was considerable variability in the results reported, the quality of the studies was generally poor and there was a shortage of studies in some categories. The marker with the strongest evidence for its prognostic significance was prostate-specific antigen (PSA) velocity (or doubling time). There was a particularly strong association between PSA velocity and prostate cancer death in both clinical and pathological models. In the clinical model the hazard ratio for death from prostate cancer was 9.8 (95% CI 2.8-34.3, p < 0.001) in men with an annual PSA velocity of more than 2 ng/ml versus an annual PSA velocity of 2 ng/ml or less; similarly, the hazard ratio was 12.8 (95% CI 3.7-43.7, p < 0.001) in the pathological model. The quality of the prognostic model studies was adequate and overall better than the quality of the prognostic marker studies. Two issues were poorly dealt with in most or all of the prognostic model studies: inclusion of established markers and consideration of the possible biases from study attrition. Given the heterogeneity of the models, they cannot be considered comparable. Only two models did not include a novel marker, and one of these included several demographic and co-morbidity variables to predict all-cause mortality. Only two models reported a measure of model performance, the C-statistic, and for neither was it calculated in an external data set. It was not possible to assess whether the models that included novel markers performed better than those without. CONCLUSIONS This review highlighted the poor quality and heterogeneity of studies, which render much of the results inconclusive. It also pinpointed the small proportion of models reported in the literature that are based on patient cohorts with a mean or median follow-up of at least 5 years, thus making long-term predictions unreliable. PSA velocity, however, stood out in terms of the strength of the evidence supporting its prognostic value and the relatively high hazard ratios. There is great interest in PSA velocity as a monitoring tool for active surveillance but there is as yet no consensus on how it should be used and, in particular, what threshold should indicate the need for radical treatment.

Comparison of treatment effect sizes associated with surrogate and final patient relevant outcomes in randomised controlled trials: meta-epidemiological study

Objective To quantify and compare the treatment effect and risk of bias of trials reporting biomarkers or intermediate outcomes (surrogate outcomes) versus trials using final patient relevant primary outcomes. Design Meta-epidemiological study. Data sources All randomised clinical trials published in 2005 and 2006 in six high impact medical journals: Annals of Internal Medicine, BMJ, Journal of the American Medical Association, Lancet, New England Journal of Medicine, and PLoS Medicine. Study selection Two independent reviewers selected trials. Data extraction Trial characteristics, risk of bias, and outcomes were recorded according to a predefined form. Two reviewers independently checked data extraction. The ratio of odds ratios was used to quantify the degree of difference in treatment effects between the trials using surrogate outcomes and those using patient relevant outcomes, also adjusted for trial characteristics. A ratio of odds ratios >1.0 implies that trials with surrogate outcomes report larger intervention effects than trials with patient relevant outcomes. Results 84 trials using surrogate outcomes and 101 using patient relevant outcomes were considered for analyses. Study characteristics of trials using surrogate outcomes and those using patient relevant outcomes were well balanced, except for median sample size (371 v 741) and single centre status (23% v 9%). Their risk of bias did not differ. Primary analysis showed trials reporting surrogate endpoints to have larger treatment effects (odds ratio 0.51, 95% confidence interval 0.42 to 0.60) than trials reporting patient relevant outcomes (0.76, 0.70 to 0.82), with an unadjusted ratio of odds ratios of 1.47 (1.07 to 2.01) and adjusted ratio of odds ratios of 1.46 (1.05 to 2.04). This result was consistent across sensitivity and secondary analyses. Conclusions Trials reporting surrogate primary outcomes are more likely to report larger treatment effects than trials reporting final patient relevant primary outcomes. This finding was not explained by differences in the risk of bias or characteristics of the two groups of trials.

An open letter to The BMJ editors on qualitative research

Seventy six senior academics from 11 countries invite The BMJ ’s editors to reconsider their policy of rejecting qualitative research on the grounds of low priority. They challenge the journal to develop a proactive, scholarly, and pluralist approach to research that aligns with its stated mission

Endoscopic Sinus Surgery for the Excision of Nasal Polyps: A Systematic Review of Safety and Effectiveness:

Background Functional endoscopic sinus surgery (FESS) has been used for >20 years for the management of sinus disease including the excision of nasal polyps. Our objective was to perform a systematic review of safety and effectiveness of FESS for the removal of nasal polyps. Methods The Cochrane Library, MEDLINE, Embase, Science Citation Index, other databases, and websites were searched in January and December 2005 using key words for nasal polyps and endoscopic surgery. All randomized controlled trials, nonrandomized comparative studies, and case series studies that described outcomes associated with FESS for the excision of nasal polyps were included. Forty-two publications were included from the 632 (6.6%) articles initially identified. Two reviewers assessed validity of included studies and extracted relevant data. Results Three randomized controlled trials, 4 nonrandomized comparative studies, and 35 case series studies were included in the review. FESS was compared with endoscopic polypectomy, Caldwell-Luc, radical nasalization, and intranasal ethmoidectomy. In general, studies were of poor quality and lacked description of important variables influencing surgical outcome. Overall complications for FESS from case series studies ranged from 0.3 to 22.4% (median, 7.0%). Major complications ranged from 0 to 1.5% (median, 0%) and minor complications ranged from 1.1 to 20.8% (median, 7.5%). The potentially most serious complications were cerebrospinal fluid leaks, injury to the internal carotid artery, dural exposure, meningitis, bleeding requiring transfusion, periorbital/orbital fat exposure, and orbital penetration. Symptomatic improvement ranged from 78 to 88% for FESS compared with 43 to 84% for comparative procedures. From case series, symptomatic improvement ranged from 40 to 98% (median, 88%). Conclusion FESS may offer some advantages in safety and effectiveness over comparative techniques, but wide variation in reported results and methodological shortcomings of studies limit the certainty of these conclusions. Wide variation in complication rates suggests the need for audit of existing practice. Additional high-quality studies with a fuller description of potential confounding factors and effect modifiers will help to define the effectiveness of FESS more clearly.

Factors influencing the implementation of fall-prevention programmes: a systematic review and synthesis of qualitative studies.

BackgroundMore than a third of people over the age of 65 years fall each year. Falling can lead to a reduction in quality of life, mortality, and a risk of prolonged hospitalisation. Reducing and preventing falls has become an international health priority. To help understand why research evidence has often not been translated into changes in clinical practice, we undertook a systematic review and synthesis of qualitative research in order to identify what factors serve as barriers and facilitators to the successful implementation of fall-prevention programmes.MethodsWe conducted a review of literature published between 1980 and January 2012 for qualitative research studies that examined barriers and facilitators to the effective implementation of fall-prevention interventions among community-dwelling older people and healthcare professionals. Two reviewers independently screened studies for inclusion, extracted data, and assessed methodological quality according to predefined criteria. Findings were synthesised using meta-ethnography.ResultsOf the 5010 articles identified through database searching, 19 were included in the review. Analysis of the 19 studies revealed limited information about the mechanisms by which barriers to implementation of fall-prevention interventions had been overcome. Data synthesis produced three overarching concepts: (1) practical considerations, (2) adapting for community, and (3) psychosocial. A line of argument synthesis describes the barriers and facilitators to the successful implementation of fall-prevention programmes. These concepts show that the implementation of fall-prevention programmes is complex and multifactorial. This is the first systematic review and synthesis of qualitative studies to examine factors influencing the implementation of fall-prevention programmes from the perspectives of both the healthcare professional and the community-dwelling older person.ConclusionsThe current literature on barriers and facilitators to the implementation of fall-prevention programmes examines a variety of interventions. However, the ways in which the interventions are reported suggests there are substantial methodological challenges that often inhibit implementation into practice. We recommend that successful implementation requires individuals, professionals, and organisations to modify established behaviours, thoughts, and practice. The issues identified through this synthesis need to be fully considered and addressed if fall-prevention programmes are to be successfully implemented into clinical practice.

A cost–utility analysis of microwave and thermal balloon endometrial ablation techniques for the treatment of heavy menstrual bleeding

Objective  To assess the cost effectiveness of the second‐generation surgical treatments for heavy menstrual bleeding (microwave and thermal balloon endometrial ablation) compared with existing endometrial ablation techniques (transcervical resection and rollerball, alone or in combination) and hysterectomy.

Human recreational exposure to antibiotic resistant bacteria in coastal bathing waters

Infections caused by antibiotic resistant bacteria (ARB) are associated with poor health outcomes and are recognised globally as a serious health problem. Much research has been conducted on the transmission of ARB to humans. Yet the role the natural environment plays in the spread of ARB and antibiotic resistance genes is not well understood. Antibiotic resistant bacteria have been detected in natural aquatic environments, and ingestion of seawater during water sports is one route by which many people could be directly exposed. The aim was to estimate the prevalence of resistance to one clinically important class of antibiotics (third-generation cephalosporins (3GCs)) amongst Escherichia coli in coastal surface waters in England and Wales. Prevalence data was used to quantify ingestion of 3GC-resistant E. coli (3GCREC) by people participating in water sports in designated coastal bathing waters. A further aim was to use this value to derive a population-level estimate of exposure to these bacteria during recreational use of coastal waters in 2012. The prevalence of 3GC-resistance amongst E. coli isolated from coastal surface waters was estimated using culture-based methods. This was combined with the density of E. coli reported in designated coastal bathing waters along with estimations of the volumes of water ingested during various water sports reported in the literature to calculate the mean number of 3GCREC ingested during different water sports. 0.12% of E. coli isolated from surface waters were resistant to 3GCs. This value was used to estimate that in England and Wales over 6.3 million water sport sessions occurred in 2012 that resulted in the ingestion of at least one 3GCREC. Despite the low prevalence of resistance to 3GCs amongst E. coli in surface waters, there is an identifiable human exposure risk for water users, which varies with the type of water sport undertaken. The relative importance of this exposure is likely to be greater in areas where a large proportion of the population enjoys water sports. Millions of water sport sessions occurred in 2012 that were likely to have resulted in people ingesting E. coli resistant to a single class of antibiotics (3GCs). However, this is expected to be a significant underestimate of recreational exposure to all ARB in seawater. This is the first study to use volumes of water ingested during different water sports to estimate human exposure to ARB. Further work needs to be done to elucidate the health implications and clinical relevance of exposure to ARB in both marine and fresh waters in order to fully understand the risk to public health.

Anonymity and confidentiality: Rural teenagers' concerns when accessing sexual health services

Context While confidentiality is recognised as a key aspect of successful health services aimed at young people, most research has looked at the concerns of those in urban centres. This paper reports on qualitative and quantitative data collected from general practitioners (GPs) and young people in a rural health district. Objective To assess the concerns of rural teenagers regarding anonymity and confidentiality when accessing sexual health services. Design The views of teenagers about using health services for issues of sexual health were sought through an in-school survey of 311 Year 9 and 119 Year 11 students. In addition, 18 single-sex focus groups discussions were conducted in North and East Devon. All GPs in the district were asked to complete a questionnaire. Results These reveal that the particular concerns of young people from small communities are more to do with the difficulties of remaining anonymous, which are related to visibility and lack of privacy in small communities. These problems were more pervasive among rural young people than those concerns more usually reported about confidential consultations.

Vaginal practices as women's agency in sub-Saharan Africa: a synthesis of meaning and motivation through meta-ethnography

This paper reports on a systematic review of qualitative research about vaginal practices in sub-Saharan Africa, which used meta-ethnographic methods to understand their origins, their meanings for the women who use them, and how they have evolved in time and place. We included published documents which were based on qualitative methods of data collection and analysis and contained information on vaginal practices. After screening, 16 texts were included which dated from 1951 to 2008. We found that practices evolve and adapt to present circumstances and that they remain an important source of power for women to negotiate challenges that they face. Recent evidence suggests that some practices may increase a womans susceptibility to HIV and other sexually transmitted infections. The success of new female-controlled prevention technologies, such as microbicides, might be determined by whether they can and will be used by women in the course of their daily life.