Carolyn J. Green

Beyond Medline: reducing bias through extended systematic review search.

OBJECTIVE To evaluate the sensitivity and precision of various extended search methods in identifying randomized controlled trials (RCTs) for systematic reviews. METHOD Prospective analysis of extended search methods (specialized databases or trial registries, reference lists, hand-searching, personal communication, and Internet) used in two systematic reviews of RCTs. The gold standard was the total number of RCTs identified by major databases (MEDLINE, EMBASE, etc.) and extended search strategies combined. Sensitivity was the proportion of all known RCTs identified by any extended search method. Precision reflected the proportion of all items uncovered by any extended search method that actually were RCTs. RESULTS The extended search identified 94 additional RCTs for the systematic reviews beyond those identified with the major databases. Specialized databases and trial registries had the highest sensitivity and precision for the lipid-lowering project (13.6% and 52.7%, respectively; p < .05) followed by scanning of reference lists (7.2% sensitivity and 41.9% precision; p <.05). Hand-searching was more effective than personal communication and Internet searching (1.7% sensitivity and 12.2% precision; p < .05). The acupuncture project had slightly different results, with the specialized databases and trial registries tied with the review of reference lists for highest sensitivity (14.2%). The precision followed the same trend as the lipid-lowering project (17.6% specialized databases; 8.3% reference lists; p < .05). A post-hoc analysis showed that 75 of the 94 RCTs were indexed in the major databases but missed by the major database search. CONCLUSIONS Extended searching identified additional RCTs for the systematic reviews beyond those found in major databases. Specialized databases and trial registries were most effective. An important number of RCTs were missed by the major database search. Timing and accuracy of indexing may explain this finding. The definitive measure, whether there is an association between the method used to uncover RCTs, the quality of the items uncovered and their impact on systematic review results, is yet to be determined.

A systematic review of craniosacral therapy: Biological plausibility, assessment reliability and clinical effectiveness

OBJECTIVES The objective of this research was to review critically the scientific basis of craniosacral therapy as a therapeutic intervention. DESIGN A systematic search for and critical appraisal of research on craniosacral therapy was conducted. Medline, Embase, Healthstar, Mantis, Allied and Alternative Medicine, Scisearch and Biosis were searched from their start date to February 1999. MAIN OUTCOME MEASURES A three-dimensional evaluative framework with related appraisal criteria: (A) craniosacral interventions and health outcomes; (B) validity of craniosacral assessment; and (C) pathophysiology of the craniosacral system. RESULTS The available research on craniosacral treatment effectiveness constitutes low-grade evidence conducted using inadequate research protocols. One study reported negative side effects in outpatients with traumatic brain injury. Low inter-rater reliability ratings were found. CONCLUSIONS This systematic review and critical appraisal found insufficient evidence to support craniosacral therapy. Research methods that could conclusively evaluate effectiveness have not been applied to date.

Systematic review of the role of gender as a health determinant of hospitalization for depression.

OBJECTIVES To conduct a systematic review of selected health determinants, including gender, and their impact on hospitalization rates for depression. Depression includes both depressive and bipolar disorders. Selected health determinants were gender, age, sex, family structure, education, and socioeconomic status. METHODS Systematic search of conventional and fugitive literature sources. All reports of primary data, systematic reviews, and meta-analysis of primary data were included if they focused on hospitalization for depression and reported data by one or more of the selected health determinants. Two researchers independently evaluated each citation for inclusion and extracted data from the included studies. RESULTS There is an important underreporting of health determinants data in studies of hospitalization for depression. No studies examined the role of gender. Age and sex were reported in 83 percent and 80 percent of the 110 included studies. Women showed a higher rate of hospitalization for depression than men (p < .05). Age and diagnosis had different effects in men and women. Adult women were significantly more likely than men to report a depressive disorder, whereas men were more likely to report a bipolar disorder (p < .05). Little can be concluded on the other health determinants. CONCLUSIONS The importance of reporting hospitalization data and conducting hospital utilization analysis by sex and health determinants, including gender, must be emphasized.

Improving population health or the population itself? Health technology assessment and our genetic future.

The province of British Columbia (BC), Canada is developing its first population-wide prenatal genetic screening program, known as triple-marker screening (TMS). TMS, initiated with a simple blood test, is most commonly used to screen for fetuses with the chromosomal abnormality known as Down syndrome or neural tube disorders. Women testing TMS-positive are offered diagnostic amniocentesis and, if the diagnosis is confirmed, selective second-trimester abortion. The project described in this study was initiated to address the broad range of issues arising from this testing technology and provides an example of the new type of health technology assessment (HTA) contribution emerging (and likely to become increasing necessary) in health policy development. With the advent of prenatal genetic screening programs, would-be parents gain the promise of identifying target conditions and, hence, the option of selective abortion of affected fetuses. There is considerable awareness that these developments pose challenges in every dimension (ethical, political, economic, and clinical) of the health-care environment. In the effort to construct an appropriate prenatal screening policy, therefore, administrators have understandably sought guidance from within the field of HTA. The report authors concluded that, within the restricted path open to it, the role of government is relatively clear. It has the responsibility to maintain equal access to prenatal testing, as to any other health service. It should also require maintenance of medical standards and evaluation of program performance. At the same time, policy-makers need actively to support those individuals born with disabilities and their families.

Will This Hospitalized Patient Develop Severe Alcohol Withdrawal Syndrome?: The Rational Clinical Examination Systematic Review.

Importance Although severe alcohol withdrawal syndrome (SAWS) is associated with substantial morbidity and mortality, most at-risk patients will not develop this syndrome. Predicting its occurrence is important because the mortality rate is high when untreated. Objective To assess the accuracy and predictive value of symptoms and signs for identifying hospitalized patients at risk of SAWS, defined as delirium tremens, withdrawal seizure, or clinically diagnosed severe withdrawal. Data Sources MEDLINE and EMBASE (1946-January 2018) were searched for articles investigating symptoms and signs predictive of SAWS in adults. Reference lists of retrieved articles were also searched. Study Selection Original studies that were included compared symptoms, signs, and risk assessment tools among patients who developed SAWS and patients who did not. Data Extraction and Synthesis Data were extracted and used to calculate likelihood ratios (LRs), sensitivity, and specificity. A meta-analysis was performed to calculate summary LR. Results Of 530 identified studies, 14 high-quality studies that included 71 295 patients and 1355 relevant cases of SAWS (1051 cases), seizure (53 cases), or delirium tremens (251 cases) were analyzed. A history of delirium tremens (LR, 2.9 [95% CI 1.7-5.2]) and baseline systolic blood pressure 140 mm Hg or higher (LR, 1.7 [95% CI, 1.3-2.3) were associated with an increased likelihood of SAWS. No single symptom or sign was associated with exclusion of SAWS. Six high-quality studies evaluated combinations of clinical findings and were useful for identifying patients in acute care facilities at high risk of developing SAWS. Of these combinations, the Prediction of Alcohol Withdrawal Severity Scale (PAWSS) was most useful, with an LR of 174 (95% CI, 43-696; specificity, 0.93) when patients had 4 or more individual findings and an LR of 0.07 (95% CI, 0.02-0.26; sensitivity, 0.99) when there were 3 or fewer findings. Conclusions and Relevance Assessment tools that use a combination of symptoms and signs are useful for identifying patients at risk of developing severe alcohol withdrawal syndrome. Most studies of these tools were not fully validated, limiting their generalizability.