Amy T. Wang

Technology-Enhanced Simulation for Health Professions Education: A Systematic Review and Meta-analysis

CONTEXT Although technology-enhanced simulation has widespread appeal, its effectiveness remains uncertain. A comprehensive synthesis of evidence may inform the use of simulation in health professions education. OBJECTIVE To summarize the outcomes of technology-enhanced simulation training for health professions learners in comparison with no intervention. DATA SOURCE Systematic search of MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, Scopus, key journals, and previous review bibliographies through May 2011. STUDY SELECTION Original research in any language evaluating simulation compared with no intervention for training practicing and student physicians, nurses, dentists, and other health care professionals. DATA EXTRACTION Reviewers working in duplicate evaluated quality and abstracted information on learners, instructional design (curricular integration, distributing training over multiple days, feedback, mastery learning, and repetitive practice), and outcomes. We coded skills (performance in a test setting) separately for time, process, and product measures, and similarly classified patient care behaviors. DATA SYNTHESIS From a pool of 10,903 articles, we identified 609 eligible studies enrolling 35,226 trainees. Of these, 137 were randomized studies, 67 were nonrandomized studies with 2 or more groups, and 405 used a single-group pretest-posttest design. We pooled effect sizes using random effects. Heterogeneity was large (I(2)>50%) in all main analyses. In comparison with no intervention, pooled effect sizes were 1.20 (95% CI, 1.04-1.35) for knowledge outcomes (n = 118 studies), 1.14 (95% CI, 1.03-1.25) for time skills (n = 210), 1.09 (95% CI, 1.03-1.16) for process skills (n = 426), 1.18 (95% CI, 0.98-1.37) for product skills (n = 54), 0.79 (95% CI, 0.47-1.10) for time behaviors (n = 20), 0.81 (95% CI, 0.66-0.96) for other behaviors (n = 50), and 0.50 (95% CI, 0.34-0.66) for direct effects on patients (n = 32). Subgroup analyses revealed no consistent statistically significant interactions between simulation training and instructional design features or study quality. CONCLUSION In comparison with no intervention, technology-enhanced simulation training in health professions education is consistently associated with large effects for outcomes of knowledge, skills, and behaviors and moderate effects for patient-related outcomes.

Adverse Effects of Testosterone Therapy in Adult Men: A Systematic Review and Meta-Analysis

CONTEXT The risks of testosterone therapy in men remain poorly understood. OBJECTIVE The aim of this study was to conduct a systematic review and meta-analyses of testosterone trials to evaluate the adverse effects of testosterone treatment in men. DATA SOURCES We searched MEDLINE, EMBASE, and Cochrane CENTRAL from 2003 through August 2008. Review of reference lists and contact with experts further identified candidate studies. STUDY SELECTION Eligible studies were comparative, randomized, and nonrandomized and reported the effects of testosterone on outcomes of interest (death, cardiovascular events and risk factors, prostate outcomes, and erythrocytosis). Reviewers, working independently and in duplicate, determined study eligibility. DATA EXTRACTION Reviewers working independently and in duplicate determined the methodological quality of studies and collected descriptive, quality, and outcome data. DATA SYNTHESIS The methodological quality of the 51 included studies varied from low to medium, and follow-up duration ranged from 3 months to 3 yr. Testosterone treatment was associated with a significant increase in hemoglobin [weighted mean difference (WMD), 0.80 g/dl; 95% confidence interval (CI), 0.45 to 1.14] and hematocrit (WMD, 3.18%; 95% CI, 1.35 to 5.01), and a decrease in high-density lipoprotein cholesterol (WMD, -0.49 mg/dl; 95% CI, -0.85 to -0.13). There was no significant effect on mortality, prostate, or cardiovascular outcomes. CONCLUSIONS The adverse effects of testosterone therapy include an increase in hemoglobin and hematocrit and a small decrease in high-density lipoprotein cholesterol. These findings are of unknown clinical significance. Current evidence about the safety of testosterone treatment in men in terms of patient-important outcomes is of low quality and is hampered by the brief study follow-up.

Comparative effectiveness of instructional design features in simulation-based education: Systematic review and meta-analysis

Background: Although technology-enhanced simulation is increasingly used in health professions education, features of effective simulation-based instructional design remain uncertain. Aims: Evaluate the effectiveness of instructional design features through a systematic review of studies comparing different simulation-based interventions. Methods: We systematically searched MEDLINE, EMBASE, CINAHL, ERIC, PsycINFO, Scopus, key journals, and previous review bibliographies through May 2011. We included original research studies that compared one simulation intervention with another and involved health professions learners. Working in duplicate, we evaluated study quality and abstracted information on learners, outcomes, and instructional design features. We pooled results using random effects meta-analysis. Results: From a pool of 10 903 articles we identified 289 eligible studies enrolling 18 971 trainees, including 208 randomized trials. Inconsistency was usually large (I 2 > 50%). For skills outcomes, pooled effect sizes (positive numbers favoring the instructional design feature) were 0.68 for range of difficulty (20 studies; p < 0.001), 0.68 for repetitive practice (7 studies; p = 0.06), 0.66 for distributed practice (6 studies; p = 0.03), 0.65 for interactivity (89 studies; p < 0.001), 0.62 for multiple learning strategies (70 studies; p < 0.001), 0.52 for individualized learning (59 studies; p < 0.001), 0.45 for mastery learning (3 studies; p = 0.57), 0.44 for feedback (80 studies; p < 0.001), 0.34 for longer time (23 studies; p = 0.005), 0.20 for clinical variation (16 studies; p = 0.24), and −0.22 for group training (8 studies; p = 0.09). Conclusions: These results confirm quantitatively the effectiveness of several instructional design features in simulation-based education.

The effect of plasma transfusion on morbidity and mortality: a systematic review and meta‐analysis

BACKGROUND: Plasma transfusion is increasingly performed without clear consensus on indications. We systematically reviewed the literature to summarize the available evidence regarding the benefits and harms of plasma transfusion in common clinical settings.

Cost: The missing outcome in simulation-based medical education research: A systematic review

BACKGROUND The costs involved with technology-enhanced simulation remain unknown. Appraising the value of simulation-based medical education (SBME) requires complete accounting and reporting of cost. We sought to summarize the quantity and quality of studies that contain an economic analysis of SBME for the training of health professions learners. METHODS We performed a systematic search of MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, Scopus, key journals, and previous review bibliographies through May 2011. Articles reporting original research in any language evaluating the cost of simulation, in comparison with nonstimulation instruction or another simulation intervention, for training practicing and student physicians, nurses, and other health professionals were selected. Reviewers working in duplicate evaluated study quality and abstracted information on learners, instructional design, cost elements, and outcomes. RESULTS From a pool of 10,903 articles we identified 967 comparative studies. Of these, 59 studies (6.1%) reported any cost elements and 15 (1.6%) provided information on cost compared with another instructional approach. We identified 11 cost components reported, most often the cost of the simulator (n = 42 studies; 71%) and training materials (n = 21; 36%). Ten potential cost components were never reported. The median number of cost components reported per study was 2 (range, 1-9). Only 12 studies (20%) reported cost in the Results section; most reported it in the Discussion (n = 34; 58%). CONCLUSION Cost reporting in SBME research is infrequent and incomplete. We propose a comprehensive model for accounting and reporting costs in SBME.

Comparative effectiveness of technology-enhanced simulation versus other instructional methods: a systematic review and meta-analysis.

Abstract To determine the comparative effectiveness of technology-enhanced simulation, we summarized the results of studies comparing technology-enhanced simulation training with nonsimulation instruction for health professions learners. We systematically searched databases including MEDLINE, Embase, and Scopus through May 2011 for relevant articles. Working in duplicate, we abstracted information on instructional design, outcomes, and study quality. From 10,903 candidate articles, we identified 92 eligible studies. In random-effects meta-analysis, pooled effect sizes (positive numbers favoring simulation) were as follows: satisfaction outcomes, 0.59 (95% confidence interval, 0.36–0.81; n = 20 studies); knowledge, 0.30 (0.16–0.43; n = 42); time measure of skills, 0.33 (0.00–0.66; n = 14); process measure of skills, 0.38 (0.24–0.52; n = 51); product measure of skills, 0.66 (0.30–1.02; n = 11); time measure of behavior, 0.56 (−0.07 to 1.18; n = 7); process measure of behavior, 0.77 (−0.13 to 1.66; n = 11); and patient effects, 0.36 (−0.06 to 0.78; n = 9). For 5 studies reporting comparative costs, simulation was more expensive and more effective. In summary, in comparison with other instruction, technology-enhanced simulation is associated with small to moderate positive effects.

Association between industry affiliation and position on cardiovascular risk with rosiglitazone: Cross sectional systematic review

Objective To explore a possible link between authors’ financial conflicts of interest and their position on the association of rosiglitazone with increased risk of myocardial infarction in patients with diabetes. Data sources On 10 April 2009, we searched Web of Science and Scopus for articles citing and commenting on either of two index publications that contributed key data to the controversy (a meta-analysis of small trials and a subsequent large trial). Data selection Articles had to comment on rosiglitazone and the risk of myocardial infarction. Guidelines, meta-analyses, reviews, clinical trials, letters, commentaries, and editorials were included. Data extraction For each article, we sought information about the authors’ financial conflicts of interest in the report itself and elsewhere (that is, in all publications within two years of the original publication and online). Two reviewers blinded to the authors’ financial relationships independently classified each article as presenting a favourable (that is, rosiglitazone does not increase the risk of myocardial infarction), neutral, or unfavourable view on the risk of myocardial infarction with rosiglitazone and on recommendations on the use of the drug. Results Of the 202 included articles, 108 (53%) had a conflict of interest statement. Ninety authors (45%) had financial conflicts of interest. Authors who had a favourable view of the risk of myocardial infarction with rosiglitazone were more likely to have financial conflicts of interest with manufacturers of antihyperglycaemic agents in general, and with rosiglitazone manufacturers in particular, than authors who had an unfavourable view (rate ratio 3.38, 95% CI 2.26 to 5.06 and 4.29, 2.63 to 7.02, respectively). There was likewise a strong association between favourable recommendations on the use of rosiglitazone and financial conflicts of interest (3.36, 1.94 to 5.83). These links persisted when articles rather than authors were used as the unit of analysis (4.69, 2.84 to 7.72), when the analysis was restricted to opinion articles (6.29, 2.15 to 18.38) or to articles in which the rosiglitazone controversy was the main focus (6.50, 2.56 to 16.53), and both in articles published before and after the Food and Drug Administration issued a safety warning for rosiglitazone (3.43, 0.99 to 11.82 and 4.95, 2.87 to 8.53, respectively). Conclusions Disclosure rates for financial conflicts of interest were unexpectedly low, and there was a clear and strong link between the orientation of authors’ expressed views on the rosiglitazone controversy and their financial conflicts of interest with pharmaceutical companies. Although these findings do not necessarily indicate a causal link between the position taken on the cardiac risk of rosiglitazone in patients with diabetes and the authors’ financial conflicts of interest, they underscore the need for further changes in disclosure procedures in order for the scientific record to be trusted.

Drug-Induced Hypoglycemia: A Systematic Review

CONTEXT Drug-induced hypoglycemia is a significant adverse effect that may cause important morbidity. OBJECTIVE The aim of the study was to systematically review the literature for drugs reported to cause hypoglycemia and assess the quality of evidence and strength of association supporting this causal link. DATA SOURCES We searched electronic databases (MEDLINE, EMBASE, Web of Science, and SCOPUS) and the drug information system Micromedex through November 2007 and sought additional references from experts. STUDY SELECTION Studies were eligible if they reported hypoglycemia as a side effect of a drug not used to treat hyperglycemia, regardless of their design, language, size, or follow-up duration. We excluded hypoglycemia caused by industrial exposures, nonpharmacological chemical exposures, alcohol, herbs, nutritional supplements, and in vitro and animal studies. DATA EXTRACTION Reviewers extracted study characteristics and methodological quality and, when possible, data to estimate the odds of developing hypoglycemia when exposed to the offending agent. DATA SYNTHESIS We found 448 eligible studies that described 2696 cases of hypoglycemia associated with 164 different drugs. The quality of evidence supporting associations between drugs and hypoglycemia was mostly very low due to methodological limitations and imprecision. The most commonly reported offending drugs were quinolones, pentamidine, quinine, beta blockers, angiotensin-converting enzyme agents, and IGF. CONCLUSIONS Very low quality evidence substantiates the association between hypoglycemia and the use of numerous nondiabetic drugs.

Lifestyle modification programs in polycystic ovary syndrome: systematic review and meta-analysis.

CONTEXT Polycystic ovary syndrome (PCOS) is a prevalent disorder that affects women of childbearing age and may be related to obesity and insulin resistance. OBJECTIVE The purpose of this systematic review was to appraise the evidence of the impact of lifestyle modification (LSM) interventions on outcomes of women with PCOS. DATA SOURCES Sources included Ovid Medline, OVID Embase, OVID Cochrane Library, Web of Science, Scopus, PsycINFO, and CINAHL (up to January 2011). STUDY SELECTION We included randomized controlled trials that enrolled woman of any age with PCOS who received LSM and compared them against women who received no intervention, minimal intervention, or metformin. DATA EXTRACTION Two authors performed the data extraction independently. DATA SYNTHESIS We included 9 trials enrolling 583 women with a high loss to follow-up rate, lack of blinding, and short follow-up. Compared with minimal intervention, LSM significantly reduced fasting blood glucose (weighted mean difference, -2.3 mg/dL; 95% confidence interval, -4.5 to -0.1, I² = 72%, P = .04) and fasting blood insulin (weighted mean difference, -2.1 μU/mL, 95% confidence interval, -3.3 to -1.0, I² = 0%, P < .001). Changes in body mass index were associated with changes in fasting blood glucose (P < .001). Metformin was not significantly better than LSM in improving blood glucose or insulin levels. We found no significant effect of LSM on pregnancy rate, and the effect on hirsutism was unclear. CONCLUSIONS The available evidence suggests that LSM reduces fasting blood glucose and insulin levels in women with PCOS. Metformin has similar effects. Translation of these short-term effects to patient-important outcomes, beyond diabetes prevention, remains uncertain.

Treatment of hyperprolactinemia: a systematic review and meta-analysis

BackgroundHyperprolactinemia is a common endocrine disorder that can be associated with significant morbidity. We conducted a systematic review and meta-analyses of outcomes of hyperprolactinemic patients, including microadenomas and macroadenomas, to provide evidence-based recommendations for practitioners. Through this review, we aimed to compare efficacy and adverse effects of medications, surgery and radiotherapy in the treatment of hyperprolactinemia.MethodsWe searched electronic databases, reviewed bibliographies of included articles, and contacted experts in the field. Eligible studies provided longitudinal follow-up of patients with hyperprolactinemia and evaluated outcomes of interest. We collected descriptive, quality and outcome data (tumor growth, visual field defects, infertility, sexual dysfunction, amenorrhea/oligomenorrhea and prolactin levels).ResultsAfter review, 8 randomized and 178 nonrandomized studies (over 3,000 patients) met inclusion criteria. Compared to no treatment, dopamine agonists significantly reduced prolactin level (weighted mean difference, -45; 95% confidence interval, -77 to −11) and the likelihood of persistent hyperprolactinemia (relative risk, 0.90; 95% confidence interval, 0.81 to 0.99). Cabergoline was more effective than bromocriptine in reducing persistent hyperprolactinemia, amenorrhea/oligomenorrhea, and galactorrhea. A large body of noncomparative literature showed dopamine agonists improved other patient-important outcomes. Low-to-moderate quality evidence supports improved outcomes with surgery and radiotherapy compared to no treatment in patients who were resistant to or intolerant of dopamine agonists.ConclusionOur results provide evidence to support the use of dopamine agonists in reducing prolactin levels and persistent hyperprolactinemia, with cabergoline proving more efficacious than bromocriptine. Radiotherapy and surgery are useful in patients with resistance or intolerance to dopamine agonists.