Patricia J. Erwin

Internet-based learning in the health professions:a meta-analysis

CONTEXT The increasing use of Internet-based learning in health professions education may be informed by a timely, comprehensive synthesis of evidence of effectiveness. OBJECTIVES To summarize the effect of Internet-based instruction for health professions learners compared with no intervention and with non-Internet interventions. DATA SOURCES Systematic search of MEDLINE, Scopus, CINAHL, EMBASE, ERIC, TimeLit, Web of Science, Dissertation Abstracts, and the University of Toronto Research and Development Resource Base from 1990 through 2007. STUDY SELECTION Studies in any language quantifying the association of Internet-based instruction and educational outcomes for practicing and student physicians, nurses, pharmacists, dentists, and other health care professionals compared with a no-intervention or non-Internet control group or a preintervention assessment. DATA EXTRACTION Two reviewers independently evaluated study quality and abstracted information including characteristics of learners, learning setting, and intervention (including level of interactivity, practice exercises, online discussion, and duration). DATA SYNTHESIS There were 201 eligible studies. Heterogeneity in results across studies was large (I(2) > or = 79%) in all analyses. Effect sizes were pooled using a random effects model. The pooled effect size in comparison to no intervention favored Internet-based interventions and was 1.00 (95% confidence interval [CI], 0.90-1.10; P < .001; n = 126 studies) for knowledge outcomes, 0.85 (95% CI, 0.49-1.20; P < .001; n = 16) for skills, and 0.82 (95% CI, 0.63-1.02; P < .001; n = 32) for learner behaviors and patient effects. Compared with non-Internet formats, the pooled effect sizes (positive numbers favoring Internet) were 0.10 (95% CI, -0.12 to 0.32; P = .37; n = 43) for satisfaction, 0.12 (95% CI, 0.003 to 0.24; P = .045; n = 63) for knowledge, 0.09 (95% CI, -0.26 to 0.44; P = .61; n = 12) for skills, and 0.51 (95% CI, -0.24 to 1.25; P = .18; n = 6) for behaviors or patient effects. No important treatment-subgroup interactions were identified. CONCLUSIONS Internet-based learning is associated with large positive effects compared with no intervention. In contrast, effects compared with non-Internet instructional methods are heterogeneous and generally small, suggesting effectiveness similar to traditional methods. Future research should directly compare different Internet-based interventions.

Adverse Effects of Testosterone Therapy in Adult Men: A Systematic Review and Meta-Analysis

CONTEXT The risks of testosterone therapy in men remain poorly understood. OBJECTIVE The aim of this study was to conduct a systematic review and meta-analyses of testosterone trials to evaluate the adverse effects of testosterone treatment in men. DATA SOURCES We searched MEDLINE, EMBASE, and Cochrane CENTRAL from 2003 through August 2008. Review of reference lists and contact with experts further identified candidate studies. STUDY SELECTION Eligible studies were comparative, randomized, and nonrandomized and reported the effects of testosterone on outcomes of interest (death, cardiovascular events and risk factors, prostate outcomes, and erythrocytosis). Reviewers, working independently and in duplicate, determined study eligibility. DATA EXTRACTION Reviewers working independently and in duplicate determined the methodological quality of studies and collected descriptive, quality, and outcome data. DATA SYNTHESIS The methodological quality of the 51 included studies varied from low to medium, and follow-up duration ranged from 3 months to 3 yr. Testosterone treatment was associated with a significant increase in hemoglobin [weighted mean difference (WMD), 0.80 g/dl; 95% confidence interval (CI), 0.45 to 1.14] and hematocrit (WMD, 3.18%; 95% CI, 1.35 to 5.01), and a decrease in high-density lipoprotein cholesterol (WMD, -0.49 mg/dl; 95% CI, -0.85 to -0.13). There was no significant effect on mortality, prostate, or cardiovascular outcomes. CONCLUSIONS The adverse effects of testosterone therapy include an increase in hemoglobin and hematocrit and a small decrease in high-density lipoprotein cholesterol. These findings are of unknown clinical significance. Current evidence about the safety of testosterone treatment in men in terms of patient-important outcomes is of low quality and is hampered by the brief study follow-up.

Diagnostic performance of body mass index to identify obesity as defined by body adiposity: a systematic review and meta-analysis

Objective:We performed a systematic review and meta-analysis of studies that assessed the performance of body mass index (BMI) to detect body adiposity.Design:Data sources were MEDLINE, EMBASE, Cochrane, Database of Systematic Reviews, Cochrane CENTRAL, Web of Science, and SCOPUS. To be included, studies must have assessed the performance of BMI to measure body adiposity, provided standard values of diagnostic performance, and used a body composition technique as the reference standard for body fat percent (BF%) measurement. We obtained pooled summary statistics for sensitivity, specificity, positive and negative likelihood ratios (LRs), and diagnostic odds ratio (DOR). The inconsistency statistic (I2) assessed potential heterogeneity.Results:The search strategy yielded 3341 potentially relevant abstracts, and 25 articles met our predefined inclusion criteria. These studies evaluated 32 different samples totaling 31 968 patients. Commonly used BMI cutoffs to diagnose obesity showed a pooled sensitivity to detect high adiposity of 0.50 (95% confidence interval (CI): 0.43–0.57) and a pooled specificity of 0.90 (CI: 0.86–0.94). Positive LR was 5.88 (CI: 4.24–8.15), I 2=97.8%; the negative LR was 0.43 (CI: 0.37–0.50), I 2=98.5%; and the DOR was 17.91 (CI: 12.56–25.53), I 2=91.7%. Analysis of studies that used BMI cutoffs ⩾30 had a pooled sensitivity of 0.42 (CI: 0.31–0.43) and a pooled specificity of 0.97 (CI: 0.96–0.97). Cutoff values and regional origin of the studies can only partially explain the heterogeneity seen in pooled DOR estimates.Conclusion:Commonly used BMI cutoff values to diagnose obesity have high specificity, but low sensitivity to identify adiposity, as they fail to identify half of the people with excess BF%.

Treatment of Pediatric Obesity: A Systematic Review and Meta-Analysis of Randomized Trials

CONTEXT The efficacy of treatments for pediatric obesity remains unclear. OBJECTIVE We performed a systematic review of randomized trials to estimate the efficacy of nonsurgical interventions for pediatric obesity. DATA SOURCES Librarian-designed search strategies of nine electronic databases from inception until February 2006, review of reference lists from published reviews, and content expert advice provided potentially eligible studies. STUDY SELECTION Eligible studies were randomized trials of overweight children and adolescents assessing the effect of nonsurgical interventions on obesity outcomes. DATA EXTRACTION Independently and in duplicate, reviewers assessed the quality of each trial and collected data on interventions and outcomes. DATA SYNTHESIS Of 76 eligible trials, 61 had complete data for meta-analysis. Short-term medications were effective, including sibutramine [random-effects pooled estimate of body mass index (BMI) loss of 2.4 kg/m(2) with a 95% confidence interval (CI) of 1.8-3.1; proportion of between-study inconsistency not due to chance (I(2)) = 30%] and orlistat (BMI loss = 0.7 kg/m(2); CI = 0.3-1.2; I(2) = 0%). Trials that measured the effect of physical activity on adiposity (i.e. percent body fat and fat-free mass) found a moderate treatment effect (effect size = -0.52; CI = -0.73 to -0.30; I(2) = 0%), whereas trials measuring the effect on BMI found no significant effect (effect size = -0.02; CI = -0.21 to 0.18; I(2) = 0%), but reporting bias may explain this finding. Combined lifestyle interventions (24 trials) led to small changes in BMI. CONCLUSIONS Limited evidence supports the short-term efficacy of medications and lifestyle interventions. The long-term efficacy and safety of pediatric obesity treatments remain unclear.

Behavioral interventions to prevent childhood obesity: A systematic review and metaanalyses of randomized trials

CONTEXT The efficacy of lifestyle interventions to encourage healthy lifestyle behaviors to prevent pediatric obesity remains unclear. OBJECTIVE Our objective was to summarize evidence on the efficacy of interventions aimed at changing lifestyle behaviors (increased physical activity, decreased sedentary activity, increased healthy dietary habits, and decreased unhealthy dietary habits) to prevent obesity. DATA SOURCES Data sources included librarian-designed searches of nine electronic databases, references from included studies and reviews (from inception until February 2006), and content expert recommendations. STUDY SELECTION Eligible studies were randomized trials enrolling children and adolescents assessing the impact of interventions on both lifestyle behaviors and body mass index (BMI). DATA EXTRACTION Two reviewers independently abstracted data on methodological quality, study characteristics, intervention components, and treatment effects. DATA ANALYSIS We conducted random-effects metaanalyses, quantified inconsistency using I(2), and conducted planned subgroup analyses for each examined outcome. DATA SYNTHESIS Regarding target behaviors, the pooled effect size for physical activity (22 comparisons; n = 9891 participants) was 0.12 [95% confidence interval (CI) = 0.04-0.20; I(2) = 63%], for sedentary activity (14 comparisons; n = 3003) was -0.29, (CI = -0.35 to -0.22; I(2) = 0%), for healthy dietary habits (14 comparisons, n = 5468) was 0.00 (CI = -0.20; 0.20; I(2) = 83%), and for unhealthy dietary habits (23 comparisons, n = 9578) was -0.20 (CI = -0.31 to -0.09; I(2) = 34%). The effect of these interventions on BMI (43 comparisons, n = 32,003) was trivial (-0.02; CI = -0.06-0.02; I(2) = 17%) compared with control. Trials with interventions lasting more than 6 months (vs. shorter trials) and trials with postintervention outcomes (vs. in-treatment outcomes) yielded marginally larger effects. CONCLUSION Pediatric obesity prevention programs caused small changes in target behaviors and no significant effect on BMI compared with control. Trials evaluating promising interventions applied over a long period, using responsive outcomes, with longer measurement timeframes are urgently needed.

Testosterone and Cardiovascular Risk in Men: A Systematic Review and Meta-analysis of Randomized Placebo-Controlled Trials

OBJECTIVE To conduct a systematic review and meta-analysis of randomized trials that assessed the effect of testosterone use on cardiovascular events and risk factors in men with different degrees of androgen deficiency. METHODS Librarian-designed search strategies were used to search the MEDLINE (1966 to October 2004), EMBASE (1988 to October 2004), and Cochrane CENTRAL (inception to October 2004) databases. The database search was performed again in March 2005. We also reviewed reference lists from included studies and content expert files. Eligible studies were randomized trials that compared any formulation of commercially available testosterone with placebo and that assessed cardiovascular risk factors (lipid fractions, blood pressure, blood glucose), cardiovascular events (cardiovascular death, nonfatal myocardial infarction, angina or claudication, revascularization, stroke), and cardiovascular surrogate end points (ie, laboratory tests indicative of cardiac or vascular disease). Using a standardized data extraction form, we collected data on participants, testosterone administration, and outcome measures. We assessed study quality with attention to allocation concealment, blinding, and loss to follow-up. RESULTS The 30 trials included 1642 men, 808 of whom were treated with testosterone. Overall, the trials had limited reporting of methodological features that prevent biased results (only 6 trials reported allocation concealment), enrolled few patients, and were of brief duration (only 4 trials followed up patients for > 1 year). The median loss to follow-up across all 30 trials was 9%. Testosterone use in men with low testosterone levels led to inconsequential changes in blood pressure and glycemia and in all lipid fractions (total cholesterol: odds ratio [OR], -0.22; 95% confidence interval [CI], -0.71 to 0.27; high-density lipoprotein cholesterol: OR, -0.04; 95% CI, -0.39 to 0.30; low-density lipoprotein cholesterol: OR, 0.06; 95% CI, -0.30 to 0.42; and triglycerides: OR, -0.27; 95% CI, -0.61 to 0.08); results were similar in patients with low-normal to normal testosterone levels. The OR between testosterone use and any cardiovascular event pooled across trials that reported these events (n = 6) was 1.82 (95% CI, 0.78 to 4.23). Several trials failed to report data on measured outcomes. For reasons we could not explain statistically, the results were inconsistent across trials. CONCLUSION Currently available evidence weakly supports the inference that testosterone use in men is not associated with important cardiovascular effects. Patients and clinicians need large randomized trials of men at risk for cardiovascular disease to better inform the safety of long-term testosterone use.

Patient engagement in research: a systematic review

BackgroundA compelling ethical rationale supports patient engagement in healthcare research. It is also assumed that patient engagement will lead to research findings that are more pertinent to patients’ concerns and dilemmas. However; it is unclear how to best conduct this process. In this systematic review we aimed to answer 4 key questions: what are the best ways to identify patient representatives? How to engage them in designing and conducting research? What are the observed benefits of patient engagement? What are the harms and barriers of patient engagement?MethodsWe searched MEDLINE, EMBASE, PsycInfo, Cochrane, EBSCO, CINAHL, SCOPUS, Web of Science, Business Search Premier, Academic Search Premier and Google Scholar. Included studies were published in English, of any size or design that described engaging patients or their surrogates in research design. We conducted an environmental scan of the grey literature and consulted with experts and patients. Data were analyzed using a non-quantitative, meta-narrative approach.ResultsWe included 142 studies that described a spectrum of engagement. In general, engagement was feasible in most settings and most commonly done in the beginning of research (agenda setting and protocol development) and less commonly during the execution and translation of research. We found no comparative analytic studies to recommend a particular method. Patient engagement increased study enrollment rates and aided researchers in securing funding, designing study protocols and choosing relevant outcomes. The most commonly cited challenges were related to logistics (extra time and funding needed for engagement) and to an overarching worry of a tokenistic engagement.ConclusionsPatient engagement in healthcare research is likely feasible in many settings. However, this engagement comes at a cost and can become tokenistic. Research dedicated to identifying the best methods to achieve engagement is lacking and clearly needed.

Instructional design variations in internet-based learning for health professions education: A systematic review and meta-analysis

Purpose A recent systematic review (2008) described the effectiveness of Internet-based learning (IBL) in health professions education. A comprehensive synthesis of research investigating how to improve IBL is needed. This systematic review sought to provide such a synthesis. Method The authors searched MEDLINE, CINAHL, EMBASE, Web of Science, Scopus, ERIC, TimeLit, and the University of Toronto Research and Development Resource Base for articles published from 1990 through November 2008. They included all studies quantifying the effect of IBL compared with another Internet-based or computer-assisted instructional intervention on practicing and student physicians, nurses, pharmacists, dentists, and other health professionals. Reviewers working independently and in duplicate abstracted information, coded study quality, and grouped studies according to inductively identified themes. Results From 2,705 articles, the authors identified 51 eligible studies, including 30 randomized trials. The pooled effect size (ES) for learning outcomes in 15 studies investigating high versus low interactivity was 0.27 (95% confidence interval, 0.08–0.46; P = .006). Also associated with higher learning were practice exercises (ES 0.40 [0.08–0.71; P = .01]; 10 studies), feedback (ES 0.68 [0.01–1.35; P = .047]; 2 studies), and repetition of study material (ES 0.19 [0.09–0.30; P < .001]; 2 studies). The ES was 0.26 (−0.62 to 1.13; P = .57) for three studies examining online discussion. Inconsistency was large (I2 ≥89%) in most analyses. Meta-analyses for other themes generally yielded imprecise results. Conclusions Interactivity, practice exercises, repetition, and feedback seem to be associated with improved learning outcomes, although inconsistency across studies tempers conclusions. Evidence for other instructional variations remains inconclusive.

Computerized virtual patients in health professions education: a systematic review and meta-analysis.

Purpose Educators increasingly use virtual patients (computerized clinical case simulations) in health professions training. The authors summarize the effect of virtual patients compared with no intervention and alternate instructional methods, and elucidate features of effective virtual patient design. Method The authors searched MEDLINE, EMBASE, CINAHL, ERIC, PsychINFO, and Scopus through February 2009 for studies describing virtual patients for practicing and student physicians, nurses, and other health professionals. Reviewers, working in duplicate, abstracted information on instructional design and outcomes. Effect sizes were pooled using a random-effects model. Results Four qualitative, 18 no-intervention controlled, 21 noncomputer instruction-comparative, and 11 computer-assisted instruction-comparative studies were found. Heterogeneity was large (I2>50%) in most analyses. Compared with no intervention, the pooled effect size (95% confidence interval; number of studies) was 0.94 (0.69 to 1.19; N=11) for knowledge outcomes, 0.80 (0.52 to 1.08; N=5) for clinical reasoning, and 0.90 (0.61 to 1.19; N=9) for other skills. Compared with noncomputer instruction, pooled effect size (positive numbers favoring virtual patients) was −0.17 (−0.57 to 0.24; N=8) for satisfaction, 0.06 (−0.14 to 0.25; N=5) for knowledge, −0.004 (−0.30 to 0.29; N=10) for reasoning, and 0.10 (−0.21 to 0.42; N=11) for other skills. Comparisons of different virtual patient designs suggest that repetition until demonstration of mastery, advance organizers, enhanced feedback, and explicitly contrasting cases can improve learning outcomes. Conclusions Virtual patients are associated with large positive effects compared with no intervention. Effects in comparison with noncomputer instruction are on average small. Further research clarifying how to effectively implement virtual patients is needed.

Testosterone Use in Men With Sexual Dysfunction: A Systematic Review and Meta-analysis of Randomized Placebo-Controlled Trials

OBJECTIVE To conduct a systematic review and meta-analysis of randomized placebo-controlled trials to measure the effect of testosterone use on sexual function in men with sexual dysfunction and varying testosterone levels. METHODS Librarian-designed search strategies were used to search the MEDLINE (1966 to October 2004), EMBASE (1988 to October 2004), and Cochrane CENTRAL (inception to October 2004) databases. The MEDLINE search was rerun in March 2005. We also reviewed reference lists from included studies and content expert files. We selected randomized placebo-controlled trials of testosterone vs placebo that enrolled men with sexual dysfunction and measured satisfaction with erectile function and libido and overall sexual satisfaction. RESULTS We included 17 trials (N = 862 participants) in this review. Trials that enrolled participants with low testosterone levels showed (1) a moderate nonsignificant and inconsistent effect of testosterone use on satisfaction with erectile function (random-effects pooled effect size, 0.80; 95% confidence interval [CI], -0.10 to 1.60), (2) a large effect on libido (pooled effect size, 1.31; 95% CI, 0.40 to 2.25), and (3) no significant effect on overall sexual satisfaction. Trials that enrolled patients with low-normal and normal testosterone levels at baseline showed testosterone that caused (1) a small effect on satisfaction with erectile function (pooled effect size, 0.34; 95% CI, 0.03 to 0.65), (2) moderate nonsignificant effect on libido (pooled effect size, 0.41; 95% CI, -0.01 to 0.83), and (3) no significant effect on overall sexual satisfaction. CONCLUSION Testosterone use in men is associated with small improvements in satisfaction with erectile function and moderate improvements in libido. Unexplained inconsistent results across trials, wide CIs, and possible reporting bias weaken these inferences.