Susanne Weinbrenner

Harmonising evidence-based medicine teaching : a study of the outcomes of e-learning in five European countries

BackgroundWe developed and evaluated the outcomes of an e-learning course for evidence based medicine (EBM) training in postgraduate medical education in different languages and settings across five European countries.MethodsWe measured changes in knowledge and attitudes with well-developed assessment tools before and after administration of the course. The course consisted of five e-learning modules covering acquisition (formulating a question and search of the literature), appraisal, application and implementation of findings from systematic reviews of therapeutic interventions, each with interactive audio-visual learning materials of 15 to 20 minutes duration. The modules were prepared in English, Spanish, German and Hungarian. The course was delivered to 101 students from different specialties in Germany (psychiatrists), Hungary (mixture of specialties), Spain (general medical practitioners), Switzerland (obstetricians-gynaecologists) and the UK (obstetricians-gynaecologists). We analysed changes in scores across modules and countries.ResultsOn average across all countries, knowledge scores significantly improved from pre- to post-course for all five modules (p < 0.001). The improvements in scores were on average 1.87 points (14% of total score) for module 1, 1.81 points (26% of total score) for module 2, 1.9 points (11% of total score) for module 3, 1.9 points (12% of total score) for module 4 and 1.14 points (14% of total score) for module 5. In the country specific analysis, knowledge gain was not significant for module 4 in Spain, Switzerland and the UK, for module 3 in Spain and Switzerland and for module 2 in Spain. Compared to pre-course assessment, after completing the course participants felt more confident that they can assess research evidence and that the healthcare system in their country should have its own programme of research about clinical effectiveness.ConclusionE-learning in EBM can be harmonised for effective teaching and learning in different languages, educational settings and clinical specialties, paving the way for development of an international e-EBM course.

Effectiveness of an e-learning course in evidence-based medicine for foundation (internship) training

Summary Aim To evaluate the educational effectiveness of a clinically integrated e-learning course for teaching basic evidence-based medicine (EBM) among postgraduate medical trainees compared to a traditional lecture-based course of equivalent content. Methods We conducted a cluster randomized controlled trial to compare a clinically integrated e-learning EBM course (intervention) to a lecture-based course (control) among postgraduate trainees at foundation or internship level in seven teaching hospitals in the UK West Midlands region. Knowledge gain among participants was measured with a validated instrument using multiple choice questions. Change in knowledge was compared between groups taking into account the cluster design and adjusted for covariates at baseline using generalized estimating equations (GEE) model. Results There were seven clusters involving teaching of 237 trainees (122 in the intervention and 115 in the control group). The total number of postgraduate trainees who completed the course was 88 in the intervention group and 72 in the control group. After adjusting for baseline knowledge, there was no difference in the amount of improvement in knowledge of EBM between the two groups. The adjusted post course difference between the intervention group and the control group was only 0.1 scoring points (95% CI −1.2–1.4). Conclusion An e-learning course in EBM was as effective in improving knowledge as a standard lecture-based course. The benefits of an e-learning approach need to be considered when planning EBM curricula as it allows standardization of teaching materials and is a potential cost-effective alternative to standard lecture-based teaching.

The effectiveness of a clinically integrated e-learning course in evidence-based medicine: A cluster randomised controlled trial

BackgroundTo evaluate the educational effects of a clinically integrated e-learning course for teaching basic evidence-based medicine (EBM) among postgraduates compared to a traditional lecture-based course of equivalent content.MethodsWe conducted a cluster randomised controlled trial in the Netherlands and the UK involving postgraduate trainees in six obstetrics and gynaecology departments. Outcomes (knowledge gain and change in attitude towards EBM) were compared between the clinically integrated e-learning course (intervention) and the traditional lecture based course (control). We measured change from pre- to post-intervention scores using a validated questionnaire assessing knowledge (primary outcome) and attitudes (secondary outcome).ResultsThere were six clusters involving teaching of 61 postgraduate trainees (28 in the intervention and 33 in the control group). The intervention group achieved slightly higher scores for knowledge gain compared to the control, but these results were not statistically significant (difference in knowledge gain: 3.5 points, 95% CI -2.7 to 9.8, p = 0.27). The attitudinal changes were similar for both groups.ConclusionA clinically integrated e-learning course was at least as effective as a traditional lecture based course and was well accepted. Being less costly than traditional teaching and allowing for more independent learning through materials that can be easily updated, there is a place for incorporating e-learning into postgraduate EBM curricula that offer on-the-job training for just-in-time learning.Trial registrationTrial registration number: ACTRN12609000022268.

How can we teach EBM in clinical practice?? An analysis of barriers to implementation of on-the-job EBM teaching and learning

Introduction: Evidence-based medicine (EBM) improves the quality of health care. Courses on how to teach EBM in practice are available, but knowledge does not automatically imply its application in teaching. We aimed to identify and compare barriers and facilitators for teaching EBM in clinical practice in various European countries. Methods: A questionnaire was constructed listing potential barriers and facilitators for EBM teaching in clinical practice. Answers were reported on a 7-point Likert scale ranging from not at all being a barrier to being an insurmountable barrier. Results: The questionnaire was completed by 120 clinical EBM teachers from 11 countries. Lack of time was the strongest barrier for teaching EBM in practice (median 5). Moderate barriers were the lack of requirements for EBM skills and a pyramid hierarchy in health care management structure (median 4). In Germany, Hungary and Poland, reading and understanding articles in English was a higher barrier than in the other countries. Conclusion: Incorporation of teaching EBM in practice faces several barriers to implementation. Teaching EBM in clinical settings is most successful where EBM principles are culturally embedded and form part and parcel of everyday clinical decisions and medical practice.

Teaching trainers to incorporate evidence-based medicine (EBM) teaching in clinical practice: the EU-EBM project.

BackgroundEvidence based medicine (EBM) is considered an integral part of medical training, but integration of teaching various EBM steps in everyday clinical practice is uncommon. Currently EBM is predominantly taught through theoretical courses, workshops and e-learning. However, clinical teachers lack confidence in teaching EBM in workplace and are often unsure of the existing opportunities for teaching EBM in the clinical setting. There is a need for continuing professional development (CPD) courses that train clinical trainers to teach EBM through on-the-job training by demonstration of applied EBM real time in clinical practice. We developed such a course to encourage clinically relevant teaching of EBM in post-graduate education in various clinical environments.MethodsWe devised an e-learning course targeting trainers with EBM knowledge to impart educational methods needed to teach application of EBM teaching in commonly used clinical settings. The curriculum development group comprised experienced EBM teachers, clinical epidemiologists, clinicians and educationalists from institutions in seven European countries. The e-learning sessions were designed to allow participants (teachers) to undertake the course in the workplace during short breaks within clinical activities. An independent European steering committee provided input into the process.ResultsThe curriculum defined specific learning objectives for teaching EBM by exploiting educational opportunities in six different clinical settings. The e-modules incorporated video clips that demonstrate practical and effective methods of EBM teaching in everyday clinical practice. The course encouraged focussed teaching activities embedded within a trainers personal learning plan and documentation in a CPD portfolio for reflection.ConclusionThis curriculum will help senior clinicians to identify and make the best use of available opportunities in everyday practice in clinical situations to teach various steps of EBM and demonstrate their applicability to clinical practice. Once fully implemented, the ultimate outcome of this pilot project will be a European qualification in teaching EBM, which will be used by doctors, hospitals, professional bodies responsible for postgraduate qualifications and continuing medical education.

How far did we get? : How far to go? : A European survey on postgraduate courses in evidence-based medicine

BACKGROUND Over the past decade, evidence-based medicine (EBM) has gained recognition as a means to improve the quality of health care provision. However, little is known about learning opportunities to acquire EBM-associated skills. The EUebm-Unity partnership explored current educational activities for EBM practice for doctors across Europe. METHODS We surveyed organizations offering postgraduate EBM courses across Europe inquiring about their course programme, teaching content and strategies, and interest in a Europe-wide curriculum in EBM. RESULTS One hundred and fifty-six organizers in eight European countries reported 403 courses that had started first-time from 1996 to 2006. Despite a steady increase, in absolute terms, the frequency of courses was low and varied from 1 first-time offering of a course per 640 doctors (Spain) to 1 first-time offering per 5600 doctors (Austria) over 10 years. Most adopted the McMaster EBM teaching concept of small group, problem-based learning focussing on interventions, diagnostic tests and guidelines, and included efforts to link EBM to patient care. Teaching staff consisted of doctors from academic and non-academic settings, supported by methodologists. Efforts to formally integrate EBM in postgraduate activities were only partially successful. Most organizations welcomed a standardized European qualification in EBM. A limitation of the survey is the lack of follow-up information about the continuation of courses following the first-time offering. CONCLUSIONS All countries offer some EBM courses with varying teaching intensity. Learning opportunities are insufficient to ensure widespread dissemination of knowledge and skills. Most countries welcome more efforts to develop inexpensive and feasible educational activities at a postgraduate level.

Conflicts of interest among authors of medical guidelines: an analysis of guidelines produced by German specialist societies.

BACKGROUND Conflicts of interest can bias the recommendations of clinical guidelines. In 2010, the Association of Scientific Medical Societies in Germany (Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften, AWMF) revised its rules about how conflicts of interest in guidelines should be managed. METHODS All S2 and S3 guidelines in the AWMF database that were created in the years 2009-2011 were independently examined by two reviewers each (TL, MG, SC, BW, LF, SS). Information on conflicts of interest was extracted and descriptively analyzed. The effects of the new AWMF rules were studied with a before-and-after comparison. RESULTS 60 (20%) of the 297 guidelines studied contained explicit declarations of conflict of interest by their authors. 680 authors (49%) stated that they had financial relationships that constituted a conflict of interest; 86% declared conflicts arising from membership in specialty societies or professional associations. From 2009 to 2011, there was a substantial rise in the frequency of conflict-of-interest declarations in guidelines (8% of 256 guidelines that were created before the AWMF revised its rules in 2010 and 95% of 41 guidelines created afterward). The percentage of persons declaring financial conflicts of interest rose after the new rules were introduced, while the mode of documentation of conflict-of-interest evaluation and of any measures that might have been taken as a result remained unchanged. CONCLUSION From 2011 onward, all conflict-of-interest declarations by guideline authors have been published in the AWMF database. There is no current standard for the evaluation and management of conflicts of interest in guideline-creating groups, and this situation urgently needs to be remedied.

How are "teaching the teachers" courses in evidence based medicine evaluated? A systematic review

BackgroundTeaching of evidence-based medicine (EBM) has become widespread in medical education. Teaching the teachers (TTT) courses address the increased teaching demand and the need to improve effectiveness of EBM teaching. We conducted a systematic review of assessment tools for EBM TTT courses. To summarise and appraise existing assessment methods for teaching the teachers courses in EBM by a systematic review.MethodsWe searched PubMed, BioMed, EmBase, Cochrane and Eric databases without language restrictions and included articles that assessed its participants. Study selection and data extraction were conducted independently by two reviewers.ResultsOf 1230 potentially relevant studies, five papers met the selection criteria. There were no specific assessment tools for evaluating effectiveness of EBM TTT courses. Some of the material available might be useful in initiating the development of such an assessment tool.ConclusionThere is a need for the development of educationally sound assessment tools for teaching the teachers courses in EBM, without which it would be impossible to ascertain if such courses have the desired effect.

Development of the Interdisciplinary Evidence-Based S3 Guideline for the Diagnosis and Treatment of Prostate Cancer: Methodological Challenges and Solutions

Evidence-based guidelines are important sources of knowledge in everyday clinical practice. In 2005, the German Society for Urology decided to develop a highquality evidence-based guideline for the early detection, diagnosis and treatment of the different clinical manifestations of prostate cancer. The guideline project started in 2005 and involved 75 experts from 10 different medical societies or medical organizations including a patient organization. The guideline was issued in September 2009 and consists of 8 chapters, 170 recommendations, and 42 statements. Due to the broad spectrum of clinical questions covered by the guideline and the high number of participating organizations and authors, the organizers faced several methodological and organizational challenges. This article describes the methods used in the development of the guideline and highlights critical points and challenges in the development process. Strategies to overcome these problems are suggested which might be beneficial in the development of new evidence-based guidelines in the future.

Gender: Neue methodische Herausforderungen bei der Leitlinienentwicklung

Gender and diversity have a strong impact on health and illness as evidenced by sex and gender differences in the onset and progression of diseases as well as in diagnosis, therapy, and therapeutic outcome. The number of sex/gender-specific studies in medicine has increased steadily in recent years, indicating sex (biological) and gender (social) differences in numerous diseases. Despite this evidence, however, sex/gender differences are rarely considered in medical practice or in health systems, suggesting a delay in transferring such research into evidence-based medical treatment. Similarly, quality improvement guidelines in medical care do not systematically integrate the sex/gender perspective. Against this backdrop, this paper seeks to enumerate the necessary components of a guideline development and evaluation process that systematically integrates sex/gender differences in addition to providing a sex/gender-based methodological approach. The latter is illustrated by a pilot study in which four international guidelines on depression were selected. The sex/gender appropriateness of these guidelines was analysed using two methods: first, sex/gender-relevant words were counted; and second, relevant sex/gender differences were summarised based on a systematic literature review and then compared with the information given in the guidelines. The findings of the pilot study revealed that although strong evidence exists on sex/gender differences in depression, such research was rarely implemented in the guidelines. Given the scope and potential of guidelines to improve the quality of health care, it is essential that they consider the crucial role of sex/gender differences. To date, sex/gender differences have been insufficiently addressed in guideline development and evaluation when they should be an integral component of the process.