Maria Amélia Ferreira

What Are We Looking for in Computer-Based Learning Interventions in Medical Education? A Systematic Review

Background Computer-based learning (CBL) has been widely used in medical education, and reports regarding its usage and effectiveness have ranged broadly. Most work has been done on the effectiveness of CBL approaches versus traditional methods, and little has been done on the comparative effects of CBL versus CBL methodologies. These findings urged other authors to recommend such studies in hopes of improving knowledge about which CBL methods work best in which settings. Objective In this systematic review, we aimed to characterize recent studies of the development of software platforms and interventions in medical education, search for common points among studies, and assess whether recommendations for CBL research are being taken into consideration. Methods We conducted a systematic review of the literature published from 2003 through 2013. We included studies written in English, specifically in medical education, regarding either the development of instructional software or interventions using instructional software, during training or practice, that reported learner attitudes, satisfaction, knowledge, skills, or software usage. We conducted 2 latent class analyses to group articles according to platform features and intervention characteristics. In addition, we analyzed references and citations for abstracted articles. Results We analyzed 251 articles. The number of publications rose over time, and they encompassed most medical disciplines, learning settings, and training levels, totaling 25 different platforms specifically for medical education. We uncovered 4 latent classes for educational software, characteristically making use of multimedia (115/251, 45.8%), text (64/251, 25.5%), Web conferencing (54/251, 21.5%), and instructional design principles (18/251, 7.2%). We found 3 classes for intervention outcomes: knowledge and attitudes (175/212, 82.6%), knowledge, attitudes, and skills (11.8%), and online activity (12/212, 5.7%). About a quarter of the articles (58/227, 25.6%) did not hold references or citations in common with other articles. The number of common references and citations increased in articles reporting instructional design principles (P=.03), articles measuring online activities (P=.01), and articles citing a review by Cook and colleagues on CBL (P=.04). There was an association between number of citations and studies comparing CBL versus CBL, independent of publication date (P=.02). Conclusions Studies in this field vary highly, and a high number of software systems are being developed. It seems that past recommendations regarding CBL interventions are being taken into consideration. A move into a more student-centered model, a focus on implementing reusable software platforms for specific learning contexts, and the analysis of online activity to track and predict outcomes are relevant areas for future research in this field.

How students perceive medical competences: a cross-cultural study between the Medical Course in Portugal and African Portuguese Speaking Countries

BackgroundA global effort has been made in the last years to establish a set of core competences that define the essential professional competence of a physician. Regardless of the environment, culture or medical education conditions, a set of core competences is required for medical practice worldwide. Evaluation of educational program is always needed to assure the best training for medical students and ultimately best care for patients. The aim of this study was to determine in what extent medical students in Portugal and Portuguese speaking African countries, felt they have acquired the core competences to start their clinical practice. For this reason, it was created a measurement tool to evaluate self-perceived competences, in different domains, across Portuguese and Portuguese-speaking African medical schools.MethodsThe information was collected through a questionnaire that defines the knowledge, attitudes and skills that future doctors should acquire. The Cronbachs Alpha and Principal Components Analysis (PCA) were used to evaluate the reliability of the questionnaire. In order to remove possible confounding effect, individual scores were standardized by country.ResultsThe order of the domains scores was similar between countries. After standardization, Personal Attitudes and Professional Behavior showed median scores above the country global median and Knowledge alone showed median score below the country global median. In Portugal, Clinical Skills showed score below the global median. In Angola, Clinical Skills and General Skills showed a similar result. There were only significant differences between countries in Personal Attitudes (p < 0.001) and Professional Behavior (p = 0.043).ConclusionsThe reliability of the instrument in Portuguese and Portuguese-speaking African medical schools was confirmed. Students have perceived their level of competence in personal attitudes in a high level and in opposite, knowledge and clinical skills with some weaknesses.

A novel collaborative e-learning platform for medical students - ALERT STUDENT

BackgroundThe increasing complexity of medical curricula would benefit from adaptive computer supported collaborative learning systems that support study management using instructional design and learning object principles. However, to our knowledge, there are scarce reports regarding applications developed to meet this goal and encompass the complete medical curriculum. The aim of ths study was to develop and assess the usability of an adaptive computer supported collaborative learning system for medical students to manage study sessions.ResultsA study platform named ALERT STUDENT was built as a free web application. Content chunks are represented as Flashcards that hold knowledge and open ended questions. These can be created in a collaborative fashion. Multiple Flashcards can be combined into custom stacks called Notebooks that can be accessed in study Groups that belong to the user institution. The system provides a Study Mode that features text markers, text notes, timers and color-coded content prioritization based on self-assessment of open ended questions presented in a Quiz Mode. Time spent studying and Perception of knowledge are displayed for each student and peers using charts. Computer supported collaborative learning is achieved by allowing for simultaneous creation of Notebooks and self-assessment questions by many users in a pre-defined Group. Past personal performance data is retrieved when studying new Notebooks containing previously studied Flashcards. Self-report surveys showed that students highly agreed that the system was useful and were willing to use it as a reference tool.ConclusionsThe platform employs various instructional design and learning object principles in a computer supported collaborative learning platform for medical students that allows for study management. The application broadens student insight over learning results and supports informed decisions based on past learning performance. It serves as a potential educational model for the medical education setting that has gathered strong positive feedback from students at our school.This platform provides a case study on how effective blending of instructional design and learning object principles can be brought together to manage study, and takes an important step towards bringing information management tools to support study decisions and improving learning outcomes.

Characterization of medical students recall of factual knowledge using learning objects and repeated testing in a novel e-learning system

BackgroundSpaced-repetition and test-enhanced learning are two methodologies that boost knowledge retention. ALERT STUDENT is a platform that allows creation and distribution of Learning Objects named flashcards, and provides insight into student judgments-of-learning through a metric called ‘recall accuracy‘. This study aims to understand how the spaced-repetition and test-enhanced learning features provided by the platform affect recall accuracy, and to characterize the effect that students, flashcards and repetitions exert on this measurement.MethodsThree spaced laboratory sessions (s0, s1 and s2), were conducted with n=96 medical students. The intervention employed a study task, and a quiz task that consisted in mentally answering open-ended questions about each flashcard and grading recall accuracy. Students were randomized into study-quiz and quiz groups. On s0 both groups performed the quiz task. On s1 and s2, the study-quiz group performed the study task followed by the quiz task, whereas the quiz group only performed the quiz task. We measured differences in recall accuracy between groups/sessions, its variance components, and the G-coefficients for the flashcard component.ResultsAt s0 there were no differences in recall accuracy between groups. The experiment group achieved a significant increase in recall accuracy that was superior to the quiz group in s1 and s2. In the study-quiz group, increases in recall accuracy were mainly due to the session, followed by flashcard factors and student factors. In the quiz group, increases in recall accuracy were mainly accounted by flashcard factors, followed by student and session factors. The flashcard G-coefficient indicated an agreement on recall accuracy of 91% in the quiz group, and of 47% in the study-quiz group.ConclusionsRecall accuracy is an easily collectible measurement that increases the educational value of Learning Objects and open-ended questions. This metric seems to vary in a way consistent with knowledge retention, but further investigation is necessary to ascertain the nature of such relationship. Recall accuracy has educational implications to students and educators, and may contribute to deliver tailored learning experiences, assess the effectiveness of instruction, and facilitate research comparing blended-learning interventions.

Performance Equivalency between Computer-Based and Traditional Pen-and-Paper Assessment: A Case Study in Clinical Anatomy.

The time, material, and staff‐consuming nature of anatomys traditional pen‐and‐paper assessment system, the increase in the number of students enrolling in medical schools and the ever‐escalating workload of academic staff have made the use of computer‐based assessment (CBA) an attractive proposition. To understand the impact of such shift in the assessment method, an experimental study evaluating its effect on students’ performance was designed. Additionally, students’ opinions toward CBA were gathered. Second‐year medical students attending a Clinical Anatomy course were randomized by clusters in two groups. The pen‐and‐paper group attended two sessions, each consisting of a traditional sectional anatomy steeplechase followed by a theoretical examination, while the computer group was involved in two similar sessions conducted in a computerized environment. At the end of each of the computer sessions, students in this group filled an anonymous questionnaire. In the first session, pen‐and‐paper group students scored significantly better than computer‐group students in both the steeplechase (mean ± standard deviation: 66.00 ± 14.15% vs. 43.50 ± 19.10%; P < 0.001) and the theoretical examination (52.50 ± 12.70% vs. 39.00 ± 21.10%; P < 0.001). In the second session, no statistically significant differences were found for both the steeplechase (59.50 ± 17.30% vs. 54.50 ± 17.00%; P = 0.085) and the theoretical examination (57.50 ± 13.70% vs. 54.00 ± 14.30%; P = 0.161). Besides, an intersession improvement in students’ perceptions toward CBA was registered. These results suggest that, after a familiarization period, CBA might be a performance equivalent and student accepted alternative to clinical anatomy pen‐and‐paper theoretical and practical examinations. Anat Sci Educ 11: 124–136.

Longitudinal evaluation, acceptability and long-term retention of knowledge on a horizontally integrated organic and functional systems course

Undergraduate medical education is moving from traditional disciplinary basic science courses into more integrated curricula. Integration models based on organ systems originated in the 1950s, but few longitudinal studies have evaluated their effectiveness. This article outlines the development and implementation of the Organic and Functional Systems (OFS) courses at the University of Minho in Portugal, using evidence collected over 10 years. It describes the organization of content, student academic performance and acceptability of the courses, the evaluation of preparedness for future courses and the retention of knowledge on basic sciences. Students consistently rated the OFS courses highly. Physician tutors in subsequent clinical attachments considered that students were appropriately prepared. Performance in the International Foundations of Medicine examination of a self-selected sample of students revealed similar performances in basic science items after the last OFS course and 4 years later, at the moment of graduation. In conclusion, the organizational and pedagogical approaches of the OFS courses achieve high acceptability by students and result in positive outcomes in terms of preparedness for subsequent training and long-term retention of basic science knowledge.

To participate or not participate in unprofessional behavior – Is that the question?

Abstract Introduction: Medical education provides students with abundant learning opportunities, each of which is embodied with messages concerning what is expected from students. This paper analyses students? exposure to instances of unprofessional behavior, investigating whether they judge such behavior to be unprofessional and whether they also participate in unprofessional behavior. Methods: The survey developed in the Pritzker School of Medicine at the University of Chicago was the basis of this questionnaire that was answered by 276 students from two medical schools in Brazil and Portugal. Results: Unprofessional behavior was observed frequently by students in both universities, and the mean participation rates were similar (26% and 27%). Forty-five percent of students? participation in unprofessional behavior was explained by academic year, prior observation, and judgment. Discussion: The results indicate that once students have observed, participated in or misjudged unprofessional behavior, they tend to participate in and misjudge such behavior. The frequency with which students judged behaviors they had observed or participated in as ?borderline? or unprofessional could mean that they are experiencing moral distress. Conclusion: Proper discussion of unprofessional behavior should foster a broad debate to encourage empowered students, faculties, and physicians to co-create a more professional environment for patient care.

The use of portfolios to foster professionalism: attributes, outcomes, and recommendations

Abstract The main objective of this research was to review the characteristics of portfolios and their outcomes for teaching professionalism to undergraduate medical students. A systematic review on the use of portfolios in teaching professionalism to medical students identified 1257 papers. Of these, 11 articles met all inclusion criteria. According to the papers, the use of portfolios for teaching professionalism shows versatility, supports learning strategies and has the potential to be used in different contexts, including for formative and summative purposes. The weaknesses were based on the artificiality of the reflections, deficient instructions, time-consuming processes and preference among students for other teaching methods. Students complained about feeling that the reflection was ‘forced’, and they tended to write based on social conventions rather than reveal their true thoughts. Reflection is a powerful component of the portfolio, but the method by which it is taught could easily ruin its potential to boost professionalism. Requiring reflection did not ensure its achievement; increased understanding by students regarding how and why they were doing it, the clarity of assessment methods and constructive feedback might strengthen the potential for success. A framework was designed to support faculty members in developing and applying portfolios with a clear and broad view of this teaching strategy.

Neuroanatomy Education: The Impact on Perceptions, Attitudes, and Knowledge of an Intensive Course on General Practice Residents.

General practitioners are responsible for the management of an increasing number of patients with neurological illness, and thus a solid education in neurosciences is a necessary component of their training. This study examines the effects of an intensive clinical neuroanatomy course on twenty general practice residents’ perceptions, attitudes, and knowledge. A knowledge test was completed by the participants and by a control group at four different time points. The participants were asked to answer a questionnaire about their reasons for signing up for the course and their attitudes and perceptions toward the course experience. Experimental and control groups demonstrated identical mean baseline test scores. The experimental group significantly increased its test scores (plus 49.0% correct answers, a mean improvement of 120%) relative to controls after the educational intervention. There were no differences among scores from the evaluated time points after the educational intervention in the experimental group. In the control group, there were likewise no significant differences between the four evaluated time points. Most participants indicated that they signed up for the course to update/acquire knowledge and skills in the field of neurosciences, and also because they had difficulty in diagnosing and managing patients with neurological diseases. Participants’ attitudes and perceptions toward the course experience were very positive. Most of the participants (n = 17; 85%) rated the course as “extremely useful,” and 3 (15%) rated it as “very useful.” This study provides evidence demonstrating the potential positive effect of neurosciences education to general practice residents. Anat Sci Educ 10: 465–474.

Knowledge, source of information, and perception of Portuguese medical students and junior doctors of infection control precautions

Medical education should include infection control precautions (ICPs). Portuguese medical students showed reasonable knowledge in ICPs; however, contact isolation and glove and mask use should be reinforced. Only 25% referred to the curriculum as the most important information source. There was a positive association between academic year (P = .032), previous training in ICPs (P = .016), and knowledge. Main strategies proposed to acquire competences in ICPs were bedside teaching (26.9%) and curriculum and bedside teaching (20.2%).