Olivier Courteille

The use of a virtual patient case in an OSCE-based exam - A pilot study

Background: This study focuses on a skills test based clinical assessment where 118 fourth-year medical students at the four teaching hospitals of Karolinska Institutet participated in the same 12-module OSCE. The goal of one of the twelve examination modules was to assess the students’ skills and ability to solve a virtual patient (VP) case (the ISP system), which included medical history taking, lab tests, physical examinations and suggestion of a preliminary diagnosis. Aims: The primary aim of this study was to evaluate the potential of a VP as a possible tool for assessment of clinical reasoning and problem solving ability among medical students. The feeling of realism of the VP and its possible affective impact on the students confidence were also investigated. Method: We observed and analysed students’ reactions, engagement and performance (activity log files) during their interactive sessions with the simulation. An individual human assistant was provided along with the computer simulation and the videotaped interaction student/assistant was then analysed in detail and related to the students’ outcomes. Results: The results indicate possible advantages of using ISP-like systems for assessment. The VP was for instance able to reliably differentiate between students’ performances but some weaknesses were also identified, like a confounding influence on students’ outcomes by the assistants used. Significant differences, affecting the results, were found between the students in their degree of affective response towards the system as well as the perceived usefulness of assistance. Conclusion: Students need to be trained beforehand in mastering the assessment tool. Rating compliance needs to be targeted before VP-based systems like ISP can be used in exams and if such systems would be used in high-stake exams, the use of human assistants should be limited and scoring rubrics validated (and preferably automated).

Interactive Simulated Patient: Experiences with Collaborative E-Learning in Medicine.

Interactive Simulated Patient (ISP) is a computer-based simulation tool designed to provide medical students with the opportunity to practice their clinical problem solving skills. The ISP system allows students to perform most clinical decision-making procedures in a simulated environment, including history taking in natural language, many hundreds of laboratory tests (e.g., images and endoscopy), and physical examination procedures. The system has been evaluated in a number of courses at three universities, Karolinska Institutet and Uppsala University in Sweden, and Stanford University in the United States. This article describes a study conducted in 2002, with an emphasis on results that pertain to collaboration between students. Results indicate that ISP is engaging and stimulates more active student involvement than traditional paper-based case presentation methods and that students seem to collaborate more easily when using ISP compared to traditional paper-based methods.

Interpersonal behaviors and socioemotional interaction of medical students in a virtual clinical encounter

BackgroundThe virtual clinical encounter (VCE) may function as an important support for medical students in or prior to clinical practice to train and ease communication and socioemotional interactions with patients. Few studies have however focused on the dynamics of interpersonal behaviors in clinical interviewing with a virtual patient (VP) and the affective responses evoked by such a learning experience. The study was designed to investigate the dynamics and congruence of interpersonal behaviors and socioemotional interaction exhibited during the learning experience in a VCE, and to evaluate which interaction design characteristics contribute most to the behavioral and affective engagement in medical students.MethodsThirty medical students (sixth semester) participated voluntarily in an exploratory observational study with a highly interactive VP case based on a trustworthy VP encounter with a natural and realistic dialogue interface. Students worked collaboratively in pairs. They were videotaped for further behavioral analysis and self-reported (in both a survey and an interview) their personal opinions, perceptions and attitudes about the VCE. A mixed methods approach was applied.ResultsAll participants demonstrated an adequate, respectful and relevant clinical case management and to obtain psychosocial history. The collaborative workspace played its role and led to dynamic and engaged discussions fostering thus shared understanding. The results suggest that the VCE studied was perceived as a meaningful, intrinsically motivational and activating learning environment, and was found to socially and emotionally engage learners. We also found that VCEs have the potential to support the development of relevant and congruent interpersonal communication skills in trainees.ConclusionsBy taking advantage of socioemotional interaction, VCEs promote not only critical reflection skills or strategy-selection skills, but also to develop listening and nonverbal skills, induce self-awareness and target coping behaviours. We believe that, if applied in early medical education, this learning approach may facilitate clinical encounters at an early stage and contribute to responsible clinical decision making.

Learning through a virtual patient vs. recorded lecture : a comparison of knowledge retention in a trauma case

Objectives To compare medical students’ and residents’ knowledge retention of assessment, diagnosis and treatment procedures, as well as a learning experience, of patients with spinal trauma after training with either a Virtual Patient case or a video-recorded traditional lecture. Methods A total of 170 volunteers (85 medical students and 85 residents in orthopedic surgery) were randomly allocated (stratified for student/resident and gender) to either a video-recorded standard lecture or a Virtual Patient-based training session where they interactively assessed a clinical case portraying a motorcycle accident. The knowledge retention was assessed by a test immediately following the educational intervention and repeated after a minimum of 2 months. Participants’ learning experiences were evaluated with exit questionnaires. A repeated-measures analysis of variance was applied on knowledge scores. A total of 81% (n = 138) of the participants completed both tests. Results There was a small but significant decline in first and second test results for both groups (F(1, 135) = 18.154, p = 0.00). However, no significant differences in short-term and long-term knowledge retention were observed between the two teaching methods. The Virtual Patient group reported higher learning experience levels in engagement, stimulation, general perception, and expectations. Conclusions Participants’ levels engagement were reported in favor of the VP format. Similar knowledge retention was achieved through either a Virtual Patient or a recorded lecture.