Andy Wearn

Technology-enabled assessment of health professions education: Consensus statement and recommendations from the Ottawa 2010 conference

The uptake of information and communication technologies (ICTs) in health professions education can have far-reaching consequences on assessment. The medical education community still needs to develop a deeper understanding of how technology can underpin and extend assessment practices. This article was developed by the 2010 Ottawa Conference Consensus Group on technology-enabled assessment to guide practitioners and researchers working in this area. This article highlights the changing nature of ICTs in assessment, the importance of aligning technology-enabled assessment with local context and needs, the need for better evidence to support use of technologies in health profession education assessment, and a number of challenges, particularly validity threats, that need to be addressed while incorporating technology in assessment. Our recommendations are intended for all practitioners across health professional education. Recommendations include adhering to principles of good assessment, the need for developing coherent institutional policy, using technologies to broaden the competencies to be assessed, linking patient-outcome data to assessment of practitioner performance, and capitalizing on technologies for the management of the entire life-cycle of assessment.

Evaluation of consent for peer physical examination: students reflect on their clinical skills learning experience

Introduction  Early clinical skills teaching often requires students to learn through examining one another. This model should acknowledge ethical, practical and individual issues, disclosure and identification of abnormalities. Consent to peer physical examination (PPE) is usually expected rather than discussed and sought.

Medical students’ attitudes towards peer physical examination: findings from an international cross-sectional and longitudinal study

Although studies have begun to shed light on medical students’ attitudes towards peer physical examination (PPE), they have been conducted at single sites, and have generally not examined changes in medical students’ attitudes over time. Employing both cross-sectional and longitudinal designs, the current study examines medical students’ attitudes towards PPE at schools from different geographical and cultural regions and assess changes in their attitudes over their first year of medical study. Students at six schools (Peninsula, UK; Durham, UK; Auckland, New Zealand; Flinders, Australia; Sapporo, Japan and Li Ka Shing, Hong Kong) completed the Examining Fellow Students (EFS) questionnaire near the start of their academic year (T1), and students at four schools (Peninsula, Durham, Auckland and Flinders) completed the EFS for a second time, around the end of their academic year (T2). Univariate and multivariate analyses revealed a high level of acceptance for PPE of non-intimate body regions amongst medical students from all schools (greater than 83%, hips, at T1 and 94.5%, hips and upper body, at T2). At T1 and T2, students’ willingness to engage in PPE was associated with their gender, ethnicity, religiosity and school. Typically, students least comfortable with PPE at T1 and T2 were female, non-white, religious and studying at Auckland. Although students’ attitudes towards PPE were reasonably stable over their first year of study, and after exposure to PPE, we did find some statistically significant differences in attitudes between T1 and T2. Interestingly, attitude changes were consistently predicted by gender, even when controlling for school. While male students’ attitudes towards PPE were relatively stable over time, females’ attitudes were changeable. In this paper, we discuss our findings in light of existing research and theory, and discuss their implications for educational practice and further research.

Multischool, international survey of medical students' attitudes toward "holism".

Purpose Core and optional courses of study in complementary and alternative medicine (CAM) are being incorporated into medical curricula. The authors carried out this study to validate a tool to examine students’ attitudes toward holism and CAM and explore the relationships between their attitudes and other demographic and education-related characteristics in a large, multischool, international sample of medical students. Method In 2003 the authors used a modified version of the Integrated Medicine Attitude Questionnaire (IMAQ) to survey students at a total of six medical schools in the United Kingdom, New Zealand, Canada, the United States, and Hong Kong, China. A three-factor model was tested using confirmatory factor analysis, and the internal consistency of the factors were identified using Cronbach’s alpha coefficients. A multiple-indicator multiple-cause (MIMIC) analysis was carried out to determine the relationship between IMAQ factors and student characteristics. Results The authors validated a three-factor model for the IMAQ: (1) attitudes toward holism, (2) attitudes toward the effectiveness of CAM, and (3) attitudes toward introspection and the doctor–patient relationship. Cronbach’s α coefficients ranged from .41 to .71. The MIMIC model indicated that various background variables were associated with IMAQ factors (gender, race/ethnicity, and school), depending on whether students had previously visited a CAM practitioner and whether students were willing to undertake a special study module in CAM. Conclusions Further development work on the IMAQ is required and qualitative research to verify and examine the reasons behind the relationships found in this study between students’ attitudes to holism and their demographic and education-related characteristics.

Understanding student concerns about peer physical examination using an activity theory framework

Context  Peer physical examination (PPE) has been employed for several decades as part of the formal curriculum for learning clinical skills. Most of the existing studies exploring students’ attitudes towards PPE are single‐site and use quantitative methods. Currently, there is a lack of theoretical underpinning to PPE as a learning method.

Medical students' attitudes to complementary and alternative medicine: further validation of the IMAQ and findings from an international longitudinal study.

Background: Current research mainly employs cross-sectional designs to examine changes in medical students’ attitudes towards complementary and alternative medicine (CAM). Aims: This paper reports the findings of a longitudinal study to further validate the Integrative Medicine Attitude Questionnaire (IMAQ) and examine changes in medical students’ attitudes over 3 years. Methods: A total of 154 medical students from four schools in three countries completed a modified version of the IMAQ during their first (T1) and fourth year (T2). Results: We established the validity of a three-factor model for the IMAQ: (1) attitudes towards holism; (2) attitudes towards the effectiveness of CAM therapies, and (3) attitudes towards introspection and the doctor–patient relationship. We found that IMAQ factor scores did not differ significantly from T1 to T2, emphasizing the relative stability in attitudes across time. Various student characteristics were significantly associated with IMAQ factor scores at T2: age, gender, CAM use, CAM education and school; and two variables (gender and CAM use) predicted changes in medical students’ attitudes between T1 and T2. Conclusions: We urge medical educators to continue exploring medical students’ attitude changes towards CAM and we provide examples of what further research is needed.

Don't want to show fellow students my naughty bits: Medical students' anxieties about peer examination of intimate body regions at six schools across UK, Australasia and Far-East Asia

Background: Although recent quantitative research suggests that medical students are reluctant to engage in peer physical examination (PPE) of intimate body regions, we do not know why. Aim: This article explores first-year medical students’ anxieties about PPE of intimate body regions at six schools. Methods: Using the Examining Fellow Students (EFS) questionnaire, we collected qualitative data from students in five countries (UK; Australia; New Zealand; Japan; Hong Kong) between 2005 and 2007. Results: Our framework analysis of 617 (78.7%) students’ qualitative comments yielded three themes: present and future benefits of PPE; possible barriers to PPE; and student stipulations for successful PPE. This article focuses on several sub-themes relating to students’ anxieties about PPE of intimate body regions and their associated sexual, gender, cultural and religious concerns. By exploring students’ euphemisms about intimate areas, our findings reveal further insights into the relationship between students’ anxieties, gender and culture. Conclusion: First-year students are anxious about examining intimate body regions, so a staged approach starting with manikins is recommended. Further qualitative research is needed employing interviews to explore in depth students’ anxieties about examinations of intimate body regions and how their views are shaped by interactions with peers, patients and doctors.

A student-centred feedback model for educators.

Background:  Effective feedback is instrumental to effective learning. Current feedback models tend to be educator driven rather than learner‐centred, with the focus on how the supervisor should give feedback rather than on the role of the learner in requesting and responding to feedback.

What are threshold concepts and how can they inform medical education

Abstract The notion of “threshold concepts” is being widely applied and researched in many disciplines but is rarely discussed within medical education. This article is written by three medical educators who regularly draw on threshold concept theory in their work. They explore here the nature of threshold concepts and describe how the theory can offer medical educators new perspectives in terms of how they design curricula, approach teaching and support learners.

Progress testing in the medical curriculum: students’ approaches to learning and perceived stress

BackgroundProgress Tests (PTs) draw on a common question bank to assess all students in a programme against graduate outcomes. Theoretically PTs drive deep approaches to learning and reduce assessment-related stress. In 2013, PTs were introduced to two year groups of medical students (Years 2 and 4), whereas students in Years 3 and 5 were taking traditional high-stakes assessments. Staged introduction of PTs into our medical curriculum provided a time-limited opportunity for a comparative study. The main purpose of the current study was to compare the impact of PTs on undergraduate medical students’ approaches to learning and perceived stress with that of traditional high-stakes assessments. We also aimed to investigate the associations between approaches to learning, stress and PT scores.MethodsUndergraduate medical students (N = 333 and N = 298 at Time 1 and Time 2 respectively) answered the Revised Study Process Questionnaire (R-SPQ-2F) and the Perceived Stress Scale (PSS) at two time points to evaluate change over time. The R-SPQ-2F generated a surface approach and a deep approach score; the PSS generated an overall perceived stress score.ResultsWe found no significant differences between the two groups in approaches to learning at either time point, and no significant changes in approaches to learning over time in either cohort. Levels of stress increased significantly at the end of the year (Time 2) for students in the traditional assessment cohort, but not in the PT cohort. In the PT cohort, surface approach to learning, but not stress, was a significant negative predictor of students’ PT scores.ConclusionsWhile confirming an association between surface approaches to learning and lower PT scores, we failed to demonstrate an effect of PTs on approaches to learning. However, a reduction in assessment-associated stress is an important finding.