Siun O'Flynn

Undergraduate medical research: the student perspective

Abstract Background: #All authors contributed equally to this work.Research training is essential in a modern undergraduate medical curriculum. Our evaluation aimed to (a) gauge students’ awareness of research activities, (b) compare students’ perceptions of their transferable and research-specific skills competencies, (c) determine students’ motivation for research and (d) obtain students’ personal views on doing research. Methods: Undergraduate medical students (N=317) completed a research skills questionnaire developed by the Centre for Excellence in Teaching and Learning in Applied Undergraduate Research Skills (CETL-AURS) at Reading University. The questionnaire assessed students’ transferable skills, research-specific skills (e.g., study design, data collection and data analysis), research experience and attitude and motivation towards doing research. Results: The majority of students are motivated to pursue research. Graduate entrants and male students appear to be the most confident regarding their research skills competencies. Although all students recognise the role of research in medical practice, many are unaware of the medical research activities or successes within their university. Of those who report no interest in a career incorporating research, a common perception was that researchers are isolated from patients and clinical practice. Discussion: Students have a narrow definition of research and what it entails. An explanation for why research competence does not align more closely with research motivation is derived from students’ lack of understanding of the concept of translational research, as well as a lack of awareness of the research activity being undertaken by their teachers and mentors. We plan to address this with specific research awareness initiatives.

A psychometric appraisal of the DREEM

BackgroundThe quality of the Educational environment is a key determinant of a student centred curriculum. Evaluation of the educational environment is an important component of programme appraisal. In order to conduct such evaluation use of a comprehensive, valid and reliable instrument is essential. One of most widely used contemporary tools for evaluation of the learning environment is the Dundee Ready Education Environment Measure (DREEM). Apart from the initial psychometric evaluation of the DREEM, few published studies report its psychometric properties in detail. The aim of this study was to examine the psychometric quality of the DREEM measure in the context of medical education in Ireland and to explore the construct validity of the device.Methods239 final year medical students were asked to complete the DREEM inventory. Anonymised responses were entered into a database. Data analysis was performed using PASW 18 and confirmatory factor analysis performed.ResultsWhilst the total DREEM score had an acceptable level of internal consistency (alpha 0.89), subscale analysis shows that two subscales had sub-optimal internal consistency. Multiple group confirmatory factor analysis (using Flemings indices) shows an overall fit of 0.76, representing a weak but acceptable level of fit. 17 of the 50 items manifest fit indices less than 0.70. We sought the best fitting oblique solution to the 5-subscale structure, which showed large correlations, suggesting that the independence of the separate scales is open to question.ConclusionsThere has perhaps been an inadequate focus on establishing and maintaining the psychometric credentials of the DREEM. The present study highlights two concerns. Firstly, the internal consistency of the 5 scales is quite variable and, in our sample, appears rather low. Secondly, the construct validity is not well supported. We suggest that users of the DREEM will provide basic psychometric appraisal of the device in future published reports.

The clinical conscientiousness index: a valid tool for exploring professionalism in the clinical undergraduate setting.

Purpose The need to develop effective tools to measure professionalism continues to challenge medical educators; thus, as a follow-up to a recent examination of the “Conscientiousness Index” (CI, a novel measure of one facet of professionalism) in one setting with preclinical medical students, the authors aimed to investigate the validity of the CI as a proxy measure of professionalism in a different context and in the clinical phase of undergraduate medical education. Method In academic year 2009–2010, the authors collected data similar to those collected for the original preclinical study. In an effort to create a Clinical Conscientiousness Index (CCI) score, they collected the following information on 124 third-year medical students completing their clinical rotations: attendance, timeliness of assessment submissions, and completion of rotation evaluations. Then, they compared the resultant CCI scores with faculty views on professionalism and with formal assessments of students’ professionalism (i.e., their portfolios and objective structured clinical examinations [OSCEs]). Results The authors demonstrate significant correlations between CCI scores and faculty views on professionalism (rS = 0.3; P = .001), and between CCI scores and OSCE score (rS = 0.237; P = .008), but not between CCI scores and portfolio assessment (rS = 0.084; P = .354). The authors also present relationships between CCI scores and demographics. Conclusion The CCI is a practical, valid proxy measure of professionalism, achieving good correlation with faculty views on professionalism and clinical competency examinations, but not portfolio assessment, in one clinical undergraduate setting.Purpose: The need to develop effective tools to measure professionalism continues to challenge medical educators; thus, as a follow-up to a recent examination of the “Conscientiousness Index” (CI, a novel measure of one facet of professionalism) in one setting with preclinical medical students, the authors aimed to investigate the validity of the CI as a proxy measure of professionalism in a different context and in the clinical phase of undergraduate medical education. Method: In academic year 2009–2010, the authors collected data similar to those collected for the original preclinical study. In an effort to create a Clinical Conscientiousness Index (CCI) score, they collected the following information on 124 third-year medical students completing their clinical rotations: attendance, timeliness of assessment submissions, and completion of rotation evaluations. Then, they compared the resultant CCI scores with faculty views on professionalism and with formal assessments of students’ professionalism (i.e., their portfolios and objective structured clinical examinations [OSCEs]). Results: The authors demonstrate significant correlations between CCI scores and faculty views on professionalism (rS = 0.3; P = .001), and between CCI scores and OSCE score (rS = 0.237; P = .008), but not between CCI scores and portfolio assessment (rS = 0.084; P = .354). The authors also present relationships between CCI scores and demographics. Conclusion: The CCI is a practical, valid proxy measure of professionalism, achieving good correlation with faculty views on professionalism and clinical competency examinations, but not portfolio assessment, in one clinical undergraduate setting.

The Medical Student Stress Profile: a tool for stress audit in medical training

Medical Education 2010: 44: 1027–1037

Association between learning style preferences and anatomy assessment outcomes in graduate-entry and undergraduate medical students.

An improved understanding of the relationship between anatomy learning performance and approaches to learning can lead to the development of a more tailored approach to delivering anatomy teaching to medical students. This study investigated the relationship between learning style preferences, as measured by Visual, Aural, Read/write, and Kinesthetic (VARK) inventory style questionnaire and Honey and Mumfords learning style questionnaire (LSQ), and anatomy and clinical skills assessment performance at an Irish medical school. Additionally, mode of entry to medical school [undergraduate/direct‐entry (DEM) vs. graduate‐entry (GEM)], was examined in relation to individual learning style, and assessment results. The VARK and LSQ were distributed to first and second year DEM, and first year GEM students. DEM students achieved higher clinical skills marks than GEM students, but anatomy marks did not differ between each group. Several LSQ style preferences were shown to be weakly correlated with anatomy assessment performance in a program‐ and year‐specific manner. Specifically, the “Activist” style was negatively correlated with anatomy scores in DEM Year 2 students (rs = −0.45, P = 0.002). The “Theorist” style demonstrated a weak correlation with anatomy performance in DEM Year 2 (rs = 0.18, P = 0.003). Regression analysis revealed that, among the LSQ styles, the “Activist” was associated with poorer anatomy assessment performance (P < 0.05), while improved scores were associated with students who scored highly on the VARK “Aural” modality (P < 0.05). These data support the contention that individual student learning styles contribute little to variation in academic performance in medical students. Anat Sci Educ 9: 391–399.

Selection of student-selected component [SSCs] modules across the medical undergraduate curriculum: relationship with motivational factors.

Student-selected components (SSCs) encourage the following within the undergraduate medical curriculum: greater exploration of core curriculum topics; exploration of non-core subjects/experiences; research and self-directed learning; and personal and professional development opportunities. This study examined the motivational factors which influence SSC choice to assess (a) SSC selection patterns across each year of the curriculum (direct and graduate entry) and (b) motivation underlying SSC selection across the curriculum. During SSC registration at University College Cork, all medical undergraduates (years 1–3, graduate-entry medicine) were required to select an SSC and provide a written justification for their selection. Five primary motivational factors were identified: correction of perceived deficits; genuine interest in subject and wish to study in more depth; career strategy; exam strategy; and taking a chance. A complex pattern of relationships emerged in relation to matching of motivational factors with SSC categories, e.g. selection of research skills SSCs was strongly associated with the ‘career strategy’ motivation. Significant differences were observed across curriculum years, as well as between direct-entry versus graduate-entry undergraduates, with respect to SSC selections and underlying motivation. This study provides insight into changing patterns of SSC selection in medicine, as well as accompanying motivational factors, across the undergraduate years.

Enhanced research assessment performance in graduate vs. undergraduate-entry medical students: implications for recruitment into academic medicine

BACKGROUND Studies investigating variance between the academic performance of direct-entry (DEM) versus graduate-entry (GEM) medical students have yielded conflicting results, but their performance in undergraduate research-based assessments has not been compared to-date. AIM We aimed to compare the results of DEM and GEM students with respect to their senior research dissertation module. METHODS This retrospective study examined the final year results between 2011-2012 in DEM, (n = 219) and GEM (n = 84) students. Between-group comparisons of dissertation module marks were conducted using independent t-tests. Correlations between marks in dissertation module and in other disciplines assessed during the final year were attained using Pearsons correlation. Multiple regression analysis was employed to adjust for potential confounding factors such as student age and gender. RESULTS No apparent difference was apparent between the DEM and GEM students with respect to results achieved across the clinical disciplines examined. However, GEM students performed significantly better than DEMs in their senior research dissertation assessment (Mean = 66.81% vs. 65.00%, fully adjusted p = 0.048). The variable which remained influential in regression analysis was nationality, where North American and Asian students were demonstrated to score lower than their Irish counterparts in the dissertation module (B coefficient = -1.90, SE = 0.94, P = 0.045 and B coefficient = -4.88, SE = 1.00, P < 0.001 respectively). CONCLUSIONS Performance in the research-based module was significantly better in GEM relative to their DEM colleagues. This finding may have implications for future recruitment into academic medicine, as aptitude and interest in research at undergraduate level has been shown to be associated with increased likelihood of an academic career in medicine.

Attitudes towards professionalism in graduate and non-graduate entrants to medical school.

Background: The number of places available in Ireland and the United Kingdom (UK) for graduate entry to medical school has increased in the past decade. Research has primarily focused on academic and career outcomes in this cohort, but attitudes towards professionalism in medicine have not been systematically assessed. The purpose of this study was to compare the importance of items related to professional behaviour among graduate entrants and their ′school-leaver′ counterparts. Methods: This was a quantitative cross-sectional study, conducted in University College Cork (UCC), Ireland. A validated questionnaire was distributed to undergraduate-entry (UG) and graduate-entry (GE) students with items addressing the following areas: Demographic and academic characteristics and attitudes towards several classes of professional behaviours in medicine. Results: GE students ascribed greater importance, relative to UG students, to various aspects of professionalism across the personal characteristics, interaction with patients and social responsibility categories. Additionally, in UG students, a significant decrease in perceived importance of the following professionalism items was evident across the course of the degree programme: Respect for patients as individuals, treating the underprivileged and reporting dishonesty of others. Among both groups of students, individual mentoring was rated the most important method for teaching professionalism in medicine. Discussion: This study is the first comparison of attitudes to professionalism in UG and GE students. This study highlighted important group differences between GE and UG students in attitudes towards professional behaviours, together with different perspectives regarding how professionalism might be incorporated within the curriculum.

Simulation in undergraduate medical education.

In this issue, Hallikainen et al. [1] describe medical student performance at induction of anaesthesia following standardized training provided either in a clinical or a simulated environment. Those students who received training in the simulated environment performed better when assessed using the (same) simulator 1–3 weeks later. The authors describe a framework, which employed many of the features of simulation known to lead to effective learning, as documented by the Best Evidence Medical Education (BEME) group [2]. These include the provision of feedback, repetitive practice, curriculum integration, a range of levels of difficulty, multiple learning strategies, the need to capture clinical variation, a controlled environment, individualized learning, reproducible standardized educational experiences in which learners are active participants not passive bystanders, defined outcomes and simulator validity. It appears that training in simulated environments confers benefits in terms of formative feedback, and collaborative learning if appropriately structured (as outlined above).

Can less be more? Comparison of an 8-item placement quality measure with the 50-item Dundee Ready Educational Environment Measure (DREEM)

Clinical clerks learn more than they are taught and not all they learn can be measured. As a result, curriculum leaders evaluate clinical educational environments. The quantitative Dundee Ready Environment Measure (DREEM) is a de facto standard for that purpose. Its 50 items and 5 subscales were developed by consensus. Reasoning that an instrument would perform best if it were underpinned by a clearly conceptualized link between environment and learning as well as psychometric evidence, we developed the mixed methods Manchester Clinical Placement Index (MCPI), eliminated redundant items, and published validity evidence for its 8 item and 2 subscale structure. Here, we set out to compare MCPI with DREEM. 104 students on full-time clinical placements completed both measures three times during a single academic year. There was good agreement and at least as good discrimination between placements with the smaller MCPI. Total MCPI scores and the mean score of its 5-item learning environment subscale allowed ten raters to distinguish between the quality of educational environments. Twenty raters were needed for the 3-item MCPI training subscale and the DREEM scale and its subscales. MCPI compares favourably with DREEM in that one-sixth the number of items perform at least as well psychometrically, it provides formative free text data, and it is founded on the widely shared assumption that communities of practice make good learning environments.