Hyuksoon Song

Just enough, but not too much interactivity leads to better clinical skills performance after a computer assisted learning module

Background: Well-designed computer-assisted instruction (CAI) can potentially transform medical education. Yet little is known about whether specific design features such as direct manipulation of the content yield meaningful gains in clinical learning. We designed three versions of a multimedia module on the abdominal exam incorporating different types of interactivity. Methods: As part of their physical diagnosis course, 162 second-year medical students were randomly assigned (1:1:1) to Watch, Click or Drag versions of the abdominal exam module. First, students’ prior knowledge, spatial ability, and prior experience with abdominal exams were assessed. After using the module, students took a posttest; demonstrated the abdominal exam on a standardized patient; and wrote structured notes of their findings. Results: Data from143 students were analyzed. Baseline measures showed no differences among groups regarding prior knowledge, experience, or spatial ability. Overall there was no difference in knowledge across groups. However, physical exam scores were significantly higher for students in the Click group. Conclusions: A mid-range level of behavioral interactivity was associated with small to moderate improvements in performance of clinical skills. These improvements were likely mediated by enhanced engagement with the material, within the bounds of learners’ cognitive capacity. These findings have implications for the design of CAI materials to teach procedural skills.

Assessing Medical Students' Self-Regulation as Aptitude in Computer-Based Learning

We developed a Self-Regulation Measure for Computer-based learning (SRMC) tailored toward medical students, by modifying Zimmerman’s Self-Regulated Learning Interview Schedule (SRLIS) for K-12 learners. The SRMC’s reliability and validity were examined in 2 studies. In Study 1, 109 first-year medical students were asked to complete the SRMC. Bivariate correlation analysis results indicated that the SRMC scores had a moderate degree of correlation with student achievement in a teacher-developed test. In Study 2, 58 third-year clerkship students completed the SRMC. Regression analysis results indicated that the frequency of medical students’ usage of self-regulation strategies was associated with their general clinical knowledge measured by a nationally standardized licensing exam. These two studies provided evidence for the reliability and concurrent validity of the SRMC to assess medical students’ self-regulation as aptitude. Future work should provide evidence to guide and improve instructional design as well as inform educational policy.

Twelve tips for improving the effectiveness of web-based multimedia instruction for clinical learners

Abstract Using educational technology does not necessarily make medical education more effective. There are many different kinds of technology available to the contemporary medical teacher and what constitutes effective use may depend on the technology, the learning situation and many other factors. Web-based multimedia instruction (WBMI) provides learners with self-directed independent learning opportunities based on didactic material enhanced with multimedia features such as video and animations. WBMI may be used to replace other didactic events (e.g. lectures) or it may be provided in addition to other learning opportunities. Clinical educators looking to use WBMI need to make sure that it will meet both their learners’ needs and the program’s needs, and it has to align to the contexts in which it is used. The following 12 tips have been developed to help guide faculty through some of the key features of the effective use of WBMI in clinical teaching programs. These tips are based on more than a decade developing, using and appraising WBMI in support of surgical clerkship education across the USA and beyond and they are intended both to inform individual uses of WBMI in clinical training and to guide the strategic use of WBMI in clinical clerkship curricula.

Medical students as human subjects in educational research

INTRODUCTION Special concerns often arise when medical students are themselves the subjects of education research. A recently completed large, multi-center randomized controlled trial of computer-assisted learning modules for surgical clerks provided the opportunity to explore the perceived level of risk of studies where medical students serve as human subjects by reporting on: 1) the response of Institutional Review Boards (IRBs) at seven institutions to the same study protocol; and 2) the thoughts and feelings of students across study sites about being research subjects. METHODS From July 2009 to August 2010, all third-year medical students at seven collaborating institutions were eligible to participate. Patterns of IRB review of the same protocol were compared. Participation burden was calculated in terms of the time spent interacting with the modules. Focus groups were conducted with medical students at each site. Transcripts were coded by three independent reviewers and analyzed using Atlas.ti. RESULTS The IRBs at the seven participating institutions granted full (n=1), expedited (n=4), or exempt (n=2) review of the WISE Trial protocol. 995 (73% of those eligible) consented to participate, and 207 (20%) of these students completed all outcome measures. The average time to complete the computer modules and associated measures was 175 min. Common themes in focus groups with participant students included the desire to contribute to medical education research, the absence of coercion to consent, and the low-risk nature of the research. DISCUSSION Our findings demonstrate that risk assessment and the extent of review utilized for medical education research vary among IRBs. Despite variability in the perception of risk implied by differing IRB requirements, students themselves felt education research was low risk and did not consider themselves to be vulnerable. The vast majority of eligible medical students were willing to participate as research subjects. Participants acknowledged the time demands of their participation and were readily able to withdraw when those burdens became unsustainable.Introduction : Special concerns often arise when medical students are themselves the subjects of education research. A recently completed large, multi-center randomized controlled trial of computer-assisted learning modules for surgical clerks provided the opportunity to explore the perceived level of risk of studies where medical students serve as human subjects by reporting on: 1) the response of Institutional Review Boards (IRBs) at seven institutions to the same study protocol; and 2) the thoughts and feelings of students across study sites about being research subjects. Methods : From July 2009 to August 2010, all third-year medical students at seven collaborating institutions were eligible to participate. Patterns of IRB review of the same protocol were compared. Participation burden was calculated in terms of the time spent interacting with the modules. Focus groups were conducted with medical students at each site. Transcripts were coded by three independent reviewers and analyzed using Atlas.ti. Results : The IRBs at the seven participating institutions granted full (n=1), expedited (n=4), or exempt (n=2) review of the WISE Trial protocol. 995 (73% of those eligible) consented to participate, and 207 (20%) of these students completed all outcome measures. The average time to complete the computer modules and associated measures was 175 min. Common themes in focus groups with participant students included the desire to contribute to medical education research, the absence of coercion to consent, and the low-risk nature of the research. Discussion : Our findings demonstrate that risk assessment and the extent of review utilized for medical education research vary among IRBs. Despite variability in the perception of risk implied by differing IRB requirements, students themselves felt education research was low risk and did not consider themselves to be vulnerable. The vast majority of eligible medical students were willing to participate as research subjects. Participants acknowledged the time demands of their participation and were readily able to withdraw when those burdens became unsustainable.

Measuring professional identity formation early in medical school

Abstract Aim: To assess the feasibility and utility of measuring baseline professional identity formation (PIF) in a theory-based professionalism curriculum for early medical students. Methods: All 132 entering students completed the professional identity essay (PIE) and the defining issues test (DIT2). Students received score reports with individualized narrative feedback and wrote a structured reflection after a large-group session in which the PIF construct was reviewed. Analysis of PIEs resulted in assignment of a full or transitional PIF stage (1–5). The DIT2 score reflects the proportion of the time students used universal ethical principles to justify a response to 6 moral dilemma cases. Students’ reflections were content analyzed. Results: PIF scores were distributed across stage 2/3, stage 3, stage 3/4, and stage 4. No student scores were in stages 1, 2, 4/5, or 5. The mean DIT2 score was 53% (range 9.7?76.5%); the correlation between PIF stage and DIT score was ρ =  0.18 (p = 0.03). Students who took an analytic approach to the data and demonstrated both awareness that they are novices and anticipation of continued PIF tended to respond more positively to the feedback. Conclusions: These PIF scores distributed similarly to novice students in other professions. Developmental-theory based PIF and moral reasoning measures are related. Students reflected on these measures in meaningful ways suggesting utility of measuring PIF scores in medical education.