Jwa-Seop Shin

The use of specially designed tasks to enhance student interest in the cadaver dissection laboratory.

Cadaver dissection is a key component of anatomy education. Unfortunately, students sometimes regard the process of dissection as uninteresting or stressful. To make laboratory time more interesting and to encourage discussion and collaborative learning among medical students, specially designed tasks were assigned to students throughout dissection. Student response and the effects of the tasks on examination scores were analyzed. The subjects of this study were 154 medical students who attended the dissection laboratory in 2009. Four tasks were given to teams of seven to eight students over the course of 2 weeks of lower limb dissection. The tasks were designed such that the answers could not be obtained by referencing books or searching the Internet, but rather through careful observation of the cadavers and discussion among team members. Questionnaires were administered. The majority of students agreed that the tasks were interesting (68.0%), encouraged team discussion (76.8%), and facilitated their understanding of anatomy (72.8%). However, they did not prefer that additional tasks be assigned during the other laboratory sessions. When examination scores of those who responded positively were compared with those who responded neutrally or negatively, no statistically significant differences could be found. In conclusion, the specially designed tasks assigned to students in the cadaver dissection laboratory encouraged team discussion and collaborative learning, and thereby generated interest in laboratory work. However, knowledge acquisition was not improved. Anat Sci Educ.

Evaluation of an international faculty development program for developing countries in Asia: the Seoul Intensive Course for Medical Educators

BackgroundThe issue of collaboration in medical education is becoming prominent. Some faculty development programs have suggested an approach for promoting collaboration on a global level. However, non-English-speaking developing countries in Asia, especially in Southeast Asia, do not take advantage of them due to their unique context, such as language and culture. To address these issues, Seoul National University College of Medicine initiated a 6-week international faculty development program called the “Seoul Intensive Course for Medical Educators” for 16 fellows from five Asian countries (Cambodia, Laos, Mongolia, Myanmar, and Vietnam). The aim of this study is to report the evaluation results of the outcome of the program and discuss better ways of collaborating with developing countries.MethodsThree levels of collaboration—intraorganizational, intranational, and international—were central initiatives of the program. Prior to setting up the program details, we first established four design principles, following which the contents, materials, and facilitators were determined to maintain consistency with the design principles. The evaluation of the program was done with Kirkpatrick’s four-level model. Most of the evaluation data for level 1 were collected by two questionnaires, the post-module survey and the post-program survey. Portfolios and progress reports were mainly used to collect outcome data for levels 2 and 3, respectively.ResultsThe reaction was generally positive throughout the program and there was a significant correlation between satisfaction and relevance to one’s job or needs. Despite the fellows’ propensity for overestimating themselves, both the evaluators and fellows reported that there was significant improvement in learning. Opinions on the impact or urgency of the topics were slightly different from country to country; however, the answers regarding feasibility were fairly similar. Moreover, we could observe from the post-program progress reports that the transfer of learning was actively in progress, mainly for topics that were highly feasible.ConclusionsThese results show that the program was successful in terms of its effectiveness. Consistent and timely support is essential for the sustainable development of the medical education systems in these countries. Further understanding of the underlying factors on transfer (level 3) could improve the effectiveness of faculty development programs for developing countries.

Evaluation using simulated students for reliability of multiple standardized-patients scoring in clinical performance examinations

Background: The consistency of rating among different standardized patients (SPs) is very important in clinical performance examinations (CPX). Aims: We evaluated the usefulness of simulated students to assess the reliability of a group of standardized patients in a CPX. Methods: Five SPs in each case were trained to simulate the same patient in a CPX. Ten fourth-year medical student volunteers were selected to act as simulated students. After the simulated students encountered the first SP, they reviewed a video of their performance and sequentially repeated the performance with the other 4 SPs. Results: The average maximum difference (Δmax ± SD) of multiple SPs’ percent scores on a simulated student was 18 ± 7. In 10 pairs of SPs who gave largest Δmax on a given student, the median Δmax was 30 (range, 26–38) while median difference of percent score in the faculty scoring on the same simulated student was 3 (range, 0–7). Five problematic SPs whose ratings were significantly different from 3 or more other SPs’ ratings in each case were identified. Conclusions: Simulated students may be a useful means to check the consistency of rating among different SPs in a CPX.

Evaluation of a continuing professional development training program for physicians and physician assistants in hospitals in Laos based on the Kirkpatrick model

Purpose: Medical professionals from Korea and Laos have been working together to develop a continuing professional development training program covering the major clinical fields of primary care. This study aimed to evaluate the effectiveness of the program from 2013 to 2014 using the Kirkpatrick model. Methods: A questionnaire was used to evaluate the reaction of the trainees, and the trainers assessed the level of trainees’ performance at the beginning and the end of each clinical section. The transfer (behavioral change) of the trainees was evaluated through the review of medical records written by the trainees before and after the training program. Results: The trainees were satisfied with the training program, for which the average score was 4.48 out of 5.0. The average score of the trainees’ performance at the beginning was 2.39 out of 5.0, and rose to 3.88 at the end of each section. The average score of the medical records written before the training was 2.92 out of 5.0, and it rose to 3.34 after the training. The number of patient visits to the district hospitals increased. Conclusion: The continuing professional development training program, which was planned and implemented with the full engagement and responsibility of Lao health professionals, proved to be effective.

Research and development of evaluation criteria for premedical curriculum

PURPOSE The purpose of this study was to develop criteria to evaluate a premedical curriculum to ultimately improve the quality of premedical education. METHODS The first draft of the evaluation criteria was developed through a literature review and expert consultation. The Delphi survey was conducted to ensure the validity of the draft. RESULTS The final premedical curriculum criteria consisted of three evaluation areas (curriculum development, curriculum implementation, and curriculum outcome), five evaluation items (educational objective, organization of curriculum, instructional method, class management,and educational outcome), and 18 evaluation indicators. CONCLUSION There should be further discussion on the evaluation questionnaire and the content for each evaluation indicator with regard to its practical application. Also, a concrete evaluation system, including evaluation standards and rating scales, should be developed.

Institutional factors affecting participation in national faculty development programs: a nation-wide investigation of medical schools

BackgroundMedical schools have used faculty development programs as an essential means to improve the instruction of faculty members. Thus far, however, participating in such programs has been largely voluntary for individuals even though a certain degree of participation is required to achieve practical effectiveness. In addition, the learning behaviors of faculty members are known to be influenced by organizational contexts such as a hidden curriculum. Therefore, this study explored the organizational characteristics of medical schools affecting attendance at faculty development programs.MethodsForty medical schools in South Korea were included in this study. In total, 1,667 faculty members attended the faculty development programs at the National Teacher Training Center for Health Personnel between 2007 and 2015. For independent variables, information on the basic characteristics and the educational states was collected from all the medical schools. Themes were identified from their educational goals and objectives by inductive content analysis.ResultsThe number of nine-year cumulative attendees from medical schools ranged from 8 to 104. The basic characteristics of the medical schools had little influence on faculty development program attendance, while several themes in the educational goals and objectives, including “cooperation”, “serving various societies”, and “dealing with a changing future” showed a significant difference in participation. The number of full-time faculty showed a significant positive correlation when it was smaller than the median, and the proportion of alumni faculty showed a significant negative correlation when it was higher than 50%.ConclusionsThis study adds to existing knowledge on factors affecting attendance at faculty development programs by identifying related institutional factors that influence attendance. While the variations depending on the basic characteristics were minimal, the organizational environment surrounding medical education significantly contributed to attendance. Addressing institutional as well as individual factors could contribute to improving participation by faculty members in faculty development programs.

Evaluation of Scientific Programs at a Large-Scale Academic Congress: Lessons from the 22nd World Congress of Dermatology

Background: The organization of a scientific program and the arrangement of the speakers require a considerable amount of time and effort. However, little is known about how to reinforce the participants’ satisfaction with scientific programs at a large-scale academic congress with multiple parallel sessions. Objectives: This study had three main purposes: (1) to create a reference for future congresses, (2) to determine session popularity and participation rate, and (3) to identify which characteristics of sessions can affect the perception of the audience. Methods: A total of 216 scientific sessions during the 22nd World Congress of Dermatology were evaluated using printed evaluation surveys. Results: The average scores for all sessions and speakers were relatively high. There were significant differences in the numbers of total session scores, collected surveys and speakers for each session category. The number of speakers at each session was not related to the session results. It was found that among the three different session grades (excellent, fair and poor), the proportion of speakers of each grade especially contributed to the perceived quality of the poor-grade sessions. Conclusions: This survey will help to organize scientific sessions and improve the quality of academic congresses.

Developing a core competency model for translational medicine curriculum

Purpose This study aimed to develop a core competency model for translational medicine curriculum in the Korean graduate education context. Methods We invited specialists and key stakeholders to develop a consensus on a core competency model. The working group composed of 17 specialists made an initial draft of a core competency model based on the literature review. The initial draft was sent to the survey group by email to ask whether they agreed or disagreed with each core competency. The working group simplified, merged, or excluded the competencies that received less than 80% agreement among the 43 survey respondents. The working group also reorganized the order of the domains and competencies based on the survey results, and clustered the domains into four major areas. Results The final core competency model has four areas, 12 domains, and 34 core competencies. The major areas are theory-based problem assessment and formulation, study design and measurement, study implementation, and literature review and critique. Conclusion This new core competency model will provide guidance for the competency based education of translational medicine in Korea.

Process-oriented evaluation of an international faculty development program for Asian developing countries: a qualitative study

BackgroundNon-English-speaking developing countries in Southeast Asia have been provided only limited opportunities for faculty development in the education of health professions. Although there exist a few programs that have been shown to be effective, they are frequently presented with few explanations on how and why the programs work due to their outcome-oriented nature. This study explores the process of the Lee Jong-Wook Fellowship for Health Professional Education, an international faculty development program designed for capacity building of educators of health professions in Southeast Asian developing countries.MethodsFellows were from Cambodia, Myanmar, and Laos. Qualitative data were collected from two types of semi-structured interviews – group and individual. Thematic analysis was conducted to explore the factors related to the effectiveness of the program, framed by four components of faculty development, which included context, facilitators, program, and participants.ResultsFrom the thematic analysis, the authors identified a total of 12 themes in the four components of faculty development. In the context domain, the resource-poor setting, a culture that puts emphasis on hierarchy and seniority, and educational environment depending on individual commitment rather than broad consensus emerged as key factors. In the facilitators domain, their teaching methods and materials, mutual understanding between teacher and learner, and collaboration between facilitators mainly influenced the learning during the fellowship. In the program domain, the key advantages of the fellowship program were its applicability to the workplace of the fellows and enough allowed time for practice and reflection. Finally, in the participants domain, Fellows valued their heterogeneity of composition and recognized cognitive as well as non-cognitive attributes of the participants as essential.ConclusionsThis process-oriented evaluation reveals the diverse factors that contributed to achieving the intended outcomes of the fellowship. Although much evidence from best practices in faculty development are still valid, the findings suggest that the selection strategies, learning environment, and English communication should be given more consideration when organizing a program targeting these people and cultures. A comprehensive understanding of the process would contribute to developing tailored strategies for educators of health professions in developing countries in similar settings.

Transnational collaboration for faculty development in health professions education in Mongolia

Purpose The Mongolian National University of Medical Sciences is the only national university in Mongolia and has produced more than 90% of health professionals in the country. Experts from Mongolia and Korea embarked on a collaborative effort to develop educational programs for faculty development based on the personal and professional needs of faculty members. This study aimed to evaluate the outcomes of those educational programs to determine whether this transnational collaboration was successful. Methods A needs assessment survey was conducted among 325 faculty members. Based on the results of this survey, the joint expert team developed educational programs on seven core topics: clinical teaching, curriculum development, e-learning, item writing, medical research, organizational culture, and resident selection. Surveys evaluating the satisfaction and the attitudes of the participants were conducted for each program. Results Throughout the 17-day program, 16 experts from Korea and 14 faculty members from Mongolia participated as instructors, and a total of 309 participants attended the program. The average satisfaction score was 7.15 out of 8.0, and the attitudes of the participants towards relevant competencies significantly improved after each educational program. Conclusion The faculty development programs that were developed and implemented as part of this transnational collaboration between Mongolia and Korea are expected to contribute to the further improvement of health professions education in Mongolia. Future studies are needed to evaluate the long-term outcomes of these educational programs.