Hyun Bae Yoon

Evaluation of an international faculty development program for developing countries in Asia: the Seoul Intensive Course for Medical Educators

BackgroundThe issue of collaboration in medical education is becoming prominent. Some faculty development programs have suggested an approach for promoting collaboration on a global level. However, non-English-speaking developing countries in Asia, especially in Southeast Asia, do not take advantage of them due to their unique context, such as language and culture. To address these issues, Seoul National University College of Medicine initiated a 6-week international faculty development program called the “Seoul Intensive Course for Medical Educators” for 16 fellows from five Asian countries (Cambodia, Laos, Mongolia, Myanmar, and Vietnam). The aim of this study is to report the evaluation results of the outcome of the program and discuss better ways of collaborating with developing countries.MethodsThree levels of collaboration—intraorganizational, intranational, and international—were central initiatives of the program. Prior to setting up the program details, we first established four design principles, following which the contents, materials, and facilitators were determined to maintain consistency with the design principles. The evaluation of the program was done with Kirkpatrick’s four-level model. Most of the evaluation data for level 1 were collected by two questionnaires, the post-module survey and the post-program survey. Portfolios and progress reports were mainly used to collect outcome data for levels 2 and 3, respectively.ResultsThe reaction was generally positive throughout the program and there was a significant correlation between satisfaction and relevance to one’s job or needs. Despite the fellows’ propensity for overestimating themselves, both the evaluators and fellows reported that there was significant improvement in learning. Opinions on the impact or urgency of the topics were slightly different from country to country; however, the answers regarding feasibility were fairly similar. Moreover, we could observe from the post-program progress reports that the transfer of learning was actively in progress, mainly for topics that were highly feasible.ConclusionsThese results show that the program was successful in terms of its effectiveness. Consistent and timely support is essential for the sustainable development of the medical education systems in these countries. Further understanding of the underlying factors on transfer (level 3) could improve the effectiveness of faculty development programs for developing countries.

Evaluation of a continuing professional development training program for physicians and physician assistants in hospitals in Laos based on the Kirkpatrick model

Purpose: Medical professionals from Korea and Laos have been working together to develop a continuing professional development training program covering the major clinical fields of primary care. This study aimed to evaluate the effectiveness of the program from 2013 to 2014 using the Kirkpatrick model. Methods: A questionnaire was used to evaluate the reaction of the trainees, and the trainers assessed the level of trainees’ performance at the beginning and the end of each clinical section. The transfer (behavioral change) of the trainees was evaluated through the review of medical records written by the trainees before and after the training program. Results: The trainees were satisfied with the training program, for which the average score was 4.48 out of 5.0. The average score of the trainees’ performance at the beginning was 2.39 out of 5.0, and rose to 3.88 at the end of each section. The average score of the medical records written before the training was 2.92 out of 5.0, and it rose to 3.34 after the training. The number of patient visits to the district hospitals increased. Conclusion: The continuing professional development training program, which was planned and implemented with the full engagement and responsibility of Lao health professionals, proved to be effective.

Developing a core competency model for translational medicine curriculum

Purpose This study aimed to develop a core competency model for translational medicine curriculum in the Korean graduate education context. Methods We invited specialists and key stakeholders to develop a consensus on a core competency model. The working group composed of 17 specialists made an initial draft of a core competency model based on the literature review. The initial draft was sent to the survey group by email to ask whether they agreed or disagreed with each core competency. The working group simplified, merged, or excluded the competencies that received less than 80% agreement among the 43 survey respondents. The working group also reorganized the order of the domains and competencies based on the survey results, and clustered the domains into four major areas. Results The final core competency model has four areas, 12 domains, and 34 core competencies. The major areas are theory-based problem assessment and formulation, study design and measurement, study implementation, and literature review and critique. Conclusion This new core competency model will provide guidance for the competency based education of translational medicine in Korea.

Validity and reliability assessment of a peer evaluation method in team-based learning classes

Purpose Team-based learning (TBL) is increasingly employed in medical education because of its potential to promote active group learning. In TBL, learners are usually asked to assess the contributions of peers within their group to ensure accountability. The purpose of this study is to assess the validity and reliability of a peer evaluation instrument that was used in TBL classes in a single medical school. Methods A total of 141 students were divided into 18 groups in 11 TBL classes. The students were asked to evaluate their peers in the group based on evaluation criteria that were provided to them. We analyzed the comments that were written for the highest and lowest achievers to assess the validity of the peer evaluation instrument. The reliability of the instrument was assessed by examining the agreement among peer ratings within each group of students via intraclass correlation coefficient (ICC) analysis. Results Most of the students provided reasonable and understandable comments for the high and low achievers within their group, and most of those comments were compatible with the evaluation criteria. The average ICC of each group ranged from 0.390 to 0.863, and the overall average was 0.659. There was no significant difference in inter-rater reliability according to the number of members in the group or the timing of the evaluation within the course. Conclusion The peer evaluation instrument that was used in the TBL classes was valid and reliable. Providing evaluation criteria and rules seemed to improve the validity and reliability of the instrument.

Transnational collaboration for faculty development in health professions education in Mongolia

Purpose The Mongolian National University of Medical Sciences is the only national university in Mongolia and has produced more than 90% of health professionals in the country. Experts from Mongolia and Korea embarked on a collaborative effort to develop educational programs for faculty development based on the personal and professional needs of faculty members. This study aimed to evaluate the outcomes of those educational programs to determine whether this transnational collaboration was successful. Methods A needs assessment survey was conducted among 325 faculty members. Based on the results of this survey, the joint expert team developed educational programs on seven core topics: clinical teaching, curriculum development, e-learning, item writing, medical research, organizational culture, and resident selection. Surveys evaluating the satisfaction and the attitudes of the participants were conducted for each program. Results Throughout the 17-day program, 16 experts from Korea and 14 faculty members from Mongolia participated as instructors, and a total of 309 participants attended the program. The average satisfaction score was 7.15 out of 8.0, and the attitudes of the participants towards relevant competencies significantly improved after each educational program. Conclusion The faculty development programs that were developed and implemented as part of this transnational collaboration between Mongolia and Korea are expected to contribute to the further improvement of health professions education in Mongolia. Future studies are needed to evaluate the long-term outcomes of these educational programs.