Alberto Sarfatis

Development of ACLEEM questionnaire, an instrument measuring residents' educational environment in postgraduate ambulatory setting

Background: Students’ perceptions of their educational environment (EE) have been studied in undergraduate and postgraduate curricula. Postgraduate EE has been measured in hospital settings. However, there are no instruments available to measure the EE in postgraduate ambulatory settings. Aim: The aim of this study was to develop the “Ambulatory Care Learning Education Environment Measure” (ACLEEM). Methods: A mixed methodology was used including three stages: (1) Grounded theory (focus groups); (2) Delphi technique to identify consensus; and (3) Pilot study. Results: Three quota samples of approximately 60 stakeholders were formed, one as Focus Groups and two as Delphi panels. Eight focus groups were carried out including 58 residents (Latin-American Spanish speakers). The results were analysed and 173 items were offered to a National Delphi panel (61 residents and teachers). They reduced in two rounds the number of important items to 54. The 54-item questionnaire was then piloted with 63 residents and refined to the final version of the ACLEEM with 50 items and three domains. Conclusions: The 50-item inventory is a valid instrument to measure the EE in postgraduate ambulatory setting in Chile. Large-scale administration of the ACLEEM questionnaire to evaluate its construct validity and reliability are the next steps to test the psychometric properties of the instrument.

Management of Helicobacter pylori infection in Latin America: a Delphi technique-based consensus.

AIM To optimize diagnosis and treatment guidelines for this geographic region, a panel of gastroenterologists, epidemiologists, and basic scientists carried out a structured evaluation of available literature. METHODS Relevant questions were distributed among the experts, who generated draft statements for consideration by the entire panel. A modified three-round Delphi technique method was used to reach consensus. Critical input was also obtained from representatives of the concerned medical community. The quality of the evidence and level of recommendation supporting each statement was graded according to United States Preventive Services Task Force criteria. RESULTS A group of ten experts was established. The survey included 15 open-ended questions that were distributed among the experts, who assessed the articles associated with each question. The levels of agreement achieved by the panel were 50% in the first round, 73.3% in the second round and 100% in the third round. Main consensus recommendations included: (1) when available, urea breath and stool antigen test (HpSA) should be used for non-invasive diagnosis; (2) detect and eradicate Helicobacter pylori (H. pylori) in all gastroscopy patients to decrease risk of peptic ulcer disease, prevent o retard progression in patients with preneoplastic lesions, and to prevent recurrence in patients treated for gastric cancer; (3) further investigate implementation issues and health outcomes of H. pylori eradication for primary prevention of gastric cancer in high-risk populations; (4) prescribe standard 14-d triple therapy or sequential therapy for first-line treatment; (5) routinely assess eradication success post-treatment in clinical settings; and (6) select second- and third-line therapies according to antibiotic susceptibility testing. CONCLUSION These achievable steps toward better region-specific management can be expected to improve clinical health outcomes.

Evaluación del ambiente educacional en programas de especialización médica

BACKGROUND The Postgraduate Hospital Education Environment Measure (PHEEM) questionnaire, is a valid and reliable instrument to measure the educational environment (EE) in postgraduate medical education. AIM To evaluate the EE perceived by the residents of a postgraduate training program using the PHEEM. MATERIAL AND METHODS The PHEEM was applied in 2010-2011 in 35 specialty programs. We calculated their individual results and compared means of both global and individual domain scores of the PHEEM, by gender, university of origin and nationality. Cronbachs alpha coefficients and D study (Generalizability theory) were performed for reliability. RESULTS Three hundred eighteen residents were surveyed (75.7% of the total universe). The mean score of the PHEEM was 105.09 ± 22.46 (65.7% of the maximal score) which is considered a positive EE. The instrument is highly reliable (Cronbachs alpha = 0.934). The D study found that 15 subjects are required to obtain reliable results (G coefficient = 0.813). There were no significant differences between gender and university of origin. Foreigners evaluated better the EE than Chileans and racism was not perceived. The programs showed a safe physical environment and teachers with good clinical skills. The negative aspects perceived were a lack of information about working hours, insufficient academic counseling, and scanty time left for extracurricular activities. CONCLUSIONS This questionnaire allowed us to identify positive aspects of the EE, and areas to be improved in the specialty programs. The PHEEM is a useful instrument to evaluate the EE in Spanish-speaking participants of medical specialty programs.Background: The Postgraduate Hospital Education Environment Measure (PHEEM) questionnaire, is a valid and reliable instrument to measure the educational environment (EE) in postgraduate medical education. Aim: To evaluate the EE perceived by the residents of a postgraduate training program using the PHEEM. Material and Methods: The PHEEM was applied in 2010-2011 in 35 specialty programs. We calculated their individual results and compared means of both global and individual domain scores of the PHEEM, by gender, university of origin and nationality. Cronbachs alpha coefficients and D study (Generalizability theory) were performed for reliability. Results: Three hundred eighteen residents were surveyed (75.7% of the total universe). The mean score of the PHEEM was 105.09 ± 22.46 (65.7% of the maximal score) which is considered a positive EE. The instrument is highly reliable (Cronbachs alpha = 0.934). The D study found that 15 subjects are required to obtain reliable results (G coefficient = 0.813). There were no significant differences between gender and university of origin. Foreigners evaluated better the EE than Chileans and racism was not perceived. The programs showed a safe physical environment and teachers with good clinical skills. The negative aspects perceived were a lack of information about working hours, insufficient academic counseling, and scanty time left for extracurricular activities. Conclusions: This questionnaire allowed us to identify positive aspects of the EE, and areas to be improved in the specialty programs. The PHEEM is a useful instrument to evaluate the EE in Spanish-speaking participants of medical specialty programs.

Evaluación de docentes clínicos de Postgrado: desarrollo y propiedades psicométricas del instrumento MEDUC-PG14

Experts in medical education, teachers and residents of a medical school participated in interviews and focus groups. With this information, 26 categories (79 items) were proposed and reduced to 14 items (Likert scale 1-5) by an expert’s Delphi panel, generating the MEDUC-PG14 survey, which was answered by 123 residents from different programs of medical specialties. Construct validity was carried out. Factor analysis showed three domains: Teaching and evaluation, respectful behavior towards patients and health care team, and providing feedback. The global score was 4.46 ± 0.94 (89% of the maximum). One teachers’ strength, as evaluated by their residents was “respectful behavior” with 4.85 ± 0.42 (97% of the maximum). “Providing feedback” obtained 4.09 ± 1.0 points (81.8% of the maximum). MEDUC-PG14 survey had a Cronbach’s alpha coefficient of 0.947.

Módulos interactivos en línea de semiología médica: Una herramienta para estandarizar el aprendizaje clínico

Background: The learning process for medical semiology depends on multidisciplinary teaching activities, including simulation tools. These tools should achieve a standardization level aiming at a same level of basic knowledge in each student. Aim: To evaluate an interactive online semiology learning tool. Material and methods: An interactive online learning method for medical semiology was developed. It focused mainly on physical examination and incorporated audiovisual and self-explanatory elements, to strengthen the acquisition of skills and basic knowledge for each standardized clinical learning simulation session. Subsequently, a satisfaction survey was conducted. Also the performance of students in a clinical examination was compared with that of students of the previous year. Results: Student satisfaction was outstanding, and there was a significant improvement in the performance on the final exam. Conclusions: The use of interactive self-learning online content for medical semiology provides an effective tool to improve student learning.

Evaluación para el aprendizaje: experiencia en un curso teórico de pregrado en medicina.

Background: Assessment for learning is a paradigm that is taking shape in the field of medical education. This approach aims to embed the assessment process within the educational and learning process. Aim: to evaluate the impact of curricular changes, from a focus of assessment of learning to one of assessment for learning, in the perception of undergraduate students of medicine and their final grades obtained in a theoretical course (TCG). Material and methods: In the year 2011 lectures were reduced and intermediate assessments followed by a feedback session were introduced. The activities of each program course, surveys about student perceptions of the course and the final grades of students (assessments with multiple choice questions) were compared between the periods prior and after curricular changes (2005-2010 and 2011-2013). Results: As a consequence of curricular changes, time for lectures was reduced by 19.5%, time for summative assessments was increased by 8.5%, and feedback activity, occupying 7.3% of the course time was added. There were significant improvements in student is perceptions in all areas assessed by surveys, emphasizing feedback and assessments. The overall grade assigned to the course dictated after implementing the changes increased from 6.18 to 6.59 (p <0.001, 1-7 scale). The grades of students also improved from an average of 5.78 to 6.43 (p<0.001, 1-7 scale). Conclusions: Assessment for learning achieved the desired educational impact without increasing the assigned curricular time. Programmatic assessment is favorably perceived by students.BACKGROUND Assessment for learning is a paradigm that is taking shape in the field of medical education. This approach aims to embed the assessment process within the educational and learning process. AIM To evaluate the impact of curricular changes, from a focus of assessment of learning to one of assessment for learning, in the perception of undergraduate students of medicine and their final grades obtained in a theoretical course (TCG). MATERIAL AND METHODS In the year 2011 lectures were reduced and intermediate assessments followed by a feedback session were introduced. The activities of each program course, surveys about student perceptions of the course and the final grades of students (assessments with multiple choice questions) were compared between the periods prior and after curricular changes (2005-2010 and 2011-2013). RESULTS As a consequence of curricular changes, time for lectures was reduced by 19.5%, time for summative assessments was increased by 8.5%, and feedback activity, occupying 7.3% of the course time was added. There were significant improvements in student is perceptions in all areas assessed by surveys, emphasizing feedback and assessments. The overall grade assigned to the course dictated after implementing the changes increased from 6.18 to 6.59 (p < 0.001, 1-7 scale). The grades of students also improved from an average of 5.78 to 6.43 (p < 0.001, 1-7 scale). CONCLUSIONS Assessment for learning achieved the desired educational impact without increasing the assigned curricular time. Programmatic assessment is favorably perceived by students.