Markus Krautter

Effects of Peyton's Four-Step Approach on Objective Performance Measures in Technical Skills Training: A Controlled Trial

Background: Although skills-lab training is widely used for training undergraduates in technical procedures, the way in which clinical skills are to be used and instructed remains a matter of debate. Purpose: We conducted a randomized controlled trial to evaluate the learning outcome of two different instructional approaches in the context of acquiring procedural–technical skills. Methods: Volunteer 2nd- and 3rd-year medical students were randomly assigned to an intervention group receiving instruction according to Peytons Four-Step Approach (IG; n = 17) or to a control group receiving standard instruction (CG; n = 17). Both groups were taught gastric-tube insertion using a manikin. Following each of the two forms of instruction, participants’ first independent gastric-tube insertions were video recorded and scored by two independent video assessors using binary checklists and global rating forms. The time required for each instructional approach and for the first independent performance of the skill was measured. Results: A total of 34 students agreed to participate in the trial. There were no statistically significant group differences with regard to age, sex, completed education in a medical profession, or completed medical clerkships. The groups did not differ in terms of correct stepwise performance of the procedure as assessed by a binary checklist (p < .802). However, ratings based on global rating scales assessing professionalism and accompanying patient-doctor communication proved significantly better in IG (both ps < .001). The length of the different instructional approaches did not differ significantly between the two groups (IG: 605 ± 65 s; CG: 572 ± 79 s; p < .122), but the time needed for the first independent performance of gastric-tube placement on the manikin was significantly shorter in IG (IG: 168 ± 30 s; CG: 242 ± 53 s; p < .001). Conclusions: Peytons Four-Step Approach is superior to standard instruction with respect to professionalism and accompanying doctor–patient communication and leads to faster performance when trainees perform the learned skill for the first time.

The benefit of repetitive skills training and frequency of expert feedback in the early acquisition of procedural skills

BackgroundRedundant training and feedback are crucial for successful acquisition of skills in simulation trainings. It is still unclear how or how much feedback should best be delivered to maximize its effect, and how learners’ activity and feedback are optimally blended. To determine the influence of high- versus low-frequency expert feedback on the learning curve of students’ clinical procedural skill acquisition in a prospective randomized study.MethodsN = 47 medical students were trained to insert a nasogastric tube in a mannequin, including structured feedback in the initial instruction phase at the beginning of the training (T1), and either additional repetitive feedback after each of their five subsequent repetitions (high-frequency feedback group, HFF group; N = 23) or additional feedback on just one occasion, after the fifth repetition only (low-frequency feedback group, LFF group; N = 24). We assessed a) task-specific clinical skill performance and b) global procedural performance (five items of the Integrated Procedural Performance Instrument (IPPI); on the basis of expert-rated videotapes at the beginning of the training (T1) and during the final, sixth trial (T2).ResultsThe two study groups did not differ regarding their baseline data. The calculated ANOVA for task-specific clinical skill performance with the between-subject factor ‘Group’ (HFF vs. LFF) and within-subject factors ‘Time’ (T1 vs. T2) turned out not to be significant (p < .147). An exploratory post-hoc analyses revealed a trend towards a superior performance of HFF compared to LFF after the training (T2; p < .093), whereas both groups did not differ at the beginning (T1; p < .851). The smoothness of the procedure assessed as global procedural performance, was superior in HFF compared to LFF after the training (T2; p < .004), whereas groups did not differ at the beginning (T1; p < .941).ConclusionDeliberate practice with both high- and low-frequency intermittent feedback results in a strong improvement of students’ early procedural skill acquisition. High-frequency intermittent feedback, however, results in even better and smoother performance. We discuss the potential role of the cognitive workload on the results. We advocate a thoughtful allocation of tutor resources to future skills training.

Modification of Peyton’s four-step approach for small group teaching – a descriptive study

BackgroundSkills-lab training as a methodological teaching approach is nowadays part of the training programs of almost all medical faculties. Specific ingredients have been shown to contribute to a successful learning experience in skills-labs. Although it is undoubted that the instructional approach used to introduce novel clinical technical skills to learners has a decisive impact on subsequent skills performance, as yet, little is known about differential effects of varying instructional methods. An instructional approach that is becoming increasingly prevalent in medical education is “Peyton’s Four-Step Approach”. As Peyton’s Four Step Approach was designed for a 1:1 teacher : student ratio, the aim of the present study was to develop and evaluate a modified Peyton’s Approach for small group teaching.MethodsThe modified Peyton’s Approach was applied in three skills-lab training sessions on IV catheter insertion, each with three first- or second year medical students (n = 9), delivered by three different skills-lab teachers. The presented descriptive study investigated the practicability and subjective impressions of skills-lab trainees and tutors. Skills-lab sessions were evaluated by trainees’ self-assessment, expert ratings, and qualitative analysis of semi-standardized interviews conducted with trainees and tutors.ResultsThe model was well accepted by trainees, and was rated as easy to realize, resulting in a good flow of teaching and success in attracting trainee’s attention when observed by expert raters. Qualitative semi-standardized interviews performed with all of the trainees and tutors revealed that trainees valued repeated observation, instruction of trainees and the opportunity for independent performance, while tutors stressed that trainees were highly concentrated throughout the training and that they perceived repeated observation to be a valuable preparation for their own performance.ConclusionThe modified Peyton’s Approach to instruct small groups of students in skills-lab training sessions has revealed to be practicable, well accepted by trainees, and easy for tutors to realize. Further research should address the realization of the model in larger skills-lab training groups.

Improving ward round skills

Abstract Background: Ward rounds represent an important task in clinical settings. Despite their importance, students show substantial deficits in ward round competencies (e.g. physical examination, drug prescription, documentation). Previously reported teaching methods such as ward round training with standardized patients or educational wards, however, are time-consuming and expensive. Aims: To assess the effects of a structured on-ward supervision program for final-year students with specially trained supervising doctors focusing on ward round competencies. Method: A total of 36 medical students were randomly assigned to an intervention group (IG) and a control group (CG). During an eight-week-long training course, the intervention group (IG; n = 18) received structured ward round training while the control group (CG; n = 18) received on-ward training regarding how to take patient histories and perform physical examinations. Ward round competencies were assessed using simulated ward round scenarios with objective checklist ratings and standardized patient ratings. Results: The IG achieved significantly more predefined learning goals compared to the CG. Standardized patient ratings did not differ significantly between groups. Conclusions: Results provide evidence that the presented program is a feasible and efficient tool for teaching ward round skills at the bedside. Further research should focus on cost effectiveness compared to alternative models.

Voluntary undergraduate technical skills training course to prepare students for clerkship assignment: tutees’ and tutors’ perspectives

BackgroundSkills lab training has become a widespread tool in medical education, and nowadays, skills labs are ubiquitous among medical faculties across the world. An increasingly prevalent didactic approach in skills lab teaching is peer-assisted learning (PAL), which has been shown to be not only effective, but can be considered to be on a par with faculty staff-led training. The aim of the study is to determine whether voluntary preclinical skills teaching by peer tutors is a feasible method for preparing medical students for effective workplace learning in clerkships and to investigate both tutees’ and tutors’ attitudes towards such an intervention.MethodsA voluntary clerkship preparation skills course was designed and delivered. N = 135 pre-clinical medical students visited the training sessions. N = 10 tutors were trained as skills-lab peer tutors. Voluntary clerkship preparation skills courses as well as tutor training were evaluated by acceptance ratings and pre-post self-assessment ratings. Furthermore, qualitative analyses of skills lab tutors’ attitudes towards the course were conducted following principles of grounded theory.ResultsResults show that a voluntary clerkship preparation skills course is in high demand, is highly accepted and leads to significant changes in self-assessment ratings. Regarding qualitative analysis of tutor statements, clerkship preparation skills courses were considered to be a helpful and necessary asset to preclinical medical education, which benefits from the tutors’ own clerkship experiences and a high standardization of training. Tutor training is also highly accepted and regarded as an indispensable tool for peer tutors.ConclusionsOur study shows that the demand for voluntary competence-oriented clerkship preparation is high, and a peer tutor-led skills course as well as tutor training is well accepted. The focused didactic approach for tutor training is perceived to be effective in preparing tutors for their teaching activity in this context. A prospective study design would be needed to substantiate the results objectively and confirm the effectiveness.

Peyton's four-step approach: differential effects of single instructional steps on procedural and memory performance - a clarification study.

Background Although Peyton’s four-step approach is a widely used method for skills-lab training in undergraduate medical education and has been shown to be more effective than standard instruction, it is unclear whether its superiority can be attributed to a specific single step. Purpose We conducted a randomized controlled trial to investigate the differential learning outcomes of the separate steps of Peyton’s four-step approach. Methods Volunteer medical students were randomly assigned to four different groups. Step-1 group received Peyton’s Step 1, Step-2 group received Peyton’s Steps 1 and 2, Step-3 group received Peyton’s Steps 1, 2, and 3, and Step-3mod group received Peyton’s Steps 1 and 2, followed by a repetition of Step 2. Following the training, the first independent performance of a central venous catheter (CVC) insertion using a manikin was video-recorded and scored by independent video assessors using binary checklists. The day after the training, memory performance during delayed recall was assessed with an incidental free recall test. Results A total of 97 participants agreed to participate in the trial. There were no statistically significant group differences with regard to age, sex, completed education in a medical profession, completed medical clerkships, preliminary memory tests, or self-efficacy ratings. Regarding checklist ratings, Step-2 group showed a superior first independent performance of CVC placement compared to Step-1 group (P<0.001), and Step-3 group showed a superior performance to Step-2 group (P<0.009), while Step-2 group and Step-3mod group did not differ (P=0.055). The findings were similar in the incidental free recall test. Conclusion Our study identified Peyton’s Step 3 as being the most crucial part within Peyton’s four-step approach, contributing significantly more to learning success than the previous steps and reaching beyond the benefit of a mere repetition of skills demonstration.

Workplace learning: an analysis of students' expectations of learning on the ward in the Department of Internal Medicine.

Background: Learning on the ward as a practice-oriented preparation for the future workplace plays a crucial role in the medical education of future physicians. However, students’ ward internship is partially problematic due to condensed workflows on the ward and the high workload of supervising physicians. For the first time in a German-speaking setting, students’ expectations and concerns about their internship on the ward are examined in a qualitative analysis regarding their internal medicine rotation within clinical medical education. Methods: Of a total of 168 medical students in their 6th semester at the Medical Faculty of Heidelberg, 28 students (m=8, f=20, Ø 23.6 years) took part in focus group interviews 3 to 5 days prior to their internship on the internal medicine ward within their clinical internal medicine rotation. Students were divided into four different focus groups. The protocols were transcribed and a content analysis was conducted based on grounded theory. Results: We gathered a total of 489 relevant individual statements. The students hope for a successful integration within the ward team, reliable and supportive supervisors and supervision in small groups. They expect to face the most common diseases, to train the most important medical skills, to assume full responsibility for their own patients and to acquire their own medical identity. The students fear an insufficient time frame to achieve their aims. They are also concerned they will have too little contact with patients and inadequate supervision. Conclusion: For the development and standardization of effective student internships, the greatest relevance should be attributed to guidance and supervision by professionally trained and well-prepared medical teachers, entailing a significant increase in staff and costs. A structural framework is required in order to transfer the responsibility for the treatment of patients to the students at an early stage in medical education and in a longitudinal manner. The data suggest that the development and establishment of guidelines for medical teachers associated with clearly defined learning objectives for the students’ internships are urgently needed. Based on our findings, we provide first recommendations and suggest possible solutions.

Can the 'Assessment Drives Learning' effect be detected in clinical skills training? - Implications for curriculum design and resource planning

Purpose: The acquisition of clinical-technical skills is of particular importance for the doctors of tomorrow. Procedural skills are often trained for the first time in skills laboratories, which provide a sheltered learning environment. However, costs to implement and maintain skills laboratories are considerably high. Therefore, the purpose of the present study was to investigate students’ patterns of attendance of voluntary skills-lab training sessions and thereby answer the following question: Is it possible to measure an effect of the theoretical construct related to motivational psychology described in the literature – ‘Assessment drives learning’ – reflected in patterns of attendance at voluntary skills-lab training sessions? By answering this question, design recommendations for curriculum planning and resource management should be derived. Method: A retrospective, descriptive analysis of student skills-lab attendance related to voluntary basic and voluntary advanced skills-lab sessions was conducted. The attendance patterns of a total of 340 third-year medical students in different successive year groups from the Medical Faculty at the University of Heidelberg were assessed. Results: Students showed a preference for voluntary basic skills-lab training sessions, which were relevant to clinical skills assessment, especially at the beginning and at the end of the term. Voluntary advanced skills-lab training sessions without reference to clinical skills assessment were used especially at the beginning of the term, but declined towards the end of term. Conclusion: The results show a clear influence of assessments on students’ attendance at skills-lab training sessions. First recommendations for curriculum design and resource management will be described. Nevertheless, further prospective research studies will be necessary to gain a more comprehensive understanding of the motivational factors impacting students’ utilisation of voluntary skills-lab training in order to reach a sufficient concordance between students’ requirements and faculty offers, as well as resource management.

Digital rectal examination skills: first training experiences, the motives and attitudes of standardized patients

BackgroundPhysical clinical examination is a core clinical competence of medical doctors. In this regard, digital rectal examination (DRE) plays a central role in the detection of abnormalities of the anus and rectum. However, studies in undergraduate medical students as well as newly graduated doctors show that they are insufficiently prepared for performing DRE. Training units with Standardized Patients (SP) represent one method to deliver DRE skills. As yet, however, it is little known about SPs’ attitudes.MethodsThis is a qualitative study using a grounded theory approach. Interviews were conducted with 4 standardized patients about their experiences before, during and after structured SP training to deliver DRE competencies to medical students. The resulting data were subjected to thematic content analysis.ResultsResults show that SPs do not have any predominant motives for DRE program participation. They participate in the SP training sessions with relatively little prejudice and do not anticipate feeling highly vulnerable within teaching sessions with undergraduate medical students.ConclusionsThe current study examined SPs’ motives, views, expectations and experiences regarding a DRE program during their first SP training experiences. The results enabled us to derive distinct action guidelines for the recruitment, informing and briefing of SPs who are willing to participate in a DRE program.

Physical examination skills training: Faculty staff vs. patient instructor feedback—A controlled trial

Background Standardized patients are widely used in training of medical students, both in teaching and assessment. They also frequently lead complete training sessions delivering physical examination skills without the aid of faculty teaching staff–acting as “patient instructors” (PIs). An important part of this training is their ability to provide detailed structured feedback to students which has a strong impact on their learning success. Yet, to date no study has assessed the quality of physical examination related feedback by PIs. Therefore, we conducted a randomized controlled study comparing feedback of PIs and faculty staff following a physical examination assessed by students and video assessors. Methods 14 PIs and 14 different faculty staff physicians both delivered feedback to 40 medical students that had performed a physical examination on the respective PI while the physicians observed the performance. The physical examination was rated by two independent video assessors to provide an objective performance standard (gold standard). Feedback of PI and physicians was content analyzed by two different independent video assessors based on a provided checklist and compared to the performance standard. Feedback of PIs and physicians was also rated by medical students and video assessors using a questionnaire consisting of 12 items. Results There was no statistical significant difference concerning overall matching of physician or PI feedback with gold standard ratings by video assessment (p = .219). There was also no statistical difference when focusing only on items that were classified as major key steps (p = .802), mistakes or parts that were left out during physical examination (p = .219) or mistakes in communication items (p = .517). The feedback of physicians was significantly better rated than PI feedback both by students (p = .043) as well as by video assessors (p = .034). Conclusions In summary, our study demonstrates that trained PIs are able to provide feedback of equal quantitative value to that of faculty staff physicians with regard to a physical examination performed on them. However, both the students and the video raters judged the quality of the feedback given by the physicians to be significantly better than that of the PIs.