David Marzano

Low-hanging fruit: A clementine as a simulation model for advanced laparoscopy

Introduction Low-cost, high-fidelity models for training in advanced laparoscopic surgery techniques are not currently available. The objective of this study was to evaluate a model and assessment protocol for developing associated fine, precise laparoscopic dissection skills with accompanying surgical decision making. Methods Novice to expert laparoscopists (n = 41) were asked to remove the peel of a clementine in as few pieces as possible, separate and remove all albedo from and between all fruit segments, and return the clementine to as close to its natural state as possible with completely closed skin (sutured). Clinical decision making included deciding when unacceptable segment damage would result by removing difficult-to-extract albedo, analogous to treating lesions or metastases through other methods, rather than risking damage to vital anatomic structures. Faculty assessed deidentified video-recorded performances. Data analyses included analysis of variance with Bonferroni post hoc. Results A single-performance construct (operative ability) with 2 scoring dimensions (surgical skills and clinical judgment) was confirmed through factor analysis. There were significant performance differences between all experience levels (F2,41 = 59.175, P < 0.000). There were no statistical time differences between the groups. Conclusions Validation of this low-cost, easily facilitated model for developing advanced laparoscopic surgical skills may support the preparation of residents and fellows and provide a platform for skill acquisition, assessment, and basic critical thinking for performing laparoscopic tasks.

Preparing medical students for obstetrics and gynecology milestone level one: a description of a pilot curriculum

Background The implementation of the Accreditation Council for Graduate Medical Education (ACGME) Milestones in the field of obstetrics and gynecology has arrived with Milestones Level One defined as the level expected of an incoming first-year resident. Purpose We designed, implemented, and evaluated a 4-week elective for fourth-year medical school students, which utilized a multimodal approach to teaching and assessing the Milestones Level One competencies. Methods The 78-hour curriculum utilized traditional didactic lectures, flipped classroom active learning sessions, a simulated paging curriculum, simulation training, embalmed cadaver anatomical dissections, and fresh-frozen cadaver operative procedures. We performed an assessment of student knowledge and surgical skills before and after completion of the course. Students also received feedback on their assessment and management of eight simulated paging scenarios. Students completed course content satisfaction surveys at the completion of each of the 4 weeks. Results Students demonstrated improvement in knowledge and surgical skills at the completion of the course. Paging confidence trended toward improvement at the completion of the course. Student satisfaction was high for all of the course content, and the active learning components of the curriculum (flipped classroom, simulation, and anatomy sessions) had higher scores than the traditional didactics in all six categories of our student satisfaction survey. Conclusions This pilot study demonstrates a practical approach for preparing fourth-year medical students for the expectations of Milestones Level One in obstetrics and gynecology. This curriculum can serve as a framework as medical schools and specific specialties work to meet the first steps of the ACGMEs Next Accreditation System.Background The implementation of the Accreditation Council for Graduate Medical Education (ACGME) Milestones in the field of obstetrics and gynecology has arrived with Milestones Level One defined as the level expected of an incoming first-year resident. Purpose We designed, implemented, and evaluated a 4-week elective for fourth-year medical school students, which utilized a multimodal approach to teaching and assessing the Milestones Level One competencies. Methods The 78-hour curriculum utilized traditional didactic lectures, flipped classroom active learning sessions, a simulated paging curriculum, simulation training, embalmed cadaver anatomical dissections, and fresh-frozen cadaver operative procedures. We performed an assessment of student knowledge and surgical skills before and after completion of the course. Students also received feedback on their assessment and management of eight simulated paging scenarios. Students completed course content satisfaction surveys at the completion of each of the 4 weeks. Results Students demonstrated improvement in knowledge and surgical skills at the completion of the course. Paging confidence trended toward improvement at the completion of the course. Student satisfaction was high for all of the course content, and the active learning components of the curriculum (flipped classroom, simulation, and anatomy sessions) had higher scores than the traditional didactics in all six categories of our student satisfaction survey. Conclusions This pilot study demonstrates a practical approach for preparing fourth-year medical students for the expectations of Milestones Level One in obstetrics and gynecology. This curriculum can serve as a framework as medical schools and specific specialties work to meet the first steps of the ACGMEs Next Accreditation System.

Simulation and team training

The use of simulation-based methods for clinical and team training provides an opportunity for health care professionals to develop and maintain the skills required to effectively manage patient care. This is especially true for those rare events when emergency interventions require urgent, accurate, and cohesive team functioning. We present a framework for considering simulation-based training, examine contextual factors and the outcomes of research conducted to date in this area, and provide suggestions for selecting simulation-based approaches for developing obstetrics and gynecology teams in multiple contexts.

Interdisciplinary team training identifies discrepancies in institutional policies and practices

The objective of this study was to evaluate the impact of an interdisciplinary team-training program in obstetric emergencies on identifying unsupportive institutional policies and systems-based practices. We implemented a qualitative study design with a purposive sample of interdisciplinary physicians, nurses, and ancillary allied health professionals from 4 specialties (n = 79) to conduct a 6-month, weekly simulation-based intervention for managing obstetric emergencies. Debriefing focused on identifying discrepancies between clinical practice and institutional policies. Our data yielded 5 categories of discrepancies between institutional or departmental policy and actual clinical practice. Specific institutional policies and system-based practices were recommended to health system administration for reevaluation. Simulation-based interdisciplinary team training can inform system-wide quality improvement objectives that could lead to increased patient safety.

A Low-Cost Simulator for Learning to Manage Postpartum Hemorrhage in Rural Africa

Introduction: Postpartum hemorrhage (PPH) is the leading cause of maternal mortality in Africa and Asia. Despite an UN Millennium Development Goal to reduce maternal mortality rates, no significant effect has resulted to date, in large part because women in these areas give birth in rural communities with poor access to definitive care. Traditional birth attendants (TBAs) provide care for delivering mothers; however, they are neither trained nor equipped to recognize or manage PPH as a life-threatening emergent condition. The purpose of this study was to design and evaluate a low-cost, portable simulator for training TBAs and nurse midwives in the use of bimanual compression to manage PPH. Methods: Clinicians in USA and Ghana were consulted to develop the engineering specifications, including low cost, long lifetime, easy to use, portable, and high anatomic and procedural fidelity. Pugh charts were used to finalize the design from multiple concepts. The simulator was built and evaluated for validity by American and Ghanaian obstetricians, nurse midwives, midwifery students, and TBAs. The feasibility of the simulator for training illiterate learners was also assessed. Results: The simulator was evaluated to be an effective training platform with excellent fidelity and valid feedback mechanisms. It was demonstrated to be a feasible platform for training illiterate TBAs to perform bimanual compression. Conclusions: The low cost, portable simulator developed for this project has the potential to reduce maternal mortality from PPH in the developing world. Research is ongoing in this application.

A simulation-based scenario to help prepare learners in the management of obstetric emergencies

The use of simulation-based training to develop, improve, and maintain clinical competencies is effective for clinicians at all levels of training.1–6 Simulation-based methods are especially ideal for interdisciplinary practice around rare or infrequent clinical events where practitioner performance is critical for preventing patient morbidity or mortality.7–9 These have difficult to measure outcomes because of the rarity of event occurrence. The aim of simulation-based training is to analyze performance during enactments of real-life patient scenarios, detect areas of deficiency or excess, and through immediate debriefing initiate performance improvements that will transfer to applied clinical practice.1,4–6 The relative rarity and unpredictability of obstetric emergencies makes it difficult to assess whether or not simulation acquired competencies can have an impact on subsequent clinical performance. The case presented herein recounts the results of an actual obstetric incident where the competencies practiced through simulation-based training were applied in the management of an actual obstetric and neonatal emergency.

Healthcare management strategies: interdisciplinary team factors.

Purpose of review Interdisciplinary team factors are significant contributors to clinical performance and associated patient outcomes. Quality of care and patient safety initiatives identify human factors associated with team performance as a prime improvement area for clinical patient care. Recent findings The majority of references to interdisciplinary teams in obstetrics and gynecology in the literature recommends the use of multidisciplinary approaches when managing complex medical cases. The reviewed literature suggests that interdisciplinary team development is important for achieving optimally efficient and effective performance; however, few reports provide specific recommendations for how to optimally achieve these objectives in the process of providing interdisciplinary care to patients. The absence of these recommendations presents a significant challenge for those tasked with improving team performance in the workplace. The prescribed team development programs cited in the review are principally built around communication strategies and simulation-based training mechanisms. Few reports provide descriptions of optimal team-based competencies in the various contexts of obstetric and gynecology teams. However, team-based evaluation strategies and empirical data documenting the transfer of team training to applied clinical care are increasing in number and quality. Summary Our findings suggest that research toward determining team factors that promote optimal performance in applied clinical practice requires definition of specific competencies for the variable teams serving obstetrics and gynecology.

Validity: what does it mean for competency-based assessment in obstetrics and gynecology?

Validity refers to an evidence-based claim about the trustworthiness of decisions made from context-specific performance data. Validity requirements for competency-based assessments in obstetrics and gynecology have not been defined in the literature. We explain why validity is intrinsic to any discussion about competency assessment and provide a model for obstetrics and gynecology programs to use in determining the essential validity evidence for various forms of assessments. The implications of decisions made from assessment results influence the requisite level and precision of validity evidence. Although validity evidence is essential, it is also flexibly tied to the implications of decisions made from assessment results and not all assessments require the same degree of validity. We propose a model for considering validity, and build a discussion around specific assessment examples targeting progressive levels of expertise along the training continuum.

The Decision to Incision Curriculum: Teaching Preoperative Skills and Achieving Level 1 Milestones

OBJECTIVE To evaluate the effectiveness of a preoperative skills curriculum, and to assess and document competence in associated Obstetrics and Gynecology Level 1 Milestones. DESIGN The Decision to Incision curriculum was developed by a team of medical educators with the goal of teaching and evaluating 5 skills pertinent to Milestone 1: Preoperative consent, patient positioning, Foley catheter placement, surgical scrub, and preoperative time-out. Competence, overall skill performance, and knowledge were assessed by evaluator rating using checklists before and after the educational intervention. Differences between preintervention and postintervention skills performance and competence were assessed using Wilcoxon rank test and Fisher exact test, respectively. SETTING Clinical Simulation Center at an academic medical center. PARTICIPANTS Overall, 29 fourth year medical students matriculating into Obstetrics and Gynecology residencies. RESULTS The proportion of participants meeting Milestone competence significantly increased in all 5 skills, with competence achieved in 95.6% (95% CI: 92.1-99.0) of posttest skills assessments. Median overall performance also significantly improved for all 5 skills, with 83.6% (95% CI: 77.3-89.9) earning scores of 4 out of 5 or greater on the posttest. For knowledge testing, the proportion of correct responses significantly increased for both topics evaluated, from 45.2% to 99.7% (p < 0.0001) for positioning and from 32.8% to 83.1% (p < 0.0001) for time-out. CONCLUSIONS The decision to incision curriculum significantly improved preoperative skills, including skills that may be required on day 1 of residency. This curriculum also facilitated achievement and documentation of competence in multiple Milestones.

Evaluation of a precise and measurable model for learning laparoscopic tissue handling.

Introduction Laparoscopic tissue handling is quite difficult to measure using virtual-reality laparoscopic simulators and box-trainer exercises, and therefore, completion time is the predominant performance measure for simulation-based laparoscopic training exercises. The purpose of this study was to evaluate the construct validity of a training and assessment model for precise laparoscopic handling of delicate tissue. Methods Participants (n = 35) completed 2 progressively challenging laparoscopic tissue translocation exercises using delicate foam pieces and templates. Deidentified performances were scored using objective measures for tissue damage, accuracy, percentage complete, and completion time. Evaluation included multiple analysis of variance with repeated measures among the 3 groups as follows: medical students, residents and faculty who perform laparoscopic surgery less than once per week, and faculty members who perform laparoscopic surgery at least once per week. Results The model demonstrated significant construct validity by discriminating performances between the types of shapes and templates and across the levels of surgical experience on all dimensions. A significant interaction effect between the level of expertise and the difficulty of the exercise revealed excellent discrimination between experienced laparoscopic surgeons and others. Discussion This low-cost model provides an alternative or adjunct platform for laparoscopic training and assessment that requires precise and measurable handling of a delicate tissue.