Martha Todd

The Development of a Quantitative Evaluation Tool for Simulations in Nursing Education

In a complex healthcare environment, educating nursing students to safely care for clients is a challenging endeavor. As the use of high fidelity simulations increases, the ability to evaluate students is essential. A review of the literature identified a lack of tested simulation evaluation instruments to accurately measure student performance. A simulation evaluation tool was developed and tested with senior nursing students. Content validity was established from the literature and from the review of the tool by an expert panel. Reliability was established using sixteen simulation sessions, with two trained evaluators at each session. Percent agreement by evaluators ranged from 84.4% to 89.1%. Additional research needs to verify these results with different evaluators, varying levels of students, and additional scenarios. A valid, reliable tool to evaluate simulation experiences improves student assessment skills and ultimately clinical performance.

A Unique Simulation Teaching Method

Simulation is an excellent venue for students to learn experientially and provides opportunities for students to practice problem solving and psychomotor skills in a safe, controlled environment. Through the use of a specifically designed format, faculty at Creighton University School of Nursing have developed a unique method of implementing high-fidelity simulation that allows a more comprehensive learning experience. This innovative teaching strategy incorporates not just skill acquisition, but also care management concepts into the scenario, while requiring only one faculty member. Students simultaneously take one of two paths through the components of this method to achieve the same learning outcomes.

Reliability and internal consistency findings from the C-SEI

Human patient simulation (HPS) is increasingly being used as both a teaching and an evaluation strategy in nursing education. To meaningfully evaluate student performance in HPS activities, nurse educators must be equipped with valid and reliable instruments for measuring student performance. This study used a novel method, including leveled, video-archived simulation scenarios, a virtual classroom, and webinar and e-mail communication, to assess the reliability and internal consistency of data produced using the Creighton Simulation Evaluation Instrument. The interrater reliability, calculated using intraclass correlation (2,1) and 95% confidence interval, was 0.952 (0.697, 0.993). The intrarater reliability, calculated using intraclass correlation (3,1) and 95% confidence interval, was 0.883 (-0.001, 0.992), and the internal consistency, calculated using Cronbachs alpha, was α = 0.979. This article includes a sample of the instrument and provides valuable resources and reliability data for nurse educators and researchers interested in measuring student performance in HPS activities.

The development of an instrument to evaluate interprofessional student team competency

ABSTRACT Healthcare institutions, accreditation agencies for higher learning, and organizations such as the National Academy of Medicine in the United States, support interprofessional education (IPE) opportunities. However, incorporating IPE opportunities into academic settings remains difficult. One challenge is assessing IPE learning and practice outcomes, especially at the level of student performance to ensure graduates are “collaboration-ready”. The Creighton-Interprofessional Collaborative Evaluation (C-ICE) instrument was developed to address the need for a measurement tool for interprofessional student team performance. Four interprofessional competency domains provide the framework for the C-ICE instrument. Twenty-six items were identified as essential to include in the C-ICE instrument. This instrument was found to be both a reliable and a valid instrument to measure interprofessional interactions of student teams. Inter-rater reliability as measured by Krippendorff’s nominal alpha (nKALPHA) ranged from .558 to .887; with four of the five independent assessments achieving nKALPHA greater than or equal to 0.796. The findings indicated that the instrument is understandable (Gwet’s alpha coefficient (gAC) 0.63), comprehensive (gAC = 0.62), useful and applicable (gAC = 0.54) in a variety of educational settings. The C-ICE instrument provides educators a comprehensive evaluation tool for assessing student team behaviors, skills, and performance.

Preparing Students for Team-Based Care for Vulnerable Populations

Health professionals have an obligation to improve both the health of the individual and the public in a time of scarce resources. The Institute of Medicine (IOM), Healthy People Curriculum Task Force and professional education accreditation standards indicate the need for health care professionals to demonstrate competencies related to community engagement, basic health promotion skills and the ability to work effectively in interprofessional teams. An Interprofessional Course, IPE 413: Developing Care for a Vulnerable Population provides students the opportunity to collaborate to address health needs in cooperation with a community partner. Students work in teams to address the complex health care needs of an individual community member. The one hour elective course is open to students from nursing, occupational therapy, pharmacy, social work, and exercise science. Efforts are underway to explore the possibility of offering this course to medical students. Students are assessed on the knowledge and experience gained through this interprofessional experience using the Team Skills Scale and student reflections. Faculties from each of the disciplines utilize a collaborative model in the instructional design of the course. The content is co-taught and faculty not only role model interprofessional care, but also serve as mentors and resource personnel for the students as they work with their clients. Received: 07/10/2015 Accepted: 08/28/2015