Tyler J. Mulhearn

Are Ethics Training Programs Improving? A Meta-Analytic Review of Past and Present Ethics Instruction in the Sciences

Given the growing public concern and attention placed on cases of research misconduct, government agencies and research institutions have increased their efforts to develop and improve ethics education programs for scientists. The present study sought to assess the impact of these increased efforts by sampling empirical studies published since the year 2000. Studies published prior to 2000 examined in other meta-analytic work were also included to provide a baseline for assessing gains in ethics training effectiveness over time. In total, this quantitative review consisted of 66 empirical studies, 106 ethics courses, 150 effect sizes, and 10,069 training participants. Overall, the findings indicated that ethics instruction resulted in sizable benefits to participants and has improved considerably within the last decade. A number of specific findings also emerged regarding moderators of instructional effectiveness. Recommendations are discussed for improving the development, delivery, and evaluation of ethics instruction in the sciences.

How Do We Know What Works? A Review and Critique of Current Practices in Ethics Training Evaluation

ABSTRACT Training is a costly investment. As such, it is of great interest to know the extent to which that investment is yielding a positive return. Recent meta-analytic efforts have observed that ethics training programs are, indeed, having a positive effect, leading to the conclusion that the programs are working. However, they have also uncovered considerable variability in the effectiveness of ethics training programs, which leads to the purpose of the present study—to review current practices in ethics training evaluation. Through this review of 243 studies, consisting of 380 ethics trainings, we identified major themes in evaluation practices and training design. The tradeoffs associated with these evaluation procedures and designs are discussed, along with directions for future research.

Modeling the Instructional Effectiveness of Responsible Conduct of Research Education: A Meta-Analytic Path-Analysis

Predictive modeling in education draws on data from past courses to forecast the effectiveness of future courses. The present effort sought to identify such a model of instructional effectiveness in scientific ethics. Drawing on data from 235 courses in the responsible conduct of research (RCR), structural equation modeling techniques were used to test a predictive model of RCR course effectiveness. Fit statistics indicated the model fit the data well, with the instructional characteristics included in the model explaining approximately 85% of the variance in RCR instructional effectiveness. Implications for using the model to develop and improve future RCR courses are discussed.

A Meta-analytic Comparison of Face-to-Face and Online Delivery in Ethics Instruction: The Case for a Hybrid Approach

Despite the growing body of literature on training in the responsible conduct of research, few studies have examined the effectiveness of delivery formats used in ethics courses (i.e., face-to-face, online, hybrid). The present effort sought to address this gap in the literature through a meta-analytic review of 66 empirical studies, representing 106 ethics courses and 10,069 participants. The frequency and effectiveness of 67 instructional and process-based content areas were also assessed for each delivery format. Process-based contents were best delivered face-to-face, whereas contents delivered online were most effective when restricted to compliance-based instructional contents. Overall, hybrid courses were found to be most effective, suggesting that ethics courses are best delivered using a blend of formats and content areas. Implications and recommendations for future development of ethics education courses in the sciences are discussed.

Biomedical ethics education may benefit from integrating compliance and analysis approaches.

Two approaches have been widely applied in ethics education in the biomedical sciences: field-specific compliance and professional decision processes. Both approaches offer unique benefits to trainees, but future courses that integrate these two approaches might prove particularly valuable.

Effective Practices in the Delivery of Research Ethics Education: A Qualitative Review of Instructional Methods

ABSTRACT In order to delineate best practices for courses on research ethics, the goal of the present effort was to identify themes related to instructional methods reflected in effective research ethics and responsible conduct of research (RCR) courses. By utilizing a qualitative review, four themes relevant to instructional methods were identified in effective research ethics courses: active participation, case-based activities, a combination of individual and group approaches, and a small number of instructional methods. Three instructional method themes associated with less effective courses were also identified: passive learning, a group-based approach, and a large number of instructional methods. Key characteristics of each theme, along with example courses relative to each theme, are described. Additionally, implications regarding these instructional method themes and recommendations for best practices in research ethics courses are discussed.

Cross-Field Comparison of Ethics Education: Golden Rules and Particulars.

ABSTRACT Research misconduct negatively impacts the scientific community and society in general. Providing training in the responsible conduct of research (RCR) to researchers is one viable approach to minimizing research misconduct. Although recent evidence suggests ethics training can indeed be effective, little empirical work has examined the similarities and differences across fields. In the present study, we analyzed 62 empirical studies in engineering, biomedical science, social science, and mixed fields. The findings suggest certain instructional principles, or “golden rules,” apply generally to all fields. These golden rules include maintaining a field-specific or field-general approach and emphasizing processes in training. The findings also suggest that content areas contributing to instructional effectiveness vary as a function of field. Generally, it appears that all fields may benefit from taking a multi-pronged approach to ethics education wherein the salient field issues are covered. Implications for RCR education are discussed.

Leadership Models for Team Dynamics and Cohesion: The Mars Mission

Abstract In this chapter, we view team cohesion from a more generalized perspective of team dynamics, and focus on four leadership models for understanding these dynamics in teams in the context of the Mars Mission. Given the long duration of the mission with periods of no or intermittent communication and support, isolation and confinement, and the risk of great physical and psychological harm, having tailored leadership models for this unique team dynamics context is critical. And yet, many of these same dangerous conditions occur in other contexts such as for first responders, crisis management teams, Special Forces operations, and scientific exploration teams in extreme environments. As such, building from a model of leadership and team dynamics for dangerous contexts, for a long-duration space mission involving both Mission Control and the Astronaut Crew, these models of leadership and team dynamics include a collective-level approach for scientists and engineers, a primarily crew-based socioemotional approach, a leader-level crisis/emergency approach, and a dyadic or sortie-level approach. Implications of these models for effective leadership in building and maintaining team dynamics and cohesion for the Mars Mission and across a variety of other dangerous and extreme contexts are discussed.

How Did You Like This Course? The Advantages and Limitations of Reaction Criteria in Ethics Education

Ethics courses are most commonly evaluated using reaction measures. However, little is known about the specific types of reaction data being collected (e.g., content relevance, course satisfaction) and how these reaction data relate to improvements in trainee performance (e.g., knowledge, moral reasoning). Using a sample of 381 ethics training sessions, major reaction data categories were identified. Content and course satisfaction were the most frequently collected types of reaction criteria. Furthermore, content relevance (r = .84) and course satisfaction (r = .79) showed strong, positive relationships with performance criteria, whereas content satisfaction demonstrated a moderate, negative relationship (r = –.28). These results and future directions for ethics training evaluation are discussed.

Curricular Approaches in Research Ethics Education: Reflecting on More and Less Effective Practices in Instructional Content

ABSTRACT Over the past decade, the effectiveness of ethics education programs has increased with regard to trainee outcomes, such as knowledge, awareness, and ethical decision making. However, despite the overall improvement in training effectiveness, considerable variability still exists across programs. One potential source of variability arises from the substantial range in instructional training content utilized across ethics training courses. The goal of the present effort was to clarify which approaches in ethics education result in positive training outcomes through the identification of instructional content themes. Through a qualitative review of ethics training courses, we identified key themes in instructional content curriculum associated with effective courses: domain-general, domain-specific, standard compliance, professionalism, and process-based. In addition, we identified key themes associated with less effective courses: mixed-specificity, narrow coverage, and idealized ethics. Descriptions and key characteristics of each theme along with example courses are provided. Implications of the content themes for ethics education are discussed.