Laurie Stevahn

Establishing Essential Competencies for Program Evaluators

This article presents a comprehensive taxonomy of essential competencies for program evaluators. First, the authors provide a rationale for developing evaluator competencies, along with a brief history of the initial development and validation of the taxonomy of essential evaluator competencies in King, Stevahn, Ghere, and Minnema (2001). Second, they present a revised version of that taxonomy and describe the revision process. Third, a crosswalk accompanying the taxonomy indicates which competencies address standards, principles, and skills endorsed by major evaluation associations in North America. Finally, the authors identify future needs related to the taxonomy, including the need for validation research, a shared understanding of terms, and the construction of descriptive rubrics for assessing competence.

Toward a Taxonomy of Essential Evaluator Competencies

This article discusses an exploratory study designed to determine the extent to which evaluation professionals, representing diverse backgrounds and approaches, could reach agreement on a proposed taxonomy of essential evaluator competencies. Participants were 31 diverse individuals in the field of program evaluation in the greater Minneapolis-St. Paul, Minnesota area who systematically engaged in a Multi-Attribute Consensus Reaching process. Both quantitative and qualitative results predominantly indicated consensus on more than three-fourths of the proposed competencies. Areas of disagreement reflected the role- and context-specific nature of evaluation practice.

A Professional Development Unit for Reflecting on Program Evaluator Competencies

This article describes an interactive professional development unit that engages both novice and experienced evaluators in (a) learning about the Essential Competencies for Program Evaluators (ECPE), (b) applying the competencies to program evaluation contexts, and (c) using the ECPE to reflect on their own professional practices. The article briefly summarizes current issues about program evaluator competencies and the components of effective professional development. It then describes the ECPE; the objectives, content, and process of the professional development session; and the ECPE Self-Assessment Instrument. Facilitators can adapt and use the unit in a variety of settings, including university courses and program evaluation conferences.

Managing Conflict Constructively in Program Evaluation

Evaluators almost inevitably experience conflict in the course of conducting evaluation studies. This article first presents two theoretical frameworks from social psychology - conflict strategies theory and constructive conflict resolution theory - useful for constructively managing conflict in evaluation settings. Second, we discuss theory-derived skills related to structuring cooperative goals and tasks in evaluation studies as well as how to use integrative negotiation procedures to address disputes that arise during the evaluation process. Finally, we explain how these theories can provide evaluators with a lens through which to analyze evaluation contexts, thereby helping them to make wise decisions for effective evaluation practice.

The Plot Thickens: Supporting Pre-Service Teachers in Authentic Use of Cooperative Learning through the Storypath Instructional Approach.

Abstract Pre-service teachers typically find it challenging to implement cooperative learning authentically in schools given the complexities of classroom environments. Curriculum integration also is demanding because it requires combining research-informed pedagogies and best practices to promote academic and social learning. This article describes how Storypath, a narrative approach to organising the curriculum, assists novice teachers in skilfully implementing cooperative learning and meaningfully integrating it with other best practices. It begins by describing cooperative learning’s central role in Seattle University’s Master in Teaching (MIT) programme, along with elements foundational to cooperative work. It continues by explaining how Storypath scaffolds pre-service teachers’ capacity to successfully facilitate cooperative learning, then provides a specific example focused on environmental sustainability. The example illustrates how Storypath naturally creates positive interdependence among participants, thereby nurturing compelling successful cooperative experiences in creating the story. The article concludes with reflections on impact from MIT graduates.