William R. Penuel

What Makes Professional Development Effective? Strategies That Foster Curriculum Implementation

This study uses a sample of 454 teachers engaged in an inquiry science program to examine the effects of different characteristics of professional development on teachers’ knowledge and their ability to implement the program. The authors analyzed results from a survey of teachers served by 28 professional development providers within a hierarchical linear modeling framework. Consistent with findings from earlier studies of effective professional development, this study points to the significance of teachers’ perceptions about how coherent their professional development experiences were for teacher learning and program implementation. The authors also found that the incorporation of time for teachers to plan for implementation and provision of technical support were significant for promoting program implementation in the program.

Implementation and Effects of One-to-One Computing Initiatives: A Research Synthesis.

Abstract There are now a large number of initiatives designed to make laptops with wireless connectivity available to all students in schools. This paper synthesizes findings from research and evaluation studies that analyzed implementation and effects of one-to-one initiatives from a range of countries. Factors related to successful implementation reported in the research include extensive teacher professional development, access to technical support, and positive teacher attitudes toward student technology use. Outcome studies with rigorous designs are few, but those studies that did measure outcomes consistently reported positive effects on technology use, technology literacy, and writing skills.

Organizing Research and Development at the Intersection of Learning, Implementation, and Design:

This article describes elements of an approach to research and development called design-based implementation research. The approach represents an expansion of design research, which typically focuses on classrooms, to include development and testing of innovations that foster alignment and coordination of supports for improving teaching and learning. As in policy research, implementation is a key focus of theoretical development and analysis. What distinguishes this approach from both traditional design research and policy research is the presence of four key elements: (a) a focus on persistent problems of practice from multiple stakeholders’ perspectives; (b) a commitment to iterative, collaborative design; (c) a concern with developing theory related to both classroom learning and implementation through systematic inquiry; and (d) a concern with developing capacity for sustaining change in systems.

Handhelds go to school: lessons learned

Working in conjunction with teachers, researchers have developed a series of projects exploring the potential for using wireless handheld devices to enhance K-12 classroom instruction.

DESIGNING FORMATIVE ASSESSMENT SOFTWARE WITH TEACHERS: AN ANALYSIS OF THE CO-DESIGN PROCESS

Researchers in the learning sciences have explored a collaborative approach to developing innovations that fit into real classroom contexts. The co-design process relies on teachers’ ongoing involvement with the design of educational innovations, which typically employ technology as a critical support for practice. To date, investigators have described the application and results of co-design, but they have not defined the process nor explored how it plays out over time. In this paper, we define co-design as a highly-facilitated, teambased process in which teachers, researchers, and developers work together in defined roles to design an educational innovation, realize the design in one or more prototypes, and evaluate each prototype’s significance for addressing a concrete educational need. We suggest seven key process components and use data from a systematic set of interviews to illustrate the roles of teachers and researchers in co-design and describe how tensions in the process can unfold and be resolved over time.

Relevance to Practice as a Criterion for Rigor

The authors argue for a reconceptualization of rigor that requires sustained, direct, and systematic documentation of what takes place inside programs to document how students and teachers change and adapt interventions in interactions with each other in relation to their dynamic local contexts. Building on promising new programs at the Institute of Education Sciences, they call for the formulation of collaborative research standards that must require researchers to provide evidence that they have engaged in a process to surface and negotiate the focus of their joint work, and to document the ways participation in this process was structured to include district and school leaders, teachers, parents, community stakeholders, and, wherever possible, children and youth. They close by describing how this new criterion—“relevance to practice”—can ensure the longevity and efficacy of educational research.

The Alignment of the Informal and Formal Organizational Supports for Reform: Implications for Improving Teaching in Schools

Previous qualitative studies show that when the formal organization of a school and patterns of informal interaction are aligned, faculty and leaders in a school are better able to coordinate instructional change. This article combines social network analysis with interview data to analyze how well the formal and informal aspects of a school’s social context are aligned. The focus is on two elementary schools engaged in initiatives aimed to use data to inform instructional decision making. The multimethod case study integrated findings from questionnaire and interview data. Data were collected over two years from case study schools. By fitting multilevel social selection models to longitudinal social network data collected from surveys, the authors estimated the relative influence of formal and informal processes on patterns of advice giving in each school. They used interview data to contextualize and corroborate findings. The social selection models they fit revealed distinct patterns in each school that helped explain why one school had been successful in developing a shared vision for change and a second school had been unsuccessful. The authors’ research shows that efforts to promote formal collaboration can and do vary in their success in ways that are evident from social network analyses. These case studies imply directions for future analyses of the social context of teaching and schools.

Preparing Teachers to Design Sequences of Instruction in Earth Systems Science A Comparison of Three Professional Development Programs

This research study examined whether and how professional development can help teachers design sequences of instruction that lead to improved science learning. The efficacy of three professional development programs and a control condition was compared in a cluster randomized trial involving 53 middle school science teachers from a single school district. The four conditions varied along two dimensions: (a) the extent to which the programs guided teachers’ selection of curriculum materials and (b) whether or not teachers received explicit instruction in models of teaching associated with particular methods for designing instruction. Results indicated that the two programs most effective at improving students’ science learning were the ones in which teachers received explicit instruction in models of teaching.

Using Social Network Analysis to Study How Collegial Interactions Can Augment Teacher Learning from External Professional Development.

This article presents an analysis showing how collegial interactions can augment the mechanism of teachers’ learning from professional development. The analysis relies on social network data and self-reports of writing instructional practices from teachers in 20 different schools that were part of a longitudinal study of the National Writing Project’s partnership activities. The results indicate that both organized professional development and interactions with colleagues who gained instructional expertise from participating in prior professional development were associated with the extent to which teachers changed their writing processes instruction. Furthermore, the effects of professional development varied by teachers’ baseline practices. The study illustrates the potential for using data on teachers’ social networks to investigate indirect effects of professional development and the variation in professional development effects associated with different initial levels of expertise.

Focus, Fiddle, and Friends: Experiences that Transform Knowledge for the Implementation of Innovations

Although knowledge has been linked to productivity within and between organizations, little is known about how knowledge flows into schools and then diffuses from teacher to teacher within schools. Here, the authors hypothesize that the value of different sources of knowledge depends on a teacher’s current level of implementation. The authors test their theory using longitudinal network data from 470 teachers in 13 schools. From models of change (i.e., first differences) in teachers’ use of computers over a one-year period, the authors infer that the more a teacher at the lowest initial levels of implementing an innovation is exposed to professional development focused on student learning, the more she increases her level of implementation (focus); the more a teacher at an intermediate initial level of implementation has opportunities to experiment and explore, the more she sustains her level of implementation (fiddle); and the more a teacher at a high initial level of implementation accesses the knowledge of others, the more she increases her level of implementation (friends). Concerning the potential for selection bias, the authors quantify how large the impacts (Frank 2000) of confounding variables must be to invalidate their inferences. In the discussion, the authors emphasize the changing nature of knowledge through the diffusion process.