James Sebastian

The Influence of Principal Leadership on Classroom Instruction and Student Learning: A Study of Mediated Pathways to Learning

Purpose: This study examines the influence of principal leadership in high schools on classroom instruction and student achievement through key organizational factors, including professional capacity, parent–community ties, and the school’s learning climate. It identifies paths through which leadership explains differences in achievement and instruction between schools and differences in instruction among teachers within the same school. Research Design: Multilevel structural equation modeling was used to examine the relationships among principal leadership, school organizational structures, classroom instruction, and student grades and test gains on ACT’s Education Planning and Assessment System. Measures of principal leadership and school organizational structures were collected from teacher surveys administered to all high school teachers in Chicago Public Schools in the 2006–2007 school years. Findings: Within schools, variation in classroom instruction is associated with principal leadership through multiple pathways, the strongest of which is the quality of professional development and coherence of programs. Between schools, differences in instruction and student achievement are associated with principal leadership only via the learning climate. This suggests that in high schools, establishing a safe, college-focused climate may be the most important leadership function for promoting achievement schoolwide.

Developing Instructional Leaders: Using Mixed Methods to Explore the Black Box of Planned Change in Principals’ Professional Practice:

Purpose: This study examines learning, and both cognitive and behavioral change among a sample of randomly assigned urban principals, half of whom participated in a sustained, district-based professional development program (DPD). Research Methods: Latent class analyses of daily log data, qualitative typology development, and case studies of change provide a rich portrait of the learning and change process. Findings: Few dramatic transformations of practice. Instead, principals attributed to the DPD a gradual refinement of existing practice through a process that allowed them to “break down” declarative knowledge to better understand its consequences for their work, but also provided knowledge structures, tools, and routines for reintegrating ideas from the program into strategically valuable procedural knowledge. Implications: Results suggest potential for developing principals’ competencies within continuing practice communities, but expectation of incremental rather than a dramatic “turn around” in principals’ leadership through program interventions.

Assessing the Utility of a Daily Log for Measuring Principal Leadership Practice

Purpose: This study examines the feasibility and utility of a daily log for measuring principal leadership practice. Setting and Sample: The study was conducted in an urban district with approximately 50 principals. Approach: The log was assessed against two criteria: (a) Is it feasible to induce strong cooperation and high response rates among principals with a daily instrument? and (b) Can daily logs accurately measure important aspects of principal leadership? The first criterion was assessed through a discussion of data collection procedures and results. The second criterion was assessed through mixed-method analyses comparing daily logs, observations, and an experience-sampling instrument. Results: The authors found that substantial participant contact time and strategic follow-up achieved strong cooperation and yielded high response rates. The accuracy of the log was confirmed through comparisons with an experience-sampling instrument and direct observations. The results also contribute to a broader understanding of how principals allocate their time across leadership domains. Like earlier structured observation studies, the authors found that principals spend more time on management, personnel issues, and student affairs and less time on instructional leadership than advocated by leadership scholars and professional standards. Implications for Research and Practice: Daily logs appear to be a viable means of measuring important aspects of principal practice and overcoming measurement errors associated with one-time surveys that are common in leadership research. Strategies used to maintain high participation rates are discussed in detail, and an example of a district’s adaptation of the daily log methodology is provided.

Assessing the Validity of an Annual Survey for Measuring the Enacted Literacy Curriculum

Surveys are frequently used to inform consequential decisions about teachers, policies, and programs. Consequently, it is important to understand the validity of these instruments. This study assesses the validity of measures of instruction captured by an annual survey by comparing survey data with those of a validated daily log. The two instruments produced similar rankings of the frequency with which teachers use particular practices but more than three fourths of the teachers in the study were found to overreport their instruction on the annual survey. Multilevel models revealed a number of teacher and school characteristics related to survey reporting error. The study’s implications for users of survey evidence are discussed.

Portraits of Principal Practice: Time Allocation and School Principal Work.

Purpose: The purpose of this study was to examine how school principals in urban settings distributed their time working on critical school functions. We also examined who principals worked with and how their time allocation patterns varied by school contextual characteristics. Research Method/Approach: The study was conducted in an urban school district with approximately 50 school principals and utilized self-reported End of Day log data collected at multiple points in between 2005 and 2007. We utilized hierarchical linear models to analyze variation in principals’ time allocation by time (hour, day, semester), school function (building operations, student affairs, district functions, etc.), and school personnel (self, teacher, student, etc.). Findings: Variation in principals’ practice is domain dependent. Consistent with prior research, we find that a principal’s workday is characterized by long hours and diverse tasks. We find little support for the notion that typical tasks are characterized by brevity. Principals also spend most of their time working with within-building colleagues rather than working alone. Of all predictors we examined in the study, only hour of the day predicts principals’ time allocation on different functional domains. Conclusions: The portrait of principals’ work described in this study expands and enriches the field’s current understanding of how principals allocate their time across the multiple domains of responsibility that require their attention. We find that our data offer support for some of popular conceptions of principals’ work described in the research literature while challenging other common conceptions.

The relationship of school-based parental involvement with student achievement: a comparison of principal and parent survey reports from PISA 2012

Abstract This paper explores parental involvement using principal and parent survey reports to examine whether parents’ involvement in their children’s schools predicts academic achievement. Survey data from principals and parents of seven countries from the PISA 2012 database and hierarchical linear modelling were used to analyse between- and within- school variance in students’ math achievement. Factor analysis of both principal and parent responses revealed three dimensions of parental involvement with schools: parent-initiated involvement, teacher-initiated involvement and parent volunteerism. Principal reports of parent-initiated involvement positively predicted between-school differences in student achievement. Within schools, parent reports of teacher-initiated involvement negatively predicted student achievement. The paper shows the importance of understanding the source of information for survey measures. Information on parental involvement from the parent surveys of the PISA study is suitable for describing within-school variation in student achievement, whereas principal reports can be used to predict variation between schools.

The role of schools in bridging within-school achievement gaps based on socioeconomic status: a cross-national comparative study

Since the publication of the Coleman report in 1966, research on the role of schools in influencing student achievement relative to the role of family background has generated considerable interest and controversy. A large volume of international and comparative research has also been devoted to studying school effects on student achievement. Relatively few studies have examined international differences in the importance of schools in bridging achievement gaps based on socioeconomic status (SES). Using PISA 2012 data, this study examines the role of schools in bridging within-school SES gaps in achievement and compares findings across 61 countries. Contrary to prior research, we find that schools may have limited ability in bridging SES gaps that exist within schools. We also find that across all countries included in the study, specific factors such as the school’s learning environment and school context are not systematically associated with within-school SES gaps.

An Examination of the Benefits, Limitations, and Challenges of Conducting Randomized Experiments With Principals

Purpose: The past decade has seen considerable debate about how to best evaluate the efficacy of educational improvement initiatives, and members of the educational leadership research community have entered the debate with great energy. Throughout this debate, the use of randomized experiments has been a particularly contentious subject. This study examines the potential benefits, limitations, and challenges involved in using experiments to evaluate professional development for principals. Approach: We present a case study of an experimental evaluation of a professional development program for principals. The case study is grounded in key themes in recent debates about the use of experiments in educational research, scholarship on challenges in conducting experiments, and experimental studies involving principals. Setting and Sample: The case study was conducted in an urban school district with 48 principals. Implications for Research: The experimental component of the study allowed us to form a trustworthy summary inference about whether or not a professional development program had an overall effect on principals. However, the experiment did not illuminate why or how the program failed to influence principal practice. Using descriptions of the intended curriculum for principals, professional development attendance records, and interview data, we developed an understanding of why the program failed to achieve its intended goals. Based on our experiences, we support continued advocacy of research designs that bring rich evidence to bear about causal mechanisms, implementation conditions, potential measures of delivery of and adherence to treatment protocols, and measures of participants’ exposure to treatment.

Examining integrated leadership systems in high schools: connecting principal and teacher leadership to organizational processes and student outcomes

ABSTRACT Research on school leadership suggests that both principal and teacher leadership are important for school improvement. However, few studies have studied the interaction of principal and teacher leadership as separate but linked systems in how they relate to student outcomes. In this study, we examine how leadership pathways are related in the context of high schools and compare findings to research in elementary schools. Using survey and administrative data from high schools in a large urban context, the paper explores direct and indirect pathways from leadership to student achievement growth. The results indicate that there are 2 pathways through which principal leadership is related to student learning in high schools. One pathway is mediated by teacher leadership, whereas the second pathway does not include teacher leadership. We find that similar to elementary schools, the learning climate is the only organizational factor that links principal and teacher leadership with student achievement.

The Role of Teacher Leadership in How Principals Influence Classroom Instruction and Student Learning

School principals can play an important role in promoting teacher leadership by delegating authority and empowering teachers in ways that allow them influence in key organizational decisions and processes. However, it is unclear whether instruction and student learning are enhanced by promoting teacher influence in all aspects of school organization or whether it is better for principals to directly work on certain processes while delegating influence on others. We compare pathways from principal leadership through school organizational processes to student outcomes that include teacher influence as a mediating factor to pathways that do not include teachers’ influence. Our results suggest that effective principals use teacher leadership to improve the school learning climate while they work directly on professional development and school program coherence.