Xiu Cravens

The Evaluation of Principals: What and How Do States and Urban Districts Assess Leadership?

In this article we present results of a comprehensive review of principal leadership assessment practices in the United States. Our analyses of both the general content and the usage of 65 instruments, 56 at the district level and 9 at the state level, provided an in‐depth look at what and how districts and states evaluate principals. Using the learning‐centered leadership framework, we focused on identifying the congruence (or lack thereof) between documented assessment practices and the research‐based criteria for effective leadership that are associated with improved school performance. Using an iterative and deductive process for instrument content analysis, we found that states and districts focused on a variety of performance areas (e.g., management, external environment, or personal traits) when evaluating their principals, with different formats at various levels of specificity. We also found very limited coverage of leadership behaviors that ensure rigorous curriculum and quality instruction, which are linked with schoolwide improvement for the ultimate purpose of enhanced student learning. In seeking information on how principals are evaluated, we found that in most cases, the practices of leadership assessment lacked justification and documentation in terms of the utility, psychometric properties, and accuracy of the instruments.

Instructional Conditions in Charter Schools and Students' Mathematics Achievement Gains.

Since charter school research on student achievement is mixed, many researchers and policy makers advocate looking inside the “black box” of schools to better understand the conditions under which schools of choice may be effective. We begin to address this issue with data from charter schools and a comparison group of traditional public schools. We also conduct propensity score matching at the student level to further understand achievement gains. In our analyses of these data, we find no charter school effects on students’ achievement gains. Instructional conditions, such as teachers’ focus on academic achievement, are related to mathematics gains. However, we find that our innovation measure is negatively associated with gains (when other conditions are controlled for), which suggests that innovation for innovation’s sake should not be the sole focus of schools, whether charter or not.

The Convergent and Divergent Validity of the Vanderbilt Assessment of Leadership in Education (VAL-ED): Instructional Leadership and Emotional Intelligence.

Purpose – The purpose of this paper is to contribute to the ongoing dialog of whether and how instructional leadership is distinguished conceptually from general leadership notions, such as charisma, and to continue the ongoing psychometric research on the The Vanderbilt Assessment of Leadership in Education (VAL-ED) by examining its convergent and divergent validity. The authors hypothesize that the VAL-ED will be highly correlated with another measure of instructional leadership, but will be weakly correlated with more general measures of leadership that are rooted in personality theories. To test the convergent validity the authors implement the Hallinger and Murphy (1985) Instructional Management Behavior of Principals (IMBP) inventory, (Hallinger and Murphy, 1985; Hallinger, 2011). The authors use an instrument for emotional intelligence, Trait Emotional Intelligence Questionnaire (TEIQue) as the divergent measure (Petrides et al., 2007). Results indicate that principals and teachers have different p...

Principal Professional Development in China: Challenges, Opportunities, and Strategies

This article examines the essential role of school principals in Chinas “Quality-Oriented Education” national reform movement. Keeping Chinas cultural and historical context in mind, and taking into consideration the impact of political and societal forces on the nation, we discuss the major challenges faced by Chinese schools, specifically the rising demand for a new generation of school leaders. To address this issue we conduct a critical review of the existing principal evaluation and training systems in China. From this data we then propose a framework of strategic directions for systemic professional development for school leaders.

Setting Proficiency Standards for School Leadership Assessment: An Examination of Cut Score Decision Making.

Purpose: Performance evaluation informs professional development and helps school personnel improve student learning. Although psychometric literature indicates that a rational, sound, and coherent standard-setting process adds to the credibility of an assessment, few studies have empirically examined the decision-making process. This article sheds light on the inner workings of setting cut scores for leadership proficiency from the deliberative perspectives of expert-panel participants, including principals, teachers, district supervisors, and researchers. Research Design: Qualitative methods are used to observe and document a standards-setting process as it takes place and to analyze the results. Findings: The findings indicate that setting cut scores for principal leadership proficiency is a cognitively demanding but achievable process for effective implementation of carefully designed procedures. The study also provides insight regarding the influence of external factors, such as backgrounds of panelists, consideration of school contexts, and concerns about consequence during the standard-setting deliberation.

School Leadership and Change in East Asia: Building Capacity for Education Reform

In recent decades the East Asia region has demonstrated some of the most dramatic gains in social and economic development. This applies to the regions education systems as well, which have underg...

Leadership Practice in the Context of U.S. School Choice Reform

Choice schools provide a unique laboratory where variation in governance and management structure is predicted. We examine the results from principal surveys from traditional and choice public schools, and compare challenges faced by principals and their leadership practice. Analyses show that while differences across school types are small, there are noteworthy variations among different types of charter schools. Our study broadens the understanding of school leadership in a choice environment by examining not only the association between leadership practices and school types, but also the influence of school management structures on instructional development beyond school type differences.

Teacher peer excellence groups (TPEGs): Building communities of practice for instructional improvement

Purpose The purpose of this paper is to study the viability of implementing a protocol-guided model designed to provide structure and focus for teacher collaboration from Shanghai in today’s US public schools. The authors examine whether the new model, Teacher Peer Excellence Group (TPEG), fosters the desired key features of productive communities of practice where teachers can jointly construct, transform, preserve, and continuously deepen the meaning of effective teaching. The authors also explore the extent to which existing school conditions – principal instructional leadership, trust, teacher efficacy, and teachers’ sense of school-wide professional community – enable or moderate the desired outcomes. Design/methodology/approach Data for this paper are drawn from a series of surveys administered to teachers from 24 pilot schools in six school districts over two school years. Descriptive and multilevel modeling analyses are conducted. Findings The findings provide encouraging evidence that, given sufficient support and guidance, teachers report higher levels of engagement in deprivatized practice and instructional collaboration. These findings also hold after controlling for key enabling conditions and school characteristics. Social implications The TPEG approach challenges school leaders to take on the responsibilities of helping teachers make their practice public, sharable, and better – three critical objectives in the shift to develop the profession of teaching. Originality/value The indication of TPEG model’s positive impact on strengthening the features of communities of practice in selected public schools provides the impetus for further efforts in understanding the transformational changes needed and challenges ahead at the classroom, school, and district levels.

The cross-cultural validity of the Learning-Centered Leadership framework and its assessment instrument for principals

Purpose – The purpose of this paper is to select a theoretical framework for effective school leadership that is connected with research, standards and current practices in the USA, and examine its validity and generalizability cross-culturally. Design/methodology/approach – The paper uses both qualitative and quantitative methods through expert panel evaluation, cognitive interviews, and field testing of the instrument. The author asks: How well does the Learning-Centered Leadership (LCL) framework align with the professional standards and current practices of principals in urban Chinese schools in the opinion of the experts? Is there evidence that its leadership assessment instrument has construct validity in Chinese urban schools based on the re-examination of its content and measurement criteria? And is there evidence that the instrument is yielding consistent results when taken by the intended participants? How effective are the analytic strategies employed by this study in detecting the equivalences...

From Shanghai to Tennessee: Developing instructional leadership through Teacher Peer Excellence Groups

Purpose The purpose of this paper is to document a three-year international project aimed to improve the capacity of participating schools and districts in implementing and scaling Teacher Peer Excellence Groups (TPEGs). The TPEG model involves teams of teachers organized by subject matter or grade levels, deeply engaged in communities of practice for instructional improvement. It facilitates the professionalization of teaching through the de-privatization of teacher practice, collaborative planning, giving and receiving actionable feedback, and holding one another accountable for implementing improvement measures. Design/methodology/approach The project is a collaborative partnership between US and Chinese universities and school districts in Tennessee and Shanghai. Mixed-method approaches were used to track the development and implementation of the TPEG model in 27 pilot schools in six Tennessee districts from 2013 to 2016. Data were collected through school site visits, lesson-planning documents, classroom observations, focus groups, interviews, and teacher and principal surveys. Findings This paper compiles the key findings from multiple research studies and program reports about the TPEG project. Findings provide encouraging evidence that, given sufficient support and guidance, teachers can construct productive learning communities. The results show consistent positive and statistically significant result across all three key signposts for effective communities of practice – increases in instructional collaboration, comfort with deprivatized teaching practice, and engagement in deprivatized teaching practice. These findings hold after controlling for key enabling conditions and school characteristics. Qualitative analyses provide a rich and nuanced picture of how TPEGs were doing after the implementation grants. Participating schools reported a full range of engagements in TPEGs, and emphasized the role of school leadership in facilitating and supporting teachers to lead and participate in TPEGs. Originality/value The TPEG project provides a valuable case study to address the benefits, concerns, and potential risks associated with cross-cultural learning of effective instructional practices. Findings from the three-year process highlight the key steps of cultivating the necessary culture and expertise to support, implement, and sustain effective TPEGs school-wide and district-wide. It also underscores the necessity of developing and customizing tools and resource kit for supporting this work such as observation protocols, feedback guides, and examples of timetables to conduct TPEG activities.