Roddy Theobald

Uneven Playing Field? Assessing the Teacher Quality Gap Between Advantaged and Disadvantaged Students

Policymakers aiming to close the well-documented achievement gap between advantaged and disadvantaged students have increasingly turned their attention to issues of teacher quality. A number of studies have demonstrated that teachers are inequitably distributed across student subgroups by input measures, like experience and qualifications, as well as output measures, like value-added estimates of teacher performance, but these tend to focus on either individual measures of teacher quality or particular school districts. In this study, we present a comprehensive, descriptive analysis of the inequitable distribution of both input and output measures of teacher quality across various indicators of student disadvantage across all school districts in Washington State. We demonstrate that in elementary school, middle school, and high school classrooms, virtually every measure of teacher quality we examine—experience, licensure exam scores, and value added—is inequitably distributed across every indicator of student disadvantage—free/reduced-price lunch status, underrepresented minority, and low prior academic performance. Finally, we decompose these inequities to the district, school, and classroom levels and find that patterns in teacher sorting at all three levels contribute to the overall teacher quality gaps.

Is It the Intervention or the Students? Using Linear Regression to Control for Student Characteristics in Undergraduate STEM Education Research

Existing methods for analyzing pre/posttest data can lead to incorrect conclusions, as they do not control for student academic ability and preparation. Using an example data set from an introductory biology course, this paper shows how regression models offer a solution to this problem.

Managing the Teacher Workforce in Austere Times: The Determinants and Implications of Teacher Layoffs

Over 2,000 teachers in the state of Washington received reduction-in-force (RIF) notices across the 2008–09 and 2009–10 school years. We link data on these RIF notices to an administrative data set that includes student, teacher, school, and district variables to determine the factors that predict the likelihood of a teacher receiving a RIF notice. Not surprisingly, we find that a teachers seniority is the strongest predictor, but we also find (all else equal) that teachers with masters degrees and those credentialed in the high-need areas of math, science, and special education were less likely to receive a RIF notice. Value-added measures of teacher effectiveness, which can be calculated for a subset of the teachers, were not correlated with the probability of receiving a RIF notice. Finally, simulations suggest that a very different group of teachers would be targeted for layoffs under an effectiveness-based layoff scenario than under the seniority-driven system that exists today.

A Foot in the Door Exploring the Role of Student Teaching Assignments in Teachers’ Initial Job Placements

We use data from Washington State to examine two stages of the teacher pipeline: the placement of prospective teachers into student teaching assignments and the hiring of prospective teachers into their first teaching positions. We find that prospective teachers are likely to complete their student teaching near their college and hometowns but that prospective teachers’ student teaching positions are much more predictive of their first teaching positions than their hometowns. This suggests that student teaching assignments may contribute to the “draw of home” in new teacher hiring. We also find that more qualified prospective teachers tend to student teach in more advantaged districts, suggesting that patterns in student teaching assignments may contribute to the inequitable distribution of teacher quality.

Teacher Collective Bargaining: Assessing the Internal Validity of Partial Independence Item Response Measures of Contract Restrictiveness

In 2010, Strunk and Reardon introduced a potentially transformative method for analyzing teacher collective bargaining agreements (CBAs). We extend Strunk and Reardon’s work by assessing whether the Partial Independence Item Response (PIIR) approach can be applied to subsets of provisions from CBAs, data that may be more feasible for researchers to collect. Utilizing a new data set derived from all provisions in all active CBAs in Washington state, we find that estimates calculated from a subset of high-profile provisions are moderately highly correlated with estimates calculated from the full range of provisions, as are estimates calculated from several categories of provisions. This suggests that researchers can still draw important conclusions by applying the PIIR method to readily available data on teacher CBAs.

Evaluating Prospective Teachers: Testing the Predictive Validity of the edTPA:

We use longitudinal data from Washington State to provide estimates of the extent to which performance on the edTPA, a performance-based, subject-specific assessment of teacher candidates, is predictive of the likelihood of employment in the teacher workforce and value-added measures of teacher effectiveness. While edTPA scores are highly predictive of employment in the state’s public teaching workforce, evidence on the relationship between edTPA scores and teaching effectiveness is more mixed. Specifically, continuous edTPA scores are a significant predictor of student mathematics achievement in some specifications, but when we consider that the edTPA is a binary screen of teaching effectiveness (i.e., pass/fail), we find that passing the edTPA is significantly predictive of teacher effectiveness in reading but not in mathematics. We also find that Hispanic candidates in Washington were more than 3 times more likely to fail the edTPA after it became consequential in the state than non-Hispanic White candidates.

Missing Elements in the Discussion of Teacher Shortages

Though policymakers are increasingly concerned about teacher shortages in U.S. public schools, the national discussion does not reflect historical patterns of the supply of and demand for newly minted teachers. Specifically, the production of teacher candidates has increased steadily since the mid-1980s, and only about half of graduating teacher candidates are hired as public school teachers in a typical year. That said, there is considerable evidence of teacher shortages in specific subjects (e.g., STEM and special education) and specific types of schools (e.g., disadvantaged). We therefore discuss public policies that contribute to these specific shortages and potential solutions.

My End of the Bargain

A large literature on teacher collective bargaining describes the potential influence of the provisions in collectively bargained teacher union contracts on teachers and student achievement, but little is known about what influences the provisions that end up in these contracts. Using a unique data set made up of every active teacher collective bargaining agreement in Washington State, the authors estimate spatial lag models to explore the relationship between the restrictiveness of a bargained contract in one district and the restrictiveness of contracts in nearby districts. Employing various measures of geographic and institutional proximity, they find that spatial relationships play a major role in determining bargaining outcomes. These spatial relationships, however, are actually driven by two “institutional bargaining structures”: education service districts (ESDs), which support school districts, and UniServ councils, which determine who is bargaining on behalf of local teachers’ unions. This finding suggests that the influence of geographic distance found in previous studies of teacher wages may simply reflect the influence of these bargaining structures.

Does the Match Matter? Exploring Whether Student Teaching Experiences Affect Teacher Effectiveness.

We use data from six Washington State teacher education programs to investigate the relationship between teacher candidates’ student teaching experiences and their later teaching effectiveness. Our primary finding is that teachers are more effective when the student demographics of their current school are similar to the student demographics of the school in which they did their student teaching. While descriptive, this suggests that the school context in which student teaching occurs has important implications for the later outcomes of teachers and their students and that teacher education programs and school districts should consider placing student teachers in schools that are similar to the schools in which they are likely to teach once they enter the workforce.

Likes attract: Students self-sort in a classroom by gender, demography, and academic characteristics:

Although a growing literature has documented the effectiveness of informal group work during class sessions, virtually no data exist on which students are collaborating. As a result, instructors rarely know whether students are self-sorting in ways that maximize learning. This article explores which undergraduate students worked together on each of five exercises scheduled throughout the term, in a large-enrollment course for majors that emphasized intensive peer interaction. Pairwise logistic regression models were used to assess the likelihood that students collaborated based on shared demographic characteristics, socioeconomic status, and academic performance. In almost all cases, students self-sorted by ethnicity and gender. In addition, students who were predicted to do well in the course, based on their academic history, worked together initially; students who actually did well in the course, based on their final grade, were working together at the end; and students who were predicted to struggle in the course began collaborating late in the term.