Douglas Lee Lauen

Shining a Light or Fumbling in the Dark? The Effects of NCLB's Subgroup-Specific Accountability on Student Achievement.

The theory of action behind the No Child Left Behind Act of 2001 is that “shining a light” on subgroup performance will increase reading and math test scores for minority and disadvantaged students. Using a panel of all students in Grades 3 through 8 in North Carolina from 2000 to 2008 (N = 1.7 million students in 1,800 schools), the authors estimate double- and triple-differenced models with school fixed effects to examine whether subgroup-specific accountability threats increase high-stakes test scores. These sanctions are found to have positive effects for minority and disadvantaged students. Larger positive effects emerge for the lowest achieving schools rather than schools near the margin of passing. Some evidence of adverse effects is also found for low and high achievers in math, but not in reading, a finding attributed to the combination of increases in the rigor of state standards in math and responses to an accountability metric based on test score status rather than growth. The implications of the findings for the design of educational accountability systems are discussed.

Exposure to Classroom Poverty and Test Score Achievement: Contextual Effects or Selection?

It is widely believed that impoverished contexts harm children. Disentangling the effects of family background from the effects of other social contexts, however, is complex, making causal claims difficult to verify. This study examines the effect of exposure to classroom poverty on student test achievement using data on a cohort of children followed from third through eighth grade. Cross-sectional methods reveal a substantial negative association between exposure to high-poverty classrooms and test scores; this association grows with grade level, becoming especially large for middle school students. Growth models, however, produce much smaller effects of classroom poverty exposure on academic achievement. Even smaller effects emerge from student fixed-effects models that control for time-invariant unobservables and from marginal structural models that adjust for observable time-dependent confounding. These findings suggest that causal claims about the effects of classroom poverty exposure on achievement may be unwarranted.

To Choose or not to Choose: High School Choice and Graduation in Chicago

School choice reforms have been proposed as ways to enhance efficiency, equity, and effectiveness in education. This study examines the consequences of participating in public high school choice in Chicago, a city with a wide variety of choice programs, including career academies, charter schools, magnet schools, and selective test-based college prep high schools. The analysis uses population-level administrative and survey data on all public school eighth graders enrolled in Chicago to estimate the effect of school choice participation on on-time graduation propensity (i.e., in 4 years). Techniques employed to estimate this effect include propensity score, catchment area fixed effects, and multilevel analysis. Results suggest that there is a modest positive graduation benefit from exercising school choice. There are no racial/ethnic differences in the choice benefit, but low-achieving students benefit less from high school choice than high-achieving students. In addition, students in high-poverty neighborhoods gain less from exercising choice than do students in low-poverty neighborhoods. These findings call into question the extent to which school choice enhances equity for low-achieving students and students in high-poverty neighborhoods.

School accountability and the black–white test score gap

Since at least the 1960s, researchers have closely examined the respective roles of families, neighborhoods, and schools in producing the black-white achievement gap. Although many researchers minimize the ability of schools to eliminate achievement gaps, the No Child Left Behind Act (NCLB) increased pressure on schools to do so by 2014. In this study, we examine the effects of NCLBs subgroup-specific accountability pressure on changes in black-white math and reading test score gaps using a school-level panel dataset on all North Carolina public elementary and middle schools between 2001 and 2009. Using difference-in-difference models with school fixed effects, we find that accountability pressure reduces black-white achievement gaps by raising mean black achievement without harming mean white achievement. We find no differential effects of accountability pressure based on the racial composition of schools, but schools with more affluent populations are the most successful at reducing the black-white math achievement gap. Thus, our findings suggest that school-based interventions have the potential to close test score gaps, but differences in school composition and resources play a significant role in the ability of schools to reduce racial inequality.

Accountability Pressure, Academic Standards, and Educational Triage

Despite common conceptions, evidence on whether No Child Left Behind (NCLB) has had adverse effects for low achieving students is mixed. We hypothesize that the incentive to shift attention away from the lowest achieving students increases with the rigor of state standards. Using panel data from students in North Carolina, we exploit two natural experiments: increases in the rigor of standards in math in 2006 and then again in reading in 2008. We report an increase in test score gaps between low and high achievers and students near grade level. Adverse effects on low achievers are largest in the lowest achieving schools. We discuss the policy implications of our findings given the widespread adoption of more rigorous Common Core Standards.

Positioning Charter Schools in Los Angeles: Diversity of Form and Homogeneity of Effects.

The debate over charter school effectiveness relies largely on neoclassical logic: individual parents or students express demand for a widening array of school types and then experience variable levels of organizational quality. We argue that market-like behavior is nested in segments of local organizational fields with different types of charter school operators seeking market niches to reduce resource uncertainties. We first describe the emergence of three legally defined charter types in the Los Angeles Unified School District between 2002 and 2008. We show how these charter segments became stratified, as gauged by demographic attributes and quite different baseline achievement levels. While this structuration could also plausibly condition uneven achievement effects, we find that, in this initial period of charter expansion, all three types failed to raise achievement, compared with the achievement growth trajectories displayed by peers attending regular public schools.

Early Colleges at Scale: Impacts on Secondary and Postsecondary Outcomes.

We examine the impacts of early college high schools, small schools of choice located on college campuses. These schools provide a no-cost opportunity for students to earn college credit—or a 2-year degree—while in high school. Using rich administrative data on multiple cohorts of students and quasiexperimental methods informed by the within-study comparison literature, we estimate program impacts of enrolling in a North Carolina early college in ninth grade on a variety of secondary and postsecondary outcomes. We include all such schools in the state, and we report generally promising findings. Early colleges increase important high school outcomes, boost associate’s degree completion, and raise 4-year-college enrollment at less selective public institutions. We also show the differences of these impacts across race, home-district performance, and host site, helping us better understand the implementation and effects of this promising intervention in one state that has brought this school reform model to scale.

Jumping at the Chance: The Effects of Accountability Incentives on Student Achievement.

Abstract Pay for performance plans are spreading across the country due to the Obama administrations

Status versus growth: The distributional effects of school accountability policies

4 billion Race to the Top initiative, which places a high priority on merit pay. Through a program that involved public accountability and bonuses, the state of North Carolina awarded more than

Generational Status and Educational Outcomes Among Asian and Hispanic 1988 Eighth Graders

1 billion in school-based performance bonuses for meeting test score growth targets between 1997 and 2009. Using statewide student-level data from North Carolina, I examine the effects of accountability consequences on test scores in 2008, a year in which math and reading scores were “high stakes” and science tests were “low stakes.” Results from nonparametric discontinuity models show that at the margin, accountability incentives cause higher reading gains and have no adverse effects on science scores or on low achieving students. Incentive effects on science are generally positive rather than negative. Effects on science are much stronger in low-poverty schools, however, which suggests that interventions implemented in these schools to increase math and reading scores may have complemented, rather than substituted for, science instruction.