Cassandra M. D. Hart

Can Research Design Explain Variation in Head Start Research Results? A Meta-Analysis of Cognitive and Achievement Outcomes

This study explores the extent to which differences in research design explain variation in Head Start program impacts. We employ meta-analytic techniques to predict effect sizes for cognitive and achievement outcomes as a function of the type and rigor of research design, quality and type of outcome measure, activity level of control group, and attrition. Across program evaluations, the average program-level effect size was 0.27 standard deviations. About 41% of the variation in estimates across evaluations can be explained by research design features, including the extent to which the control group experienced other forms of early care or education, and 11% of the variation within programs can be explained by the quality and type of the outcome measures.

Online Course-taking and Student Outcomes in California Community Colleges

This paper uses fixed effects analyses to estimate differences in student performance under online versus face-to-face course delivery formats in the California Community College system. On average, students have poorer outcomes in online courses in terms of the likelihood of course completion, course completion with a passing grade, and receiving an A or B. These estimates are robust across estimation techniques, different groups of students, and different types of classes. Accounting for differences in instructor characteristics (including through the use of instructor fixed effects) dampens but does not fully explain the estimated relationships. Online course-taking also has implications for downstream outcomes, although these effects are smaller. Students are more likely to repeat courses taken online, but are less likely to take new courses in the same subject following courses taken online.

Exposure to Same-Race Teachers and Student Disciplinary Outcomes for Black Students in North Carolina:

Using student-level administrative data from North Carolina, we explore whether exposure to same-race teachers affects the rate at which Black students receive exclusionary discipline, such as out-of-school suspensions, in-school suspensions, and expulsion. We find consistent evidence that exposure to same-race teachers is associated with reduced rates of exclusionary discipline for Black students. This relationship holds for elementary, middle, and high school grade ranges for male and female students, and for students who do and do not use free and reduced-price lunch. Although we find reductions in referrals for a number of different types of offenses, we find particularly consistent evidence that exposure to same-race teachers lowers office referrals for willful defiance across all grade levels, suggesting that teacher discretion plays a role in driving our results.

Contexts Matter: Selection in Means-Tested School Voucher Programs.

This study examines public school characteristics, and public and private school market characteristics, associated with participation among elementary-aged students in a means-tested school voucher program in Florida. Participants are more likely than eligible nonparticipants to come from disadvantaged public schools on multiple dimensions. On average, participants’ public schools have lower aggregate student achievement, and higher rates of disciplinary incidents. Participants’ schools receive less positive ratings on various measures from principals and teachers. Participants face more competitive private school markets, and less competitive public school markets, than do nonparticipants. When these factors are considered together, the mean achievement and disciplinary incident rate of students’ own public schools, as well as public and private school market variables, independently predict voucher use.

Unionization and Productivity: Evidence from Charter Schools

This paper studies the relationship between teacher unionization and student achievement. Generally stable patterns of teacher unionization since the 1970s have historically presented challenges in measuring the effects of unionization on educational production. However, the blossoming of the charter school sector in recent decades provides fertile ground for study because while most charters are non-union, teachers at some charters have unionized. Using a generalized difference-in-difference approach combining California union certification data with student achievement data from 2003-2012, we find that, aside from a one-year dip in achievement associated with the unionization process itself, unionization does not affect student achievement.