Aaron J. McDonald

A Randomized Experimental Evaluation of the Impact of Accelerated Reader/Reading Renaissance Implementation on Reading Achievement in Grades 3 to 6.

Components of the School Renaissance® program, including Accelerated Reader and Reading Renaissance, have been implemented in more than 65,000 schools in the United States. Despite the programs popularity, there have been no published, well-controlled evaluations of its effectiveness. This randomized field experiment was designed to gauge program impacts on the reading achievement of 978 urban students in Grades 3 to 6. Schools and teachers within schools volunteered to participate in the study, with the foreknowledge that teachers would be randomly assigned to either implement School Renaissance or serve as controls. A 3-level hierarchical linear model was used to estimate the impact of the program on student reading growth trajectories on the STAR Reading test. Students in School Renaissance classrooms exhibited significantly higher growth rates than those in control classrooms, with effect size estimates ranging from +0.07 to +0.34 across grades. Quality of program implementation did not predict student achievement growth but was correlated with a reduction in the negative effect of learning disability status.

Using School Reform Models to Improve Reading Achievement: A Longitudinal Study of Direct Instruction and Success for All in an Urban District.

This research examined the effectiveness in an urban school district of 2 of the most widely used Comprehensive School Reform (CSR) programs-Direct Instruction (DI), implemented in 9 district elementary schools, and Success for All (SFA), implemented in 2 elementary schools. In examining impacts on student achievement and school change outcomes (e.g., teacher buy-in, school climate), a mixed-method research design was employed, encompassing both quantitative and qualitative analyses. Student achievement results on the reading sections of the Ohio Proficiency Test and the Stanford Achievement Test showed that both DI and SFA schools performed comparably to other district schools after statistically adjusting for school and student variables. Qualitative measures indicated generally positive support for both models by teachers, principals, and parents. However, in the case of DI, findings indicated weaknesses in implementation due largely to uncertainties involving school versus district roles and inadequate training. Results are discussed with regard to the influences of contextual and implementation variables on judging CSR model effectiveness in general and for specific schools and districts.

Achievement and Climate Outcomes for the Knowledge is Power Program in an Inner-City Middle School

This study was designed to examine the effects of a whole school reform, the Knowledge is Power Program (KIPP), specifically designed to raise academic achievement of at-risk urban middle school students by establishing an extended school day and year, a rigorous curriculum, after-school access to teachers, and increased family-school connections. In our mixed-methods design, qualitative (interview and observation) and quantitative (survey and achievement test) measures are employed to determine first-year program implementation and student outcomes for the KIPP:DIAMOND (Daring Individual Achievers Making Outstanding New Dreams) Academy (KIPP:DA), an inner-city school in a large, high-poverty urban district. For the achievement analyses, 49 KIPP:DA students were individually matched to highly comparable control students of the same ethnicity, socioeconmic status, gender, and ability, who attended different district schools in the same neighborhood. Statistically significant and educationally meaningful advantages for KIPP:DA students were found on 4 out of 6 standardized tests. The achievement results are interpreted in relation to the key program elements, the positive school climate established, and the quality of the 1st-year implementation.

Comprehensive School Reform in Middle Schools: The Effects of Different Ways of Knowing on Student Achievement in a Large Urban District

Comprehensive school reform (CSR), a federally funded program, is designed to raise student achievement via the implementation of whole school reforms. Unfortunately, although close to 400 CSR models have been adopted by schools nationally, there is relatively limited empirical evidence from rigorous research studies regarding the effectiveness of CSR in general or of specific models in particular. Of additional importance is the extent to which CSR models can demonstrate positive effects over time. The purpose of this study is to evaluate the effects on student achievement and attendance, in an urban school district in Kentucky, of the Year 3 implementation of the Different Ways of Knowing (DWoK) for the Middle Grades model. Results indicated that achievement results on both the Comprehensive Test of Basic Skills and Kentucky Core Content Test were significantly superior for the DWoK schools relative to matched control schools; no positive impacts on student attendance occurred for Year 3. The implications of the study lies in revealing that learner-centered CSR models that integrate the arts with the core curriculum can produce observable achievement gains in both normed- and criterion-referenced tests.