Keynote: Accountable assessment

Abstract

There is widespread agreement about the importance of accounting for the extent to which educational systems advance student learning. Yet, the forms and formats of accountable assessments often ill serve students and teachers; the summative judgements of student performance that are typically employed to indicate proficiencies on benchmarks of student learning commonly fail to capture student performance in ways that are specific and actionable for teachers. Timing is another key barrier to the utility of summative assessment. In the US, summative evaluations occur at the end of the school year and may serve future students, but do not help teachers better support the students who were tested. In contrast, formative assessments provide actionable grounds to improve the quality of instruction on the basis of both the granularity and specificity of their content and their timing. Unfortunately, the psychometric qualities of formative assessments are often unknown. I describe an innovative approach to assessment that aims to blend the productive characteristics of both summative and formative assessment. The resulting assessment system is accountable to students and teachers by providing actionable information for improving classroom instruction, and at the same time, it addresses the demands of psychometric quality for purposes of system accountability as it is currently practiced (in the US). The innovative assessment system relies on partnership with teachers to generate (1) a shared conceptual frame for describing instructional goals and valued forms of teaching and learning; (2) a set of electronic tools to help teachers detect, share, analyse, and interpret student learning data; and (3) classroom and school-level community professional development structures to support and sustain a widespread practice of assessing to guide instruction. These features are coupled with new psychometric models, developed by the Berkeley Evaluation and Research Center, that provide more robust estimates of student learning by linking information from multiple sources, including student classroom work, student responses to formative assessments, and summative evaluations. (Mark Wilson will address the psychometric modeling during this conference.) Here I describe challenges and prospects for this innovation with a case study of its implementation in a K–5 elementary school that is seeking to improve the quality of instruction and students’ understandings of measure and rational number arithmetic.