Courtney A. Bell

An Argument Approach to Observation Protocol Validity.

This article develops a validity argument approach for use on observation protocols currently used to assess teacher quality for high-stakes personnel and professional development decisions. After defining the teaching quality domain, we articulate an interpretive argument for observation protocols. To illustrate the types of evidence that might compose a validity argument, we draw on data from a validity study of the Classroom Assessment Scoring System for secondary classrooms. Based on data from 82 Algebra classrooms, we illustrate how data from observation scores, value-added models, generalizability studies, and measures of teacher knowledge, student achievement, and teacher and student beliefs could be used to build a validity argument for observation protocols. Strengths and limitations of the validity argument approach as well as the issues the approach raises for observation protocol validity research are considered.

Effect of Observation Mode on Measures of Secondary Mathematics Teaching.

Classroom observation of teachers is a significant part of educational measurement; measurements of teacher practice are being used in teacher evaluation systems across the country. This research investigated whether observations made live in the classroom and from video recording of the same lessons yielded similar inferences about teaching. Using scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) from 82 algebra classrooms, we explored the effect of observation mode on inferences about the level or ranking of teaching in a single lesson or in a classroom for a year. We estimated the correlation between scores from the two observation modes and tested for mode differences in the distribution of scores, the sources of variance in scores, and the reliability of scores using generalizability and decision studies for the latter comparisons. Inferences about teaching in a classroom for a year were relatively insensitive to observation mode. However, time trends in the raters’ use of the score scale were significant for two CLASS-S domains, leading to mode differences in the reliability and inferences drawn from individual lessons. Implications for different modes of classroom observation with the CLASS-S are discussed.

Teaching Through Interactions in Secondary School Classrooms: Revisiting the Factor Structure and Practical Application of the Classroom Assessment Scoring System- Secondary

Valid measurement of how students’ experiences in secondary school classrooms lead to gains in learning requires a developmental approach to conceptualizing classroom processes. This article presents a potentially useful theoretical model, the Teaching Through Interactions framework, which posits teacher-student interactions as a central driver for student learning and that teacher-student interactions can be organized into three major domains. Results from 1,482 classrooms provide evidence for distinct emotional, organizational, and instructional domains of teacher-student interaction. It also appears that a three-factor structure is a better fit to observational data than alternative one- and two-domain models of teacher-student classroom interactions, and that the three-domain structure is generalizable from 6th through 12th grade. Implications for practitioners, stakeholders, and researchers are discussed.

Handbook of Research on Teaching

The fifth edition of the Handbook of Research on Teaching is an essential resource for students and scholars dedicated to the study of teaching and learning. It offers a vast array of topics ranging from the history of teaching to technological and literacy issues.In each authoritative chapter, the authors summarize the state of the field while providing conceptual overviews of critical topics related to research on teaching. Each of the volumes 23 chapters is a canonical piece that will serve as a reference tool for the field. The chapters, all broad treatments of areas of study, will help readers see how particular areas of research connect with the larger issues of teaching and teacher education.The handbook provides readers with an unaparalleled view of the current state of research on teaching across its multiple facets and related fields.

When policy instruments combine to promote coherence: an analysis of Connecticut’s policies related to teacher quality

This paper explicates the elements of several policy instruments used in Connecticut, the political conditions under which they were chosen, and their intended targets and expected effects on teacher quality and student learning. The purpose of the paper is to explain how the Connecticut General Assembly (CGA) and the Connecticut State Department of Education (CSDE) were able to implement and sustain a set of integrated policies related to teaching and learning over a 20‐year period from 1985 to 2005. We argue that this occurred for three primary reasons. First, the state legislature combined changes in teacher certification requirements in the 1980s with significant increases in teacher salaries in order to build strong political support among teachers and teacher union leaders for the new requirements. Second, in the 1980s and 1990s, CGA and CSDE repeatedly combined policy instruments in ways that involved multiple stakeholders and strong elements of capacity‐building, thereby increasing their likelihood of success. Third, several policies enacted in Connecticut in the 1990s were directly connected to and strongly reinforced each other.

Strategies for Assessing Classroom Teaching: Examining Administrator Thinking as Validity Evidence

ABSTRACT All 50 states use observations to evaluate practicing teachers, but we know little about how administrators actually reason when they use those observation protocols. Drawing on think-aloud and stimulated recall data, this study describes the types of strategies and warrants practicing administrators used when rating with their district’s observation protocol. Administrators in a large urban district used an observation protocol aligned to Danielson’s Framework for Teaching to rate a brief lesson clip. Administrators’ thinking was recorded, clarified, and inductively coded. Findings suggest administrator thinking and justification is complex even for short lengths of instruction. Administrators used a range of reasoning strategies, many of which were not sanctioned by their training. Exploratory analyses suggest strategy use was not related to the accuracy of ratings. Implications for the validity of teacher observation scores in high-stakes settings are considered.