Christopher M. Dudek

Predictive Validity of the Classroom Strategies Scale—Observer Form on Statewide Testing Scores: An Initial Investigation

The present study examined the validity of a teacher observation measure, the Classroom Strategies Scale--Observer Form (CSS), as a predictor of student performance on statewide tests of mathematics and English language arts. The CSS is a teacher practice observational measure that assesses evidence-based instructional and behavioral management practices in elementary school. A series of two-level hierarchical generalized linear models were fitted to data of a sample of 662 third- through fifth-grade students to assess whether CSS Part 2 Instructional Strategy and Behavioral Management Strategy scale discrepancy scores (i.e., ∑ |recommended frequency--frequency ratings|) predicted statewide mathematics and English language arts proficiency scores when percentage of minority students in schools was controlled. Results indicated that the Instructional Strategy scale discrepancy scores significantly predicted mathematics and English language arts proficiency scores: Relatively larger discrepancies on observer ratings of what teachers did versus what should have been done were associated with lower proficiency scores. Results offer initial evidence of the predictive validity of the CSS Part 2 Instructional Strategy discrepancy scores on student academic outcomes.

Measuring Teacher Self-Report on Classroom Practices: Construct Validity and Reliability of the Classroom Strategies Scale-Teacher Form.

This article presents information about the construct validity and reliability of a new teacher self-report measure of classroom instructional and behavioral practices (the Classroom Strategies Scales-Teacher Form; CSS-T). The theoretical underpinnings and empirical basis for the instructional and behavioral management scales are presented. Information is provided about the construct validity, internal consistency, test-retest reliability, and freedom from item-bias of the scales. Given previous investigations with the CSS Observer Form, it was hypothesized that internal consistency would be adequate and that confirmatory factor analyses (CFA) of CSS-T data from 293 classrooms would offer empirical support for the CSS-Ts Total, Composite and subscales, and yield a similar factor structure to that of the CSS Observer Form. Goodness-of-fit indices of χ2/df, Root Mean Square Error of Approximation, Goodness of Fit Index, and Adjusted Goodness of Fit Index suggested satisfactory fit of proposed CFA models whereas the Comparative Fit Index did not. Internal consistency estimates of .93 and .94 were obtained for the Instructional Strategies and Behavioral Strategies Total scales respectively. Adequate test-retest reliability was found for instructional and behavioral total scales (r = .79, r = .84, percent agreement 93% and 93%). The CSS-T evidences freedom from item bias on important teacher demographics (age, educational degree, and years of teaching experience). Implications of results are discussed.

Concurrent Validity of the Classroom Strategies Scale for Elementary School—Observer Form:

The present study is an initial investigation of the concurrent validity of a new assessment, the Classroom Strategies Scale (CSS version 2.0) for Elementary School—Observer Form. The CSS assesses teachers’ use of instructional and behavioral management strategies. In the present study, the CSS is compared to the Classroom Assessment Scoring System (CLASS), a widely researched measure of global classroom quality. In a sample of 125 general education K-5 grade teachers, correlations were computed to assess the relationship between the CSS scales and conceptually similar and dissimilar domains and dimensions on the CLASS. In comparison to the CLASS, the CSS classroom observations and strategy rating scale scores demonstrated correspondence with conceptually similar scales, providing initial evidence for the concurrent and discriminant validity of the CSS. Results highlight the unique features of the CSS for assessing teacher classroom practices.

Teacher Formative Assessment: The Missing Link in Response to Intervention

Response to intervention (RTI) focuses on the assessment, intervention, and progress monitoring of student academic performance and social behavior. Despite requiring highly qualified personnel for successful implementation, the implementation of RTI has not focused on applying its foundational principles towards promoting teacher effectiveness through assessment, intervention, and progress monitoring of teacher classroom practice. Compounding this problem is the lack of availability of reliable and valid teacher assessments to apply in an RTI model for teacher professional development. This chapter provides a rationale for applying RTI principles to teacher professional development and how teacher formative assessment can improve educator effectiveness, student learning, and social behaviors. The Classroom Strategies Scale (CSS), a new multidimensional assessment of instructional and behavioral management practices, is discussed as an example of one promising tool for promoting teachers’ professional development within an RTI model. We offer a synthesis of the theory, research, and evidence of reliability and validity of the CSS. The application of teacher formative assessment in job-embedded professional development/coaching models for schools is discussed. Finally, implications for practice and research are outlined.

Observer and Student Ratings of the Class Environment: A Preliminary Investigation of Convergence.

The present study examined the relationship between student and observer ratings of the class environment. More specifically, class responses on the Responsive Environmental Assessment for Classroom Teaching (REACT; Theodore J. Christ & Colleagues, 2015) were compared with observer ratings on the Classroom Strategies Assessment System—Observer Form (Reddy, Fabiano, & Dudek, 2013). This study included 38 teachers and 582 students from 5 high-poverty schools. Observational data were reported as discrepancy scores, which reflect the difference between the recommended frequency and observed frequency of specific instructional and behavioral management strategies for classroom teachers. Pearson correlations were used to evaluate the relationship between the 6 subscales included on the REACT and the 9 subscales included on the CSAS-O. Results provide preliminary evidence for the relationship between observer and student ratings of the class environment. More specifically, as discrepancy scores decreased, student ratings of the class environment tended to be more positive. The relationship between the REACT and the CSAS-O differed across subscales; however, in general, subscales that were conceptually similar tended to demonstrate stronger relationships than subscales that were conceptually distinct. Thus, the observed results also provide preliminary evidence that students are capable of discriminating between the quality of different components of the class environment. The potential use of both observer and student ratings of the class environment to provide teachers with a more robust and comprehensive reference for professional development purposes is discussed within the context of a tiered model of support.

Teacher coaching supported by formative assessment for improving classroom practices

The present study is a wait-list controlled, randomized study investigating a teacher coaching approach that emphasizes formative assessment and visual performance feedback to enhance elementary school teachers’ classroom practices. The coaching model targeted instructional and behavioral management practices as measured by the Classroom Strategies Assessment System (CSAS) Observer and Teacher Forms. The sample included 89 general education teachers, stratified by grade level, and randomly assigned to 1 of 2 conditions: (a) immediate coaching, or (b) waitlist control. Results indicated that, relative to the waitlist control, teachers in immediate coaching demonstrated significantly greater improvements in observations of behavior management strategy use but not for observations of instructional strategy use. Observer- and teacher-completed ratings of behavioral management strategy use at postassessment were significantly improved by both raters; ratings of instructional strategy use were significantly improved for teacher but not observer ratings. A brief coaching intervention improved teachers’ use of observed behavior management strategies and self-reported use of behavior management and instructional strategies.

Relation of teacher self-efficacy and classroom practices: A preliminary investigation

Teachers’ perceptions of self-efficacy are one of the few individual characteristics that predict teacher practice. There is limited research linking teachers’ perceptions of self-efficacy and actual classroom practices. The study examined teacher’ perceptions of self-efficacy and actual instructional and behavior management practices using the Classroom strategies assessment system (CSAS), a multidimensional validated observation system. Fifty-eight Greek teachers completed the Teacher sense of efficacy scale (TSES) and were observed using the CSAS by independent observers. Significant differences between teachers’ self-reported self-efficacy and observers’ ratings were found in the domain of instructional strategies. Implications for research, professional development and school psychological practice are discussed.

Improving Universal Classroom Practices Through Teacher Formative Assessment and Coaching

This article presents the Classroom Strategies Coaching (CSC) Model, a data-driven coaching approach that uses teacher formative assessment data to drive improvements in universal practices. The classroom strategies assessment system (CSAS), a formative assessment of evidence-based instructional and behavioral management practices was used to facilitate the coaching process. Results from 32 elementary school teachers who received brief coaching after participating as waitlist controls in a randomized controlled trial are presented. Teachers’ practices remained stable across baseline periods. Following coaching, teachers displayed improvements toward their behavioral management goals (e.g., ds = .50–.83). Results also showed meaningful reductions in the overall need for change in instruction (d = .88) and in behavior management practices (d = .68) at postintervention. Findings illustrate the benefits of integrating teacher formative assessment in coaching to improve teaching practices. Implications for practice and future directions are outlined.

Concurrent Validity of the Classroom Strategies Scale–Teacher Form: A Preliminary Investigation

The present study investigated the concurrent validity of the Classroom Strategies Scale–Teacher Form (CSS-T), a multidimensional teacher formative assessment of instructional and behavioral management practices. The CSS-T is compared with the Classroom Assessment Scoring System (CLASS), a well-known teacher assessment of overall classroom quality. A sample of 126 kindergarten through 5th-grade general education teachers self-reported on their usage of empirically supported instructional and behavioral management strategies as measured by the CSS-T while a certified independent observer completed the CLASS. Correlational analyses were used to compare CSS-T frequency and discrepancy scores and the CLASS scores. As hypothesized, results demonstrated significant positive (CSS-T frequency scale scores) and negative (CSS-T discrepancy scale scores) correlations between specific CLASS domains and dimensions, thus providing initial evidence for the concurrent and discriminant validity of the CSS-T. Implications of findings are discussed.