Robert Hoselton

Predictors of Sustained Implementation of School-Wide Positive Behavioral Interventions and Supports.

In this analysis of extant data from 3,011 schools implementing school-wide positive behavioral interventions and supports (SWPBIS) across multiple years, we assessed the predictive power of various school characteristics and speed of initial implementation on sustained fidelity of implementation of SWPBIS at 1, 3, and 5 years. In addition, we partitioned variance in whether schools sustained SWPBIS at the school, district, and state levels. Results showed that the largest differences in fidelity were at the state level. In addition, school characteristics (particularly grade levels served) and speed of initial implementation were significant but small predictors of sustained implementation. Results are discussed in terms of effective supports at the state and district levels, as well as addressing types of schools at greater risk of abandonment, such as high schools.

Examining Barriers to Sustained Implementation of School-Wide Prevention Practices

The purpose of this study was to determine if an experimental five-item measure of barriers to implementing and sustaining school-wide prevention practices, the Assessment of Barriers to Implementation and Sustainability in Schools (ABISS), would relate to objective measures of school-wide positive behavioral interventions and supports (SWPBIS) implementation fidelity. The ABISS was administered to individuals in 704 U.S. schools implementing SWPBIS across 11 states, and scores were compared with school demographic variables and SWPBIS fidelity of implementation. Results showed acceptable model fit for the ABISS, partial measurement invariance, and statistically significant relations, after controlling for school demographic variables, with SWPBIS fidelity of implementation, except for schools implementing SWPBIS for 5 or more years. These patterns indicate substantial but decreasing relations of perceived barriers to implementation fidelity as schools continue to implement SWPBIS. Implications are discussed in terms of how assessment of perceived barriers can support implementation and sustainability of school-wide prevention practices.

Comparability of Fidelity Measures for Assessing Tier 1 School-Wide Positive Behavioral Interventions and Supports:

Several reliable and valid fidelity surveys are commonly used to assess Tier 1 implementation in School-Wide Positive Behavioral Interventions and Supports (SWPBIS); however, differences across surveys complicate consequential decisions regarding school implementation status when multiple measures are compared. To address this concern, the current study (a) provides updated convergent validity estimates for five fidelity measures, (b) tests mean differences in scores and reports the percentages of schools meeting recommended implementation criteria by measure, and (c) investigates sensitivity of the measures to differences between schools at varied levels of implementation. Across most surveys, convergent validity estimates were moderate (r = .59–.71), and mean differences were negligible for all surveys other than the School-Wide Evaluation Tool (SET), on which higher scores were more likely to be obtained. Despite higher average scores, the SET classified similar percentages of schools as adequately implementing compared with other measures with a 70% implementation criterion, but fewer schools when compared with measures with an 80% criterion. Compared with other measures, the PBIS Self-Assessment Survey (SAS) was more sensitive to differences among schools at higher levels of implementation. Implications for SWPBIS research and fidelity assessment are discussed.

Predicting Abandonment of School-wide Positive Behavioral Interventions and Supports

This study examines predictors of abandonment of evidence-based practices through descriptive analyses of extant state-level training data, fidelity of implementation data, and nationally reported school demographic data across 915 schools in three states implementing school-wide positive behavioral interventions and supports (SWPBIS). Schools included in this study were tracked for a 5-year period after initial training, yet some elected to abandon SWPBIS at various times during implementation. Results showed that a small proportion of schools in the sample abandoned SWPBIS (7%). Logistic regression analysis identified school locale as the only statistically significant predictor of SWPBIS abandonment with schools located in cities being more likely to abandon. Results are discussed in terms of addressing types of schools at greater risk for abandonment and the importance of state-level training and coaching support.

A Psychometric Study of the Infant and Toddler Intervals of the Social Emotional Assessment Measure.

Psychometric and utility studies on Social Emotional Assessment Measure (SEAM), an innovative tool for assessing and monitoring social-emotional and behavioral development in infants and toddlers with disabilities, were conducted. The Infant and Toddler SEAM intervals were the study focus, using mixed methods, including item response theory modeling and classical test theory. Results using a Rasch one-parameter logistic model indicated model fit statistics were consistent for age and item difficulty as well as for ability and item characteristics. Classical test theory analyses generally confirmed the developmental structure; mean scores increased with age and were significantly correlated across 6-month increments. Reliability studies indicated strong internal consistency and moderate interrater agreement between teachers. Test–retest reliability results completed by parents online indicated significant agreement. Overall, 90% of parents reported the SEAM asked appropriate questions and took less than 10 min to complete.

Within-year fidelity growth of SWPBIS during installation and initial implementation.

The purpose of this study was to document within-year fidelity growth during installation and initial implementation of School-Wide Positive Behavioral Interventions and Supports (SWPBIS). Participants included school teams from schools throughout the United States that were in years 1 to 4 of SWPBIS implementation and routinely evaluated their implementation fidelity. The fidelity outcome was assessed with the Team Implementation Checklist (TIC) and was completed multiple times per year by SWPBIS teams. Results from multilevel fidelity growth models documented within- and between-school variability and growth predictors. Years implementing, location, school type, and enrollment size were significant predictors of beginning-year fidelity scores (intercept), and years implementing and relative socioeconomic status were significant predictors of the average rate of fidelity change per month of school (slope). These results add to the growing field of implementation science, and practice recommendations are outlined. (PsycINFO Database Record