Studies in Educational Evaluation | 2021
The development and psychometric properties of an educational development impact questionnaire
Abstract
Abstract The purpose of this study was to develop and provide psychometric evidence of the Educational Development Impact Questionnaire (EDIQ) for evaluating complex outcomes of multifaceted educational development work within centres of teaching and learning. Our study addresses the need for a user-friendly and psychometrically sound survey instrument adaptable to differing higher education contexts. Our outcomes framework, mapping the intended short- and medium-term outcomes of our centre’s educational development activities, provided the necessary framework on which to create survey items. Scores from 267 instructors from a research-intensive university provided the data for examining the EDIQ’s initial factor structure using exploratory factor analysis. We justify our use of two different cut-scores to generate two models of factor structures. Factors common to both models are instructor growth, scholarship of teaching and learning, technology integration, impact on students, and knowledge enhancement. We discuss how the models provide different opportunities for assessing short-term and medium-term outcomes over time and the usefulness of the EDIQ beyond the current study context.