Amber Walraven

The effect of regulation feedback in a computer-based formative assessment on information problem solving

This study examines the effect of regulation feedback in a computer-based formative assessment in the context of searching for information online. Fifty 13-year-old students completed two randomly selected assessment tasks, receiving automated regulation feedback between them. Student performance was (self-)graded by students and by experts. Expert, as well as student (self)grades showed a significant increase between Task 1 and Task 2. However, further analysis of the expert grades showed significant improvement in performance for girls only. Furthermore, the formative assessment system traced the number of searches and the number of websites consulted per student to complete the two assignments. On average, the results showed that students consulted significantly more websites for Task 2, compared to Task 1. The average number of searches did not differ significantly between Tasks 1 and 2. On the other hand, significant differences were found for those students who, during the evaluation of their performance on Task 1, explicitly stated that they would increase their searches. We examined the effect of regulation feedback in computer-based formative assessment on behaviour and performance.Focus on regulation feedback in Digital Information Skills Measurement tool (DIM).DIM traces student information problem solving behaviour.Applied learning analytics indicates behavioural changes.Performance improvement observed for female respondents only.

Towards Optimal Education Including Self-Regulated Learning in Technology-Enhanced Preschools and Primary Schools.

At the start of preschool, four-year-old pupils differ in their development, including in their capacity to self-regulate their playing and learning. In preschool and primary school, educational processes are generally adapted to the mean age of the pupils in the class. The same may apply to pupil-monitoring systems based on information and communication technology (ICT). This norm-based factor undermines the potential of ICT to support the educational differentiation needed for pupils and increases the amount of daily work for teachers. A theoretical framework is sketched in which pedagogical-didactical, organisational and ICT guidelines enhance differentiated, self-regulated playing and learning for each pupil within preschool and primary school. To develop and check such optimal education and ICT conditions in practice, a pilot and a randomised intervention study are carried out in integrated Dutch preschools/primary schools for pupils aged 4–12. Pilot results support the use of a procedure to screen each childs characteristics at the start of preschool by parents and preschool teachers, and also the immediate relevance of criterion-based and norm-based ordering (‘double diagnostics’) of playing and learning materials. Final attention is given to the intervention study and further development of optimal education in a European research context.

Factors affecting intervention fidelity of differentiated instruction in kindergarten

Abstract This paper reports on the findings in the first phase of a design-based research project as part of a large-scale intervention study in Dutch kindergartens. The project aims at enhancing differentiated instruction and evaluating its effects on children’s development, in particular high-ability children. This study investigates relevant intervention fidelity factors based on [Fullan, M. (2007). The New Meaning of Educational Change. New York: Teachers College Press]. A one-year intervention in 18 K-6 schools was conducted to implement the screening of children’s entry characteristics, differentiation of (preparatory) mathematics and language curricula, and a policy for the differentiation and teaching high-ability children. The intervention fidelity and implementation process were scored for each school using data from observations, field notes and log books. Self-report questionnaires measured participants’ perceptions of the intervention (n = 35 teachers, 18 principals). Quantitative results showed that intervention fidelity differed between schools. Qualitative analyses of perceptions and cross-case analyses of three kindergartens showed that a strong need, pressure from parents, an involved principal, and teacher time and motivation contributed to successful implementation. Implementation barriers were the innovation’s complexity, teacher beliefs, an absent principal and low teacher motivation (which was partly due to communication problems). Implications for interventions in general and differentiated instruction for high-ability children in particular are discussed.

Improving kindergarten teachers’ differentiation practices to better anticipate student differences

Abstract This article presents the findings from a teacher intervention in Dutch kindergartens aimed at improving teachers’ differentiation practices (DP) to better anticipate student differences. The intervention was designed to improve the match between student levels and curricular activities, in particular for high-ability students and consists of three components. A pretest–posttest cluster randomised design was used with three conditions: control (n = 34), pilot intervention (n = 32) and improved intervention (n = 34). Quantitative results demonstrate that the intervention fidelity was relatively high in the improved intervention. Correlations confirmed that teacher-reported DP were higher in schools where the intervention was more completely implemented. DP were enhanced in both intervention conditions, but showed greater improvement in the improved intervention. Qualitative data revealed process characteristics that reflect problems schools encounter with this intervention. Teachers can be supported in improving DP, but this requires school-wide intensive and long support.