Sarah Gielen

Evaluating the Consequential Validity of New Modes of Assessment: The Influence of Assessment on Learning, Including Pre-, Post-, and True Assessment Effects

The role of assessment and evaluation in education has been crucial, probably since the earliest approaches to formal education. However, much more attention has been paid to this role in the last few decades, largely due to wider developments in society. The most fundamental change in our views of assessment is represented by the notion of assessment as a tool for learning (Dochy & Mc Dowell, 1997). Whereas in the past, we have seen assessment primarily as a means to determine measures and thus for certification, there is now a belief that the potential benefits of assessing are much wider and impinge on in all stages of the learning process. The new assessment culture (Birenbaum & Dochy, 1996) strongly emphasises the integration of instruction and assessment. Students play far more active roles in the assessment of their achievement. The construction of tasks, the development of criteria for the assessment and the scoring of performance may be shared or negotiated among teachers and students. The assessment takes all kinds of forms such as observations, textand curriculumembedded questions and tests, interviews, performance assessments, writing samples, exhibitions, portfolio assessment, overall assessment. Several labels have been used to describe subsets of these assessment modes, with the most

An inventory of peer assessment diversity

Since Topping published his literature review on peer assessment in 1998, the number of studies on this subject has doubled, if not tripled. However, along with this expansion, the diversity of peer assessment applications increased equally fast. Based on recent literature, this contribution focuses specifically on the diversity that has come to exist in order to update Toppings typology, adding eight variables, extending eight others with extra sub‐dimensions, and including the implementation factors. Five original variables were absorbed into larger entities, leaving 20 variables which were finally grouped into five clusters. For teachers or advisors, this inventory may be of interest as a source of inspiration or as a checklist of important decisions to make when working with peer evaluation. For researchers, it may be a guide towards covering the full scope of particularities when introducing their peer assessment design. Moreover, the framework developed in this paper might relieve the possible confusion originating from the use of a single term to cover a multitude of sometimes incompatible practices.

A Comparative Study of Peer and Teacher Feedback and of Various Peer Feedback Forms in a Secondary School Writing Curriculum.

This study examines whether peer feedback can be a substitute for teacher feedback and which measures can be taken to improve its effectiveness. A pre‐test post‐test control group design examined the long‐term learning effects of individual peer feedback and of collective teacher feedback on writing assignments in secondary education. Moreover, it examined the added value of a priori question forms and a posteriori reply forms aimed at supporting the assessee’s response to peer feedback. The study supports the ‘non‐inferiority’ hypothesis of there being no significant difference in students’ progress after plain substitutional peer feedback or teacher feedback. Both groups (plain peer feedback and teacher feedback), however, improved significantly less than the groups that worked with question or reply forms, confirming the added‐value of these forms. Almost half of the students found the received peer feedback helpful, but less than a quarter considered giving feedback an aid in their own learning process.

Goals of peer assessment and their associated quality concepts

The output of peer assessment in higher education has been investigated increasingly in recent decades. However, this output is evaluated against a variety of quality criteria, resulting in a cluttered picture. This article analyses the different conceptualisations of quality that appear in the literature. Discussions about the most appropriate quality criteria for the output of peer assessment should be brought back to the underlying differences in goals. The most obvious goal is its use as an assessment tool, and the learning goal of peer assessment has also been well established. Investigating the literature more closely yields three additional goals: installation of social control; preparation for self-monitoring and self-regulation in lifelong learning; and active participation of students in the classroom. Each goal results in different quality criteria. Only the criteria that are congruent with the goal that one is trying to achieve should be considered when evaluating the quality of peer assessment.

The influence of classroom disciplinary climate of schools on reading achievement: a cross-country comparative study

Despite considerable interest in research and practice in the effect of classroom disciplinary climate of schools on academic achievement, little is known about the generalizability of this effect over countries. Using hierarchical linear analyses, the present study reveals that a better classroom disciplinary climate in a school is significantly associated with better school reading performance in 53 of the 65 Programme for International Student Assessment (PISA) 2009 participant countries. The classroom disciplinary climate of schools can explain 11% of the between-school differences in reading achievement over countries. Controlling for economic, social, and cultural variables and student gender-related variables at student and school levels, the between-country differences in the effect of classroom disciplinary climate of schools shrank by three quarters. These findings can inform countries that face educational inequality issues (e.g., Argentina) and gender gap issues (e.g., Trinidad and Tobago), suggesting the possibility of tackling these issues via intervening on classroom disciplinary climate of schools.

Information seeking in secondary schools: A multilevel network approach

Abstract In this study, we investigate information seeking interactions in secondary schools from a multilevel network approach. Based on network-related theories, we examine the facilitating role of formal subunits. We apply exponential random graph models for multilevel networks and summarize our findings by using a meta-analysis technique. Our results indicate that formal subunits (e.g. subject departments) can, to some extent, facilitate interactions, in loosely coupled organizations (e.g. secondary schools). Finally, this study shows that a multilevel network approach can provide a more informative representation of information seeking ties in knowledge-intensive organizations.

Regional inequality in reading performance: an exploration in Belgium

ABSTRACT In the 2009 Programme for International Student Assessment, the Flemish community of Belgium outscored its French community in reading, with low achievers accounting for a large proportion of the score gaps. In this study, between-community comparisons based on the Blinder-Oaxaca decomposition method showed that the Flemish community benefits largely from its policies and practices of giving schools relative autonomy in resource allocation, promoting good student conduct, and decreasing grade retention. Between-community comparisons using the Juhn-Murphy-Pierce decomposition method showed that compared to their Flemish peers in the same percentile, low achievers in the French community are hindered more by their relatively low grade level; disadvantageous school economic, social, and cultural composition; and negative school supportive climate while medium and high achievers benefit more from their advantageous school economic, social, and cultural composition; positive supportive climate; and high proportion of qualified teachers in schools.

What Makes the Difference in Reading Achievement? Comparisons between Finland and Shanghai.

Finland and Shanghai are strong performers in the Program for International Student Assessment (PISA). The current study explored the similarities and differences in educational effectiveness between these 2 strong performers. To this end, 14 predictors representing student background and school process characteristics were selected from the PISA 2009 database. The results show that the Finnish educational system is more efficient in transforming given inputs, specially student background characteristics, into reading achievement, while the general condition of the school climate in Shanghai, in terms of value and effect size of the predictors, contributes a large part to its comparative strength in reading achievement. Suggestions for improvement at school and system level are given.

Teacher Leadership in Practice: Mapping the Negotiation of the Position of the Special Educational Needs Coordinator in Schools

ABSTRACT Special needs care has taken on a substantial evolution within education. Special educational needs coordinators (SENCOs) are no longer considered to provide individual guidance to students but to support and professionalize regular teachers in fulfilling special needs care in their classroom. In doing so, they act as teacher leaders. Many concerns are raised about how teacher leadership may interfere with the existing working relationships in schools. In this study, we use Positioning Theory as a theoretical approach to obtain an in-depth understanding of how the position of the SENCO and the responsibilities attached to this position are negotiated within the school. The findings illustrate that SENCOs received the legitimacy to act as teacher leaders when their expertise was recognized, when teachers perceived their task as first-line helpers, and when school principals were willing to release power.