Johanna Fleckenstein

Teachers' Judgement Accuracy Concerning CEFR Levels of Prospective University Students.

ABSTRACT Most English-medium programs at European universities require prospective students to take standardised tests for English as a foreign language (EFL) to be admitted. However, there are contexts in which individual teachers’ judgements serve the same function, thus having high-stakes consequences for the higher education entrance of their students. The present study investigates the accuracy of CEFR-based judgements of upper secondary school EFL teachers in Germany and compares it to the accuracy of conventional grading. Seventy-three teachers located each of the students in their EFL class onto a CEFR level. Teachers’ judgements were compared to the CEFR levels estimated from the TOEFL ITP using level, differentiation, and ranking component as indicators of judgement accuracy. Findings show that while CEFR-based judgements of relative EFL proficiency within classes (rank component) are rather appropriate, teachers substantially overestimate the total level of their students’ achievement (level component). Compared to conventional grading, however, CEFR-based judgements lead to more accurate estimations of variance between students in a class (differentiation component). The findings are discussed with particular reference to the consequences for higher education entrance policy concerning CEFR levels B2 and C1 as relevant benchmarks.