MakeTests: Generate and Correct Individualized Questions with Many Styles

Abstract

Hardcopy exams are one of the most traditional evaluation methods. However, the greater the class the more endeavour to correct them. Automatic generation and evaluation tools can help but most of them are restricted to multiple-choice tests. Our paper presents MakeTests, a free of charge and open source system that automates both generation and correction of exams. MakeTests’ main contributions are: (1) highly parametrized questions drawn from a database; (2) inclusion of many question styles besides multiple-choice (true/false, matching, numerical and written response, only this one with manual correction); (3) real-time correction with webcam upon handing in. This paper shows how to elaborate exams with MakeTests, specially regarding the several question styles with parametrization, and also how to correct them automatically. These procedures are illustrated here by two experiments: the first one focused on feedback immediately upon handing in a test that was given to 78 students, and the second one managed by a professor without any programming knowledge. Our results indicate that MakeTests allows for quick elaboration of parametric questions and fast correction, even for users that lack technical knowledge.