Matematikte Kavram Karikatürlerinin Değerlendirilmesine Yönelik Puanlama Anahtarının Geliştirilmesi

Abstract

The aim of this study is to develop a valid and reliable rubric in order to evaluate the concept cartoons prepared for mathematics lesson. Research data were obtained by evaluating 36 concept cartoons created by mathematics teachers working in Sivas city center. Two mathematics educators who had a master s degree in mathematics education carried out the evaluation process. In the validity studies, experts opinions about rubric were examined one by one in the context of content, structure and criteria. It has been observed that the percentages of agreement between the opinions of the experts about their suitability and competence with rubric are at an acceptable level and varied between 82% and 95%. Within the scope of the validity study, the content validity index was also calculated and the content validity indexes for each sub-dimension were found between 0.80 and 1. Considering both the concordance percentages and the content validity indexes, it has been seen that the developed rubric is a valid measurement tool for evaluating the concept characteristics. In reliability studies, within the scope of classical test theory, the harmony between two raters was determined by Spearman Correlation Coefficient for the total scores, while the fit in each sub-criterion was determined by Cohen’s Kappa . While it was observed that there was a positive, significant and high (Rho = 0.856, p <0.01) relationship between the total scores given by the two evaluators to rubric, Cohen s Kappa results were found between 0.706 and 0.797 for the sub-criteria. In the reliability studies, reliability calculations were made for rater, scored (concept cartoons) and item surfaces, taking into account the Multi-Facial Rasch Measurement Model within the scope of item response theory. The reliability indices of these surfaces were found to be 0.87, 0.80 and 0.89, respectively. When rubric s Spearman correlation calculated for total score and Cohen s Kappa values calculated for sub-criterion scores were evaluated together with the reliable indexes of rater, scored (concept cartoons) and item surfaces, it was seen that the rubric created was a reliable scoring key. The findings of the study were discussed considering the relevant literature and various suggestions were made.