Liesel Knaack

Evaluating the Learning in Learning Objects

A comprehensive review of the literature on the evaluation of learning objects revealed a number of problem areas, including emphasizing technology ahead of learning, an absence of reliability and validity estimates, over‐reliance on informal descriptive data, a tendency to embrace general impressions of learning objects rather than focusing on specific design features, the use of formative or summative evaluation, but not both, and testing on small, vaguely described sample populations using a limited number of learning objects. This study explored a learning‐based approach for evaluating learning objects using a large, diverse, sample of secondary school students. The soundness of this approach was supported by estimates of reliability and validity, using formal statistics where applicable, incorporating both formative and summative evaluations, examining specific learning objects features based on instructional design research, and testing of a range of learning objects. The learning‐based evaluation tool produced useful and detailed information for educators, designers and researchers about the impact of learning objects in the classroom.

Developing Learning Objects for Secondary School Students: A Multi-Component Model

Previous research on the development of learning objects have three notable characteristics: a focus on either technical or learning features, but not both, a target audience consisting exclusively of higher education students, and the absence of formal evaluation. This study provides a detailed description and formal evaluation of a multi-component model used to develop five learning objects for secondary school students. Overall, two thirds of the students reported that the learning objects were beneficial, citing a motivating theme, interactivity, and visual qualities as the most important features. However, almost 60% of all students were critical about the learning object quality. Clarity of instructions, help functions and organization/layout presented the most problems. While the development model used in the study emphasized both technical and learning components, the latter was far more important to teachers and students. Key steps that appeared to be beneficial in the development process included a collaborative team approach, understanding the learner, a focus on clear instruction and organization, and using a comprehensive, theoretically supported evaluation metric to examine the quality and benefits of learning objects.

A formative analysis of individual differences in the effectiveness of learning objects in secondary school

The purpose of this study was to examine individual differences in the effectiveness of learning objects in secondary school classrooms. Specifically, gender, age, grade, subject area, and computer comfort (self-efficacy) were examined in 850 students. Effectiveness was measured in terms of student attitude (learning, quality, and engagement) and student performance. No gender differences were observed between males and females with respect to student attitudes or performance. Age was significantly correlated with student attitudes and performance, however correlation coefficients were small. Grade 12 students were more positive about learning objects and performed better than grade 9 and 10 students. Science students had significantly more positive attitudes and performed better than mathematics students. Finally, students who were more comfortable about computers, appreciated learning objects more than their less confident peers, however performance was unaffected.

Exploring Teachers Perceptions of Web-Based Learning Tools

Over the past 8 to 10 years, web-based learning tools (WBLT s), also known as learning objects, have been evaluated and received positively by higher education students. However, little research has been done examining teachers perceptions of these tools, particularly in middle and secondary school environments. The purpose of the current study was to analyse teacher perceptions of the use of WBLT in middle and secondary school classrooms. Data collected from the Learning Object Scale for Teachers (LOES-T) showed moderate to good reliability and demonstrated construct and convergent validity. Overall, most teachers rated WBLT s as easy-to-use and engaging for students. They also reported that WBLT s promoted successful learning. A number of teachers noted that significant time was spent searching for appropriate WBLT s and preparing lessons. T echnological problems related to WBLT s were not reported often and focussed mostly on Internet speed. The main suggestion offered by teachers was to be prepared to spend time selecting, testing, and preparing the materials in order to ensure successful use of WBLT s. Ke ywords: evaluate, assess, usability, scale, secondary school, WBLT s, web-based learning tools

Investigating the Use of Learning Objects for Secondary School Mathematics

Research on the impact of learning objects in secondary school mathematics classes is limited. To date, only two investigations have been reported in this area. The current study presents a comprehensive analysis of the use and effect of learning objects in secondary school mathematics classrooms. T eacher and student attitudes, as well as student performance, were used to assess the impact of learning objects for 298 students and 11 teachers in 20 different classrooms. T eacher attitudes were positive with respect to quality, engagement, and learning value of learning objects. Student attitudes, on the other hand, varied markedly. Overall, student performance increased significantly after using learning objects, although gains observed were small and highly variable. Student performance was significantly related to the intended purpose of a lesson and teaching strategy selected. Planning time, using learning objects for review or to introduce new concepts, and supplying guided handouts improved student performance. It is reasonable to conclude that mathematics-based learning objects are viable teaching tools when used with the appropriate goals and strategies. Ke ywords: mathematics, use, evaluate, secondary school, learning object

Exploring Individual Differences in Attitudes toward Audience Response Systems

The purpose of this study was to examine individual differences in attitudes toward Audience Response Systems (ARSs) in secondary school classrooms. Specifically, the impact of gender, grade, subject area, computer comfort level, participation level, and type of use were examined in 659 students. Males had significantly more positive attitudes toward ARSs than female students. Students who were more comfortable with computers had significantly more positive attitudes than students who were less comfortable. Students who did not actively participate in class before ARSs were used were more positive about this tool than students who regularly participated. Finally, students were significantly more positive about ARSs when they were used for formative (not for grades) as opposed to summative (for grades) assessment. There were no significant differences observed for grade level or subject area taught. Resume La presente etude visait a etudier les variations personnelles dans la disposition des eleves du secondaire envers l’utilisation de systemes de reponse, ou televoteurs, en classe. Plus precisement, l’etude a examine l’impact du sexe, de l’annee d’etudes, de la matiere, de l’aisance en informatique, du niveau de participation et du type d’utilisation sur 659 eleves. La disposition des garcons envers les televoteurs etait significativement meilleure que celle des filles. De plus, les eleves les plus a l’aise avec les ordinateurs avaient une reponse significativement plus positive que les eleves moins a l’aise. Les eleves qui ne participaient pas activement en classe avant l’utilisation de televoteurs avaient quant a eux une attitude plus positive envers cet outil que les eleves qui participaient deja regulierement. Enfin, les eleves demontraient une attitude plus favorable envers les televoteurs lorsque ceux-ci etaient utilises aux fins d’evaluations formatives (non notees), par opposition aux fins d’evaluations sommatives (notees). Il n’y avait pas de differences significatives observees en fonction de l’annee d’etudes ou de la matiere enseignee.