Kai Halttunen

Learning Information Retrieval through an Educational Game. Is Gaming sufficient for learning

Computer-supported learning environment (CSLE) Information Retrieval Game (IR Game) is described and evaluated. The IR Game is based on the idea that test collections used in laboratory-based IR experiments could be used in instruction as a rapid query analysis tool. The goal is to provide a realistic environment for demonstrating the performance of queries in different types of search situations. The outline of the IR Game is introduced both at the technical and instructional levels. An evaluation experiment is reported revealing that students found different characteristics of the IR Game both enhancing and inhibiting learning. The perceived usefulness of features like query performance feedback, visualization of serch results, comparison of queries, document browsing and help facilities are discussed. Several ideas for the elaboration of information retrieval learning environments are put forward. These include design of search tasks, implementation of feedback, social negotiation and articulation of student’s working theories.

Assessing learning outcomes in two information retrieval learning environments

In order to design information retrieval (IR) learning environments and instruction, it is important to explore learning outcomes of different pedagogical solutions. Learning outcomes have seldom been evaluated in IR instruction. The particular focus of this study is the assessment of learning outcomes in an experimental, but naturalistic, learning environment compared to more traditional instruction. The 57 participants of an introductory course on IR were selected for this study, and the analysis illustrates their learning outcomes regarding both conceptual change and development of IR skill. Concept mapping of student essays was used to analyze conceptual change and log-files of search exercises provided data for performance assessment. Students in the experimental learning environment changed their conceptions more regarding linguistic aspects of IR and paid more emphasis on planning and management of search process. Performance assessment indicates that anchored instruction and scaffolding with an instructional tool, the IR Game, with performance feedback enables students to construct queries with fewer semantic knowledge errors also in operational IR systems.

Two information retrieval learning environments: their design and evaluation

The design and evaluation of two information retrieval (IR) learning environments took place in a basic course of IR (6 ECTS credits) at the Department of Information Studies at the University of Tampere. The course consisted of lectures, web exercises and tutored search exercises. Tutored exercises were carried out in two learning environments, in a traditional and in an experimental one. The participants in the study (n=57), were undergraduate students of information studies at the university.

Pedagogical Design and Evaluation of Interactive Information Retrieval Learning Environment

In this chapter, the pedagogical design and evaluation of interactive information retrieval learning environment is presented. The course consisted of lectures, Web exercises, and tutored search exercises. The pedagogical design of the learning environment was based on the ideas from anchored instruction and intentional scaffolding. Anchoring related the search exercises to a simulated work-task situation. Scaffolding, i.e., various ways of supporting learners in proceeding with their task was provided by an instructional tool, the Query Performance Analyzer, or by a teacher. The effect of the learning environment on the students’ learning experiences, performance, and learning outcomes was evaluated. The evaluation and student feedback was based on seven different datasets. The data collection with qualitative and quantitative analysis methods is described in the chapter.