Beat A. Schwendimann

Perceiving Learning at a Glance: A Systematic Literature Review of Learning Dashboard Research

This paper presents a systematic literature review of the state-of-the-art of research on learning dashboards in the fields of Learning Analytics and Educational Data Mining. Research on learning dashboards aims to identify what data is meaningful to different stakeholders and how data can be presented to support sense-making processes. Learning dashboards are becoming popular due to the increased use of educational technologies, such as Learning Management Systems (LMS) and Massive Open Online Courses (MOOCs). The initial search of five main academic databases and GScholar resulted in 346 papers out of which 55 papers were included in the final analysis. Our review distinguishes different kinds of research studies as well as various aspects of learning dashboards and their maturity regarding evaluation. As the research field is still relatively young, most studies are exploratory and proof-of-concept. The review concludes by offering a definition for learning dashboards and by outlining open issues and future lines of work in the area of learning dashboards. There is a need for longitudinal research in authentic settings and studies that systematically compare different dashboard designs.

Understanding learning at a glance: an overview of learning dashboard studies

Research on learning dashboards aims to identify what data is meaningful to different stakeholders in education, and how data can be presented to support sense-making processes. This paper summarizes the main outcomes of a systematic literature review on learning dashboards, in the fields of Learning Analytics and Educational Data Mining. The query was run in five main academic databases and enriched with papers coming from GScholar, resulting in 346 papers out of which 55 were included in the final analysis. Our review distinguishes different kinds of research studies as well as different aspects of learning dashboards and their maturity in terms of evaluation. As the research field is still relatively young, many of the studies are exploratory and proof-of-concept. Among the main open issues and future lines of work in the area of learning dashboards, we identify the need for longitudinal research in authentic settings, as well as studies that systematically compare different dashboard design options.

Making Sense of Knowledge Integration Maps

Digital knowledge maps are rich sources of information to track students’ learning. However, making sense of concept maps has been found challenging. Using multiple quantitative and qualitative methods in combination allows triangulating of changes in students’ understanding. This chapter introduces a novel form of concept map, called knowledge integration map (KIM), and uses KIMs as examples for an overview of concept map analysis methods. KIMs are a form of digital knowledge maps. KIMs have been implemented in high school science classrooms to facilitate and assess complex science topics, such as evolution. KIM analysis aims to triangulate changes in learners’ conceptual understanding through a multi-level analysis strategy, combining quantitative and qualitative methodologies. Quantitative analysis included overall, selected, and weighted propositional analysis using a knowledge integration rubric and network analysis describing changes in network density and prominence of selected concepts. Research suggests that scoring only selected propositions can be more sensitive to measuring conceptual change because it focuses on key concepts of the map. Qualitative analysis of KIMs included topographical analysis methods to describe the overall geometric structure of the map and qualitative analysis of link types. This chapter suggests that a combination of quantitative and qualitative analysis methods can capture different aspects of KIMs and can provide a rich description of changes in students’ understanding of complex topics.

The ‘Erfahrraum’: a pedagogical model for designing educational technologies in dual vocational systems

Vocational education taking place in the dual contexts of workplace and school often lacks integration of concrete experiences with theoretical knowledge. The interplay between workplace and school contexts and their often antagonistic priorities call for a specific model that transforms these divergences into learning opportunities and connects different forms of knowledge into an integrated body of knowledge that contributes to developing vocational competence. This paper presents a multidimensional pedagogical model, called the ‘Erfahrraum’, for the design and implementation of educational technologies as a way to foster this integration in initial dual vocational education and training (VET). The ‘Erfahrraum’ model informs the design of shared spaces for capturing and reflecting on experiences made in different contexts in which VET takes place. The model particularly emphasises the importance of shared reflection processes to turn concrete experiences into relevant integrated knowledge. Examples of implementations in different professions using a range of different technologies illustrate the power of the ‘Erfahrraum’ model.

Research on critique and argumentation from the technology enhanced learning in science center

Technology Enhanced Learning in Science Center (TELS) received funding from the U.S. National Science Foundation to investigate approaches for improving learning and instruction in science classes for students in grades 6–12 with a focus on the role that information technology can play. The knowledge integration framework informs the design of TELS curricula in terms of supporting students in (1) eliciting ideas, (2) adding ideas, (3) developing criteria for evaluating ideas, and (4) sorting and connecting ideas based on those criteria. Critique, argument construction, and argumentation represent central TELS research foci for supporting those foci. This chapter provides an overview of that research. More specifically, this chapter synthesizes research on the role of critique in students’ experimentation skills, the manner in which students warrant ideas in their explanations and arguments, approaches for supporting students in critique and argumentation, approaches for supporting students in revising their explanations and arguments, designs to optimize dialogic argumentation, and approaches for analyzing students’ critique and argumentation.

Critiquing as an Alternative to Generating Concept Maps to Support Knowledge Integration Processes

As constructing concept maps from scratch can be time consuming, this study explores critiquing given concept maps with deliberate errors as an alternative. A form of concept map that distinguishes between different levels, called Knowledge Integration Map (KIM), was used as an assessment and embedded learning tool. The technology-enhanced biology unit was implemented in four high school science classes (n = 93). Student dyads in each class were randomly assigned to the KIM generation (n = 41) or critique (n = 52) task. Dyads in the generation group created their own connections from a given list of concepts, while dyads in the critique group received a concept map that included commonly found errors. KIMs in both groups consisted of the same concepts. Findings indicate that generating or critiquing KIMs can facilitate the construction of cross-level connections. Furthermore, results suggest that critiquing concept maps might be a more time-efficient alternative to generating concept maps from scratch.

The State-of-the-Art of Collaborative Technologies for Initial Vocational Education: A Systematic Literature Review

Future workplaces require collaboration skills in which members of different work communities use technologies to solve complex problems. Vocational education and training (VET) programs need to meet the challenge to prepare students to be part of a competent workforce. Particularly initial vocational education is under pressure to develop learners’ collaboration skills and abilities. To date, however, no attempt has been made to perform a comprehensive review of the use of computer-supported collaborative learning (CSCL) technologies across different vocational education settings to account for contextual factors of VET. In this systematic review, 26 published studies were analyzed with respect to their demographics, research methodology, use of technology, and measured outcomes. This review illuminates that research on CSCL still leaves the vocational learning context as an under-represented field of study. At the same time, technologies offer a range of new types of learning possibilities for vocational education. As the direct result of that development, vocational education is increasingly taking place in new technology-enhanced learning settings. Education can benefit from the opportunities of CSCL technologies, but on the other hand, such technologies create new challenges for facilitating vocational learning. Therefore, this review also identifies three topic areas specific to vocational learning (collaborative writing-to-learn, simulations and game-like solutions, and tangible objects) and enumerates desirable lines for future research.

Comparing Expert and Novice Concept Map Construction Through a Talk-Aloud Protocol

Concept map analysis usually focuses only on the final product. This case study used a talk aloud protocol to study the concept map construction processes of novices and experts. Three biology experts and three novices (9th/10th grade high school students) constructed a concept map from a given list of concepts. Findings suggest that final concept maps of high performing students cannot be distinguished from expert-generated maps. However, analysis of oral elaborations during the construction process revealed that experts often used the same link labels as novices but associated more complex knowledge with the label. Some final propositions would be considered incorrect without an oral explanation. Findings suggest extending concept map evaluation by complementing the final product with an analysis of intermediate stages and accompanying elaborations. Additionally, this study highlights that each expert created a different map and that there is no single best expert map.

Analysing the Structural Properties of Learning Networks

A good repertoire of methods for analysing and sharing ideas about existing designs can make a useful contribution to improving the quality and efficiency of educational design work. Just as architects can improve their practice by studying historic and contemporary buildings, so people who design to help people learn can get better at what they do by understanding the designs of others.

Education for the future

We asked young scientists: Are our schools and universities adequately prepared to educate young people for future challenges? What is the most pressing issue in your field, and what one improvement could your country make to its current education system to prepare students to face it? The responses expressed concerns about the current state of education in countries around the world. Many students lack access to the information they need, and those with access are often constrained by curriculum that emphasizes rote learning and isolated subjects. Our respondents suggested a variety of improvements to prepare the next generation for success.