Quan Nguyen

Towards Actionable Learning Analytics Using Dispositions

Studies in the field of learning analytics (LA) have shown students’ demographics and learning management system (LMS) data to be effective identifiers of “at risk” performance. However, insights generated by these predictive models may not be suitable for pedagogically informed interventions due to the inability to explain why students display these behavioral patterns. Therefore, this study aims at providing explanations of students’ behaviors on LMS by incorporating dispositional dimensions (e.g., self-regulation and emotions) into conventional learning analytics models. Using a combination of demographic, trace, and self-reported data of eight contemporary social-cognitive theories of education from 1,069 students in a blended introductory quantitative course, we demonstrate the potential of dispositional characteristics of students, such as procrastination and boredom. Our results highlight the need to move beyond simple engagement metrics, whereby dispositional learning analytics provide an actionable bridge between learning analytics and educational intervention.

Student profiling in a dispositional learning analytics application using formative assessment

How learning disposition data can help us translating learning feedback from a learning analytics application into actionable learning interventions, is the main focus of this empirical study. It extends previous work (Tempelaar, Rienties, & Giesbers, 2015), where the focus was on deriving timely prediction models in a data rich context, encompassing trace data from learning management systems, formative assessment data, e-tutorial trace data as well as learning dispositions. In this same educational context, the current study investigates how the application of cluster analysis based on e-tutorial trace data allows student profiling into different at-risk groups, and how these at-risk groups can be characterized with the help of learning disposition data. It is our conjecture that establishing a chain of antecedent-consequence relationships starting from learning disposition, through student activity in e-tutorials and formative assessment performance, to course performance, adds a crucial dimension to current learning analytics studies: that of profiling students with descriptors that easily lend themselves to the design of educational interventions.

Mixing and Matching Learning Design and Learning Analytics

In the last five years, learning analytics has proved its potential in predicting academic performance based on trace data of learning activities. However, the role of pedagogical context in learning analytics has not been fully understood. To date, it has been difficult to quantify learning in a way that can be measured and compared. By coding the design of e-learning courses, this study demonstrates how learning design is being implemented on a large scale at the Open University UK, and how learning analytics could support as well as benefit from learning design. Building on our previous work, our analysis was conducted longitudinally on 23 undergraduate distance learning modules and their 40,083 students. The innovative aspect of this study is the availability of fine-grained learning design data at individual task level, which allows us to consider the connections between learning activities, and the media used to produce the activities. Using a combination of visualizations and social network analysis, our findings revealed a diversity in how learning activities were designed within and between disciplines as well as individual learning activities. By reflecting on the learning design in an explicit manner, educators are empowered to compare and contrast their design using their own institutional data.

Analytics in online and offline language learning environments: the role of learning design to understand student online engagement

Language education has a rich history of research and scholarship focusing on the effectiveness of learning activities and the impact these have on student behaviour and outcomes. One of the basic ...

Analysing the Use of Worked Examples and Tutored and Untutored Problem-Solving in a Dispositional Learning Analytics Context

The identification of students’ learning strategies by using multi-modal data that combine trace data with self-report data is the prime aim of this study. Our context is an application of dispositional learning analytics in a large introductory course mathematics and statistics, based on blended learning. Building on previous studies in which we found marked differences in how students use worked examples as a learning strategy, we compare different profiles of learning strategies on learning dispositions and learning outcome. Our results cast a new light on the issue of efficiency of learning by worked examples, tutored and untutored problem-solving: in contexts where students can apply their own preferred learning strategy, we find that learning strategies depend on learning dispositions. As a result, learning dispositions will have a confounding effect when studying the efficiency of worked examples as a learning strategy in an ecologically valid context.