Manuel Ninaus

An update to the systematic literature review of empirical evidence of the impacts and outcomes of computer games and serious games

Continuing interest in digital games indicated that it would be useful to update Connolly et al.s (2012) systematic literature review of empirical evidence about the positive impacts and outcomes of games. Since a large number of papers was identified in the period from 2009 to 2014, the current review focused on 143 papers that provided higher quality evidence about the positive outcomes of games. Connolly et al.s multidimensional analysis of games and their outcomes provided a useful framework for organising the varied research in this area. The most frequently occurring outcome reported for games for learning was knowledge acquisition, while entertainment games addressed a broader range of affective, behaviour change, perceptual and cognitive and physiological outcomes. Games for learning were found across varied topics with STEM subjects and health the most popular. Future research on digital games would benefit from a systematic programme of experimental work, examining in detail which game features are most effective in promoting engagement and supporting learning. The current systematic literature review updates Author (date).The review looks at impacts and outcomes of playing digital games from 2009 to 2014.Multi-component coding of papers, games and learning outcomes was used.Many papers were found with 143 papers providing high quality evidence.Games for entertainment and learning addressed different outcomes.

Learning to modulate one's own brain activity: the effect of spontaneous mental strategies

Using neurofeedback (NF), individuals can learn to modulate their own brain activity, in most cases electroencephalographic (EEG) rhythms. Although a large body of literature reports positive effects of NF training on behavior and cognitive functions, there are hardly any reports on how participants can successfully learn to gain control over their own brain activity. About one third of people fail to gain significant control over their brain signals even after repeated training sessions. The reasons for this failure are still largely unknown. In this context, we investigated the effects of spontaneous mental strategies on NF performance. Twenty healthy participants performed either a SMR (sensorimotor rhythm, 12–15 Hz) based or a Gamma (40–43 Hz) based NF training over ten sessions. After the first and the last training session, they were asked to write down which mental strategy they have used for self-regulating their EEG. After the first session, all participants reported the use of various types of mental strategies such as visual strategies, concentration, or relaxation. After the last NF training session, four participants of the SMR group reported to employ no specific strategy. These four participants showed linear improvements in NF performance over the ten training sessions. In contrast, participants still reporting the use of specific mental strategies in the last NF session showed no changes in SMR based NF performance over the ten sessions. This effect could not be observed in the Gamma group. The Gamma group showed no prominent changes in Gamma power over the NF training sessions, regardless of the mental strategies used. These results indicate that successful SMR based NF performance is associated with implicit learning mechanisms. Participants stating vivid reports on strategies to control their SMR probably overload cognitive resources, which might be counterproductive in terms of increasing SMR power.

Control beliefs can predict the ability to up-regulate sensorimotor rhythm during neurofeedback training

Technological progress in computer science and neuroimaging has resulted in many approaches that aim to detect brain states and translate them to an external output. Studies from the field of brain-computer interfaces (BCI) and neurofeedback (NF) have validated the coupling between brain signals and computer devices; however a cognitive model of the processes involved remains elusive. Psychological parameters usually play a moderate role in predicting the performance of BCI and NF users. The concept of a locus of control, i.e., whether one’s own action is determined by internal or external causes, may help to unravel inter-individual performance capacities. Here, we present data from 20 healthy participants who performed a feedback task based on EEG recordings of the sensorimotor rhythm (SMR). One group of 10 participants underwent 10 training sessions where the amplitude of the SMR was coupled to a vertical feedback bar. The other group of ten participants participated in the same task but relied on sham feedback. Our analysis revealed that a locus of control score focusing on control beliefs with regard to technology negatively correlated with the power of SMR. These preliminary results suggest that participants whose confidence in control over technical devices is high might consume additional cognitive resources. This higher effort in turn may interfere with brain states of relaxation as reflected in the SMR. As a consequence, one way to improve control over brain signals in NF paradigms may be to explicitly instruct users not to force mastery but instead to aim at a state of effortless relaxation.

Neural substrates of cognitive control under the belief of getting neurofeedback training

Learning to modulate ones own brain activity is the fundament of neurofeedback (NF) applications. Besides the neural networks directly involved in the generation and modulation of the neurophysiological parameter being specifically trained, more general determinants of NF efficacy such as self-referential processes and cognitive control have been frequently disregarded. Nonetheless, deeper insight into these cognitive mechanisms and their neuronal underpinnings sheds light on various open NF related questions concerning individual differences, brain-computer interface (BCI) illiteracy as well as a more general model of NF learning. In this context, we investigated the neuronal substrate of these more general regulatory mechanisms that are engaged when participants believe that they are receiving NF. Twenty healthy participants (40–63 years, 10 female) performed a sham NF paradigm during fMRI scanning. All participants were novices to NF-experiments and were instructed to voluntarily modulate their own brain activity based on a visual display of moving color bars. However, the bar depicted a recording and not the actual brain activity of participants. Reports collected at the end of the experiment indicate that participants were unaware of the sham feedback. In comparison to a passive watching condition, bilateral insula, anterior cingulate cortex and supplementary motor and dorsomedial and lateral prefrontal areas were activated when participants actively tried to control the bar. In contrast, when merely watching moving bars, increased activation in the left angular gyrus was observed. These results show that the intention to control a moving bar is sufficient to engage a broad frontoparietal and cingulo-opercular network involved in cognitive control. The results of the present study indicate that tasks such as those generally employed in NF training recruit the neuronal correlates of cognitive control even when only sham NF is presented.

Neurophysiological methods for monitoring brain activity in serious games and virtual environments: a review

The use of serious games and virtual environments for learning is increasing worldwide. These technologies have the potential to collect live data from users through game play and can be combined with neuroscientific methods such as EEG, fNIRS and fMRI. The several learning processes triggered by serious games are associated with specific patterns of activation that distributed in time and space over different neural networks. This paper explores the opportunities offered and challenges posed by neuroscientific methods when capturing user feedback and using the data to create greater user adaptivity in game. Existing neuroscientific studies examining cortical correlates of game-based learning do not form a common or homogenous field. In contrast, they often have disparate research questions and are represented through a broad range of study designs and game genres. In this paper, the range of studies and applications of neuroscientific methods in game-based learning are reviewed.

Brain volumetry and self-regulation of brain activity relevant for neurofeedback

Neurofeedback is a technique to learn to control brain signals by means of real time feedback. In the present study, the individual ability to learn two EEG neurofeedback protocols - sensorimotor rhythm and gamma rhythm - was related to structural properties of the brain. The volumes in the anterior insula bilaterally, left thalamus, right frontal operculum, right putamen, right middle frontal gyrus, and right lingual gyrus predicted the outcomes of sensorimotor rhythm training. Gray matter volumes in the supplementary motor area and left middle frontal gyrus predicted the outcomes of gamma rhythm training. These findings combined with further evidence from the literature are compatible with the existence of a more general self-control network, which through self-referential and self-control processes regulates neurofeedback learning.

Individual differences in solving arithmetic word problems

BackgroundWith the present functional magnetic resonance imaging (fMRI) study at 3 T, we investigated the neural correlates of visualization and verbalization during arithmetic word problem solving. In the domain of arithmetic, visualization might mean to visualize numbers and (intermediate) results while calculating, and verbalization might mean that numbers and (intermediate) results are verbally repeated during calculation. If the brain areas involved in number processing are domain-specific as assumed, that is, that the left angular gyrus (AG) shows an affinity to the verbal domain, and that the left and right intraparietal sulcus (IPS) shows an affinity to the visual domain, the activation of these areas should show a dependency on an individual’s cognitive style.Methods36 healthy young adults participated in the fMRI study. The participants habitual use of visualization and verbalization during solving arithmetic word problems was assessed with a short self-report assessment. During the fMRI measurement, arithmetic word problems that had to be solved by the participants were presented in an event-related design.ResultsWe found that visualizers showed greater brain activation in brain areas involved in visual processing, and that verbalizers showed greater brain activation within the left angular gyrus.ConclusionsOur results indicate that cognitive styles or preferences play an important role in understanding brain activation. Our results confirm, that strong visualizers use mental imagery more strongly than weak visualizers during calculation. Moreover, our results suggest that the left AG shows a specific affinity to the verbal domain and subserves number processing in a modality-specific way.

Neuronal Correlates of Cognitive Control during Gaming Revealed by Near-Infrared Spectroscopy.

In everyday life we quickly build and maintain associations between stimuli and behavioral responses. This is governed by rules of varying complexity and past studies have identified an underlying fronto-parietal network involved in cognitive control processes. However, there is only limited knowledge about the neuronal activations during more natural settings like game playing. We thus assessed whether near-infrared spectroscopy recordings can reflect different demands on cognitive control during a simple game playing task. Sixteen healthy participants had to catch falling objects by pressing computer keys. These objects either fell randomly (RANDOM task), according to a known stimulus-response mapping applied by players (APPLY task) or according to a stimulus-response mapping that had to be learned (LEARN task). We found an increased change of oxygenated and deoxygenated hemoglobin during LEARN covering broad areas over right frontal, central and parietal cortex. Opposed to this, hemoglobin changes were less pronounced for RANDOM and APPLY. Along with the findings that fewer objects were caught during LEARN but stimulus-response mappings were successfully identified, we attribute the higher activations to an increased cognitive load when extracting an unknown mapping. This study therefore demonstrates a neuronal marker of cognitive control during gaming revealed by near-infrared spectroscopy recordings.

Ability to Gain Control Over One’s Own Brain Activity and its Relation to Spiritual Practice: A Multimodal Imaging Study

Spiritual practice, such as prayer or meditation, is associated with focusing attention on internal states and self-awareness processes. As these cognitive control mechanisms presumably are also important for neurofeedback (NF), we investigated whether people who pray frequently (N = 20) show a higher ability of self-control over their own brain activity compared to a control group of individuals who rarely pray (N = 20). All participants underwent structural magnetic resonance imaging (MRI) and one session of sensorimotor rhythm (SMR, 12–15 Hz) based NF training. Individuals who reported a high frequency of prayer showed improved NF performance compared to individuals who reported a low frequency of prayer. The individual ability to control one’s own brain activity was related to volumetric aspects of the brain. In the low frequency of prayer group, gray matter volumes in the right insula and inferior frontal gyrus were positively associated with NF performance, supporting prior findings that more general self-control networks are involved in successful NF learning. In contrast, participants who prayed regularly showed a negative association between gray matter volume in the left medial orbitofrontal cortex (Brodmann’s area (BA) 10) and NF performance. Due to their regular spiritual practice, they might have been more skillful in gating incoming information provided by the NF system and avoiding task-irrelevant thoughts.

A Game-Based Approach to Examining Students’ Conceptual Knowledge of Fractions

Considering the difficulties many students and even educated adults face with reasoning about fractions, the potential for serious games to augment traditional instructional approaches on this topic is strong. The present study aims at providing evidence for the validity of a serious game used for studying students’ conceptual knowledge of fractions. A total of 54 Finnish fifth graders played the math game on tablet computers using tilt-control to maneuver an avatar along a number line for a total of 30 min. Results indicated that most of the hallmark effects of fraction magnitude processing as identified in basic research on numerical cognition were successfully replicated using our serious game. This clearly suggests that game-based approaches for fraction education (even using tilt-control) are possible and may be effective tools for assessing and possibly promoting students’ conceptual knowledge of fractions.