Bernard N’Kaoua

Predicting Mental Imagery-Based BCI Performance from Personality, Cognitive Profile and Neurophysiological Patterns

Mental-Imagery based Brain-Computer Interfaces (MI-BCIs) allow their users to send commands to a computer using their brain-activity alone (typically measured by ElectroEncephaloGraphy—EEG), which is processed while they perform specific mental tasks. While very promising, MI-BCIs remain barely used outside laboratories because of the difficulty encountered by users to control them. Indeed, although some users obtain good control performances after training, a substantial proportion remains unable to reliably control an MI-BCI. This huge variability in user-performance led the community to look for predictors of MI-BCI control ability. However, these predictors were only explored for motor-imagery based BCIs, and mostly for a single training session per subject. In this study, 18 participants were instructed to learn to control an EEG-based MI-BCI by performing 3 MI-tasks, 2 of which were non-motor tasks, across 6 training sessions, on 6 different days. Relationships between the participants’ BCI control performances and their personality, cognitive profile and neurophysiological markers were explored. While no relevant relationships with neurophysiological markers were found, strong correlations between MI-BCI performances and mental-rotation scores (reflecting spatial abilities) were revealed. Also, a predictive model of MI-BCI performance based on psychometric questionnaire scores was proposed. A leave-one-subject-out cross validation process revealed the stability and reliability of this model: it enabled to predict participants’ performance with a mean error of less than 3 points. This study determined how users’ profiles impact their MI-BCI control ability and thus clears the way for designing novel MI-BCI training protocols, adapted to the profile of each user.

The Use of Virtual Reality for Episodic Memory Assessment Effects of Active Navigation

Episodic memory was assessed using Virtual Reality (VR). Forty-four (44) subjects visualized a target virtual apartment containing specific objects in each room. Then they visualized a second virtual apartment comprised of specific objects and objects shared by the two apartments. Subjects navigated in the virtual apartments in one of the following two conditions: active and passive. Four main episodic memory components were scored from the VR exposures: (1) learning effect; (2) active forgetting effect; (3) strategies at encoding and at retrieval; and (4) false recognitions (FRs). The effect of navigation mode (active vs. passive) on each memory component was examined. Active subjects had better learning and retrieval (recognition hits) performances compared to passive subjects. A beneficial effect of active navigation was also observed on the source-based FR rates. Active subjects made fewer source-based FRs compared to passive subjects. These overall results for the effect of active navigation are discussed in terms of the distinction between item-specific and relational processing.

Age-related wayfinding differences in real large-scale environments: detrimental motor control effects during spatial learning are mediated by executive decline?

The aim of this study was to evaluate motor control activity (active vs. passive condition) with regards to wayfinding and spatial learning difficulties in large-scale spaces for older adults. We compared virtual reality (VR)-based wayfinding and spatial memory (survey and route knowledge) performances between 30 younger and 30 older adults. A significant effect of age was obtained on the wayfinding performances but not on the spatial memory performances. Specifically, the active condition deteriorated the survey measure in all of the participants and increased the age-related differences in the wayfinding performances. Importantly, the age-related differences in the wayfinding performances, after an active condition, were further mediated by the executive measures. All of the results relative to a detrimental effect of motor activity are discussed in terms of a dual task effect as well as executive decline associated with aging.

Assessing the impact of automatic vs. controlled rotations on spatial transfer with a joystick and a walking interface in VR

We present a user study assessing spatial transfer in a 3D navigation task, with two different motor activities: a minimal (joystick) and an extensive motor activity (walking Interface), with rotations of the viewpoint either controlled by the user, or automatically managed by the system. The task consisted in learning a virtual path of a 3D model of a real city, with either one of these four conditions: Joystick / Treadmill Vs Manual Rotation / Automatic Rotation. We assessed spatial knowledge with six spatial restitution tasks. To assess the interfaces used, we analyzed also the interaction data acquired during the learning path. Our results show that the direct control of rotations has different effects, depending on the motor activity required by the input modality. The quality of spatial representation increases with the Treadmill when rotations are enabled. With the Joystick, controlling the rotations affect spatial representations. We discuss our findings in terms of cognitive, sensorimotor processes and human computer interaction issues.

Are visual cues helpful for virtual spatial navigation and spatial memory in patients with mild cognitive impairment or Alzheimer’s disease?

Objective: To evaluate whether visual cues are helpful for virtual spatial navigation and memory in Alzheimer’s disease (AD) and patients with mild cognitive impairment (MCI). Method: 20 patients with AD, 18 patients with MCI and 20 age-matched healthy controls (HC) were included. Participants had to actively reproduce a path that included 5 intersections with one landmark at each intersection that they had seen previously during a learning phase. Three cueing conditions for navigation were offered: salient landmarks, directional arrows and a map. A path without additional visual stimuli served as control condition. Navigation time and number of trajectory mistakes were recorded. Results: With the presence of directional arrows, no significant difference was found between groups concerning the number of trajectory mistakes and navigation time. The number of trajectory mistakes did not differ significantly between patients with AD and patients with MCI on the path with arrows, the path with salient landmarks and the path with a map. There were significant correlations between the number of trajectory mistakes under the arrow condition and executive tests, and between the number of trajectory mistakes under the salient landmark condition and memory tests. Conclusion: Visual cueing such as directional arrows and salient landmarks appears helpful for spatial navigation and memory tasks in patients with AD and patients with MCI. This study opens new research avenues for neuro-rehabilitation, such as the use of augmented reality in real-life settings to support the navigational capabilities of patients with MCI and patients with AD.

Modéliser les phénomènes de compensation mnésique dans le cadre des niveaux de traitement : application au vieillissement

Cet article concerne l’etude des phenomenes de compensation mnesique dans le cadre de la theorie des niveaux de traitement et du vieillissement. Precisement, l’objectif du travail etait de determiner la capacite du modele MINERVA 2 a : 1. simuler les effets de profondeur de traitement et d’elaboration ainsi que leur interaction ; 2. prendre en compte les difficultes mnesiques liees a l’âge ; et 3. fournir une interpretation des phenomenes compensatoires coherente avec celle proposee par Backman et Dixon (par ex., 1992). Une experimentation nous a tout d’abord permis de retrouver les effets couramment observes dans la litterature du domaine. L’utilisation de MINERVA 2 nous a ensuite permis non seulement de simuler les resultats experimentaux mais aussi d’en proposer un modele explicatif proche de celui de Backman et Dixon, en regard de l’adequation entre les caracteristiques du sujet et de la tâche, et du role de cette adequation dans la mise en jeu des phenomenes compensatoires.