Jérémy Bourgeois

A Feasibility Study with Image-Based Rendered Virtual Reality in Patients with Mild Cognitive Impairment and Dementia.

Virtual Reality (VR) has emerged as a promising tool in many domains of therapy and rehabilitation, and has recently attracted the attention of researchers and clinicians working with elderly people with MCI, Alzheimer’s disease and related disorders. Here we present a study testing the feasibility of using highly realistic image-based rendered VR with patients with MCI and dementia. We designed an attentional task to train selective and sustained attention, and we tested a VR and a paper version of this task in a single-session within-subjects design. Results showed that participants with MCI and dementia reported to be highly satisfied and interested in the task, and they reported high feelings of security, low discomfort, anxiety and fatigue. In addition, participants reported a preference for the VR condition compared to the paper condition, even if the task was more difficult. Interestingly, apathetic participants showed a preference for the VR condition stronger than that of non-apathetic participants. These findings suggest that VR-based training can be considered as an interesting tool to improve adherence to cognitive training in elderly people with cognitive impairment.

The Multilingual CID-5: A New Tool to Study the Perception of Communicative Interactions in Different Languages

The investigation of the ability to perceive, recognize, and judge upon social intentions, such as communicative intentions, on the basis of body motion is a growing research area. Cross-cultural differences in ability to perceive and interpret biological motion, however, have been poorly investigated so far. Progress in this domain strongly depends on the availability of suitable stimulus material. In the present method paper, we describe the multilingual CID-5, an extension of the CID-5 database, allowing for the investigation of how non-conventional communicative gestures are classified and identified by speakers of different languages. The CID-5 database contains 14 communicative interactions and 7 non-communicative actions performed by couples of agents and presented as point-light displays. For each action, the database provides movie files with the point-light animation, text files with the 3-D spatial coordinates of the point-lights, and five different response alternatives. In the multilingual CID-5 the alternatives were translated into seven languages (Chinese, Dutch, English, French, German, Italian, and Polish). Preliminary data collected to assess the recognizability of the actions in the different languages suggest that, for most of the action stimuli, information presented in point-light displays is sufficient for the distinctive classification of the action as communicative vs. individual, as well as for identification of the specific communicative gesture performed by the actor in all the available languages.

Recommendations for the Use of Serious Games in Neurodegenerative Disorders: 2016 Delphi Panel

The use of Serious Games (SG) in the health domain is expanding. In the field of neurodegenerative disorders (ND) such as Alzheimer’s disease, SG are currently employed both to support and improve the assessment of different functional and cognitive abilities, and to provide alternative solutions for patients’ treatment, stimulation, and rehabilitation. As the field is quite young, recommendations on the use of SG in people with ND are still rare. In 2014 we proposed some initial recommendations (Robert et al., 2014). The aim of the present work was to update them, thanks to opinions gathered by experts in the field during an expert Delphi panel. Results confirmed that SG are adapted to elderly people with mild cognitive impairment (MCI) and dementia, and can be employed for several purposes, including assessment, stimulation, and improving wellbeing, with some differences depending on the population (e.g., physical stimulation may be better suited for people with MCI). SG are more adapted for use with trained caregivers (both at home and in clinical settings), with a frequency ranging from 2 to 4 times a week. Importantly, the target of SG, their frequency of use and the context in which they are played depend on the SG typology (e.g., Exergame, cognitive game), and should be personalized with the help of a clinician.

Relearning of activities of daily living: A comparison of the effectiveness of three learning methods in patients with dementia of the Alzheimer type

This study examined the effectiveness of three different learning methods: trial and error learning (TE), errorless learning (EL) and learning by modeling with spaced retrieval (MR) on the relearning process of IADL in mild-to-moderately severe Alzheimers Dementia (AD) patients (n=52), using a 6-weeks randomized controlled trial design. The participants had to relearn three IADLs. Repeated-measure analyses during pre-intervention, post-intervention and 1-month delayed sessions were performed. All three learning methods were found to have similar efficiency. However, the intervention produced greater improvements in the actual performance of the IADL tasks than on their explicit knowledge. This study confirms that the relearning of IADL is possible with AD patients through individualized interventions, and that the improvements can be maintained even after the intervention.

PRAXIS: Towards Automatic Cognitive Assessment Using Gesture Recognition

Abstract Praxis test is a gesture-based diagnostic test which has been accepted as diagnostically indicative of cortical pathologies such as Alzheimer’s disease. Despite being simple, this test is oftentimes skipped by the clinicians. In this paper, we propose a novel framework to investigate the potential of static and dynamic upper-body gestures based on the Praxis test and their potential in a medical framework to automatize the test procedures for computer-assisted cognitive assessment of older adults. In order to carry out gesture recognition as well as correctness assessment of the performances we have recollected a novel challenging RGB-D gesture video dataset recorded by Kinect v2, which contains 29 specific gestures suggested by clinicians and recorded from both experts and patients performing the gesture set. Moreover, we propose a framework to learn the dynamics of upper-body gestures, considering the videos as sequences of short-term clips of gestures. Our approach first uses body part detection to extract image patches surrounding the hands and then, by means of a fine-tuned convolutional neural network (CNN) model, it learns deep hand features which are then linked to a long short-term memory to capture the temporal dependencies between video frames. We report the results of four developed methods using different modalities. The experiments show effectiveness of our deep learning based approach in gesture recognition and performance assessment tasks. Satisfaction of clinicians from the assessment reports indicates the impact of framework corresponding to the diagnosis.

Teaching Literacy Skills to French Minimally Verbal School-Aged Children with Autism Spectrum Disorders with the Serious Game SEMA-TIC: An Exploratory Study

Learning to read is very challenging for children with Autism Spectrum Disorders (ASD), but also very important, as it can give them access to new knowledge. This is even more challenging in minimally verbal children, who do not have the verbal abilities to learn through usual methods. To address the learning of literacy skills in French minimally verbal school-aged children with ASD, we designed the serious game SEMA-TIC, which relies on non-verbal cognitive skills and uses specific learning strategies adapted to the features of autistic individuals. This study investigated the usability of SEMA-TIC (in terms of adaptability, efficiency, and effectiveness) for the acquisition of literacy skills in French minimally verbal school-aged children with ASD. Twenty-five children with ASD and no functional language participated in the study. Children in the training group received the SEMA-TIC training over 23 weeks (on average), while no intervention was provided to children in the non-training group. Results indicated that SEMA-TIC presents a suitable usability, as all participants were able to play (adaptability), to complete the training (efficiency) and to acquire significant literacy skills (effectiveness). Indeed, the literacy skills in the training group significantly improved after the training, as measured by specific experimental tasks (alphabet knowledge, word reading, word-non-word discrimination, sentence reading and word segmentation; all p ≤ 0.001) compared to the non-training group. More importantly, 3 out of 12 children of the training group could be considered as word decoders at the end of the intervention, whereas no children of the non-training group became able to decode words efficiently. The present study thus brings preliminary evidence that French minimally verbal school-aged children with ASD are able to learn literacy skills through SEMA-TIC, a specific computerized intervention consisting in a serious game based on non-verbal cognitive skills.

Children Facial Expression Production: Influence of Age, Gender, Emotion Subtype, Elicitation Condition and Culture

The production of facial expressions (FEs) is an important skill that allows children to share and adapt emotions with their relatives and peers during social interactions. These skills are impaired in children with Autism Spectrum Disorder. However, the way in which typical children develop and master their production of FEs has still not been clearly assessed. This study aimed to explore factors that could influence the production of FEs in childhood such as age, gender, emotion subtype (sadness, anger, joy, and neutral), elicitation task (on request, imitation), area of recruitment (French Riviera and Parisian) and emotion multimodality. A total of one hundred fifty-seven children aged 6–11 years were enrolled in Nice and Paris, France. We asked them to produce FEs in two different tasks: imitation with an avatar model and production on request without a model. Results from a multivariate analysis revealed that: (1) children performed better with age. (2) Positive emotions were easier to produce than negative emotions. (3) Children produced better FE on request (as opposed to imitation); and (4) Riviera children performed better than Parisian children suggesting regional influences on emotion production. We conclude that facial emotion production is a complex developmental process influenced by several factors that needs to be acknowledged in future research.

Le serious game, un lien entre institution et domicile.

Serious game is a personal innovative technology to facilitate learning and social interaction. It can be used in a patients home or in an institution. This training tool can also be developed for health professionals, especially accommodation facilities for the elderly. The objective is to integrate knowledge and know-how.