Jessica Schrouff

PRoNTo: Pattern Recognition for Neuroimaging Toolbox.

In the past years, mass univariate statistical analyses of neuroimaging data have been complemented by the use of multivariate pattern analyses, especially based on machine learning models. While these allow an increased sensitivity for the detection of spatially distributed effects compared to univariate techniques, they lack an established and accessible software framework. The goal of this work was to build a toolbox comprising all the necessary functionalities for multivariate analyses of neuroimaging data, based on machine learning models. The “Pattern Recognition for Neuroimaging Toolbox” (PRoNTo) is open-source, cross-platform, MATLAB-based and SPM compatible, therefore being suitable for both cognitive and clinical neuroscience research. In addition, it is designed to facilitate novel contributions from developers, aiming to improve the interaction between the neuroimaging and machine learning communities. Here, we introduce PRoNTo by presenting examples of possible research questions that can be addressed with the machine learning framework implemented in PRoNTo, and cannot be easily investigated with mass univariate statistical analysis.

Brain functional integration decreases during propofol-induced loss of consciousness

Consciousness has been related to the amount of integrated information that the brain is able to generate. In this paper, we tested the hypothesis that the loss of consciousness caused by propofol anesthesia is associated with a significant reduction in the capacity of the brain to integrate information. To assess the functional structure of the whole brain, functional integration and partial correlations were computed from fMRI data acquired from 18 healthy volunteers during resting wakefulness and propofol-induced deep sedation. Total integration was significantly reduced from wakefulness to deep sedation in the whole brain as well as within and between its constituent networks (or systems). Integration was systematically reduced within each system (i.e., brain or networks), as well as between networks. However, the ventral attentional network maintained interactions with most other networks during deep sedation. Partial correlations further suggested that functional connectivity was particularly affected between parietal areas and frontal or temporal regions during deep sedation. Our findings suggest that the breakdown in brain integration is the neural correlate of the loss of consciousness induced by propofol. They stress the important role played by parietal and frontal areas in the generation of consciousness.

Biased binomial assessment of cross-validated estimation of classification accuracies illustrated in diagnosis predictions

Multivariate classification is used in neuroimaging studies to infer brain activation or in medical applications to infer diagnosis. Their results are often assessed through either a binomial or a permutation test. Here, we simulated classification results of generated random data to assess the influence of the cross-validation scheme on the significance of results. Distributions built from classification of random data with cross-validation did not follow the binomial distribution. The binomial test is therefore not adapted. On the contrary, the permutation test was unaffected by the cross-validation scheme. The influence of the cross-validation was further illustrated on real-data from a brain–computer interface experiment in patients with disorders of consciousness and from an fMRI study on patients with Parkinson disease. Three out of 16 patients with disorders of consciousness had significant accuracy on binomial testing, but only one showed significant accuracy using permutation testing. In the fMRI experiment, the mental imagery of gait could discriminate significantly between idiopathic Parkinsons disease patients and healthy subjects according to the permutation test but not according to the binomial test. Hence, binomial testing could lead to biased estimation of significance and false positive or negative results. In our view, permutation testing is thus recommended for clinical application of classification with cross-validation.

Multiclass classification of FDG PET scans for the distinction between Parkinson's disease and atypical parkinsonian syndromes

Most available pattern recognition methods in neuroimaging address binary classification problems. Here, we used relevance vector machine (RVM) in combination with booststrap resampling (‘bagging’) for non-hierarchical multiclass classification. The method was tested on 120 cerebral 18fluorodeoxyglucose (FDG) positron emission tomography (PET) scans performed in patients who exhibited parkinsonian clinical features for 3.5 years on average but that were outside the prevailing perception for Parkinsons disease (PD). A radiological diagnosis of PD was suggested for 30 patients at the time of PET imaging. However, at follow-up several years after PET imaging, 42 of them finally received a clinical diagnosis of PD. The remaining 78 APS patients were diagnosed with multiple system atrophy (MSA, N = 31), progressive supranuclear palsy (PSP, N = 26) and corticobasal syndrome (CBS, N = 21), respectively. With respect to this standard of truth, classification sensitivity, specificity, positive and negative predictive values for PD were 93% 83% 75% and 96%, respectively using binary RVM (PD vs. APS) and 90%, 87%, 79% and 94%, respectively, using multiclass RVM (PD vs. MSA vs. PSP vs. CBS). Multiclass RVM achieved 45%, 55% and 62% classification accuracy for, MSA, PSP and CBS, respectively. Finally, a majority confidence ratio was computed for each scan on the basis of class pairs that were the most frequently assigned by RVM. Altogether, the results suggest that automatic multiclass RVM classification of FDG PET scans achieves adequate performance for the early differentiation between PD and APS on the basis of cerebral FDG uptake patterns when the clinical diagnosis is felt uncertain. This approach cannot be recommended yet as an aid for distinction between the three APS classes under consideration.

Cross-Modal Decoding of Neural Patterns Associated with Working Memory: Evidence for Attention-Based Accounts of Working Memory

Recent studies suggest common neural substrates involved in verbal and visual working memory (WM), interpreted as reflecting shared attention-based, short-term retention mechanisms. We used a machine-learning approach to determine more directly the extent to which common neural patterns characterize retention in verbal WM and visual WM. Verbal WM was assessed via a standard delayed probe recognition task for letter sequences of variable length. Visual WM was assessed via a visual array WM task involving the maintenance of variable amounts of visual information in the focus of attention. We trained a classifier to distinguish neural activation patterns associated with high- and low-visual WM load and tested the ability of this classifier to predict verbal WM load (high-low) from their associated neural activation patterns, and vice versa. We observed significant between-task prediction of load effects during WM maintenance, in posterior parietal and superior frontal regions of the dorsal attention network; in contrast, between-task prediction in sensory processing cortices was restricted to the encoding stage. Furthermore, between-task prediction of load effects was strongest in those participants presenting the highest capacity for the visual WM task. This study provides novel evidence for common, attention-based neural patterns supporting verbal and visual WM.

fMRI Artefact Rejection and Sleep Scoring Toolbox

We started writing the “fMRI artefact rejection and sleep scoring toolbox”, or “FA𝕊T”, to process our sleep EEG-fMRI data, that is, the simultaneous recording of electroencephalographic and functional magnetic resonance imaging data acquired while a subject is asleep. FA𝕊T tackles three crucial issues typical of this kind of data: (1) data manipulation (viewing, comparing, chunking, etc.) of long continuous M/EEG recordings, (2) rejection of the fMRI-induced artefact in the EEG signal, and (3) manual sleep-scoring of the M/EEG recording. Currently, the toolbox can efficiently deal with these issues via a GUI, SPM8 batching system or hand-written script. The tools developed are, of course, also useful for other EEG applications, for example, involving simultaneous EEG-fMRI acquisition, continuous EEG eye-balling, and manipulation. Even though the toolbox was originally devised for EEG data, it will also gracefully handle MEG data without any problem. “FA𝕊T” is developed in Matlab as an add-on toolbox for SPM8 and, therefore, internally uses its SPM8-meeg data format. “FA𝕊T” is available for free, under the GNU-GPL.

Decoding semi-constrained brain activity from FMRI using support vector machines and gaussian processes.

Predicting a particular cognitive state from a specific pattern of fMRI voxel values is still a methodological challenge. Decoding brain activity is usually performed in highly controlled experimental paradigms characterized by a series of distinct states induced by a temporally constrained experimental design. In more realistic conditions, the number, sequence and duration of mental states are unpredictably generated by the individual, resulting in complex and imbalanced fMRI data sets. This study tests the classification of brain activity, acquired on 16 volunteers using fMRI, during mental imagery, a condition in which the number and duration of mental events were not externally imposed but self-generated. To deal with these issues, two classification techniques were considered (Support Vector Machines, SVM, and Gaussian Processes, GP), as well as different feature extraction methods (General Linear Model, GLM and SVM). These techniques were combined in order to identify the procedures leading to the highest accuracy measures. Our results showed that 12 data sets out of 16 could be significantly modeled by either SVM or GP. Model accuracies tended to be related to the degree of imbalance between classes and to task performance of the volunteers. We also conclude that the GP technique tends to be more robust than SVM to model unbalanced data sets.

Experience-dependent induction of hypnagogic images during daytime naps: a combined behavioural and EEG study.

This study characterizes hypnagogic hallucinations reported during a polygraphically recorded 90‐min daytime nap following or preceding practice of the computer game Tetris. In the experimental group (N = 16), participants played Tetris in the morning for 2 h during three consecutive days, while in a first control group (N = 13, controlling the effect of experience) participants did not play any game, and in a second control group (N = 14, controlling the effect of anticipation) participants played Tetris after the nap. During afternoon naps, participants were repetitively awakened 15, 45, 75, 120 or 180 s after the onset of S1, and were asked to report their mental content. Reports content was scored by three judges (inter‐rater reliability 85%). In the experimental group, 48 out of 485 (10%) sleep‐onset reports were Tetris‐related. They mostly consisted of images and sounds with very little emotional content. They exactly reproduced Tetris elements or mixed them with other mnemonic components. By contrast, in the first control group, only one report out of 107 was scored as Tetris‐related (1%), and in the second control group only three reports out of 112 were scored as Tetris‐related (3%; between‐groups comparison; P = 0.006). Hypnagogic hallucinations were more consistently induced by experience than by anticipation (P = 0.039), and they were predominantly observed during the transition of wakefulness to sleep. The observed attributes of experience‐related hypnagogic hallucinations are consistent with the particular organization of regional brain activity at sleep onset, characterized by high activity in sensory cortices and in the default‐mode network.

Mapping human temporal and parietal neuronal population activity and functional coupling during mathematical cognition

Significance Humans have the unique ability to perform exact mental arithmetic, which derives from the association of symbols (e.g., “3”) with discrete quantities. Using direct intracranial recordings, we measured electrophysiological activity from neuronal populations in the lateral parietal cortex (LPC) and ventral temporal cortex (VTC) that are known to be important for numerical processing as subjects performed various experiments. We observed functional heterogeneity within each region at the millimeter and millisecond scales and report empirical evidence of functional coupling between the LPC and VTC during mathematical cognition. Our results suggest the presence of an anatomically selective numerical cognition system that engages discrete neuronal populations of the ventral temporal and lateral parietal regions in different time windows of numerical processing. Brain areas within the lateral parietal cortex (LPC) and ventral temporal cortex (VTC) have been shown to code for abstract quantity representations and for symbolic numerical representations, respectively. To explore the fast dynamics of activity within each region and the interaction between them, we used electrocorticography recordings from 16 neurosurgical subjects implanted with grids of electrodes over these two regions and tracked the activity within and between the regions as subjects performed three different numerical tasks. Although our results reconfirm the presence of math-selective hubs within the VTC and LPC, we report here a remarkable heterogeneity of neural responses within each region at both millimeter and millisecond scales. Moreover, we show that the heterogeneity of response profiles within each hub mirrors the distinct patterns of functional coupling between them. Our results support the existence of multiple bidirectional functional loops operating between discrete populations of neurons within the VTC and LPC during the visual processing of numerals and the performance of arithmetic functions. These findings reveal information about the dynamics of numerical processing in the brain and also provide insight into the fine-grained functional architecture and connectivity within the human brain.

Correlation between resting state fMRI total neuronal activity and PET metabolism in healthy controls and patients with disorders of consciousness

The mildly invasive 18F‐fluorodeoxyglucose positron emission tomography (FDG‐PET) is a well‐established imaging technique to measure ‘resting state’ cerebral metabolism. This technique made it possible to assess changes in metabolic activity in clinical applications, such as the study of severe brain injury and disorders of consciousness.