Evangelos Paraskevopoulos

Musical Expertise Induces Audiovisual Integration of Abstract Congruency Rules

Perception of everyday life events relies mostly on multisensory integration. Hence, studying the neural correlates of the integration of multiple senses constitutes an important tool in understanding perception within an ecologically valid framework. The present study used magnetoencephalography in human subjects to identify the neural correlates of an audiovisual incongruency response, which is not generated due to incongruency of the unisensory physical characteristics of the stimulation but from the violation of an abstract congruency rule. The chosen rule—“the higher the pitch of the tone, the higher the position of the circle”—was comparable to musical reading. In parallel, plasticity effects due to long-term musical training on this response were investigated by comparing musicians to non-musicians. The applied paradigm was based on an appropriate modification of the multifeatured oddball paradigm incorporating, within one run, deviants based on a multisensory audiovisual incongruent condition and two unisensory mismatch conditions: an auditory and a visual one. Results indicated the presence of an audiovisual incongruency response, generated mainly in frontal regions, an auditory mismatch negativity, and a visual mismatch response. Moreover, results revealed that long-term musical training generates plastic changes in frontal, temporal, and occipital areas that affect this multisensory incongruency response as well as the unisensory auditory and visual mismatch responses.

Statistical learning effects in musicians and non-musicians: An MEG study

This study aimed to assess the effect of musical training in statistical learning of tone sequences using Magnetoencephalography (MEG). Specifically, MEG recordings were used to investigate the neural and functional correlates of the pre-attentive ability for detection of deviance, from a statistically learned tone sequence. The effect of long-term musical training in this ability is investigated by means of comparison of MMN in musicians to non-musicians. Both groups (musicians and non-musicians) showed a mismatch negativity (MMN) response to the deviants and this response did not differ amongst them neither in amplitude nor in latency. Another interesting finding of this study is that both groups revealed a significant difference between the standards and the deviants in the response of P50 and this difference was significantly larger in the group of musicians. The increase of this difference in the group of musicians underlies that intensive, specialized and long term exercise can enhance the ability of the auditory cortex to discriminate new auditory events from previously learned ones according to transitional probabilities. A behavioral discrimination task between the standard and the deviant sequences followed the MEG measurement. The behavioral results indicated that the detection of deviance was not explicitly learned by either group, probably due to the lack of attentional resources. These findings provide valuable insights on the functional architecture of statistical learning.

Evidence for Training-Induced Plasticity in Multisensory Brain Structures: An MEG Study

Multisensory learning and resulting neural brain plasticity have recently become a topic of renewed interest in human cognitive neuroscience. Music notation reading is an ideal stimulus to study multisensory learning, as it allows studying the integration of visual, auditory and sensorimotor information processing. The present study aimed at answering whether multisensory learning alters uni-sensory structures, interconnections of uni-sensory structures or specific multisensory areas. In a short-term piano training procedure musically naive subjects were trained to play tone sequences from visually presented patterns in a music notation-like system [Auditory-Visual-Somatosensory group (AVS)], while another group received audio-visual training only that involved viewing the patterns and attentively listening to the recordings of the AVS training sessions [Auditory-Visual group (AV)]. Training-related changes in cortical networks were assessed by pre- and post-training magnetoencephalographic (MEG) recordings of an auditory, a visual and an integrated audio-visual mismatch negativity (MMN). The two groups (AVS and AV) were differently affected by the training. The results suggest that multisensory training alters the function of multisensory structures, and not the uni-sensory ones along with their interconnections, and thus provide an answer to an important question presented by cognitive models of multisensory training.

Neuroplastic Effects of Combined Computerized Physical and Cognitive Training in Elderly Individuals at Risk for Dementia: An eLORETA Controlled Study on Resting States

The present study investigates whether a combined cognitive and physical training may induce changes in the cortical activity as measured via electroencephalogram (EEG) and whether this change may index a deceleration of pathological processes of brain aging. Seventy seniors meeting the clinical criteria of mild cognitive impairment (MCI) were equally divided into 5 groups: 3 experimental groups engaged in eight-week cognitive and/or physical training and 2 control groups: active and passive. A 5-minute long resting state EEG was measured before and after the intervention. Cortical EEG sources were modelled by exact low resolution brain electromagnetic tomography (eLORETA). Cognitive function was assessed before and after intervention using a battery of neuropsychological tests including the minimental state examination (MMSE). A significant training effect was identified only after the combined training scheme: a decrease in the post- compared to pre-training activity of precuneus/posterior cingulate cortex in delta, theta, and beta bands. This effect was correlated to improvements in cognitive capacity as evaluated by MMSE scores. Our results indicate that combined physical and cognitive training shows indices of a positive neuroplastic effect in MCI patients and that EEG may serve as a potential index of gains versus cognitive declines and neurodegeneration. This trial is registered with ClinicalTrials.gov Identifier NCT02313935.

Musical expertise is related to altered functional connectivity during audiovisual integration

Significance Multisensory integration engages distributed cortical areas and is thought to emerge from their dynamic interplay. Nevertheless, large-scale cortical networks underpinning audiovisual perception have remained undiscovered. The present study uses magnetoencephalography and a methodological approach to perform whole-brain connectivity analysis and reveals, for the first time to our knowledge, the cortical network related to multisensory perception. The long-term training-related reorganization of this network was investigated by comparing musicians to nonmusicians. Results indicate that nonmusicians rely on processing visual clues for the integration of audiovisual information, whereas musicians use a denser cortical network that relies mostly on the corresponding auditory information. These data provide strong evidence that cortical connectivity is reorganized due to expertise in a relevant cognitive domain, indicating training-related neuroplasticity. The present study investigated the cortical large-scale functional network underpinning audiovisual integration via magnetoencephalographic recordings. The reorganization of this network related to long-term musical training was investigated by comparing musicians to nonmusicians. Connectivity was calculated on the basis of the estimated mutual information of the sources’ activity, and the corresponding networks were statistically compared. Nonmusicians’ results indicated that the cortical network associated with audiovisual integration supports visuospatial processing and attentional shifting, whereas a sparser network, related to spatial awareness supports the identification of audiovisual incongruences. In contrast, musicians’ results showed enhanced connectivity in regions related to the identification of auditory pattern violations. Hence, nonmusicians rely on the processing of visual clues for the integration of audiovisual information, whereas musicians rely mostly on the corresponding auditory information. The large-scale cortical network underpinning multisensory integration is reorganized due to expertise in a cognitive domain that largely involves audiovisual integration, indicating long-term training-related neuroplasticity.

Multisensory integration during short-term music reading training enhances both uni-and multisensory cortical processing

The human ability to integrate the input of several sensory systems is essential for building a meaningful interpretation out of the complexity of the environment. Training studies have shown that the involvement of multiple senses during training enhances neuroplasticity, but it is not clear to what extent integration of the senses during training is required for the observed effects. This study intended to elucidate the differential contributions of uni- and multisensory elements of music reading training in the resulting plasticity of abstract audiovisual incongruency identification. We used magnetoencephalography to measure the pre- and posttraining cortical responses of two randomly assigned groups of participants that followed either an audiovisual music reading training that required multisensory integration (AV-Int group) or a unisensory training that had separate auditory and visual elements (AV-Sep group). Results revealed a network of frontal generators for the abstract audiovisual incongruency response, confirming previous findings, and indicated the central role of anterior prefrontal cortex in this process. Differential neuroplastic effects of the two types of training in frontal and temporal regions point to the crucial role of multisensory integration occurring during training. Moreover, a comparison of the posttraining cortical responses of both groups to a group of musicians that were tested using the same paradigm revealed that long-term music training leads to significantly greater responses than the short-term training of the AV-Int group in anterior prefrontal regions as well as to significantly greater responses than both short-term training protocols in the left superior temporal gyrus (STG).

Audio-Tactile Integration and the Influence of Musical Training

Perception of our environment is a multisensory experience; information from different sensory systems like the auditory, visual and tactile is constantly integrated. Complex tasks that require high temporal and spatial precision of multisensory integration put strong demands on the underlying networks but it is largely unknown how task experience shapes multisensory processing. Long-term musical training is an excellent model for brain plasticity because it shapes the human brain at functional and structural levels, affecting a network of brain areas. In the present study we used magnetoencephalography (MEG) to investigate how audio-tactile perception is integrated in the human brain and if musicians show enhancement of the corresponding activation compared to non-musicians. Using a paradigm that allowed the investigation of combined and separate auditory and tactile processing, we found a multisensory incongruency response, generated in frontal, cingulate and cerebellar regions, an auditory mismatch response generated mainly in the auditory cortex and a tactile mismatch response generated in frontal and cerebellar regions. The influence of musical training was seen in the audio-tactile as well as in the auditory condition, indicating enhanced higher-order processing in musicians, while the sources of the tactile MMN were not influenced by long-term musical training. Consistent with the predictive coding model, more basic, bottom-up sensory processing was relatively stable and less affected by expertise, whereas areas for top-down models of multisensory expectancies were modulated by training.

Musical expertise is related to neuroplastic changes of multisensory nature within the auditory cortex

Recent neuroscientific evidence indicates that multisensory integration does not only occur in higher level association areas of the cortex as the hierarchical models of sensory perception assumed, but also in regions traditionally thought of as unisensory, such as the auditory cortex. Nevertheless, it is not known whether expertise‐induced neuroplasticity can alter the multisensory processing that occurs in these low‐level regions. The present study used magnetoencephalography to investigate whether musical training may induce neuroplastic changes of multisensory processing within the human auditory cortex. Magnetoencephalography data of four different experiments were used to demonstrate the effect of long‐term and short‐term musical training on the integration of auditory, somatosensory and visual stimuli in the auditory cortex. The cross‐sectional design of three of the experiments allowed us to infer that long‐term musical training is related to a significantly different way of processing multisensory information within the auditory cortex, whereas the short‐term training design of the fourth experiment allowed us to causally infer that multisensory music reading training affects the multimodal processing within the auditory cortex.

Temporal processing of audiovisual stimuli is enhanced in musicians: evidence from magnetoencephalography (MEG).

Numerous studies have demonstrated that the structural and functional differences between professional musicians and non-musicians are not only found within a single modality, but also with regard to multisensory integration. In this study we have combined psychophysical with neurophysiological measurements investigating the processing of non-musical, synchronous or various levels of asynchronous audiovisual events. We hypothesize that long-term multisensory experience alters temporal audiovisual processing already at a non-musical stage. Behaviorally, musicians scored significantly better than non-musicians in judging whether the auditory and visual stimuli were synchronous or asynchronous. At the neural level, the statistical analysis for the audiovisual asynchronous response revealed three clusters of activations including the ACC and the SFG and two bilaterally located activations in IFG and STG in both groups. Musicians, in comparison to the non-musicians, responded to synchronous audiovisual events with enhanced neuronal activity in a broad left posterior temporal region that covers the STG, the insula and the Postcentral Gyrus. Musicians also showed significantly greater activation in the left Cerebellum, when confronted with an audiovisual asynchrony. Taken together, our MEG results form a strong indication that long-term musical training alters the basic audiovisual temporal processing already in an early stage (direct after the auditory N1 wave), while the psychophysical results indicate that musical training may also provide behavioral benefits in the accuracy of the estimates regarding the timing of audiovisual events.

Playing and Listening to Tailor-Made Notched Music: Cortical Plasticity Induced by Unimodal and Multimodal Training in Tinnitus Patients

Background. The generation and maintenance of tinnitus are assumed to be based on maladaptive functional cortical reorganization. Listening to modified music, which contains no energy in the range of the individual tinnitus frequency, can inhibit the corresponding neuronal activity in the auditory cortex. Music making has been shown to be a powerful stimulator for brain plasticity, inducing changes in multiple sensory systems. Using magnetoencephalographic (MEG) and behavioral measurements we evaluated the cortical plasticity effects of two months of (a) active listening to (unisensory) versus (b) learning to play (multisensory) tailor-made notched music in nonmusician tinnitus patients. Taking into account the fact that uni- and multisensory trainings induce different patterns of cortical plasticity we hypothesized that these two protocols will have different affects. Results. Only the active listening (unisensory) group showed significant reduction of tinnitus related activity of the middle temporal cortex and an increase in the activity of a tinnitus-coping related posterior parietal area. Conclusions. These findings indicate that active listening to tailor-made notched music induces greater neuroplastic changes in the maladaptively reorganized cortical network of tinnitus patients while additional integration of other sensory modalities during training reduces these neuroplastic effects.