Pascal Barone

Heteromodal connections supporting multisensory integration at low levels of cortical processing in the monkey.

While multisensory integration is thought to occur in higher hierarchical cortical areas, recent studies in man and monkey have revealed plurisensory modulations of activity in areas previously thought to be unimodal. To determine the cortical network involved in multisensory interactions, we performed multiple injections of different retrograde tracers in unimodal auditory (core), somatosensory (1/3b) and visual (V2 and MT) cortical areas of the marmoset. We found three types of heteromodal connections linking unimodal sensory areas. Visuo‐somatosensory projections were observed originating from visual areas [probably the ventral and dorsal fundus of the superior temporal area (FSTv and FSTd), and middle temporal crescent (MTc)] toward areas 1/3b. Somatosensory projections to the auditory cortex were present from S2 and the anterior bank of the lateral sulcus. Finally, a visuo‐auditory projection arises from an area anterior to the superior temporal sulcus (STS) toward the auditory core. Injections in different sensory regions allow us to define the frontal convexity and the temporal opercular caudal cortex as putative polysensory areas. A quantitative analysis of the laminar distribution of projecting neurons showed that heteromodal connections could be either feedback or feedforward. Taken together, our results provide the anatomical pathway for multisensory integration at low levels of information processing in the primate and argue against a strict hierarchical model.

The Thalamocortical Projection Systems in Primate: An Anatomical Support for Multisensory and Sensorimotor Interplay

Multisensory and sensorimotor integrations are usually considered to occur in superior colliculus and cerebral cortex, but few studies proposed the thalamus as being involved in these integrative processes. We investigated whether the organization of the thalamocortical (TC) systems for different modalities partly overlap, representing an anatomical support for multisensory and sensorimotor interplay in thalamus. In 2 macaque monkeys, 6 neuroanatomical tracers were injected in the rostral and caudal auditory cortex, posterior parietal cortex (PE/PEa in area 5), and dorsal and ventral premotor cortical areas (PMd, PMv), demonstrating the existence of overlapping territories of thalamic projections to areas of different modalities (sensory and motor). TC projections, distinct from the ones arising from specific unimodal sensory nuclei, were observed from motor thalamus to PE/PEa or auditory cortex and from sensory thalamus to PMd/PMv. The central lateral nucleus and the mediodorsal nucleus project to all injected areas, but the most significant overlap across modalities was found in the medial pulvinar nucleus. The present results demonstrate the presence of thalamic territories integrating different sensory modalities with motor attributes. Based on the divergent/convergent pattern of TC and corticothalamic projections, 4 distinct mechanisms of multisensory and sensorimotor interplay are proposed.

Multisensory anatomical pathways.

In order to interact with the multisensory world that surrounds us, we must integrate various sources of sensory information (vision, hearing, touch...). A fundamental question is thus how the brain integrates the separate elements of an object defined by several sensory components to form a unified percept. The superior colliculus was the main model for studying multisensory integration. At the cortical level, until recently, multisensory integration appeared to be a characteristic attributed to high-level association regions. First, we describe recently observed direct cortico-cortical connections between different sensory cortical areas in the non-human primate and discuss the potential role of these connections. Then, we show that the projections between different sensory and motor cortical areas and the thalamus enabled us to highlight the existence of thalamic nuclei that, by their connections, may represent an alternative pathway for information transfer between different sensory and/or motor cortical areas. The thalamus is in position to allow a faster transfer and even an integration of information across modalities. Finally, we discuss the role of these non-specific connections regarding behavioral evidence in the monkey and recent electrophysiological evidence in the primary cortical sensory areas.

Visuo-auditory interactions in the primary visual cortex of the behaving monkey: Electrophysiological evidence

BackgroundVisual, tactile and auditory information is processed from the periphery to the cortical level through separate channels that target primary sensory cortices, from which it is further distributed to functionally specialized areas. Multisensory integration is classically assigned to higher hierarchical cortical areas, but there is growing electrophysiological evidence in man and monkey of multimodal interactions in areas thought to be unimodal, interactions that can occur at very short latencies. Such fast timing of multisensory interactions rules out the possibility of an origin in the polymodal areas mediated through back projections, but is rather in favor of heteromodal connections such as the direct projections observed in the monkey, from auditory areas (including the primary auditory cortex AI) directly to the primary visual cortex V1. Based on the existence of such AI to V1 projections, we looked for modulation of neuronal visual responses in V1 by an auditory stimulus in the awake behaving monkey.ResultsBehavioral or electrophysiological data were obtained from two behaving monkeys. One monkey was trained to maintain a passive central fixation while a peripheral visual (V) or visuo-auditory (AV) stimulus was presented. From a population of 45 V1 neurons, there was no difference in the mean latencies or strength of visual responses when comparing V and AV conditions. In a second active task, the monkey was required to orient his gaze toward the visual or visuo-auditory stimulus. From a population of 49 cells recorded during this saccadic task, we observed a significant reduction in response latencies in the visuo-auditory condition compared to the visual condition (mean 61.0 vs. 64.5 ms) only when the visual stimulus was at midlevel contrast. No effect was observed at high contrast.ConclusionOur data show that single neurons from a primary sensory cortex such as V1 can integrate sensory information of a different modality, a result that argues against a strict hierarchical model of multisensory integration. Multisensory interaction in V1 is, in our experiment, expressed by a significant reduction in visual response latencies specifically in suboptimal conditions and depending on the task demand. This suggests that neuronal mechanisms of multisensory integration are specific and adapted to the perceptual features of behavior.

McGurk effects in cochlear-implanted deaf subjects.

Cochlear implants are neuroprostheses designed to restore speech perception in case of profound bilateral hearing loss. As speech is fundamentally an audiovisual percept, a deficit in processing auditory information might lead to changes in audiovisual integration of speech comprehension. Using vowel-consonant-vowel stimuli under unimodal, audiovisual congruent and audiovisual incongruent (McGurk) conditions, we tested postlingually deaf cochlear-implanted (CI) users and normally hearing (NH) subjects in order to investigate their audiovisual perceptive strategies. Mode/Place-of-articulation perceptive analysis and information transmission analysis of congruent and incongruent percepts indicated a similar sensory specialization for CI users when compared to NH subjects, with voicing and nasality cues transmitted via audition and place cues principally transmitted via vision. NH as well as CI subjects underwent typical McGurk illusory percepts. However, while normally hearing subjects show a well-balanced bimodal integration of incongruent speech, we demonstrated that cochlear implantees present a bias toward a visual-predominant bimodal integration. Our results are complementary to previous studies showing that CI users maintain a high level of speechreading, even after several years of recovery of auditory speech comprehension. Altogether, our results suggest a cross-modal reorganization of speech comprehension in cochlear-implanted patients that might recruit more strongly than in NH the visual and visuo-auditory brain areas involved in speechreading.

Evolution of crossmodal reorganization of the voice area in cochlear-implanted deaf patients†

Psychophysical and neuroimaging studies in both animal and human subjects have clearly demonstrated that cortical plasticity following sensory deprivation leads to a brain functional reorganization that favors the spared modalities. In postlingually deaf patients, the use of a cochlear implant (CI) allows a recovery of the auditory function, which will probably counteract the cortical crossmodal reorganization induced by hearing loss. To study the dynamics of such reversed crossmodal plasticity, we designed a longitudinal neuroimaging study involving the follow‐up of 10 postlingually deaf adult CI users engaged in a visual speechreading task. While speechreading activates Brocas area in normally hearing subjects (NHS), the activity level elicited in this region in CI patients is abnormally low and increases progressively with post‐implantation time. Furthermore, speechreading in CI patients induces abnormal crossmodal activations in right anterior regions of the superior temporal cortex normally devoted to processing human voice stimuli (temporal voice‐sensitive areas‐TVA). These abnormal activity levels diminish with post‐implantation time and tend towards the levels observed in NHS. First, our study revealed that the neuroplasticity after cochlear implantation involves not only auditory but also visual and audiovisual speech processing networks. Second, our results suggest that during deafness, the functional links between cortical regions specialized in face and voice processing are reallocated to support speech‐related visual processing through cross‐modal reorganization. Such reorganization allows a more efficient audiovisual integration of speech after cochlear implantation. These compensatory sensory strategies are later completed by the progressive restoration of the visuo‐audio‐motor speech processing loop, including Brocas area. Hum Brain Mapp, 2012.

Reorganization of the Connectivity of Cortical Field DZ in Congenitally Deaf Cat

Psychophysics and brain imaging studies in deaf patients have revealed a functional crossmodal reorganization that affects the remaining sensory modalities. Similarly, the congenital deaf cat (CDC) shows supra-normal visual skills that are supported by specific auditory fields (DZ-dorsal zone and P-posterior auditory cortex) but not the primary auditory cortex (A1). To assess the functional reorganization observed in deafness we analyzed the connectivity pattern of the auditory cortex by means of injections of anatomical tracers in DZ and A1 in both congenital deaf and normally hearing cats. A quantitative analysis of the distribution of the projecting neurons revealed the presence of non-auditory inputs to both A1 and DZ of the CDC which were not observed in the hearing cats. Firstly, some visual (areas 19/20) and somatosensory (SIV) areas were projecting toward DZ of the CDC but not in the control. Secondly, A1 of the deaf cat received a weak projection from the visual lateral posterior nuclei (LP). Most of these abnormal projections to A1 and DZ represent only a small fraction of the normal inputs to these areas. In addition, most of the afferents to DZ and A1 appeared normal in terms of areal specificity and strength of projection, with preserved but smeared nucleotopic gradient of A1 in CDCs. In conclusion, while the abnormal projections revealed in the CDC can participate in the crossmodal compensatory mechanisms, the observation of a limited reorganization of the connectivity pattern of the CDC implies that functional reorganization in congenital deafness is further supported also by normal cortico-cortical connectivity.

Postnatal development of alkaline phosphatase activity correlates with the maturation of neurotransmission in the cerebral cortex

We have shown previously that the tissue nonspecific alkaline phosphatase (TNAP) is selectively expressed in the synaptic cleft of sensory cortical areas in adult mammals and, by using sensory deprivation, that TNAP activity depends on thalamocortical activity. We further analyzed this structural functional relationship by comparing the developmental pattern of TNAP activity to the maturation of the thalamocortical afferents in the primate brain (Callithrix jacchus). Cortical expression of alkaline phosphatase (AP) activity reflects the sequential maturation of the modality‐specific sensory areas. Within the visual cortex, the regional and laminar distribution of AP correlates with the differential maturation of the magno‐ and parvocellular streams. AP activity, which is transiently expressed in the white matter, exhibits a complementary distributional pattern with myelin staining. Ultrastructural analysis revealed that AP activity is localized exclusively to the myelin‐free axonal segments, including the node of Ranvier. It was also found that AP activity is gradually expressed in parallel with the maturation of synaptic contacts in the neuropile. These data suggest the involvement of AP, in addition to neurotransmitter synthesis previously suggested in the adult, in synaptic stabilization and in myelin pattern formation and put forward a role of AP in cortical plasticity and brain disorders. J. Comp. Neurol. 486:179–196, 2005.

Visual activity predicts auditory recovery from deafness after adult cochlear implantation

Modern cochlear implantation technologies allow deaf patients to understand auditory speech; however, the implants deliver only a coarse auditory input and patients must use long-term adaptive processes to achieve coherent percepts. In adults with post-lingual deafness, the high progress of speech recovery is observed during the first year after cochlear implantation, but there is a large range of variability in the level of cochlear implant outcomes and the temporal evolution of recovery. It has been proposed that when profoundly deaf subjects receive a cochlear implant, the visual cross-modal reorganization of the brain is deleterious for auditory speech recovery. We tested this hypothesis in post-lingually deaf adults by analysing whether brain activity shortly after implantation correlated with the level of auditory recovery 6 months later. Based on brain activity induced by a speech-processing task, we found strong positive correlations in areas outside the auditory cortex. The highest positive correlations were found in the occipital cortex involved in visual processing, as well as in the posterior-temporal cortex known for audio-visual integration. The other area, which positively correlated with auditory speech recovery, was localized in the left inferior frontal area known for speech processing. Our results demonstrate that the visual modalitys functional level is related to the proficiency level of auditory recovery. Based on the positive correlation of visual activity with auditory speech recovery, we suggest that visual modality may facilitate the perception of the words auditory counterpart in communicative situations. The link demonstrated between visual activity and auditory speech perception indicates that visuoauditory synergy is crucial for cross-modal plasticity and fostering speech-comprehension recovery in adult cochlear-implanted deaf patients.

Does Brain Activity at Rest Reflect Adaptive Strategies? Evidence from Speech Processing after Cochlear Implantation

In functional neuroimaging studies, task-related activity refers to the signal difference between the stimulation and rest conditions. We asked whether long-term changes in the sensory environment may affect brain activity at rest. To answer this question, we compared regional cerebral blood flow between a group of normally hearing controls and a group of cochlear-implanted (CI) deaf patients. Here we present evidence that long-term alteration of auditory experience, such as profound deafness followed by partial auditory recuperation through cochlear implantation, leads to functional cortical reorganizations at rest. Without any visual or auditory stimulation, CI subjects showed changes of cerebral blood flow in the visual, auditory cortex, Broca area, and in the posterior temporal cortex with an increment of activity in these areas from the time of activation of the implant to less than a year after the implantation.