Hans-Peter Frey

Severe Multisensory Speech Integration Deficits in High-Functioning School-Aged Children with Autism Spectrum Disorder (ASD) and Their Resolution During Early Adolescence

Under noisy listening conditions, visualizing a speakers articulations substantially improves speech intelligibility. This multisensory speech integration ability is crucial to effective communication, and the appropriate development of this capacity greatly impacts a childs ability to successfully navigate educational and social settings. Research shows that multisensory integration abilities continue developing late into childhood. The primary aim here was to track the development of these abilities in children with autism, since multisensory deficits are increasingly recognized as a component of the autism spectrum disorder (ASD) phenotype. The abilities of high-functioning ASD children (n = 84) to integrate seen and heard speech were assessed cross-sectionally, while environmental noise levels were systematically manipulated, comparing them with age-matched neurotypical children (n = 142). Severe integration deficits were uncovered in ASD, which were increasingly pronounced as background noise increased. These deficits were evident in school-aged ASD children (5-12 year olds), but were fully ameliorated in ASD children entering adolescence (13-15 year olds). The severity of multisensory deficits uncovered has important implications for educators and clinicians working in ASD. We consider the observation that the multisensory speech system recovers substantially in adolescence as an indication that it is likely amenable to intervention during earlier childhood, with potentially profound implications for the development of social communication abilities in ASD children.

What's color got to do with it? The influence of color on visual attention in different categories.

Certain locations attract human gaze in natural visual scenes. Are there measurable features, which distinguish these locations from others? While there has been extensive research on luminance-defined features, only few studies have examined the influence of color on overt attention. In this study, we addressed this question by presenting color-calibrated stimuli and analyzing color features that are known to be relevant for the responses of LGN neurons. We recorded eye movements of 15 human subjects freely viewing colored and grayscale images of seven different categories. All images were also analyzed by the saliency map model (L. Itti, C. Koch, & E. Niebur, 1998). We find that human fixation locations differ between colored and grayscale versions of the same image much more than predicted by the saliency map. Examining the influence of various color features on overt attention, we find two extreme categories: while in rainforest images all color features are salient, none is salient in fractals. In all other categories, color features are selectively salient. This shows that the influence of color on overt attention depends on the type of image. Also, it is crucial to analyze neurophysiologically relevant color features for quantifying the influence of color on attention.

Neurophysiological Indices of Atypical Auditory Processing and Multisensory Integration are Associated with Symptom Severity in Autism

Abstract Atypical processing and integration of sensory inputs are hypothesized to play a role in unusual sensory reactions and social-cognitive deficits in autism spectrum disorder (ASD). Reports on the relationship between objective metrics of sensory processing and clinical symptoms, however, are surprisingly sparse. Here we examined the relationship between neurophysiological assays of sensory processing and (1) autism severity and (2) sensory sensitivities, in individuals with ASD aged 6–17. Multiple linear regression indicated significant associations between neural markers of auditory processing and multisensory integration, and autism severity. No such relationships were apparent for clinical measures of visual/auditory sensitivities. These data support that aberrant early sensory processing contributes to autism symptoms, and reveal the potential of electrophysiology to objectively subtype autism.

The role of first- and second-order stimulus features for human overt attention

When processing complex visual input, human observers sequentially allocate their attention to different subsets of the stimulus. What are the mechanisms and strategies that guide this selection process? We investigated the influence of various stimulus features on human overt attention—that is, attention related to shifts of gaze with natural color images and modified versions thereof. Our experimental modifications, systematic changes of hue across the entire image, influenced only the global appearance of the stimuli, leaving the local features under investigation unaffected. We demonstrated that these modifications consistently reduce the subjective interpretation of a stimulus as “natural” across observers. By analyzing fixations, we found that first-order features, such as luminance contrast, saturation, and color contrast along either of the cardinal axes, correlated to overt attention in the modified images. In contrast, no such correlation was found in unmodified outdoor images. Second-order luminance contrast (“texture contrast”) correlated to overt attention in all conditions. However, although none of the second-order color contrasts were correlated to overt attention in unmodified images, one of the second-order color contrasts did exhibit a significant correlation in the modified images. These findings imply, on the one hand, that higher-order bottom-up effects—namely, those of second-order luminance contrast—may partially account for human overt attention. On the other hand, these results also demonstrate that global image properties, which correlate to the subjective impression of a scene being “natural,” affect the guidance of human overt attention

Oscillatory alpha-band suppression mechanisms during the rapid attentional shifts required to perform an anti-saccade task

Neuroimaging has demonstrated anatomical overlap between covert and overt attention systems, although behavioral and electrophysiological studies have suggested that the two systems do not rely on entirely identical circuits or mechanisms. In a parallel line of research, topographically-specific modulations of alpha-band power (~8-14 Hz) have been consistently correlated with anticipatory states during tasks requiring covert attention shifts. These tasks, however, typically employ cue-target-interval paradigms where attentional processes are examined across relatively protracted periods of time and not at the rapid timescales implicated during overt attention tasks. The anti-saccade task, where one must first covertly attend for a peripheral target, before executing a rapid overt attention shift (i.e. a saccade) to the opposite side of space, is particularly well-suited for examining the rapid dynamics of overt attentional deployments. Here, we asked whether alpha-band oscillatory mechanisms would also be associated with these very rapid overt shifts, potentially representing a common neural mechanism across overt and covert attention systems. High-density electroencephalography in conjunction with infra-red eye-tracking was recorded while participants engaged in both pro- and anti-saccade task blocks. Alpha power, time-locked to saccade onset, showed three distinct phases of significantly lateralized topographic shifts, all occurring within a period of less than 1s, closely reflecting the temporal dynamics of anti-saccade performance. Only two such phases were observed during the pro-saccade task. These data point to substantially more rapid temporal dynamics of alpha-band suppressive mechanisms than previously established, and implicate oscillatory alpha-band activity as a common mechanism across both overt and covert attentional deployments.

Atypical cortical representation of peripheral visual space in children with an autism spectrum disorder

A key feature of early visual cortical regions is that they contain discretely organized retinotopic maps. Titration of these maps must occur through experience, and the fidelity of their spatial tuning will depend on the consistency and accuracy of the eye movement system. Anomalies in fixation patterns and the ballistics of eye movements are well documented in autism spectrum disorder (ASD), with off‐center fixations a hallmark of the phenotype. We hypothesized that these atypicalities might affect the development of visuo‐spatial maps and specifically that peripheral inputs might receive altered processing in ASD. Using high‐density recordings of visual evoked potentials (VEPs) and a novel system‐identification approach known as VESPA (visual evoked spread spectrum analysis), we assessed sensory responses to centrally and peripherally presented stimuli. Additionally, input luminance was varied to bias responsiveness to the magnocellular system, given previous suggestions of magnocellular‐specific deficits in ASD. Participants were 22 ASD children (7–17 years of age) and 31 age‐ and performance‐IQ‐matched neurotypical controls. Both VEP and VESPA responses to central presentations were indistinguishable between groups. In contrast, peripheral presentations resulted in significantly greater early VEP and VESPA amplitudes in the ASD cohort. We found no evidence that anomalous enhancement was restricted to magnocellular‐biased responses. The extent of peripheral response enhancement was related to the severity of stereotyped behaviors and restricted interests, cardinal symptoms of ASD. The current results point to differential visuo‐spatial cortical mapping in ASD, shedding light on the consequences of peculiarities in gaze and stereotyped visual behaviors often reported by clinicians working with this population.

Early Spatial Attentional Modulation of Inputs to the Fovea

Attending to a specific spatial location modulates responsivity of neurons with receptive fields processing that part of the environment. A major outstanding question is whether attentional modulation operates differently for the foveal (central) representation of the visual field than it does for the periphery. Indeed, recent animal electrophysiological recordings suggest that attention differentially affects spatial integration for central and peripheral receptive fields in primary visual cortex. In human electroencephalographic recordings, spatial attention to peripheral locations robustly modulates activity in early visual regions, but it has been claimed that this mechanism does not operate in foveal vision. Here, however, we show clear early attentional modulation of foveal stimulation with the same timing and cortical sources as seen for peripheral stimuli, demonstrating that attentional gain control operates similarly across the entire field of view. These results imply that covertly attending away from the center of gaze, which is a common paradigm in behavioral and electrophysiological studies of attention, results in a precisely timed push–pull mechanism. While the amplitude of the initial response to stimulation at attended peripheral locations is significantly increased beginning at 80 ms, the amplitude of the response to foveal stimulation begins to be attenuated.

Beyond Correlation: Do Color Features Influence Attention in Rainforest?

Recent research indicates a direct relationship between low-level color features and visual attention under natural conditions. However, the design of these studies allows only correlational observations and no inference about mechanisms. Here we go a step further to examine the nature of the influence of color features on overt attention in an environment in which trichromatic color vision is advantageous. We recorded eye-movements of color-normal and deuteranope human participants freely viewing original and modified rainforest images. Eliminating red–green color information dramatically alters fixation behavior in color-normal participants. Changes in feature correlations and variability over subjects and conditions provide evidence for a causal effect of red–green color-contrast. The effects of blue–yellow contrast are much smaller. However, globally rotating hue in color space in these images reveals a mechanism analyzing color-contrast invariant of a specific axis in color space. Surprisingly, in deuteranope participants we find significantly elevated red–green contrast at fixation points, comparable to color-normal participants. Temporal analysis indicates that this is due to compensatory mechanisms acting on a slower time scale. Taken together, our results suggest that under natural conditions red–green color information contributes to overt attention at a low-level (bottom-up). Nevertheless, the results of the image modifications and deuteranope participants indicate that evaluation of color information is done in a hue-invariant fashion.

Prognostication of long-term outcomes after subarachnoid hemorrhage: The FRESH score.

To create a multidimensional tool to prognosticate long‐term functional, cognitive, and quality of life outcomes after spontaneous subarachnoid hemorrhage (SAH) using data up to 48 hours after admission.

Frontal Networks Associated With Command Following After Hemorrhagic Stroke

Background and Purpose— Level of consciousness is frequently assessed by command-following ability in the clinical setting. However, it is unclear what brain circuits are needed to follow commands. We sought to determine what networks differentiate command following from noncommand following patients after hemorrhagic stroke. Methods— Structural MRI, resting-state functional MRI, and electroencephalography were performed on 25 awake and unresponsive patients with acute intracerebral and subarachnoid hemorrhage. Structural injury was assessed via volumetric T1-weighted MRI analysis. Functional connectivity differences were analyzed against a template of standard resting-state networks. The default mode network (DMN) and the task-positive network were investigated using seed-based functional connectivity. Networks were interrogated by pairwise coherence of electroencephalograph leads in regions of interest defined by functional MRI. Results— Functional imaging of unresponsive patients identified significant differences in 6 of 16 standard resting-state networks. Significant voxels were found in premotor cortex, dorsal anterior cingulate gyrus, and supplementary motor area. Direct interrogation of the DMN and task-positive network revealed loss of connectivity between the DMN and the orbitofrontal cortex and new connections between the task-positive network and DMN. Coherence between electrodes corresponding to right executive network and visual networks was also decreased in unresponsive patients. Conclusions— Resting-state functional MRI and electroencephalography coherence data support a model in which multiple, chiefly frontal networks are required for command following. Loss of DMN anticorrelation with task-positive network may reflect a loss of inhibitory control of the DMN by motor-executive regions. Frontal networks should thus be a target for future investigations into the mechanism of responsiveness in the intensive care unit environment.