Alan Chauvin

The coarse-to-fine hypothesis revisited: Evidence from neuro-computational modeling

The human perceptual system seems to be driven by a coarse-to-fine integration of visual information. Different results have shown a faster integration of low-spatial frequency compared with high-spatial frequency (HSF) information, starting at early retinal processes. The difference in spatial scale decomposition remains throughout the lateral geniculate nucleus (Hubel & Wiesel, 1977) and V1 (Tootell, Silverman, & De Valois, 1981). During the last decade, a debate has emerged concerning the origin of the coarse-to-fine integration. Is it a constant, perceptually driven integration (Parker et al., 1992 and Parker et al., 1996)? Instead, the flexible use hypothesis suggests that different spatial frequency channels could be enhanced depending on the requirement of the task for high-level cognitive processes like categorization (Oliva and Schyns, 1997 and Schyns and Oliva, 1999). In two connectionist simulations, we have shown that global categorization performance could actually be better performed with HSF information when the amount of information is normalized across the different spatial frequency channels. Those results suggest that high-level requirement alone could not explain the coarse-to-fine bias toward LSF information. A hypothesis is proposed concerning the possible implication of the amount of data provided by different spatial frequency channel that might provide the perceptual bias toward LSF information.

Spatial frequency processing in scene-selective cortical regions

Visual analysis begins with the parallel extraction of different attributes at different spatial frequencies. Low spatial frequencies (LSF) convey coarse information and are characterized by high luminance contrast, while high spatial frequencies (HSF) convey fine details and are characterized by low luminance contrast. In the present fMRI study, we examined how scene-selective regions-the parahippocampal place area (PPA), the retrosplenial cortex (RSC) and the occipital place area (OPA)-responded to spatial frequencies when contrast was either equalized or not equalized across spatial frequencies. Participants performed a categorization task on LSF, HSF and non-filtered scenes belonging to two different categories (indoors and outdoors). We either left contrast across scenes untouched, or equalized it using a root-mean-square contrast normalization. We found that when contrast remained unmodified, LSF and NF scenes elicited greater activation than HSF scenes in the PPA. However, when contrast was equalized across spatial frequencies, the PPA was selective to HFS. This suggests that PPA activity relies on an interaction between spatial frequency and contrast in scenes. In the RSC, LSF and NF elicited greater response than HSF scenes when contrast was not modified, while no effect of spatial frequencies appeared when contrast was equalized across filtered scenes, suggesting that the RSC is sensitive to high-contrast information. Finally, we observed selective activation of the OPA in response to HSF, irrespective of contrast manipulation. These results provide new insights into how scene-selective areas operate during scene processing.

Coarse-to-fine categorization of visual scenes in scene-selective cortex

Neurophysiological, behavioral, and computational data indicate that visual analysis may start with the parallel extraction of different elementary attributes at different spatial frequencies and follows a predominantly coarse-to-fine (CtF) processing sequence (low spatial frequencies [LSF] are extracted first, followed by high spatial frequencies [HSF]). Evidence for CtF processing within scene-selective cortical regions is, however, still lacking. In the present fMRI study, we tested whether such processing occurs in three scene-selective cortical regions: the parahippocampal place area (PPA), the retrosplenial cortex, and the occipital place area. Fourteen participants were subjected to functional scans during which they performed a categorization task of indoor versus outdoor scenes using dynamic scene stimuli. Dynamic scenes were composed of six filtered images of the same scene, from LSF to HSF or from HSF to LSF, allowing us to mimic a CtF or the reverse fine-to-coarse (FtC) sequence. Results showed that only the PPA was more activated for CtF than FtC sequences. Equivalent activations were observed for both sequences in the retrosplenial cortex and occipital place area. This study suggests for the first time that CtF sequence processing constitutes the predominant strategy for scene categorization in the PPA.

Rapid scene categorization: Role of spatial frequency order, accumulation mode and luminance contrast

Visual analysis follows a default, predominantly coarse-to-fine processing sequence. Low spatial frequencies (LSF) are processed more rapidly than high spatial frequencies (HSF), allowing an initial coarse parsing of visual input, prior to analysis of finer information. Our study investigated the influence of spatial frequency processing order, accumulation mode (i.e. how spatial frequency information is received as an input by the visual system, throughout processing), and differences in luminance contrast between spatial frequencies on rapid scene categorization. In Experiment 1, we used sequences composed of six filtered scenes, assembled from LSF to HSF (coarse-to-fine) or from HSF to LSF (fine-to-coarse) to test the effects of spatial frequency order. Spatial frequencies were either successive or additive within sequences to test the effects of spatial frequency accumulation mode. Results showed that participants categorized coarse-to-fine sequences more rapidly than fine-to-coarse sequences, irrespective of spatial frequency accumulation in the sequences. In Experiment 2, we investigated the extent to which differences in luminance contrast rather than in spatial frequency account for the advantage of coarse-to-fine over fine-to-coarse processing. Results showed that both spatial frequencies and luminance contrast account for a predominant coarse-to-fine processing, but that the coarse-to-fine advantage stems mainly from differences in spatial frequencies. Our study cautions against the use of contrast normalization in studies investigating spatial frequency processing. We argue that this type of experimental manipulation can impair the intrinsic properties of a visual stimulus. As the visual system relies on these to enable recognition, bias may be induced in strategies of visual analysis.

Microsaccades are modulated by both attentional demands of a visual discrimination task and background noise

Microsaccades are miniature saccades occurring once or twice per second during visual fixation. While microsaccades and saccades share similarities at the oculomotor level, the functional roles of microsaccades are still debated. In this study, we examined the hypothesis that the microsaccadic activity is affected by the type of noisy background during the execution of a particular discrimination task. Human subjects had to judge the orientation of a tilted stimulus embedded in static or dynamic backgrounds in a forced choice-task paradigm, as adapted from Rucci, Iovin, Poletti, and Santini (2007). Static backgrounds induced more microsaccades than dynamic ones only during the execution of the discrimination task. A directional bias of microsaccades, dictated by the stimulus orientation, was temporally coupled with this period of increased activity. Both microsaccade rates and orientations were comparable across background types after the response time although subjects maintained fixation until the end of the trial. This represents a background-specific modulation of the microsaccadic activity driven by attentional demands. The visual influence of microsaccades on discrimination performances was modeled at the retinal level for both types of backgrounds. A higher simulated microsaccadic activity was necessary for static backgrounds in order to achieve discrimination performance scores comparable to that of dynamic ones. Taken together, our experimental and theoretical findings further support the idea that microsaccades are under attentional control and represent an efficient sampling strategy allowing spatial information acquisition.

Is coarse-to-fine strategy sensitive to normal aging?

Theories on visual perception agree that visual recognition begins with global analysis and ends with detailed analysis. Different results from neurophysiological, computational, and behavioral studies all indicate that the totality of visual information is not immediately conveyed, but that information analysis follows a predominantly coarse-to-fine processing sequence (low spatial frequencies are extracted first, followed by high spatial frequencies). We tested whether such processing continues to occur in normally aging subjects. Young and aged participants performed a categorization task (indoor vs. outdoor scenes), using dynamic natural scene stimuli, in which they resorted to either a coarse-to-fine (CtF) sequence or a reverse fine-to-coarse sequence (FtC). The results show that young participants categorized CtF sequences more quickly than FtC sequences. However, sequence processing interacts with semantic category only for aged participants. The present data support the notion that CtF categorization is effective even in aged participants, but is constrained by the spatial features of the scenes, thus highlighting new perspectives in visual models.

Brain Processing of Emotional Scenes in Aging: Effect of Arousal and Affective Context

Research on emotion showed an increase, with age, in prevalence of positive information relative to negative ones. This effect is called positivity effect. From the cerebral analysis of the Late Positive Potential (LPP), sensitive to attention, our study investigated to which extent the arousal level of negative scenes is differently processed between young and older adults and, to which extent the arousal level of negative scenes, depending on its value, may contextually modulate the cerebral processing of positive (and neutral) scenes and favor the observation of a positivity effect with age. With this aim, two negative scene groups characterized by two distinct arousal levels (high and low) were displayed into two separate experimental blocks in which were included positive and neutral pictures. The two blocks only differed by their negative pictures across participants, as to create two negative global contexts for the processing of the positive and neutral pictures. The results show that the relative processing of different arousal levels of negative stimuli, reflected by LPP, appears similar between the two age groups. However, a lower activity for negative stimuli is observed with the older group for both tested arousal levels. The processing of positive information seems to be preserved with age and is also not contextually impacted by negative stimuli in both younger and older adults. For neutral stimuli, a significantly reduced activity is observed for older adults in the contextual block of low-arousal negative stimuli. Globally, our study reveals that the positivity effect is mainly due to a modulation, with age, in processing of negative stimuli, regardless of their arousal level. It also suggests that processing of neutral stimuli may be modulated with age, depending on negative context in which they are presented to. These age-related effects could contribute to justify the differences in emotional preference with age.

What saccadic eye movements tell us about TMS-induced neuromodulation of the DLPFC and mood changes: a pilot study in bipolar disorders.

The study assumed that the antisaccade (AS) task is a relevant psychophysical tool to assess (i) short-term neuromodulation of the dorsolateral prefrontal cortex (DLPFC) induced by intermittent theta burst stimulation (iTBS); and (ii) mood change occurring during the course of the treatment. Saccadic inhibition is known to strongly involve the DLPFC, whose neuromodulation with iTBS requires less stimulation time and lower stimulation intensity, as well as results in longer aftereffects than the conventional repetitive transcranial magnetic stimulation (rTMS). Active or sham iTBS was applied every day for 3 weeks over the left DLPFC of 12 drug-resistant bipolar depressed patients. To assess the iTBS-induced short-term neuromodulation, the saccadic task was performed just before (S1) and just after (S2) the iTBS session, the first day of each week. Mood was evaluated through Montgomery and Asberg Depression Rating Scale (MADRS) scores and the difference in scores between the beginning and the end of treatment was correlated with AS performance change between these two periods. As expected, only patients from the active group improved their performance from S1 to S2 and mood improvement was significantly correlated with AS performance improvement. In addition, the AS task also discriminated depressive bipolar patients from healthy control subjects. Therefore, the AS task could be a relevant and useful tool for clinicians to assess if the Transcranial magnetic stimulation (TMS)-induced short-term neuromodulation of the DLPFC occurs as well as a “trait vs. state” objective marker of depressive mood disorder.

Antisaccades as a follow-up tool in major depressive disorder therapies: A pilot study

Eight patients with major depression, included in a double-blind study, performed an antisaccade task. Results suggested a link between antisaccade performances and clinical scale scores in patients who respond to therapy. Moreover, error rates may well predict response from day of inclusion, thus serving as a state-marker for mood disorders.

Improving Generalisation Skills in a Neural Network on the Basis of Neurophysiological Data.

The distribution of striate cortex cells exhibits a maximum number of cells tuned to vertical and horizontal orientations (Mansfield, 1974). This was interpreted as an adaptation of the visual system to the presence in the visual environment of greater amounts of vertical and horizontal information compared to information from other orientations (Keil & Cristobal, 2000). The present research confirms that vertical and horizontal orientations are, indeed, present in greater number in natural scenes. After normalization of the amount of information across all orientations, vertical information appeared to be better for bottom-up categorization. We demonstrate this using a connectionist autoassociator model of categorization used elsewhere in simulations of early infant categorization.