Vincent A. Billock

Sensorimotor Adaptation to Violations of Temporal Contiguity

Most events are processed by a number of neural pathways. These pathways often differ considerably in processing speed. Thus, coherent perception requires some form of synchronization mechanism. Moreover, this mechanism must be flexible, because neural processing speed changes over the life of an organism. Here we provide behavioral evidence that humans can adapt to a new intersensory temporal relationship (which was artificially produced by delaying visual feedback). The conflict between these results and previous work that failed to find such improvements can be explained by considering the present results as a form of sensorimotor adaptation.

Spatiotemporal characteristics of hemodynamic changes in the human lateral prefrontal cortex during working memory tasks.

The prefrontal cortex (PFC) is widely believed to subserve mental manipulation and monitoring processes ascribed to the central executive (CE) of working memory (WM). We attempted to examine and localize the CE by functional imaging of the frontal cortex during tasks designed to require the CE. Using near-infrared spectroscopy, we studied the spatiotemporal dynamics of oxygenated hemoglobin (oxy-Hb), an indicator of changes in regional cerebral blood flow, in both sides of lateral PFC during WM intensive tasks. In most participants, increases in oxy-Hb were localized within one subdivison during performance of the n-back task, whereas oxy-Hb increased more diffusely during the random number generation (RNG) task. Activation of the ventrolateral PFC (VLPFC) was prominent in the n-back task; both sustained and transient dynamics were observed. Transient dynamics means that oxy-Hb first increases but then decreases to less than 50% of the peak value or below the baseline level before the end of the task. For the RNG task sustained activity was also observed in the dorsolateral PFC (DLPFC), especially in the right hemisphere. However, details of patterns of activation varied across participants: subdivisions commonly activated during performance of the two tasks were the bilateral VLPFCs, either side of the VLPFC, and either side of the DLPFC in 4, 2, and 4 of the 12 participants, respectively. The remaining 2 of the 12 participants had no regions commonly activated by these tasks. These results suggest that although the PFC is implicated in the CE, there is no stereotyped anatomical PFC substrate for the CE.

Perception of forbidden colors in retinally stabilized equiluminant images: an indication of softwired cortical color opponency?

In color theory and perceptual practice, two color naming combinations are forbidden-reddish greens and bluish yellows-however, when multicolored images are stabilized on the retina, their borders fade and filling-in mechanisms can create forbidden colors. The sole report of such events found that only some observers saw forbidden colors, while others saw illusory multicolored patterns. We found that when colors were equiluminant, subjects saw reddish greens, bluish yellows, or a multistable spatial color exchange (an entirely novel perceptual phenomena); when the colors were nonequiluminant, subjects saw spurious pattern formation. To make sense of color opponency violations, we created a soft-wired model of cortical color opponency (based on winner-take-all competition) whose opponency can be disabled.

Inertia and memory in ambiguous visual perception

Perceptual multistability during ambiguous visual perception is an important clue to neural dynamics. We examined perceptual switching during ambiguous depth perception using a Necker cube stimulus, and also during binocular rivalry. Analysis of perceptual switching time series using variance–sample size analysis, spectral analysis and time series shuffling shows that switching times behave as a 1/f noise and possess very long range correlations. The long memory feature contrasts sharply with the traditional satiation models of multistability, where the memory is not incorporated, as well as with recently published models of multistability and neural processing, where memory is excluded. On the other hand, the long memory feature favors the concept of “dynamic core” or coalition of neurons, where neurons form transient coalitions. Perceptual switching then corresponds to replacement of one coalition of neurons by another. The inertia and memory measures the stability of a coalition: a strong and stable coalition has to be won over by another similarly strong and stable coalition, resulting in long switching times. The complicated transient dynamics of competing coalitions of neurons may be addressable using a combination of functional imaging, measurement of frequency-tagged magnetoencephalography and frequency-tagged encephalography, simultaneous recordings of groups of neurons in many areas of the brain, and concepts from statistical mechanics and nonlinear dynamics theory.

The relationship between simple and double opponent cells

Little is known about the formation of double opponent cells (DOCs) from geniculate afferents. Three LGN cell types have been considered as DOC precursors. No simple wiring scheme based on these cell types is consistent with the available evidence. The color and luminance multiplexed signal of P beta ganglion cells (Type I receptive fields) contains the information necessary to construct DOCs, provided that filtering operations can separate the two signals. Electrophysiological and anatomical evidence is consistent with Type I cells being filtered prior to the formation of DOCs. Cortical Type II and Type III cells can also be created by filtering.

Neural interactions between flicker-induced self-organized visual hallucinations and physical stimuli

Spontaneous pattern formation in cortical activity may have consequences for perception, but little is known about interactions between sensory-driven and self-organized cortical activity. To address this deficit, we explored the relationship between ordinary stimulus-controlled pattern perception and the autonomous hallucinatory geometrical pattern formation that occurs for unstructured visual stimulation (e.g., empty-field flicker). We found that flicker-induced hallucinations are biased by the presentation of adjacent geometrical stimuli; geometrical forms that map to cortical area V1 as orthogonal gratings are perceptually opponent in biasing hallucinations. Rotating fan blades and pulsating circular patterns are the most salient biased hallucinations. Apparent motion and fractal (1/f) noise are also effective in driving hallucinatory pattern formation (the latter is consistent with predictions of spatiotemporal pattern formation driven by stochastic resonance). The behavior of these percepts suggests that self-organized hallucinatory pattern formation in human vision is governed by the same cortical properties of localized processing, lateral inhibition, simultaneous contrast, and nonlinear retinotopic mapping that govern ordinary vision.

What do catastrophic visual binding failures look like

Ordinary vision is considered a binding success: all the pieces and aspects of an image are bound together, despite being processed by many different neurons in several different cortical areas. How this is accomplished is a key problem in visual neuroscience. The study of visual binding might be facilitated if we had ways to induce binding failures. A particularly interesting failure would involve a loss of the physical integrity of the image. Here, we identify conditions that induce such perceptual failures (e.g. the melting together of equiluminant colored images and the fragmentation of retinally stabilized images) and we suggest that these should studied using electrophysiological measures of binding.

Sensory recoding via neural synchronization: integrating hue and luminance into chromatic brightness and saturation.

If neural spike trains carry information in the frequency and timing of the spikes, then neural interactions--such as oscillatory synchronization--that alter spike frequency and timing can alter the encoded information. Using coupled oscillator theory, we show that synchronization-based processing can be used to integrate sensory information, resulting in new second-order sensory percepts signaled by the compromise frequency of the coupled system. If the signals to be coupled are nonlinearly compressed, the coupled system behaves as if it signals the product or ratio of the uncoupled signals, e.g., chromatic brightness can be signaled by the compromise frequency of coupled neurons responding to hue and luminance, and chromatic saturation can be signaled by the coupled frequency of neurons responding to hue and brightness, with a power- (Stevenss) law scaling like that observed psychophysically. These emergent properties of coupled sensory systems are intriguing because multiplicative processing and power-law scaling are fundamental aspects of sensory processing.

A Role for Cortical Crosstalk in the Binding Problem: Stimulus-driven Correlations that Link Color, Form, and Motion

The putative independence of cortical mechanisms for color, form, and motion raises the binding problemhow is neural activity coordinated to create unified and correctly segmented percepts? Binding could be guided by stimulus-driven correlations between mechanisms, but the nature of these correlations is largely unexplored and no one has (intentionally) studied effects on binding if this joint information is compromised. Here, we develop a theoretical framework which: (1) describes crosstalk-generated correlations between cortical mechanisms for color, achromatic form, and motion, which arise from retinogeniculate encoding; (2) shows how these correlations can facilitate synchronization, segmentation, and binding; (3) provides a basis for understanding perceptual oddities and binding failures that occur for equiluminant and stabilized images. These ideas can be tested by measuring both perceptual events and neural activity while achromatic border contrast or stabilized image velocity is manipulated.

Fechner-Benham subjective colors do not induce McCollough after-effects

Fechner-Benham subjective color is widely believed to be governed by local interactions in early (probably retinal) mechanisms. Here we report three lines of phenomenological evidence that suggest otherwise: subjective colors seen in spatially extended stimuli (a) are dependent on global aspects of the stimuli; (b) can become multistable in position; and (c) even after being stabilized do not support the creation of McColloughs colored after-effects--a cortically based phenomenon generally thought to be more central than Fechner-Benham color. These phenomena suggest a central locus that controls perception of subjective color, characterized by pattern dependent interactions among cortical mechanisms that draw their inputs from peripheral units.