Marcia Grabowecky

The interaction of spatial and object pathways: Evidence from balint's syndrome

An earlier report described a patient (RM) with bilateral parietal damage who showed severe binding problems between shape and color and shape and size (Friedman-Hill, Robertson, & Treisman, 1995). When shown two different-colored letters, RM reported a large number of illusory conjunctions (ICs) combining the shape of one letter with the color of the other, even when he was looking directly at one of them and had as long as 10 sec to respond. The lesions also produced severe deficits in locating and reaching for objects, and difficulty in seeing more than one object at a time, resulting in a neuropsychological diagnosis of Balints syndrome or dorsal simultanagnosia. The pattern of deficits supported predictions of Treismans Feature Integration Theory (FIT) that the loss of spatial information would lead to binding errors. They further suggested that the spatial information used in binding depends on intact parietal function. In the present paper we extend these findings and examine other deficits in RM that would be predicted by FIT. We show that: (1) Object individuation is impaired, making it impossible for him correctly to count more than one or two objects, even when he is aware that more are present. (2) Visual search for a target defined by a conjunction of features (requiring binding) is impaired, while the detection of a target defined by a unique feature is not. Search for the absence of a feature (0 among Qs) is also severely impaired, while search for the presence (Q among 0s) is not. Feature absence can only be detected when all the present features are bound to the nontarget items. (3) RMs deficits cannot be attributed to a general binding problem: binding errors were far more likely with simultaneous presentation where spatial information was required than with sequential presentation where time could be used as the medium for binding. (4) Selection for attention was severely impaired, whether it was based on the position of a marker or on some other feature (color). (5) Spatial information seems to exist that RM cannot access, suggesting that feature binding relies on a relatively late stage where implicit spatial information is made explicitly accessible. The data converge to support our conclusions that explicit spatial knowledge is necessary for the perception of accurately bound features, for accurate attentional selection, and for accurate and rapid search for a conjunction of features in a multiitem display. It is obviously necessary for directing attention to spatial locations, but the consequences of impairments in this ability seem also to affect object selection, object individuation, and feature integration. Thus, the functional effects of parietal damage are not limited to the spatial and attentional problems that have long been described in patients with Balints syndrome. Damage to parietal areas also affects object perception through damage to spatial representations that are fundamental for spatial awareness.

Attention induces synchronization-based response gain in steady-state visual evoked potentials.

When attention is voluntarily directed to a spatial location, visual sensitivity increases at that location. What causes this improved sensitivity? Studies of single neuron spike rates in monkeys have provided mixed results in regard to whether attending to a stimulus increases its effective contrast (contrast gain) or multiplicatively boosts stimulus-driven neural responses (response or activity gain). We monitored frequency-tagged steady-state visual evoked potentials (SSVEPs) in humans and found that voluntary sustained attention multiplicatively increased stimulus-driven population electrophysiological activity. Analyses of intertrial phase coherence showed that this attentional response gain was at least partially due to the increased synchronization of SSVEPs to stimulus flicker. These results suggest that attention operates in a complementary manner at different levels; attention seems to increase single-neuron spike rates in a variety of ways, including contrast, response and activity gains, while also inducing a multiplicative boost on neural population activity via enhanced response synchronization.

Stochastic resonance in binocular rivalry

When a different image is presented to each eye, visual awareness spontaneously alternates between the two images--a phenomenon called binocular rivalry. Because binocular rivalry is characterized by two marginally stable perceptual states and spontaneous, apparently stochastic, switching between them, it has been speculated that switches in perceptual awareness reflect a double-well-potential type computational architecture coupled with noise. To characterize this noise-mediated mechanism, we investigated whether stimulus input, neural adaptation, and inhibitory modulations (thought to underlie perceptual switches) interacted with noise in such a way that the system produced stochastic resonance. By subjecting binocular rivalry to weak periodic contrast modulations spanning a range of frequencies, we demonstrated quantitative evidence of stochastic resonance in binocular rivalry. Our behavioral results combined with computational simulations provided insights into the nature of the internal noise (its magnitude, locus, and calibration) that is relevant to perceptual switching, as well as provided novel dynamic constraints on computational models designed to capture the neural mechanisms underlying perceptual switching.

Haptically Linked Dyads: Are Two Motor-Control Systems Better Than One?

Are Two Motor-Control Systems Better Than One? Kyle Reed, Michael Peshkin, Mitra J. Hartmann, Marcia Grabowecky, James Patton, and Peter M. Vishton Department of Mechanical Engineering, Northwestern University; Department of Biomedical Engineering, Northwestern University; Department of Psychology, Northwestern University; Rehabilitation Institute of Chicago, Chicago, Illinois; and Department of Psychology, College of William and Mary

Evidence for Perceptual "Trapping" and Adaptation in Multistable Binocular Rivalry

When a different pattern is presented to each eye, the perceived image spontaneously alternates between the two patterns (binocular rivalry); the dynamics of these bistable alternations are known to be stochastic. Examining multistable binocular rivalry (involving four dominant percepts), we demonstrated path dependence and on-line adaptation, which were equivalent whether perceived patterns were formed by single-eye dominance or by mixed-eye dominance. The spontaneous perceptual transitions tended to get trapped within a pair of related global patterns (e.g., opponent shapes and symmetric patterns), and during such trapping, the probability of returning to the repeatedly experienced patterns gradually decreased (postselection pattern adaptation). These results suggest that the structure of global shape coding and its adaptation play a critical role in directing spontaneous alternations of visual awareness in perceptual multistability.

Brain waves following remembered faces index conscious recollection

At a glance, one can often determine whether a face belongs to a known individual. To investigate brain mechanisms underlying this memory feat, we recorded EEG signals time-locked to face presentations. In the study phase, 40 unknown faces were presented, 20 of which were accompanied by a voice simulating that person speaking. Instructions were to remember the faces with spoken biographical information (R-faces) and to forget the others (F-faces). In the test phase, famous and non-famous faces were presented in a visually degraded manner. Subjects made two-choice fame judgments and priming was observed in the form of faster and more accurate responses for old than for new non-famous faces. Priming did not differ between R-faces and F-faces. In a second experiment, faces were not degraded at test and behavioral responses were made only when faces were presented twice in immediate succession. Brain potentials elicited 300 to 900 ms after stimulus onset from frontal and parieto-occipital scalp regions were larger for R-faces than for F-faces. Recognition tested later was more accurate for R-faces than for F-faces. Because the study-phase manipulation influenced recognition but not priming, we conclude that this procedure succeeded in isolating neural correlates of recollective processing from more automatic uses of face memory as indexed by priming.

Attention during adaptation weakens negative afterimages

The effect of attention during adaptation on subsequent negative afterimages was examined. One of 2 overlapped outline figures was attended during a 7-10-s adaptation period. When the figures were readily perceptually segregated (on the basis of color or motion), the subsequent afterimages were initially weaker for the previously attended figure. This effect was confirmed by demonstrations that the onset of a single afterimage was delayed when an afterimage inducer was attended during adaptation compared with when a central digit stream or an overlapped (brightness-balanced) figure that did not generate an afterimage was attended. The attention effect was further confirmed using a criterion-independent (dot-integration) paradigm. The fact that selective attention during adaptation weakened or delayed afterimages suggests that attention primarily facilitates the adaptation of polarity-independent processes that modulate the visibility of afterimages rather than facilitating the adaptation of polarity-selective processes that mediate the formation of afterimages.

Auditory-Visual Crossmodal Integration in Perception of Face Gender

Whereas extensive neuroscientific and behavioral evidence has confirmed a role of auditory-visual integration in representing space [1-6], little is known about the role of auditory-visual integration in object perception. Although recent neuroimaging results suggest integrated auditory-visual object representations [7-11], substantiating behavioral evidence has been lacking. We demonstrated auditory-visual integration in the perception of face gender by using pure tones that are processed in low-level auditory brain areas and that lack the spectral components that characterize human vocalization. When androgynous faces were presented together with pure tones in the male fundamental-speaking-frequency range, faces were more likely to be judged as male, whereas when faces were presented with pure tones in the female fundamental-speaking-frequency range, they were more likely to be judged as female. Importantly, when participants were explicitly asked to attribute gender to these pure tones, their judgments were primarily based on relative pitch and were uncorrelated with the male and female fundamental-speaking-frequency ranges. This perceptual dissociation of absolute-frequency-based crossmodal-integration effects from relative-pitch-based explicit perception of the tones provides evidence for a sensory integration of auditory and visual signals in representing human gender. This integration probably develops because of concurrent neural processing of visual and auditory features of gender.

Long-lasting effects of subliminal affective priming from facial expressions

Unconscious processing of stimuli with emotional content can bias affective judgments. Is this subliminal affective priming merely a transient phenomenon manifested in fleeting perceptual changes, or are long-lasting effects also induced? To address this question, we investigated memory for surprise faces 24 h after they had been shown with 30-ms fearful, happy, or neutral faces. Surprise faces subliminally primed by happy faces were initially rated as more positive, and were later remembered better, than those primed by fearful or neutral faces. Participants likely to have processed primes supraliminally did not respond differentially as a function of expression. These results converge with findings showing memory advantages with happy expressions, though here the expressions were displayed on the face of a different person, perceived subliminally, and not present at test. We conclude that behavioral biases induced by masked emotional expressions are not ephemeral, but rather can last at least 24 h.

Long-Term Speeding in Perceptual Switches Mediated by Attention-Dependent Plasticity in Cortical Visual Processing

Binocular rivalry has been extensively studied to understand the mechanisms that control switches in visual awareness and much has been revealed about the contributions of stimulus and cognitive factors. Because visual processes are fundamentally adaptive, however, it is also important to understand how experience alters the dynamics of perceptual switches. When observers viewed binocular rivalry repeatedly over many days, the rate of perceptual switches increased as much as 3-fold. This long-term rivalry speeding exhibited a pattern of image-feature specificity that ruled out primary contributions from strategic and nonsensory factors and implicated neural plasticity occurring in both low- and high-level visual processes in the ventral stream. Furthermore, the speeding occurred only when the rivaling patterns were voluntarily attended, suggesting that the underlying neural plasticity selectively engages when stimuli are behaviorally relevant. Long-term rivalry speeding may thus reflect broader mechanisms that facilitate quick assessments of signals that contain multiple behaviorally relevant interpretations.