Ryan T. Maloney

Things are looking up: differential decline in face recognition following pitch and yaw rotation.

Previous research into the effects of viewpoint change on face recognition has typically dealt with rotations around the heads vertical axis (yaw). Another common, although less studied, source of viewpoint variation in faces is rotation around the heads horizontal pitch axis (pitch). In the current study we used both a sequential matching task and an old/new recognition task to examine the effect of viewpoint change following rotation about both pitch and yaw axes on human face recognition. The results of both tasks showed that recognition performance was better for faces rotated about yaw compared to pitch. Further, recognition performance for faces rotated upwards on the pitch axis was better than for faces rotated downwards. Thus, equivalent angular rotations about pitch and yaw do not produce equivalent viewpoint-dependent declines in recognition performance.

Human cortical and behavioral sensitivity to patterns of complex motion at eccentricity.

Complex patterns of image motion (contracting, expanding, rotating, and spiraling fields) are important in the coordination of visually guided behaviors. Whereas specialized detectors in monkey visual cortex show selectivity for particular patterns of complex motion, their representation in human visual cortex remains unclear. In the present study, functional magnetic resonance imaging (fMRI) was used to investigate the sensitivity of functionally defined regions of human visual cortex to parametrically modulated complex motion trajectories, coupled with complementary psychophysical testing. A unique stimulus design made it possible to disambiguate the neural responses and psychophysical sensitivity to complex motions per se from the distribution of local motions relative to the fovea, which are known to enhance cortical activity when presented radial to fixation. This involved presenting several small, separate motion fields in the periphery in a manner that distinguished them from global optic flow patterns. The patterns were morphed through complex motion space in a systematic time-locked fashion when presented in the scanner. Anisotropies were observed in the fMRI signal, marked by an enhanced response to expanding vs. contracting fields, even in early visual cortex. Anisotropies in the psychophysical sensitivity measures followed a similar pattern that was correlated with activity in areas hV4, V5/MT, and MST. This represents the first systematic examination of complex motion perception at both a behavioral and neural level in human observers. The characteristic processing anisotropy revealed in both data sets can inform models of complex motion processing, particularly with respect to computations performed in early visual cortex.

The basis of orientation decoding in human primary visual cortex: fine- or coarse-scale biases?

Orientation signals in human primary visual cortex (V1) can be reliably decoded from the multivariate pattern of activity as measured with functional magnetic resonance imaging (fMRI). The precise underlying source of these decoded signals (whether by orientation biases at a fine or coarse scale in cortex) remains a matter of some controversy, however. Freeman and colleagues (J Neurosci 33: 19695-19703, 2013) recently showed that the accuracy of decoding of spiral patterns in V1 can be predicted by a voxels preferred spatial position (the population receptive field) and its coarse orientation preference, suggesting that coarse-scale biases are sufficient for orientation decoding. Whether they are also necessary for decoding remains an open question, and one with implications for the broader interpretation of multivariate decoding results in fMRI studies.

Motion-defined surface segregation in human visual cortex

Surface segregation provides an efficient way to parse the visual scene for perceptual analysis. Here, we investigated the segregation of a bivectorial motion display into transparent surfaces through a psychophysical task and fMRI. We found that perceptual transparency correlated with neural activity in the early areas of the visual cortex, suggesting these areas may be involved in the segregation of motion-defined surfaces. Two oppositely rotating, uniquely colored random dot kinematograms (RDKs) were presented either sequentially or in a spatially interleaved manner, displayed at varying alternation frequencies. Participants reported the color and rotation direction pairing of the RDKs in the psychophysical task. The spatially interleaved display generated the percept of motion transparency across the range of frequencies tested, yielding ceiling task performance. At high alternation frequencies, performance on the sequential display also approached ceiling, indicative of perceived transparency. However, transparency broke down in lower alternation frequency sequential displays, producing performance close to chance. A corresponding pattern mirroring the psychophysical data was also evident in univariate and multivariate analyses of the fMRI BOLD activity in visual cortical areas V1, V2, V3, V3AB, hV4, and V5/MT+. Using gray RDKs, we found significant presentation by frequency interactions in most areas; differences in BOLD signal between presentation types were significant only at the lower alternation frequency. Multivariate pattern classification was similarly unable to discriminate between presentation types at the higher frequency. This study provides evidence that early visual cortex may code for motion-defined surface segregation, which in turn may enable perceptual transparency.

Transparent surface segregation enables visual feature binding in rapidly alternating displays

Visual feature binding-the mechanism by which our typically coherent and unified perceptual experience arises from distributed neural representations-is the source of much intrigue in the neuroscience of perception. Surprisingly, feature binding can occur in rapidly alternating displays of color-orientation combinations (e.g., rightward-orange, leftward-blue). However, we found that when the angular separation between orientations is reduced, binding is selectively impaired at temporal alternation frequencies around 5 Hz. To isolate the mechanisms involved, we devised a novel display in which color-orientation conjunction information was distributed temporally over two checkered stimuli and was perceptually discriminable only within an intermediate range of temporal frequencies (7.5-15 Hz). We propose that accurate color-orientation judgments at frequencies exceeding 5 Hz depend on the rapid formation of persistent surface representations that can be accessed by binding mechanisms, circumventing the latters relatively low temporal resolution.

Determinants of the direction illusion: Motion speed and dichoptic presentation interact to reveal systematic individual differences in sign

When two fields of dots with different directions of movement are presented in tandem, the perceived direction of one is biased by the presence of the other. Although this ‘‘direction illusion’’ typically involves repulsion, with an exaggeration of the perceived angular difference in direction between the dot fields, attraction effects, where the perceived difference is reduced, have also been found under certain presentation conditions. Earlier literature has been inconsistent, and there is debate surrounding the nature of the interactions that facilitate the direction illusion, as well as whether they occur at a local or global stage of the motion processing hierarchy. Here we measured the operating characteristics of the direction illusion by parametrically varying inducer contrast and coherence while examining the effects of stimulus speed and dichoptic presentation. It was found that the magnitude and sign of the direction illusion differed substantially from earlier research. Furthermore, there appeared to be significant interindividual variability, with dichoptic presentation producing an attractive rather than repulsive direction illusion in some participants.

Probing the Characteristics of Colour–Motion Binding and Its Dependence on Persistent Surface Segregation

Identifying the spatial and temporal characteristics of visual feature binding is a remaining challenge in the science of perception. Within the feature-binding literature, disparate findings have suggested the existence of more than one feature-binding mechanism with differing temporal resolutions. For example, one surprising result is that temporal alternations between two different feature pairings of colour and motion (e.g., orange dots moving left with blue dots moving right) support accurate conjunction discrimination at alternation frequencies of around 10 Hz and greater. However, at lower alternation frequencies around 5 Hz, conjunction discrimination falls to chance. To further investigate this effect, we present two experiments that probe the stimulus characteristics that facilitate or impede feature binding. Using novel manipulations of random dot kinematograms, we identify that facilitating surface representations through temporal integration can enable accurate conjunction discrimination at both intermediate and high alternation frequencies. We also offer a neurally plausible evidence accumulator model to describe these results, removing the need to suggest multiple binding mechanisms acting at different timescales. In effect, we propose a single, flexible binding process, whereby the relatively low temporal resolution for binding features can be circumvented by extracting them from rapidly formed and persistent surface representations.

Directional Limits on Motion Transparency Assessed Through Colour-Motion Binding:

Motion-defined transparency is the perception of two or more distinct moving surfaces at the same retinal location. We explored the limits of motion transparency using superimposed surfaces of randomly positioned dots defined by differences in motion direction and colour. In one experiment, dots were red or green and we varied the proportion of dots of a single colour that moved in a single direction (‘colour-motion coherence’) and measured the threshold direction difference for discriminating between two directions. When colour-motion coherences were high (e.g., 90% of red dots moving in one direction), a smaller direction difference was required to correctly bind colour with direction than at low coherences. In another experiment, we varied the direction difference between the surfaces and measured the threshold colour-motion coherence required to discriminate between them. Generally, colour-motion coherence thresholds decreased with increasing direction differences, stabilising at direction differences around 45°. Different stimulus durations were compared, and thresholds were higher at the shortest (150 ms) compared with the longest (1,000 ms) duration. These results highlight different yet interrelated aspects of the task and the fundamental limits of the mechanisms involved: the resolution of narrowly separated directions in motion processing and the local sampling of dot colours from each surface.