Moshe Bar

Visual objects in context.

We see the world in scenes, where visual objects occur in rich surroundings, often embedded in a typical context with other related objects. How does the human brain analyse and use these common associations? This article reviews the knowledge that is available, proposes specific mechanisms for the contextual facilitation of object recognition, and highlights important open questions. Although much has already been revealed about the cognitive and cortical mechanisms that subserve recognition of individual objects, surprisingly little is known about the neural underpinnings of contextual analysis and scene perception. Building on previous findings, we now have the means to address the question of how the brain integrates individual elements to construct the visual experience.

A Cortical Mechanism for Triggering Top-Down Facilitation in Visual Object Recognition

The majority of the research related to visual recognition has so far focused on bottom-up analysis, where the input is processed in a cascade of cortical regions that analyze increasingly complex information. Gradually more studies emphasize the role of top-down facilitation in cortical analysis, but it remains something of a mystery how such processing would be initiated. After all, top-down facilitation implies that high-level information is activated earlier than some relevant lower-level information. Building on previous studies, I propose a specific mechanism for the activation of top-down facilitation during visual object recognition. The gist of this hypothesis is that a partially analyzed version of the input image (i.e., a blurred image) is projected rapidly from early visual areas directly to the prefrontal cortex (PFC). This coarse representation activates in the PFC expectations about the most likely interpretations of the input image, which are then back-projected as an initial guess to the temporal cortex to be integrated with the bottom-up analysis. The top-down process facilitates recognition by substantially limiting the number of object representations that need to be considered. Furthermore, such a rapid mechanism may provide critical information when a quick response is necessary.

Cortical Analysis of Visual Context

Objects in our environment tend to be grouped in typical contexts. How does the human brain analyze such associations between visual objects and their specific context? We addressed this question in four functional neuroimaging experiments and revealed the cortical mechanisms that are uniquely activated when people recognize highly contextual objects (e.g., a traffic light). Our findings indicate that a region in the parahippocampal cortex and a region in the retrosplenial cortex together comprise a system that mediates both spatial and nonspatial contextual processing. Interestingly, each of these regions has been identified in the past with two functions: the processing of spatial information and episodic memory. Attributing contextual analysis to these two areas, instead, provides a framework for bridging between previous reports.

Cortical Mechanisms Specific to Explicit Visual Object Recognition

The cortical mechanisms associated with conscious object recognition were studied using functional magnetic resonance imaging (fMRI). Participants were required to recognize pictures of masked objects that were presented very briefly, randomly and repeatedly. This design yielded a gradual accomplishment of successful recognition. Cortical activity in a ventrotemporal visual region was linearly correlated with perception of object identity. Therefore, although object recognition is rapid, awareness of an objects identity is not a discrete phenomenon but rather associated with gradually increasing cortical activity. Furthermore, the focus of the activity in the temporal cortex shifted anteriorly as subjects reported an increased knowledge regarding identity. The results presented here provide new insights into the processes underlying explicit object recognition, as well as the analysis that takes place immediately before and after recognition is possible.

The proactive brain: memory for predictions

It is proposed that the human brain is proactive in that it continuously generates predictions that anticipate the relevant future. In this proposal, analogies are derived from elementary information that is extracted rapidly from the input, to link that input with the representations that exist in memory. Finding an analogical link results in the generation of focused predictions via associative activation of representations that are relevant to this analogy, in the given context. Predictions in complex circumstances, such as social interactions, combine multiple analogies. Such predictions need not be created afresh in new situations, but rather rely on existing scripts in memory, which are the result of real as well as of previously imagined experiences. This cognitive neuroscience framework provides a new hypothesis with which to consider the purpose of memory, and can help explain a variety of phenomena, ranging from recognition to first impressions, and from the brains ‘default mode’ to a host of mental disorders.

Humans Prefer Curved Visual Objects

People constantly make snap judgments about objects encountered in the environment. Such rapid judgments must be based on the physical properties of the targets, but the nature of these properties is yet unknown. We hypothesized that sharp transitions in contour might convey a sense of threat, and therefore trigger a negative bias. Our results were consistent with this hypothesis. The type of contour a visual object possesses—whether the contour is sharp angled or curved—has a critical influence on peoples attitude toward that object.

See it with feeling: affective predictions during object perception

People see with feeling. We ‘gaze’, ‘behold’, ‘stare’, ‘gape’ and ‘glare’. In this paper, we develop the hypothesis that the brains ability to see in the present incorporates a representation of the affective impact of those visual sensations in the past. This representation makes up part of the brains prediction of what the visual sensations stand for in the present, including how to act on them in the near future. The affective prediction hypothesis implies that responses signalling an objects salience, relevance or value do not occur as a separate step after the object is identified. Instead, affective responses support vision from the very moment that visual stimulation begins.

Magnocellular Projections as the Trigger of Top-Down Facilitation in Recognition

Object recognition is traditionally viewed as a hierarchical, bottom-up neural process. This view has been challenged recently by theoretical models and by findings indicating that top-down processes are involved in facilitating recognition. However, how such high-level information can be activated quickly enough to facilitate the bottom-up processing is yet unknown. We propose that such top-down facilitation is triggered by magnocellular information projected early and rapidly to the orbitofrontal cortex. Using human neuroimaging, we show that stimuli designed to bias processing toward the magnocellular pathway differentially activated the orbitofrontal cortex compared with parvocellular-biased stimuli. Although the magnocellular stimuli had a lower contrast than the parvocellular stimuli, they were recognized faster and just as accurately. Moreover, orbitofrontal activity predicted the performance advantage for the magnocellular, but not for the parvocellular-biased, stimuli, whereas the opposite was true in the fusiform gyrus. Last, analyses of effective connectivity using dynamic causal modeling showed that magnocellular-biased stimuli significantly activated pathways from occipital visual cortex to orbitofrontal cortex and from orbitofrontal cortex to fusiform gyrus. Conversely, parvocellular-biased stimuli significantly activated a pathway from the occipital visual cortex to fusiform gyrus. Our findings support the proposal that fast magnocellular projections linking early visual and inferotemporal object recognition regions with the orbitofrontal cortex facilitate object recognition by enabling the generation of early predictions.

Top-Down Predictions in the Cognitive Brain.

The human brain is not a passive organ simply waiting to be activated by external stimuli. Instead, we propose that the brain continuously employs memory of past experiences to interpret sensory information and predict the immediately relevant future. The basic elements of this proposal include analogical mapping, associative representations and the generation of predictions. This review concentrates on visual recognition as the model system for developing and testing ideas about the role and mechanisms of top-down predictions in the brain. We cover relevant behavioral, computational and neural aspects, explore links to emotion and action preparation, and consider clinical implications for schizophrenia and dyslexia. We then discuss the extension of the general principles of this proposal to other cognitive domains.

The role of the parahippocampal cortex in cognition

The parahippocampal cortex (PHC) has been associated with many cognitive processes, including visuospatial processing and episodic memory. To characterize the role of PHC in cognition, a framework is required that unifies these disparate processes. An overarching account was proposed whereby the PHC is part of a network of brain regions that processes contextual associations. Contextual associations are the principal element underlying many higher-level cognitive processes, and thus are suitable for unifying the PHC literature. Recent findings are reviewed that provide support for the contextual associations account of PHC function. In addition to reconciling a vast breadth of literature, the synthesis presented expands the implications of the proposed account and gives rise to new and general questions about context and cognition.