Nick E. Barraclough

Integration of Visual and Auditory Information by Superior Temporal Sulcus Neurons Responsive to the Sight of Actions

Processing of complex visual stimuli comprising facial movements, hand actions, and body movements is known to occur in the superior temporal sulcus (STS) of humans and nonhuman primates. The STS is also thought to play a role in the integration of multimodal sensory input. We investigated whether STS neurons coding the sight of actions also integrated the sound of those actions. For 23% of neurons responsive to the sight of an action, the sound of that action significantly modulated the visual response. The sound of the action increased or decreased the visually evoked response for an equal number of neurons. In the neurons whose visual response was increased by the addition of sound (but not those neurons whose responses were decreased), the audiovisual integration was dependent upon the sound of the action matching the sight of the action. These results suggest that neurons in the STS form multisensory representations of observed actions.

Feedback from V1 and inhibition from beyond the classical receptive field modulates the responses of neurons in the primate lateral geniculate nucleus

It is well established that the responses of neurons in the lateral geniculate nucleus (LGN) can be modulated by feedback from visual cortex, but it is still unclear how cortico-geniculate afferents regulate the flow of visual information to the cortex in the primate. Here we report the effects, on the gain of LGN neurons, of differentially stimulating the extraclassical receptive field, with feedback from the striate cortex intact or inactivated in the marmoset monkey, Callithrix jacchus. A horizontally oriented grating of optimal size, spatial frequency, and temporal frequency was presented to the classical receptive field. The grating varied in contrast (range: 0-1) from trial to trial, and was presented alone, or surrounded by a grating of the same or orthogonal orientation, contained within either a larger annular field, or flanks oriented either horizontally or vertically. V1 was ablated to inactivate cortico-geniculate feedback. The maximum firing rate of LGN neurons was greater with V1 intact, but was reduced by visually stimulating beyond the classical receptive field. Large horizontal or vertical annular gratings were most effective in reducing the maximum firing rate of LGN neurons. Magnocellular neurons were most susceptible to this inhibition from beyond the classical receptive field. Extraclassical inhibition was less effective with V1 ablated. We conclude that inhibition from beyond the classical receptive field reduces the excitatory influence of V1 in the LGN. The net balance between cortico-geniculate excitation and inhibition from beyond the classical receptive field is one mechanism by which signals relayed from the retina to V1 are controlled.

The sensitivity of primate STS neurons to walking sequences and to the degree of articulation in static images

We readily use the form of human figures to determine if they are moving. Human figures that have arms and legs outstretched (articulated) appear to be moving more than figures where the arms and legs are near the body (standing). We tested whether neurons in the macaque monkey superior temporal sulcus (STS), a region known to be involved in processing social stimuli, were sensitive to the degree of articulation of a static human figure. Additionally, we tested sensitivity to the same stimuli within forward and backward walking sequences. We found that 57% of cells that responded to the static image of a human figure was also sensitive to the degree of articulation of the figure. Some cells displayed selective responses for articulated postures, while others (in equal numbers) displayed selective responses for standing postures. Cells selective for static images of articulated figures were more likely to respond to movies of walking forwards than walking backwards. Cells selective for static images of standing figures were more likely to respond to movies of walking backwards than forwards. An association between form sensitivity and walking sensitivity could be consistent with an interpretation that cell responses to articulated figures act as an implied motion signal.

Seeing the future: Natural image sequences produce "anticipatory" neuronal activity and bias perceptual report.

This paper relates human perception to the functioning of cells in the temporal cortex that are engaged in high-level pattern processing. We review historical developments concerning (a) the functional organization of cells processing faces and (b) the selectivity for faces in cell responses. We then focus on (c) the comparison of perception and cell responses to images of faces presented in sequences of unrelated images. Specifically the paper concerns the cell function and perception in circumstances where meaningful patterns occur momentarily in the context of a naturally or unnaturally changing visual environment. Experience of visual sequences allows anticipation, yet one sensory stimulus also “masks” perception and neural processing of subsequent stimuli. To understand this paradox we compared cell responses in monkey temporal cortex to body images presented individually, in pairs and in action sequences. Responses to one image suppressed responses to similar images for ∼500 ms. This suppression led to responses peaking 100 ms earlier to image sequences than to isolated images (e.g., during head rotation, face-selective activity peaks before the face confronts the observer). Thus forward masking has unrecognized benefits for perception because it can transform neuronal activity to make it predictive during natural change.

Modelling childhood causes of paranormal belief and experience: Childhood trauma and childhood fantasy

Abstract Using covariance structure modelling we sought to test the childhood factors model of paranormal belief development outlined by Irwin ( Journal of American Society for Psychical Research, 86 , 199–208; 87 , 1–39). Eighty-two students at the University of Edinburgh were administered three questionnaires relating to childhood trauma, childhood fantasy, and paranormal belief and experience. Eighty suitable questionnaires were completed and analysed using EQS (Bentler, EQS Structural Relations Program Manual , 1989). The first test of Irwins model showed that the model did not provide an adequate fit to our sample data. In particular, EQS suggested dropping a direct causal link from fantasy to belief and adding a direct link from trauma and paranormal experience. Both modifications were intuitively plausible and were implemented in a post hoc modified model. This new model gave an excellent fit to the data. In addition, our study replicated Irwins ( Journal of the American Society for Psychical Research, 86 , 199–208, 1992) finding of a small but significant correlation between childhood trauma and paranormal belief, and extends previous findings showing a small correlation between childhood fantasy and paranormal belief (and experience) to the realm of childhood fantasy, thus addressing the childhood factors model proper. In conclusion, we offer up our new model for future attempts at replication, and strongly advocate the switch to a model building approach to better understand paranormal belief and experience.

Visual adaptation to goal-directed hand actions

Prolonged exposure to visual stimuli, or adaptation, often results in an adaptation “aftereffect” which can profoundly distort our perception of subsequent visual stimuli. This technique has been commonly used to investigate mechanisms underlying our perception of simple visual stimuli, and more recently, of static faces. We tested whether humans would adapt to movies of hands grasping and placing different weight objects. After adapting to hands grasping light or heavy objects, subsequently perceived objects appeared relatively heavier, or lighter, respectively. The aftereffects increased logarithmically with adaptation action repetition and decayed logarithmically with time. Adaptation aftereffects also indicated that perception of actions relies predominantly on view-dependent mechanisms. Adapting to one action significantly influenced the perception of the opposite action. These aftereffects can only be explained by adaptation of mechanisms that take into account the presence/absence of the object in the hand. We tested if evidence on action processing mechanisms obtained using visual adaptation techniques confirms underlying neural processing. We recorded monkey superior temporal sulcus (STS) single-cell responses to hand actions. Cells sensitive to grasping or placing typically responded well to the opposite action; cells also responded during different phases of the actions. Cell responses were sensitive to the view of the action and were dependent upon the presence of the object in the scene. We show here that action processing mechanisms established using visual adaptation parallel the neural mechanisms revealed during recording from monkey STS. Visual adaptation techniques can thus be usefully employed to investigate brain mechanisms underlying action perception.

From single cells to social perception

Research describing the cellular coding of faces in non-human primates often provides the underlying physiological framework for our understanding of face processing in humans. Models of face perception, explanations of perceptual after-effects from viewing particular types of faces, and interpretation of human neuroimaging data rely on monkey neurophysiological data and the assumption that neurophysiological responses of humans are comparable to those recorded in the non-human primate. Here, we review studies that describe cells that preferentially respond to faces, and assess the link between the physiological characteristics of single cells and social perception. Principally, we describe cells recorded from the non-human primate, although a limited number of cells have been recorded in humans, and are included in order to appraise the validity of non-human physiological data for our understanding of human face and social perception.

Visual Aftereffects for Walking Actions Reveal Underlying Neural Mechanisms for Action Recognition

The results of this study illustrate a new high-level visual aftereffect: Observing actors walking forward, without horizontal translation, makes subsequent actors appear to walk backward, and the opposite effect is obtained after observing backward walking. We used this aftereffect, which cannot be explained by simple low-level adaptation to motion direction, to investigate the properties of neural mechanisms underlying recognition of walking actions. Our results suggest that the perception of walking and the perception of static images of actors in walking postures rely on common brain mechanisms that are primarily object centered, rather than viewer centered, and that are blind to the identity of the actor. These results, obtained with human psychophysical adaptation techniques, support previous evidence accumulated using single-unit recording in nonhuman primates. In addition, these results provide evidence that current models of human action recognition require an object-centered processing stage.

Adaptation to facial trustworthiness is different in female and male observers

Highlights • Female and male participants adapted to trustworthy and untrustworthy faces.• Adaptation made test faces look less like the adapting face in females.• Male participants did not adapt to trustworthy and untrustworthy faces.• Perception of trustworthiness is different in females and males.

Implied motion activation in cortical area mt can be explained by visual low-level features

To investigate form-related activity in motion-sensitive cortical areas, we recorded cell responses to animate implied motion in macaque middle temporal (MT) and medial superior temporal (MST) cortex and investigated these areas using fMRI in humans. In the single-cell studies, we compared responses with static images of human or monkey figures walking or running left or right with responses to the same human and monkey figures standing or sitting still. We also investigated whether the view of the animate figure (facing left or right) that elicited the highest response was correlated with the preferred direction for moving random dot patterns. First, figures were presented inside the cells receptive field. Subsequently, figures were presented at the fovea while a dynamic noise pattern was presented at the cells receptive field location. The results show that MT neurons did not discriminate between figures on the basis of the implied motion content. Instead, response preferences for implied motion correlated with preferences for low-level visual features such as orientation and size. No correlation was found between the preferred view of figures implying motion and the preferred direction for moving random dot patterns. Similar findings were obtained in a smaller population of MST cortical neurons. Testing human MT+ responses with fMRI further corroborated the notion that low-level stimulus features might explain implied motion activation in human MT+. Together, these results suggest that prior human imaging studies demonstrating animate implied motion processing in area MT+ can be best explained by sensitivity for low-level features rather than sensitivity for the motion implied by animate figures.