Roberto Arrighi

Optimal Encoding of Interval Timing in Expert Percussionists

We measured temporal reproduction in human subjects with various levels of musical expertise: expert drummers, string musicians, and non-musicians. While duration reproduction of the non-percussionists showed a characteristic central tendency or regression to the mean, drummers responded veridically. Furthermore, when the stimuli were auditory tones rather than flashes, all subjects responded veridically. The behavior of all three groups in both modalities is well explained by a Bayesian model that seeks to minimize reproduction errors by incorporating a central tendency prior, a probability density function centered at the mean duration of the sample. We measured separately temporal precision thresholds with a bisection task; thresholds were twice as low in drummers as in the other two groups. These estimates of temporal precision, together with an adaptable Bayesian prior, predict well the reproduction results and the central tendency strategy under all conditions and for all subject groups. These results highlight the efficiency and flexibility of sensorimotor mechanisms estimating temporal duration.

A generalized sense of number

Much evidence has accumulated to suggest that many animals, including young human infants, possess an abstract sense of approximate quantity, a number sense. Most research has concentrated on apparent numerosity of spatial arrays of dots or other objects, but a truly abstract sense of number should be capable of encoding the numerosity of any set of discrete elements, however displayed and in whatever sensory modality. Here, we use the psychophysical technique of adaptation to study the sense of number for serially presented items. We show that numerosity of both auditory and visual sequences is greatly affected by prior adaptation to slow or rapid sequences of events. The adaptation to visual stimuli was spatially selective (in external, not retinal coordinates), pointing to a sensory rather than cognitive process. However, adaptation generalized across modalities, from auditory to visual and vice versa. Adaptation also generalized across formats: adapting to sequential streams of flashes affected the perceived numerosity of spatial arrays. All these results point to a perceptual system that transcends vision and audition to encode an abstract sense of number in space and in time.

Meaningful auditory information enhances perception of visual biological motion

Robust perception requires efficient integration of information from our various senses. Much recent electrophysiology points to neural areas responsive to multisensory stimulation, particularly audiovisual stimulation. However, psychophysical evidence for functional integration of audiovisual motion has been ambiguous. In this study we measure perception of an audiovisual form of biological motion, tap dancing. The results show that the audio tap information interacts with visual motion information, but only when in synchrony, demonstrating a functional combination of audiovisual information in a natural task. The advantage of multimodal combination was better than the optimal maximum likelihood prediction.

Spatiotopic selectivity of adaptation-based compression of event duration.

A. Bruno, I. Ayhan, and A. Johnston (2010) have recently challenged our report of spatiotopic selectivity for adaptation of event time (D. Burr, A. Tozzi, & M. C. Morrone, 2007) and also our claim that retinotopic adaptation of event time depends on perceived speed. To assist the reader judge this issue, we present here a mass of data accumulated in our laboratories over the last few years, all confirming our original conclusions. We also point out that where Bruno et al. made experimental measurements (rather than relying on theoretical reasoning), they too find clearly significant spatiotopically tuned adaptation-based compression of event time but of lower magnitude to ours. We speculate on the reasons for the differences in magnitude.

Blood Oxygen Level-Dependent Activation of the Primary Visual Cortex Predicts Size Adaptation Illusion

In natural scenes, objects rarely occur in isolation but appear within a spatiotemporal context. Here, we show that the perceived size of a stimulus is significantly affected by the context of the scene: brief previous presentation of larger or smaller adapting stimuli at the same region of space changes the perceived size of a test stimulus, with larger adapting stimuli causing the test to appear smaller than veridical and vice versa. In a human fMRI study, we measured the blood oxygen level-dependent activation (BOLD) responses of the primary visual cortex (V1) to the contours of large-diameter stimuli and found that activation closely matched the perceptual rather than the retinal stimulus size: the activated area of V1 increased or decreased, depending on the size of the preceding stimulus. A model based on local inhibitory V1 mechanisms simulated the inward or outward shifts of the stimulus contours and hence the perceptual effects. Our findings suggest that area V1 is actively involved in reshaping our perception to match the short-term statistics of the visual scene.

Vision and Audition Do Not Share Attentional Resources in Sustained Tasks

Our perceptual capacities are limited by attentional resources. One important question is whether these resources are allocated separately to each sense or shared between them. We addressed this issue by asking subjects to perform a double task, either in the same modality or in different modalities (vision and audition). The primary task was a multiple object-tracking task (Pylyshyn and Storm, 1988), in which observers were required to track between 2 and 5 dots for 4 s. Concurrently, they were required to identify either which out of three gratings spaced over the interval differed in contrast or, in the auditory version of the same task, which tone differed in frequency relative to the two reference tones. The results show that while the concurrent visual contrast discrimination reduced tracking ability by about 0.7 d′, the concurrent auditory task had virtually no effect. This confirms previous reports that vision and audition use separate attentional resources, consistent with fMRI findings of attentional effects as early as V1 and A1. The results have clear implications for effective design of instrumentation and forms of audio–visual communication devices.

Motion perception in preterm children: role of prematurity and brain damage

We tested 26 school-aged children born preterm at a gestational age below 34 weeks, 13 with and 13 without periventricular brain damage, with four different visual stimuli assessing perception of pure global motion (optic flow), with some form information (segregated translational motion) and form-defined static stimuli. Results were compared with a group of age-matched healthy term-born controls. Preterm children with brain damage showed significantly lower sensitivities relative to full-term controls in all four tests, whereas those without brain damage were significantly worse than controls only for the pure motion stimuli. Furthermore, when form information was embedded in the stimulus, preterm children with brain lesions scored significantly worse than those without lesions. These results suggest that in preterm children dorsal stream-related functions are impaired irrespective of the presence of brain damage, whereas deficits of the ventral stream are more related to the presence of periventricular brain damage.

Reduced perceptual sensitivity for biological motion in paraplegia patients

Summary Many physiological and psychophysical studies suggest that the perception and execution of movement may be linked [1–4]. Here we ask whether severe impairment of locomotion could impact on the capacity to perceive human locomotion. We measured sensitivity for the perception of point-light walkers — animation sequences of human biological motion portrayed by only the joints — in patients with severe spinal injury. These patients showed a huge (nearly three-fold) reduction of sensitivity for detecting and for discriminating the direction of biological motion compared with healthy controls, and also a smaller (∼40%) reduction in sensitivity to simple translational motion. However, they showed no statistically significant reduction in contrast sensitivity for discriminating the orientation of static gratings. The results point to a strong interaction between perceiving and producing motion, implicating shared algorithms and neural mechanisms.

Neural latencies do not explain the auditory and audio-visual flash-lag effect.

A brief flash presented physically aligned with a moving stimulus is perceived to lag behind, a well studied phenomenon termed the Flash-Lag Effect (FLE). It has been recently shown that the FLE also occurs in audition, as well as cross-modally between vision and audition. The present study has two goals: to investigate the acoustic and cross-modal FLE using a random motion technique; and to investigate whether neural latencies may account for the FLE in general. The random motion technique revealed a strong cross-modal FLE for visual motion stimuli and auditory probes, but not for the other conditions. Visual and auditory latencies for stimulus appearance and for motion were measured with three techniques: integration, temporal alignment and reaction times. All three techniques showed that a brief static acoustic stimulus is perceived more rapidly than a brief static visual stimulus, while a sound source in motion is perceived more slowly than a comparable visual stimulus. While the results of these three techniques agreed closely with each other, they were exactly opposite that required to account for the FLE by neural latencies. We conclude that neural latencies do not, in general, explain the flash-lag effect. Rather, our data suggest that neural integration times are more important.

Psychophysical evidence for the number sense

It is now clear that most animals, including humans, possess an ability to rapidly estimate number. Some have questioned whether this ability arises from dedicated numerosity mechanisms, or is derived indirectly from judgements of density or other attributes. We describe a series of psychophysical experiments, largely using adaptation techniques, which demonstrate clearly the existence of a number sense in humans. The number sense is truly general, extending over space, time and sensory modality, and is closely linked with action. We further show that when multiple cues are present, numerosity emerges as the natural dimension for discrimination. However, when element density increases past a certain level, the elements become too crowded to parse, and the scene is perceived as a texture rather than array of elements. The two different regimes are psychophysically discriminable in that they follow distinct psychophysical laws, and show different dependencies on eccentricity, luminance levels and effects of perceptual grouping. The distinction is important, as the ability to discriminate numerosity, but not texture, correlates with formal maths skills. This article is part of the discussion meeting issue ‘The origins of numerical abilities’.