Noam Sagiv

Synaesthesia : The prevalence of atypical cross-modal experiences

Sensory and cognitive mechanisms allow stimuli to be perceived with properties relating to sight, sound, touch, etc, and ensure, for example, that visual properties are perceived as visual experiences, rather than sounds, tastes, smells, etc. Theories of normal development can be informed by cases where this modularity breaks down, in a condition known as synaesthesia. Conventional wisdom has held that this occurs extremely rarely (0.05% of births) and affects women more than men. Here we present the first test of synaesthesia prevalence with sampling that does not rely on self-referral, and which uses objective tests to establish genuineness. We show that (a) the prevalence of synaesthesia is 88 times higher than previously assumed, (b) the most common variant is coloured days, (c) the most studied variant (grapheme - colour synaesthesia)—previously believed most common—is prevalent at 1%, and (d) there is no strong asymmetry in the distribution of synaesthesia across the sexes. Hence, we suggest that female biases reported earlier likely arose from (or were exaggerated by) sex differences in self-disclosure.

Structural Encoding of Human and Schematic Faces: Holistic and Part-Based Processes

The range of specificity and the response properties of the extrastriate face area were investigated by comparing the N170 event-related potential (ERP) component elicited by photographs of natural faces, realistically painted portraits, sketches of faces, schematic faces, and by nonface meaningful and meaningless visual stimuli. Results showed that the N170 distinguished between faces and nonface stimuli when the concept of a face was clearly rendered by the visual stimulus, but it did not distinguish among different face types: Even a schematic face made from simple line fragments triggered the N170. However, in a second experiment, inversion seemed to have a different effect on natural faces in which face components were available and on the pure gestalt-based schematic faces: The N170 amplitude was enhanced when natural faces were presented upside down but reduded when schematic faces were inverted. Inversion delayed the N170 peak latency for both natural and schematic faces. Together, these results suggest that early face processing in the human brain is subserved by a multiple-component neural system in which both whole-face configurations and face parts are processed. The relative involvement of the two perceptual processes is probably determined by whether the physiognomic value of the stimuli depends upon holistic configuration, or whether the individual components can be associated with faces even when presented outside the face context.

Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study

To compare neural activity produced by visual events that escape or reach conscious awareness, we used event-related MRI and evoked potentials in a patient who had neglect and extinction after focal right parietal damage, but intact visual fields. This neurological disorder entails a loss of awareness for stimuli in the field contralateral to a brain lesion when stimuli are simultaneously presented on the ipsilateral side, even though early visual areas may be intact, and single contralateral stimuli may still be perceived. Functional MRI and event-related potential study were performed during a task where faces or shapes appeared in the right, left, or both fields. Unilateral stimuli produced normal responses in V1 and extrastriate areas. In bilateral events, left faces that were not perceived still activated right V1 and inferior temporal cortex and evoked nonsignificantly reduced N1 potentials, with preserved face-specific negative potentials at 170 ms. When left faces were perceived, the same stimuli produced greater activity in a distributed network of areas including right V1 and cuneus, bilateral fusiform gyri, and left parietal cortex. Also, effective connectivity between visual, parietal, and frontal areas increased during perception of faces. These results suggest that activity can occur in V1 and ventral temporal cortex without awareness, whereas coupling with dorsal parietal and frontal areas may be critical for such activity to afford conscious perception.

What Aspects of Face Processing Are Impaired in Developmental Prosopagnosia

Developmental prosopagnosia (DP) is a severe impairment in identifying faces that is present from early in life and that occurs despite no apparent brain damage and intact visual and intellectual function. Here, we investigated what aspects of face processing are impaired/spared in developmental prosopagnosia by examining a relatively large group of individuals with DP (n = 8) using an extensive battery of well-established tasks. The tasks included measures of sensitivity to global motion and to global form, detection that a stimulus is a face, determination of its sex, holistic face processing, processing of face identity based on features, contour, and the spacing of features, and judgments of attractiveness. The DP cases showed normal sensitivity to global motion and global form and performed normally on our tests of face detection and holistic processing. On the other tasks, many DP cases were impaired but there was no systematic pattern. At least half showed deficits in processing of facial identity based on either the outer contour or spacing of the internal features, and/or on judgments of attractiveness. Three of the eight were impaired in processing facial identify based on the shape of internal features. The results show that DP is a heterogeneous condition and that impairment in recognizing faces cannot be predicted by poor performance on any one measure of face processing.

What is the Relationship between Synaesthesia and Visuo-Spatial Number Forms?.

This study compares the tendency for numerals to elicit spontaneous perceptions of colour or taste (synaesthesia) with the tendency to visualise numbers as occupying particular visuo-spatial configurations (number forms). The prevalence of number forms was found to be significantly higher in synaesthetes experiencing colour compared both to synaesthetes experiencing taste and to control participants lacking any synaesthetic experience. This suggests that the presence of synaesthetic colour sensations enhances the tendency to explicitly represent numbers in a visuo-spatial format although the two symptoms may nevertheless be logically independent (i.e. it is possible to have number forms without colour, and coloured numbers without forms). Number forms are equally common in men and women, unlike previous reports of synaesthesia that have suggested a strong female bias. Individuals who possess a number form are also likely to possess visuo-spatial forms for other ordinal sequences (e.g. days, months, letters) which suggests that it is the ordinal nature of numbers rather than numerical quantity that gives rise to this particular mode of representation. Finally, we also describe some consequences of number forms for performance in a number comparison task.

Varieties of grapheme-colour synaesthesia : A new theory of phenomenological and behavioural differences

Recent research has suggested that not all grapheme-colour synaesthetes are alike. One suggestion is that they can be divided, phenomenologically, in terms of whether the colours are experienced in external or internal space (projector-associator distinction). Another suggestion is that they can be divided according to whether it is the perceptual or conceptual attributes of a stimulus that is critical (higher-lower distinction). This study compares the behavioural performance of 7 projector and 7 associator synaesthetes. We demonstrate that this distinction does not map on to behavioural traits expected from the higher-lower distinction. We replicate previous research showing that projectors are faster at naming their synaesthetic colours than veridical colours, and that associators show the reverse profile. Synaesthetes who project colours into external space but not on to the surface of the grapheme behave like associators on this task. In a second task, graphemes presented briefly in the periphery are more likely to elicit reports of colour in projectors than associators, but the colours only tend to be accurate when the grapheme itself is also accurately identified. We propose an alternative model of individual differences in grapheme-colour synaesthesia that emphasises the role of different spatial reference frames in synaesthetic perception. In doing so, we attempt to bring the synaesthesia literature closer to current models of non-synaesthetic perception, attention and binding.

Priming visual face-processing mechanisms: Electrophysiological evidence

Accumulated evidence from electrophysiology and neuroimaging suggests that face perception involves extrastriate visual mechanisms specialized in processing physiognomic features and building a perceptual representation that is categorically distinct and can be identified by face-recognition units. In the present experiment, we recorded event-related brain potentials in order to explore possible contextual influences on the activity of this perceptual mechanism. Subjects were first exposed to pairs of small shapes, which did not elicit any face-specific brain activity. The same stimuli, however, elicited face-specific brain activity after subjects saw them embedded in schematic faces, which probably primed the subjects to interpret the shapes as schematic eyes. No face-specific activity was observed when objects rather than faces were used to form the context. We conclude that the activity of face-specific extrastriate perceptual mechanisms can be modulated by contextual constraints that determine the significance of the visual input.

Cross-modal interactions : lessons from synesthesia

Synesthesia is a condition in which stimulation in one modality also gives rise to a perceptual experience in a second modality. In two recent studies we found that the condition is more common than previously reported; up to 5% of the population may experience at least one type of synesthesia. Although the condition has been traditionally viewed as an anomaly (e.g., breakdown in modularity), it seems that at least some of the mechanisms underlying synesthesia do reflect universal crossmodal mechanisms. We review here a number of examples of crossmodal correspondences found in both synesthetes and nonsynesthetes including pitch-lightness and vision-touch interaction, as well as cross-domain spatial-numeric interactions. Additionally, we discuss the common role of spatial attention in binding shape and color surface features (whether ordinary or synesthetic color). Consistently with behavioral and neuroimaging data showing that chromatic-graphemic (colored-letter) synesthesia is a genuine perceptual phenomenon implicating extrastriate cortex, we also present electrophysiological data showing modulation of visual evoked potentials by synesthetic color congruency.

Does binding of synesthetic color to the evoking grapheme require attention

The neural mechanisms involved in binding features such as shape and color are a matter of some debate. Does accurate binding rely on spatial attention functions of the parietal lobe or can it occur without attentional input? One extraordinary phenomenon that may shed light on this question is that of chromatic-graphemic synesthesia, a rare condition in which letter shapes evoke color perceptions. A popular suggestion is that synesthesia results from cross-activation between different functional regions (e.g., between shape and color areas of the ventral pathway). Under such conditions binding may not require parietal involvement and could occur preattentively. We tested this hypothesis in two synesthetes who perceived grayscale letters and digits in color. We found no evidence for preattentive binding using a visual search paradigm in which the target was a synesthetic inducer. In another experiment involving color judgments, we show that the congruency of target color and the synesthetic color of irrelevant digits modulates performance more when the digits are included within the attended region of space. We propose that the mechanisms giving rise to this type of synesthesia appear to follow at least some principles of normal binding, and even synesthetic binding seems to require attention.

When Blue is Larger than Red: Colors Influence Numerical Cognition in Synesthesia

In synesthesia, certain stimuli (inducers) may give rise to perceptual experience in additional modalities not normally associated with them (concurrent). For example, color-grapheme synesthetes automatically perceive achromatic numbers as colored (e.g., 7 is turquoise). Although synesthetes know when a given color matches the one evoked by a certain number, colors do not automatically give rise to any sort of number experience. The behavioral consequences of synesthesia have been documented using Stroop-like paradigms, usually using color judgments. Owing to the unidirectional nature of the synesthetic experience, little has been done to obtain performance measures that could indicate whether bidirectional cross-activation occurs in synesthesia. Here it is shown that colors do implicitly evoke numerical magnitudes in color-grapheme synesthetes, but not in nonsynesthetic participants. It is proposed that bidirectional co-activation of brain areas is responsible for the links between color and magnitude processing in color-grapheme synesthesia and that unidirectional models of synesthesia might have to be revised.