Irmgard de la Vega

Emotional Valence and Physical Space : limits of Interaction

According to the body-specificity hypothesis, people associate positive things with the side of space that corresponds to their dominant hand and negative things with the side corresponding to their nondominant hand. Our aim was to find out whether this association holds also true for a response time study using linguistic stimuli, and whether such an association is activated automatically. Four experiments explored this association using positive and negative words. In Exp. 1, right-handers made a lexical judgment by pressing a left or right key. Attention was not explicitly drawn to the valence of the stimuli. No valence-by-side interaction emerged. In Exp. 2 and 3, right-handers and left-handers made a valence judgment by pressing a left or a right key. A valence-by-side interaction emerged: For positive words, responses were faster when participants responded with their dominant hand, whereas for negative words, responses were faster for the nondominant hand. Exp. 4 required a valence judgment without stating an explicit mapping of valence and side. No valence-by-side interaction emerged. The experiments provide evidence for an association between response side and valence, which, however, does not seem to be activated automatically but rather requires a task with an explicit response mapping to occur.

With the past behind and the future ahead: Back-to-front representation of past and future sentences

Several studies support the psychological reality of a mental timeline that runs from the left to the right and may strongly affect our thinking about time. Ulrich and Maienborn (Cognition 117:126–138, 2010) examined the linguistic relevance of this timeline during the processing of past- and future-related sentences. Their results indicate that the timeline is not activated automatically during sentence comprehension. While no explicit reference of temporal expressions to the left–right axis has been attested (e.g., *the meeting was moved to the left), natural languages refer to the back–front axis in order to encode temporal information (e.g., the meeting was moved forward). Therefore, the present study examines whether a back–frontal timeline becomes automatically activated during the processing of past- and future-related sentences. The results demonstrate a clear effect on reaction time that emerges from a time–space association along the frontal timeline (Experiment 1). However, this activation seems to be nonautomatic (Experiment 2), rendering it unlikely that this frontal timeline is involved in comprehension of the temporal content of sentences.

Root versus roof: automatic activation of location information during word processing

In four experiments, participants were presented with nouns referring to entities that are associated with an up or down location (e.g., roof, root). The required response either was compatible with the referent location or was not (e.g., upward vs. downward movement after reading roof). Across experiments, we manipulated whether the experimental task required word reading or not, as well as whether the response involved a movement or was stationary. In all experiments, participants’ responses were significantly faster in the compatible than in the incompatible condition. This strongly suggests that location information is automatically activated when nouns are being processed.

Keep your hands crossed: the valence-by-left/right interaction is related to hand, not side, in an incongruent hand-response key assignment.

The body-specificity hypothesis (Casasanto, 2009) associates positive emotional valence and the space surrounding the dominant hand, and negative valence and the space surrounding the non-dominant hand. This effect has not only been found for manual responses, but also for the left and right side. In the present study, we investigated whether this compatibility effect still shows when hand and side carry incongruent information, and whether it is then related to hand or to side. We conducted two experiments which used an incongruent hand-response key assignment, that is, participants had their hands crossed. Participants were instructed to respond with their right vs. left hand (Experiment 1) or with the right vs. left key (Experiment 2). In both experiments, a compatibility effect related to hand emerged, indicating that the association between hand and valence overrides the one between side and valence when hand and side carry contradicting information.

Reading “Sun” and Looking Up: The Influence of Language on Saccadic Eye Movements in the Vertical Dimension

Traditionally, language processing has been attributed to a separate system in the brain, which supposedly works in an abstract propositional manner. However, there is increasing evidence suggesting that language processing is strongly interrelated with sensorimotor processing. Evidence for such an interrelation is typically drawn from interactions between language and perception or action. In the current study, the effect of words that refer to entities in the world with a typical location (e.g., sun, worm) on the planning of saccadic eye movements was investigated. Participants had to perform a lexical decision task on visually presented words and non-words. They responded by moving their eyes to a target in an upper (lower) screen position for a word (non-word) or vice versa. Eye movements were faster to locations compatible with the words referent in the real world. These results provide evidence for the importance of linguistic stimuli in directing eye movements, even if the words do not directly transfer directional information.

What's up? Emotion-specific activation of vertical space during language processing.

The relationship between language processing and vertical space has been shown for various groups of words including valence words, implicit location words, and words referring to religious concepts. However, it remains unclear whether these are single phenomena or whether there is an underlying common mechanism. Here, we show that the evaluation of word valence interacts with motor responses in the vertical dimension, with positive (negative) evaluations facilitating upward (downward) responses. When valence evaluation was not required, implicit location words (e.g., bird, shoe) influenced motor responses whereas valence words (e.g., kiss, hate) did not. Importantly, a subset of specific emotional valence words that are commonly associated with particular bodily postures (e.g., proud→upright; sad→slouched) did automatically influence motor responses. Together, this suggests that while the vertical spatial dimension is not directly activated by word valence, it is activated when processing words referring to emotional states with stereotypical bodily-postures. These results provide strong evidence that the activation of spatial associations during language processing is experience-specific in nature and cannot be explained with reference to a general mapping between all valence words and space (i.e., all positive and negative words generally relate to spatial processing). These findings support the experiential view of language comprehension, suggesting that the automatic reactivation of bodily experiences is limited to word groups referring to emotions or entities directly associated with spatial experiences (e.g., posture or location in the world).

From top to bottom: spatial shifts of attention caused by linguistic stimuli

Interacting with the world around us involves dealing with constant information input. Thus, humans must selectively filter and focus attention on relevant aspects for the current situation. The current study investigates orientations of attention after words that do not convey spatial information in their meaning (e.g. cloud, shoe). The current study minimizes both the linguistic demands by simply presenting task-irrelevant words and the visual processing demands by implementing a simple target detection task. According to automatic response biases in the motor domain (Lachmair et al. 2011), we hypothesized that words such as cloud produce attention shifts in the direction of the typical location of the word’s referent in the world (e.g. cloud up in the sky). Indeed, target detection was facilitated if target location matched the typical location of the word’s referent. These findings are strong evidence for the important role of space during language processing, showing that vertical attention is modulated even by task-irrelevant verbal cues.

Relating numeric cognition and language processing: Do numbers and words share a common representational platform?

Numerical processing and language processing are both grounded in space. In the present study we investigated whether these are fully independent phenomena, or whether they share a common basis. If number processing activates spatial dimensions that are also relevant for understanding words, then we can expect that processing numbers may influence subsequent lexical access to words. Specifically, if high numbers relate to upper space, then they can be expected to facilitate understanding of words such as bird that are having referents typically found in the upper vertical space. The opposite should hold for low numbers. These should facilitate the understanding of words such as ground referring to entities with referents in the lower vertical space. Indeed, in two experiments we found evidence for such an interaction between number and word processing. By eliminating a contribution of linguistic factors gained from additional investigations on large text corpora, this strongly suggests that understanding numbers and language is based on similar modal representations in the brain. The implications of these findings for a broader perspective on grounded cognition will be discussed.

Language and vertical space: on the automaticity of language action interconnections.

Grounded models of language processing propose a strong connection between language and sensorimotor processes (Barsalou, 1999, 2008; Glenberg & Kaschak, 2002). However, it remains unclear how functional and automatic these connections are for understanding diverse sets of words (Ansorge, Kiefer, Khalid, Grassl, & König, 2010). Here, we investigate whether words referring to entities with a typical location in the upper or lower visual field (e.g., sun, ground) automatically influence subsequent motor responses even when language-processing levels are kept minimal. The results show that even subliminally presented words influence subsequent actions, as can be seen in a reversed compatibility effect. These finding have several implications for grounded language processing models. Specifically, these results suggest that language-action interconnections are not only the result of strategic language processes, but already play an important role during pre-attentional language processing stages.

When up-words meet down-sentences: evidence for word- or sentence-based compatibility effects?

Participants were presented with sentences mentioning an entity with a typical location in the upper or lower vertical space (e.g., roof vs. root). Sentences supported or reversed the typical location of the target entity. Sensibility judgments requiring upwards or downwards responses were faster when the response matched rather than mismatched the target entity’s typical location. This compatibility effect was independent of whether the sentence context supported or reversed the target entity’s typical location. The results, therefore, provide clear evidence for word-based but no evidence for sentence-based simulation processes.