Ruiming Wang

Affective valence facilitates spatial detection on vertical axis: shorter time strengthens effect.

Affective concepts can be described in terms of space, which is known as the valence-space metaphor. Previous studies have not investigated either the specifics of this metaphor on the transverse and vertical axes or the time course of this metaphoric association. With Chinese participants, we used a spatial cue task to study the valence-space metaphor on the transverse (left-and-right; Experiment 1A) and vertical (upper-and-lower; Experiment 1B) axes. After being shown an affective word and asked to keep it in mind, the participants were given a spatial target detection task. The results revealed that the metaphoric association was only found on the vertical axis. More specifically, keeping a positive word in mind facilitated the detection of the upper target, but no such effect was found in the detection of the lower target. Furthermore, in Experiment 2, we manipulated the duration of time (100, 500, and 1000 ms) between the offset of the affective word and the onset of the spatial target (i.e., interstimulus intervals, ISI), to test the dynamic time course of the valence-space metaphor on the vertical axis. The results showed that when ISI was 100 ms, keeping a positive word in mind facilitated the detection of the upper target and keeping a negative word in mind facilitated the detection of the lower target. However, when the ISI was 500 or 1000 ms, keeping a positive word in mind facilitated the detection of the upper target and no such effect was found in the detection of the lower target, indicating that ISI might be important in the valence-space metaphoric association. In sum, we found that the processing of affective valence activated the vertical spatial axis but not the transverse axis. Further, the association might be modulated by ISI, indicating that it may be related to attention allocation.

Numerical Magnitude Affects Temporal Memories but Not Time Encoding

Previous research has suggested that the perception of time is influenced by concurrent magnitude information (e.g., numerical magnitude in digits, spatial distance), but the locus of the effect is unclear, with some findings suggesting that concurrent magnitudes such as space affect temporal memories and others suggesting that numerical magnitudes in digits affect the clock speed during time encoding. The current paper reports 6 experiments in which participants perceived a stimulus duration and then reproduced it. We showed that though a digit of a large magnitude (e.g., 9), relative to a digit of a small magnitude (e.g., 2), led to a longer reproduced duration when the digits were presented during the perception of the stimulus duration, such a magnitude effect disappeared when the digits were presented during the reproduction of the stimulus duration. These findings disconfirm the account that large numerical magnitudes accelerate the speed of an internal clock during time encoding, as such an account incorrectly predicts that a large numerical magnitude should lead to a shorter reproduced duration when presented during reproduction. Instead, the findings suggest that numerical magnitudes, like other magnitudes such as space, affect temporal memories when numerical magnitudes and temporal durations are concurrently held in memory. Under this account, concurrent numerical magnitudes have the chance to influence the memory of the perceived duration when they are presented during perception but not when they are presented at the reproduction stage.

The mechanism of valence-space metaphors: ERP evidence for affective word processing.

Embodied cognition contends that the representation and processing of concepts involve perceptual, somatosensory, motoric, and other physical re-experiencing information. In this view, affective concepts are also grounded in physical information. For instance, people often say “feeling down” or “cheer up” in daily life. These phrases use spatial information to understand affective concepts. This process is referred to as valence-space metaphor. Valence-space metaphors refer to the employment of spatial information (lower/higher space) to elaborate affective concepts (negative/positive concepts). Previous studies have demonstrated that processing affective words affects performance on a spatial detection task. However, the mechanism(s) behind this effect remain unclear. In the current study, we hypothesized that processing affective words might produce spatial information. Consequently, spatial information would affect the following spatial cue detection/discrimination task. In Experiment 1, participants were asked to remember an affective word. Then, they completed a spatial cue detection task while event-related potentials were recorded. The results indicated that the top cues induced enhanced amplitude of P200 component while participants kept positive words relative to negative words in mind. On the contrary, the bottom cues induced enhanced P200 amplitudes while participants kept negative words relative to positive words in mind. In Experiment 2, we conducted a behavioral experiment that employed a similar paradigm to Experiment 1, but used arrows instead of dots to test the attentional nature of the valence-space metaphor. We found a similar facilitation effect as found in Experiment 1. Positive words facilitated the discrimination of upper arrows, whereas negative words facilitated the discrimination of lower arrows. In summary, affective words might activate spatial information and cause participants to allocate their attention to corresponding locations. Valence-space metaphors might be grounded in attention allocation.

It is there whether you hear it or not: Syntactic representation of missing arguments

Many languages allow arguments to be omitted when they are recoverable from the context, but how do people comprehend sentences with a missing argument? We contrast a syntactically-represented account whereby people postulate a syntactic representation for the missing argument, with a syntactically-non-represented account whereby people do not postulate any syntactic representation for it. We report two structural priming experiments in Mandarin Chinese that showed that comprehension of a dative sentence with a missing direct-object argument primed the production of a full-form dative sentence (relative to an intransitive) and that it behaved similarly to a corresponding full-form dative sentence. The results suggest that people construct the same constituent structure for missing-argument sentences and full-form sentences, in accord with the syntactically-represented account. We discuss the implications for syntactic representations in language processing.

Switch Costs Occur at Lemma Stage When Bilinguals Name Digits: Evidence from Language-Switching and Event-Related Potentials

Switch costs are generally found in language switching tasks. However, the locus where switch costs occur during bilingual language production remains unclear. Several studies that used a cued language-switching paradigm have attempted to investigate this question in bilingual language production, but researchers have not reached a consensus. Moreover, we are interested in where switch costs occur when language selection occurs after lemma activation. Previous studies have not investigated this question because most previous studies presented language cues before or along with the stimuli. Therefore, we used a modified cued language-switching paradigm with a combined event-related potentials (ERPs) technique to explore the locus of switch costs during bilingual language production. The cue and stimulus were separated and presented in two different presentation sequences in which Indonesian–Chinese bilingual speakers were instructed to name digits in their L1 or L2 according to the color of the cue. The ERPs related to the cue and stimulus for two presentation sequences were measured. In the stimulus-cue sequence, the analysis that was time-locked to cues revealed a reversed switch cost as early as 220 ms after the cue onset; furthermore, a switch cost was shown in L1 with a late stage post-cue onset. The results suggested that when language selection occurred after lemma activation, the switch costs mainly occurred at the lemma selection stage. In the cue-stimulus sequence, the analysis that was time-locked to cues did not reveal significant main effects of switching, whereas the analysis that was time-locked to digits yielded a switch cost, again indicating that switch costs mainly occurred at the lemma selection stage rather than at the language task schema competition stage. Overall, our results indicated that when bilinguals spoke digits aloud in the language switching task, switch costs mainly occurred at the lemma selection stage.

Bilingual Contexts Modulate the Inhibitory Control Network

The present functional magnetic resonance imaging (fMRI) study investigated influences of language contexts on inhibitory control and the underlying neural processes. Thirty Cantonese–Mandarin–English trilingual speakers, who were highly proficient in Cantonese (L1) and Mandarin (L2), and moderately proficient in English (L3), performed a picture-naming task in three dual-language contexts (L1-L2, L2-L3, and L1-L3). After each of the three naming tasks, participants performed a flanker task, measuring contextual effects on the inhibitory control system. Behavioral results showed a typical flanker effect in the L2-L3 and L1-L3 condition, but not in the L1-L2 condition, which indicates contextual facilitation on inhibitory control performance by the L1-L2 context. Whole brain analysis of the fMRI data acquired during the flanker tasks showed more neural activations in the right prefrontal cortex and subcortical areas in the L2-L3 and L1-L3 condition on one hand as compared to the L1-L2 condition on the other hand, suggesting greater involvement of the cognitive control areas when participants were performing the flanker task in L2-L3 and L1-L3 contexts. Effective connectivity analyses displayed a cortical-subcortical-cerebellar circuitry for inhibitory control in the trilinguals. However, contrary to the right-lateralized network in the L1-L2 condition, functional networks for inhibitory control in the L2-L3 and L1-L3 condition are less integrated and more left-lateralized. These findings provide a novel perspective for investigating the interaction between bilingualism (multilingualism) and inhibitory control by demonstrating instant behavioral effects and neural plasticity as a function of changes in global language contexts.

Interplay Between the Object and Its Symbol: The Size-Congruency Effect.

Grounded cognition suggests that conceptual processing shares cognitive resources with perceptual processing. Hence, conceptual processing should be affected by perceptual processing, and vice versa. The current study explored the relationship between conceptual and perceptual processing of size. Within a pair of words, we manipulated the font size of each word, which was either congruent or incongruent with the actual size of the referred object. In Experiment 1a, participants compared object sizes that were referred to by word pairs. Higher accuracy was observed in the congruent condition (e.g., word pairs referring to larger objects in larger font sizes) than in the incongruent condition. This is known as the size-congruency effect. In Experiments 1b and 2, participants compared the font sizes of these word pairs. The size-congruency effect was not observed. In Experiments 3a and 3b, participants compared object and font sizes of word pairs depending on a task cue. Results showed that perceptual processing affected conceptual processing, and vice versa. This suggested that the association between conceptual and perceptual processes may be bidirectional but further modulated by semantic processing. Specifically, conceptual processing might only affect perceptual processing when semantic information is activated. The current study

Cross-dimensional magnitude interactions arise from memory interference

Magnitudes from different dimensions (e.g., space and time) interact with each other in perception, but how these interactions occur remains unclear. In four experiments, we investigated whether cross-dimensional magnitude interactions arise from memory interference. In Experiment 1, participants perceived a constant-length line consisting of two line segments of complementary lengths and presented for a variable stimulus duration; then they received a cue about which of the two segment lengths to later reproduce. Participants were to first reproduce the stimulus duration and then the cued length. Reproduced durations increased as a function of the cued length if the cue was given before duration was retrieved from memory for reproduction (i.e. before duration reproduction; Experiment 1) but not if it was given after the duration memory had been retrieved from memory (i.e. after the start of duration reproduction; Experiment 2). These findings demonstrate that space-time interaction arises as a result of memory interference when length and duration information co-exist in working memory. Experiment 3 further demonstrated spatial interference on duration memories from memories of filled lengths (i.e. solid line segments) but not from noisier memories of unfilled lengths (demarcated empty spatial intervals), thus highlighting the role of memory noise in space-time interaction. Finally, Experiment 4 showed that time also exerted memory interference on space when space was presented as (relatively noisy) unfilled lengths. Taken together, these findings suggest that cross-dimensional magnitude interactions arise as a result of memory interference and the extent and direction of the interaction depend on the relative memory noises of the target and interfering dimensions. We propose a Bayesian model whereby the estimation of a magnitude is based on the integration of the noisily encoded percept of the target magnitude and the prior knowledge that magnitudes co-vary across dimensions (e.g., space and time). We discuss implications for cross-dimensional magnitude interactions in general.

Effects of Naming Language and Switch Predictability on Switch Costs in Bilingual Language Production

Switch costs are defined as the phenomenon that bilinguals have worse performance in switch trials relative to non-switch trials. Bilinguals’ naming language and switch predictability have been found to influence the magnitude of switch costs. However, how these two factors modulate switch costs in different phases (i.e., lemma activation and language selection) during language production remains unclear. Most previous studies using the language switching paradigm did not dissociate lemma activation from language selection, because the language cue was either presented simultaneously with or prior to a stimulus. Therefore, here we modified the language switching paradigm by presenting a digit stimulus prior to a visual cue. This allowed us to dissociate lemma activation from language selection, and thus we were able to investigate the mechanisms underlying the effects of naming language and switch predictability on switch costs during the two different phases in language production. Unbalanced Indonesian-Chinese bilinguals were required to name digits in either their L1 (Indonesian) or L2 (Chinese), and their reaction times and electrophysiological responses were recorded. The behavioral results showed the effects of switch predictability on switch costs, with responses in switch trials being slower than those in non-switch trials in the low switch predictability condition, while there was no significant difference in response times between switch trials and non-switch trials in the high switch predictability condition. The event-related potential results showed that neither naming language nor switch predictability affected switch costs during the lemma activation phase, but both did so during the language selection phase, particularly at the language task schema competition stage. The results imply that naming language and switch predictability affect switch costs mainly during the language task schema competition stage.

Remember Hard But Think Softly: Metaphorical Effects of Hardness/Softness on Cognitive Functions

Previous studies have found that bodily stimulation, such as hardness biases social judgment and evaluation via metaphorical association; however, it remains unclear whether bodily stimulation also affects cognitive functions, such as memory and creativity. The current study used metaphorical associations between “hard” and “rigid” and between “soft” and “flexible” in Chinese, to investigate whether the experience of hardness affects cognitive functions whose performance depends prospectively on rigidity (memory) and flexibility (creativity). In Experiment 1, we found that Chinese-speaking participants performed better at recalling previously memorized words while sitting on a hard-surface stool (the hard condition) than a cushioned one (the soft condition). In Experiment 2, participants sitting on a cushioned stool outperformed those sitting on a hard-surface stool on a Chinese riddle task, which required creative/flexible thinking, but not on an analogical reasoning task, which required both rigid and flexible thinking. The results suggest the hardness experience affects cognitive functions that are metaphorically associated with rigidity or flexibility. They support the embodiment proposition that cognitive functions and representations can be grounded in bodily states via metaphorical associations.