Zhenguang G. Cai

Space-time interdependence: Evidence against asymmetric mapping between time and space

Time and space are intimately related, but what is the real nature of this relationship? Is time mapped metaphorically onto space such that effects are always asymmetric (i.e., space affects time more than time affects space)? Or do the two domains share a common representational format and have the ability to influence each other in a flexible manner (i.e., time can sometimes affect space more than vice versa)? In three experiments, we examined whether spatial representations from haptic perception, a modality of relatively low spatial acuity, would lead the effect of time on space to be substantially stronger than the effect of space on time. Participants touched (but could not see) physical sticks while listening to an auditory note, and then reproduced either the length of the stick or the duration of the note. Judgements of length were affected by concurrent stimulus duration, but not vice versa. When participants were allowed to see as well as touch the sticks, however, the higher acuity of visuohaptic perception caused the effects to converge so length and duration influenced each other to a similar extent. These findings run counter to the spatial metaphor account of time, and rather support the spatial representation account in which time and space share a common representational format and the directionality of space-time interaction depends on the perceptual acuity of the modality used to perceive space.

Numerical Magnitude Affects Temporal Memories but Not Time Encoding

Previous research has suggested that the perception of time is influenced by concurrent magnitude information (e.g., numerical magnitude in digits, spatial distance), but the locus of the effect is unclear, with some findings suggesting that concurrent magnitudes such as space affect temporal memories and others suggesting that numerical magnitudes in digits affect the clock speed during time encoding. The current paper reports 6 experiments in which participants perceived a stimulus duration and then reproduced it. We showed that though a digit of a large magnitude (e.g., 9), relative to a digit of a small magnitude (e.g., 2), led to a longer reproduced duration when the digits were presented during the perception of the stimulus duration, such a magnitude effect disappeared when the digits were presented during the reproduction of the stimulus duration. These findings disconfirm the account that large numerical magnitudes accelerate the speed of an internal clock during time encoding, as such an account incorrectly predicts that a large numerical magnitude should lead to a shorter reproduced duration when presented during reproduction. Instead, the findings suggest that numerical magnitudes, like other magnitudes such as space, affect temporal memories when numerical magnitudes and temporal durations are concurrently held in memory. Under this account, concurrent numerical magnitudes have the chance to influence the memory of the perceived duration when they are presented during perception but not when they are presented at the reproduction stage.

Time does not flow without language: Spatial distance affects temporal duration regardless of movement or direction

Much evidence has suggested that people conceive of time as flowing directionally in transverse space (e.g., from left to right for English speakers). However, this phenomenon has never been tested in a fully nonlinguistic paradigm where neither stimuli nor task use linguistic labels, which raises the possibility that time is directional only when reading/writing direction has been evoked. In the present study, English-speaking participants viewed a video where an actor sang a note while gesturing and reproduced the duration of the sung note by pressing a button. Results showed that the perceived duration of the note was increased by a long-distance gesture, relative to a short-distance gesture. This effect was equally strong for gestures moving from left to right and from right to left and was not dependent on gestures depicting movement through space; a weaker version of the effect emerged with static gestures depicting spatial distance. Since both our gesture stimuli and temporal reproduction task were nonlinguistic, we conclude that the spatial representation of time is nondirectional: Movement contributes, but is not necessary, to the representation of temporal information in a transverse timeline.

It is there whether you hear it or not: Syntactic representation of missing arguments

Many languages allow arguments to be omitted when they are recoverable from the context, but how do people comprehend sentences with a missing argument? We contrast a syntactically-represented account whereby people postulate a syntactic representation for the missing argument, with a syntactically-non-represented account whereby people do not postulate any syntactic representation for it. We report two structural priming experiments in Mandarin Chinese that showed that comprehension of a dative sentence with a missing direct-object argument primed the production of a full-form dative sentence (relative to an intransitive) and that it behaved similarly to a corresponding full-form dative sentence. The results suggest that people construct the same constituent structure for missing-argument sentences and full-form sentences, in accord with the syntactically-represented account. We discuss the implications for syntactic representations in language processing.

Processing verb-phrase ellipsis in Mandarin Chinese: Evidence against the syntactic account

Theories differ as to how people recover the meaning of verb-phrase (VP) ellipsis. According to the syntactic account, people reproduce the syntactic structure of the antecedent during the processing of VP ellipsis. This account thus predicts that the ellipsis site contains syntactic information. Using the structural priming paradigm, we found that, in Mandarin, an ellipsis prime (a double-object or prepositional-object dative antecedent plus a VP ellipsis) was less effective in priming than a full-form prime sentence (the same antecedent plus the full-form equivalent of the VP ellipsis) but behaved similarly to a baseline prime (the same antecedent plus a neutral sentence). The result thus suggests that syntactic structure is not reproduced at the ellipsis site and supports the semantic account in which VP ellipsis is interpreted via a semantic representation.

The effect of nonadopted analyses on sentence processing

Are comprehenders affected by an alternative analysis that they do not adopt (a nonadopted analysis) in case of syntactic ambiguity? If the processor only considers and maintains the preferred analysis at a given time, an alternative analysis is then not considered and will hence not affect processing. In two experiments, we examined the processing of the ambiguity in English object-cleft sentences such as Because it was John that Ralph threatened the neighbour recorded their conversation, where the NP the neighbour is temporally ambiguous between a preferred subject analysis (subject of the main clause) and an object analysis (object of the preceding verb threatened). We found that though the object analysis was not adopted and maintained by the processor, it disrupted sentence processing. Such an effect was mediated by plausibility: It disappeared when the object analysis had an implausible interpretation. Overall, the results suggest that people consider an alternative analysis even when they do not maintain it.

Accent modulates access to word meaning: Evidence for a speaker-model account of spoken word recognition

Speech carries accent information relevant to determining the speaker’s linguistic and social background. A series of web-based experiments demonstrate that accent cues can modulate access to word meaning. In Experiments 1–3, British participants were more likely to retrieve the American dominant meaning (e.g., hat meaning of “bonnet”) in a word association task if they heard the words in an American than a British accent. In addition, results from a speeded semantic decision task (Experiment 4) and sentence comprehension task (Experiment 5) confirm that accent modulates on-line meaning retrieval such that comprehension of ambiguous words is easier when the relevant word meaning is dominant in the speaker’s dialect. Critically, neutral-accent speech items, created by morphing British- and American-accented recordings, were interpreted in a similar way to accented words when embedded in a context of accented words (Experiment 2). This finding indicates that listeners do not use accent to guide meaning retrieval on a word-by-word basis; instead they use accent information to determine the dialectic identity of a speaker and then use their experience of that dialect to guide meaning access for all words spoken by that person. These results motivate a speaker-model account of spoken word recognition in which comprehenders determine key characteristics of their interlocutor and use this knowledge to guide word meaning access.

On magnitudes in memory: An internal clock account of space–time interaction☆

Traditionally, research on time perception has diverged into a representational approach that focuses on the interaction between time and non-temporal magnitude information like spatial distance, and a mechanistic approach that emphasizes the workings and timecourse of components within an internal clock. We combined these approaches in order to identify the locus of space-time interaction effects in the mechanistic framework of the internal clock model. In three experiments, we contrasted the effects of spatial distance (a long- vs. short-distance line) on time perception with those of visual flicker (a flickering vs. static stimulus) in a duration reproduction paradigm. We found that both a flickering stimulus and a long-distance line lengthened reproduced time when presented during time encoding. However, when presented during time reproduction, a flickering stimulus shortened reproduced time but a long-distance line had no effect. The results thus show that, while visual flickers affects duration accumulation itself, spatial distance instead biases the memory of the accumulated duration. These findings are consistent with a clock-magnitude account of space-time interaction whereby both temporal duration and spatial distance are represented as mental magnitudes that can interfere with each other while being kept in memory, and places the locus of interaction between temporal and non-temporal magnitude dimensions at the memory maintenance stage of the internal clock model.

Retuning of lexical-semantic representations: Repetition and spacing effects in word-meaning priming.

Current models of word-meaning access typically assume that lexical-semantic representations of ambiguous words (e.g., ‘bark of the dog/tree’) reach a relatively stable state in adulthood, with only the relative frequencies of meanings and immediate sentence context determining meaning preference. However, recent experience also affects interpretation: recently encountered word-meanings become more readily available (Rodd et al., 2016, 2013). Here, 3 experiments investigated how multiple encounters with word-meanings influence the subsequent interpretation of these ambiguous words. Participants heard ambiguous words contextually-disambiguated towards a particular meaning and, after a 20- to 30-min delay, interpretations of the words were tested in isolation. We replicate the finding that 1 encounter with an ambiguous word biased the later interpretation of this word towards the primed meaning for both subordinate (Experiments 1, 2, 3) and dominant meanings (Experiment 1). In addition, for the first time, we show cumulative effects of multiple repetitions of both the same and different meanings. The effect of a single subordinate exposure persisted after a subsequent encounter with the dominant meaning, compared to a dominant exposure alone (Experiment 1). Furthermore, 3 subordinate word-meaning repetitions provided an additional boost to priming compared to 1, although only when their presentation was spaced (Experiments 2, 3); massed repetitions provided no such boost (Experiments 1, 3). These findings indicate that comprehension is guided by the collective effect of multiple recently activated meanings and that the spacing of these activations is key to producing lasting updates to the lexical-semantic network.

Cross-dimensional magnitude interactions arise from memory interference

Magnitudes from different dimensions (e.g., space and time) interact with each other in perception, but how these interactions occur remains unclear. In four experiments, we investigated whether cross-dimensional magnitude interactions arise from memory interference. In Experiment 1, participants perceived a constant-length line consisting of two line segments of complementary lengths and presented for a variable stimulus duration; then they received a cue about which of the two segment lengths to later reproduce. Participants were to first reproduce the stimulus duration and then the cued length. Reproduced durations increased as a function of the cued length if the cue was given before duration was retrieved from memory for reproduction (i.e. before duration reproduction; Experiment 1) but not if it was given after the duration memory had been retrieved from memory (i.e. after the start of duration reproduction; Experiment 2). These findings demonstrate that space-time interaction arises as a result of memory interference when length and duration information co-exist in working memory. Experiment 3 further demonstrated spatial interference on duration memories from memories of filled lengths (i.e. solid line segments) but not from noisier memories of unfilled lengths (demarcated empty spatial intervals), thus highlighting the role of memory noise in space-time interaction. Finally, Experiment 4 showed that time also exerted memory interference on space when space was presented as (relatively noisy) unfilled lengths. Taken together, these findings suggest that cross-dimensional magnitude interactions arise as a result of memory interference and the extent and direction of the interaction depend on the relative memory noises of the target and interfering dimensions. We propose a Bayesian model whereby the estimation of a magnitude is based on the integration of the noisily encoded percept of the target magnitude and the prior knowledge that magnitudes co-vary across dimensions (e.g., space and time). We discuss implications for cross-dimensional magnitude interactions in general.